Skip to content

chore(ci): recover from earthly bug with --no-cache, build images from registry#7462

Merged
ludamad merged 22 commits intomasterfrom
fix/ci-arm-build
Jul 15, 2024
Merged

chore(ci): recover from earthly bug with --no-cache, build images from registry#7462
ludamad merged 22 commits intomasterfrom
fix/ci-arm-build

Conversation

@ludamad
Copy link
Collaborator

@ludamad ludamad commented Jul 12, 2024

This tries to get a handle on the cache bug by both not reading build images from inline cache, and restarting with --no-cache if there's a graph edge bug

  • rely on pushed build-images from registry instead of earthly inline cache
  • only notify on CI failure in slack if it master is failing on the rerun
  • pump up timeouts as now anything might run --no-cache
  • handle secrets in earthly-ci script, pass env vars in run_on_tester and run_on_builder
  • set up ARM CI like normal CI but with just one e2e test (fix a blocker for this with a permission kludge) including with reruns and notifying on second run
  • disable currently failing on ARM test 'should uniswap trade on L1 from L2 funds publicly'

Copy link
Collaborator

@AztecBot AztecBot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'C++ Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.05.

Benchmark suite Current: 0eaa969 Previous: 403f4c0 Ratio
nativeClientIVCBench/Full/6 13516.417912999997 ms/iter 12420.894322999999 ms/iter 1.09
wasmClientIVCBench/Full/6 42429.245116 ms/iter 39886.975661000004 ms/iter 1.06

This comment was automatically generated by workflow using github-action-benchmark.

CC: @ludamad @codygunton

@ludamad ludamad requested a review from charlielye as a code owner July 12, 2024 16:34
@ludamad ludamad changed the title chore(ci): fix arm build, try for less CI pain chore(ci): recover from earthly bug with --no-cache, build images from registry Jul 12, 2024
# kludge until we move away from runners
WAIT_FOR_RUNNERS: false
jobs:
setup:
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

refactored to be more like ci.yml

export FORCE_COLOR=1
export EARTHLY_BUILD_ARGS="${{ env.EARTHLY_BUILD_ARGS }}"
../../scripts/earthly-ci -P \
--secret AWS_ACCESS_KEY_ID=${{ secrets.AWS_ACCESS_KEY_ID }} \
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

moved the secret passing to earthly-ci

@ludamad ludamad enabled auto-merge (squash) July 12, 2024 18:53
Copy link
Contributor

@charlielye charlielye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ludamad ludamad merged commit 09299e3 into master Jul 15, 2024
@ludamad ludamad deleted the fix/ci-arm-build branch July 15, 2024 14:26
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants