Skip to content

chore(ci): capture JUnit XML test results for rust-e2e jobs#19548

Merged
theochap merged 1 commit intoaj/chore/migrate-op-reth-makefiles-to-justfrom
aj/chore/rust-e2e-test-results
Mar 17, 2026
Merged

chore(ci): capture JUnit XML test results for rust-e2e jobs#19548
theochap merged 1 commit intoaj/chore/migrate-op-reth-makefiles-to-justfrom
aj/chore/rust-e2e-test-results

Conversation

@ajsutton
Copy link
Contributor

@ajsutton ajsutton commented Mar 14, 2026

Summary

  • Wrap go test with gotestsum in rust-e2e test recipes to produce JUnit XML results
  • Add store_test_results and store_artifacts steps to all 4 rust-e2e CI jobs
  • Enables CircleCI Test Insights, flake detection, and /ci-flakes tracking for rust-e2e tests

Stacked on #19525 (make-to-just migration for op-reth)

Changes

File What
rust/kona/tests/justfile Replace bare go test with gotestsum in test-e2e-sysgo-run (covers 5 job instances)
rust/op-reth/tests/justfile Same gotestsum wrapping for test-e2e-sysgo recipe (1 job)
.circleci/continue/rust-e2e.yml Add store_test_results + store_artifacts to all 4 jobs
3x .gitignore Ignore tmp/ output directories

Why

The rust-e2e pipeline runs Go E2E tests across 7 job instances but none report results to CircleCI Test Insights. This means no per-test timing, no flake detection, and no test-level failure visibility. The rest of the monorepo already uses gotestsum --junitfile + store_test_results.

Notes

  • gotestsum is already available via mise (gotestsum = "1.12.3")
  • kona-proof-action-tests already produced JUnit XML but never uploaded it — now it does
  • No test behavior changes — same commands, timeouts, and parallelism
  • Rebased on chore: migrate rust/op-reth Makefiles to just #19525: gotestsum changes now target the justfile instead of the deprecated Makefile

Test plan

  • rust-e2e-sysgo-tests runs → CircleCI Test Insights shows individual test names
  • kona-proof-action-tests runs → sharded results appear in Test Insights
  • rust-restart-sysgo-tests and op-reth-e2e-sysgo-tests results uploaded
  • No test regressions

Closes #19547

🤖 Generated with Claude Code

@ajsutton ajsutton requested a review from a team as a code owner March 14, 2026 21:25
@codecov
Copy link

codecov bot commented Mar 14, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 75.5%. Comparing base (98f14fb) to head (5c80591).
⚠️ Report is 2 commits behind head on aj/chore/migrate-op-reth-makefiles-to-just.

Additional details and impacted files
@@                             Coverage Diff                             @@
##           aj/chore/migrate-op-reth-makefiles-to-just   #19548   +/-   ##
===========================================================================
  Coverage                                        75.4%    75.5%           
===========================================================================
  Files                                             675      675           
  Lines                                           71571    71571           
===========================================================================
+ Hits                                            54018    54073   +55     
+ Misses                                          17409    17354   -55     
  Partials                                          144      144           
Flag Coverage Δ
cannon-go-tests-64 66.4% <ø> (ø)
contracts-bedrock-tests 80.2% <ø> (+0.6%) ⬆️
unit 75.5% <ø> (+<0.1%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 7 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

ajsutton added a commit that referenced this pull request Mar 15, 2026
The large-kona-sequencer devnet config spins up 9 nodes (1 kona
sequencer with reth + 4 kona validators with reth + 4 kona validators
with geth). On xlarge (8 vCPU, 16GB RAM) the container is consistently
killed by the OOM killer before any test step runs, producing failures
with no visible failed steps.

Split large-kona-sequencer out of the matrix and give it 2xlarge
(16 vCPU, 32GB RAM) to accommodate the memory requirements of the
full devnet.

Fixes flaky failures on #19548 (job 4581496)
and #19525 (job 4581006).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ajsutton ajsutton force-pushed the aj/chore/rust-e2e-test-results branch from da20460 to 97808dd Compare March 15, 2026 02:50
Wrap bare `go test` invocations with `gotestsum --junitfile` in the
kona tests justfile and op-reth tests Makefile so that all rust-e2e CI
jobs produce JUnit XML. Add `store_test_results` and `store_artifacts`
steps to all 4 jobs in rust-e2e.yml so CircleCI Test Insights can
surface per-test timing, flake detection, and failure details.

The kona-proof-action-tests job already produced JUnit XML via
gotestsum but never uploaded it — this change adds the missing CI
upload steps.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ajsutton ajsutton changed the base branch from develop to aj/chore/migrate-op-reth-makefiles-to-just March 16, 2026 23:23
@ajsutton ajsutton force-pushed the aj/chore/rust-e2e-test-results branch from 97808dd to 5c80591 Compare March 16, 2026 23:23
@theochap theochap merged commit 93b4470 into aj/chore/migrate-op-reth-makefiles-to-just Mar 17, 2026
128 checks passed
@theochap theochap deleted the aj/chore/rust-e2e-test-results branch March 17, 2026 02:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

chore: capture JUnit XML test results for rust-e2e CI jobs

3 participants