Skip to content

fix(ci): Disable cancel-in-progress for perf benchmark#1349

Merged
yamadashy merged 1 commit intomainfrom
fix/perf-benchmark-no-cancel
Mar 28, 2026
Merged

fix(ci): Disable cancel-in-progress for perf benchmark#1349
yamadashy merged 1 commit intomainfrom
fix/perf-benchmark-no-cancel

Conversation

@yamadashy
Copy link
Copy Markdown
Owner

@yamadashy yamadashy commented Mar 28, 2026

Disable cancel-in-progress in the perf benchmark workflow so that running benchmark jobs are not cancelled when new commits are pushed to the same PR. Queued runs will now wait for the in-progress run to complete.

Checklist

  • Run npm run test
  • Run npm run lint

Open with Devin

Prevent running benchmark jobs from being cancelled when new commits
are pushed to the same PR. Queued runs will now wait instead.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Note

Gemini is unable to generate a review for this pull request due to the file types involved not being currently supported.

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai bot commented Mar 28, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 789bfac5-8998-434c-81b3-da0ee48803b4

📥 Commits

Reviewing files that changed from the base of the PR and between bd9f343 and 98e8558.

📒 Files selected for processing (1)
  • .github/workflows/perf-benchmark.yml

📝 Walkthrough

Walkthrough

Modified the GitHub Actions workflow configuration to prevent cancellation of in-progress performance benchmark jobs when new runs are triggered for the same PR concurrency group by setting cancel-in-progress to false.

Changes

Cohort / File(s) Summary
GitHub Actions Workflow Configuration
.github/workflows/perf-benchmark.yml
Changed concurrency cancel-in-progress setting from true to false for the perf-benchmark concurrency group, allowing in-progress jobs to complete instead of being canceled by subsequent runs.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically describes the main change: disabling cancel-in-progress for the perf benchmark workflow.
Description check ✅ Passed The description includes a clear summary of changes and the checklist section is properly completed with both items checked.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/perf-benchmark-no-cancel

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 28, 2026

⚡ Performance Benchmark

Latest commit:98e8558 fix(ci): Disable cancel-in-progress for perf benchmark workflow
Status:✅ Benchmark complete!
Ubuntu:2.00s (±0.02s) → 2.00s (±0.02s) · -0.00s (-0.2%)
macOS:1.13s (±0.45s) → 1.16s (±0.28s) · +0.03s (+2.7%)
Windows:2.27s (±0.04s) → 2.27s (±0.04s) · -0.01s (-0.3%)
Details
  • Packing the repomix repository with node bin/repomix.cjs
  • Warmup: 2 runs (discarded), interleaved execution
  • Measurement: 20 runs / 30 on macOS (median ± IQR)
  • Workflow run

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 1 additional finding.

Open in Devin Review

@claude
Copy link
Copy Markdown
Contributor

claude bot commented Mar 28, 2026

Review by Claude

Verdict: Approve

This is a clean, well-scoped 1-line change that switches cancel-in-progress from true to false in the perf benchmark workflow.

Details

Analysis

The change is correct and well-motivated. Performance benchmarks need to run to completion to produce meaningful results. Cancelling an in-progress benchmark when a new commit is pushed wastes the compute already spent and delays feedback — the new run starts from scratch anyway.

With cancel-in-progress: false, queued runs wait for the current one to finish, which is the right behavior for benchmarks that:

  • Take significant time (up to 15min timeout, running across 3 OS matrices)
  • Produce artifacts that are only useful if the full run completes
  • Post results as PR comments (partial results would be misleading)

No concerns found across all review dimensions:

  • Security: No new permissions, secrets, or external actions introduced
  • Performance: This actually improves resource efficiency by avoiding wasted partial runs
  • Code quality: Minimal, focused change with clear commit message
  • Conventions: Follows the project's conventional commit format (fix(ci): ...)

Minor observation

The concurrency group is scoped per PR number (perf-benchmark-${{ github.event.pull_request.number }}), which means different PRs still run independently — only multiple pushes to the same PR queue up. This is the ideal behavior.


🤖 Generated with Claude Code

@codecov
Copy link
Copy Markdown

codecov bot commented Mar 28, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 87.13%. Comparing base (bd9f343) to head (98e8558).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1349   +/-   ##
=======================================
  Coverage   87.13%   87.13%           
=======================================
  Files         116      116           
  Lines        4393     4393           
  Branches     1020     1020           
=======================================
  Hits         3828     3828           
  Misses        565      565           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@cloudflare-workers-and-pages
Copy link
Copy Markdown

Deploying repomix with  Cloudflare Pages  Cloudflare Pages

Latest commit: 98e8558
Status: ✅  Deploy successful!
Preview URL: https://775d1fed.repomix.pages.dev
Branch Preview URL: https://fix-perf-benchmark-no-cancel.repomix.pages.dev

View logs

@yamadashy yamadashy merged commit 3e1fc1a into main Mar 28, 2026
63 checks passed
@yamadashy yamadashy deleted the fix/perf-benchmark-no-cancel branch March 28, 2026 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant