Repository navigation
Conversation
Co-authored-by: OpenAI Codex <noreply@openai.com> Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Member
Author
|
/ci run |
|
✅ Triggered Buildkite CI #89003 for commit |
Member
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Why
Main builds #88996 and #88997 lost six CPU jobs on one physical host before tests. Five image builds ended while cloning
triton-cpuwith HTTP/2 stream cancellation followed byfetch-packdisconnect, early EOF, and invalid index-pack output. The sixth lost its LLVM archive stream withBrokenPipeError: [Errno 32] Broken pipe.run-cpu-test.shalready retries transient image-build network errors, but none of those concrete transport signatures matchedBUILD_RETRY_PATTERN, so every affected job exited after attempt 1 instead of using the existing bounded retry policy. The exact PR build for each merged change had passed the relevant lanes, and these failures are unrelated to either source diff.Duplicate check
Searched open PRs and issues for
CPU build retry HTTP/2 early EOF,triton-cpu unexpected disconnect retry, andCPU CI triton clone early EOF; no existing fix was found.Tests
bash -n .buildkite/scripts/hardware_ci/run-cpu-test.shuvx --from shellcheck-py shellcheck .buildkite/scripts/hardware_ci/run-cpu-test.shPRE_COMMIT_HOME=/tmp/sherlock-precommit-cpu-retry uvx --python 3.12 pre-commit run --files .buildkite/scripts/hardware_ci/run-cpu-test.shgit diff --checkNo model evaluation is applicable; this changes CI retry classification only.
This draft was prepared with AI assistance. A human submitter must review every changed line and validate the retry behavior before marking it ready.