fix(ci): tell stale branches to pull latest staging on vacuous type-check runs - #36117
Open
mateo-berri wants to merge 3 commits into
Open
fix(ci): tell stale branches to pull latest staging on vacuous type-check runs#36117mateo-berri wants to merge 3 commits into
mateo-berri wants to merge 3 commits into
Conversation
Contributor
Greptile SummaryThis PR improves the vacuous type-check failure message so contributors are directed to update from
Confidence Score: 5/5The PR appears safe to merge. The change only augments an existing CI failure diagnostic and adds focused coverage for the intended remedy, with no blocking or independently actionable issue remaining.
|
| Filename | Overview |
|---|---|
| scripts/type_check_gate.py | Extends the vacuous-run diagnostic with the intended staging update instructions; no actionable defect was established. |
| tests/test_litellm/test_type_check_gate.py | Adds a focused regression test covering the failure condition and exact user-facing remedy. |
Reviews (1): Last reviewed commit: "fix(ci): tell stale branches to pull lat..." | Re-trigger Greptile
ryan-crabbe-berri
approved these changes
Aug 6, 2026
ryan-crabbe-berri
left a comment
Contributor
There was a problem hiding this comment.
Can you drop the test
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
Problem this solves:
How it solves it:
User Flow
Before, the failing check tells the contributor a crash happened but not what to do about it, so they stall and ask maintainers for help
GET https://github.com/BerriAI/litellm/pull/{number}/checks, and see the lint workflow redAfter, the same failure names the remedy in the log itself, so the contributor unblocks themselves without waiting on a maintainer
GET https://github.com/BerriAI/litellm/pull/{number}/checks, and see the lint workflow redgit fetch origin litellm_internal_staging, merge or rebase onto it, and pushRelevant issues
Linear ticket
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
@greptileaito re-request a review after pushing changes)Delays in PR merge?
If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).
Screenshots / Proof of Fix
The gate fires on the "basedpyright exits cleanly while emitting nothing" condition, which in the wild comes from an OOM crash on a stale base. To reproduce that condition deterministically without a multi-gigabyte stale checkout, both legs run the real gate CLI against the repo with the gate-owned venv's
basedpyrightentry point replaced by a stub that prints an empty diagnostics payload and exits 0, which is byte-for-byte the input the gate sees in the real incidentBefore, litellm_internal_staging at f6587fa: the failure states the problem and stops, with no remedy
After, this PR at 5741b26: the same run now ends with the remedy a stale-base contributor needs
This mirrors the exact confusion an OSS contributor reported on #35952, where they read the old message, concluded the CI step itself was broken, and asked maintainers to re-run the job instead of updating their base
Type
🚄 Infrastructure
Changes
scripts/type_check_gate.pyappends one sentence to the vacuous-run FAIL message incmd_check, deriving the branch name fromDEFAULT_BASEso the hint can never drift from the gate's actual base.tests/test_litellm/test_type_check_gate.pyadds a regression test that drivescmd_checkwith empty counts and asserts both the vacuous-run refusal and the exact user-visible remedy string, so dropping or rewording the hint fails the suiteFinal Attestation