[None][fix] Drop the unbound is_idle guard left in the idle disagg CTX reap - #18263
Conversation
…X reap NVIDIA#17324 removed the is_idle parameter, both call-site arguments and the local_need_ctx_check use, but left one read behind, so the single-rank CTX reap path raises NameError. The same commit left the test calling the old five-argument signature, which fails collection-time with TypeError. Both call sites invoke the method unconditionally, so the guard has no value to restore. Signed-off-by: Pranav Shrestha <254760092+pranav-nvidia@users.noreply.github.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (2)
Included review availability: Your plan provides up to 12 included reviews per hour; 9 remain after this review. WalkthroughThe executor now checks single-rank context-transfer progress regardless of idle state. The related test uses the method’s current default-only signature and keeps its existing assertions. ChangesDisaggregated transfer progress
Estimated code review effort: 1 (Trivial) | ~5 minutes Merge Risk: ⚪ Minimal · up to This localized change removes the stale idle-transfer guard and restores the affected test, with the reported unit and lint checks passing; no actionable merge-blocking risk remains after normal review. Suggested reviewers: 🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
Full details: Description checkExplanation The description explains the root cause, affected execution path, code change, test update, lint impact, and validation results. It includes the required Description, Test Coverage, and PR Checklist sections.
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
/bot run --disable-fail-fast |
|
PR_Github #69517 [ run ] triggered by Bot. Commit: |
|
/bot skip --comment "main is failing pre-commit already" |
|
PR_Github #69528 [ skip ] triggered by Bot. Commit: |
|
PR_Github #69517 [ run ] completed with state |
|
PR_Github #69528 [ skip ] completed with state |
Picks up NVIDIA#18263, which removes the unbound is_idle read that was failing this branch's Pre-commit Check. Signed-off-by: Pranav Shrestha <254760092+pranav-nvidia@users.noreply.github.com>
Description
#17324removed theis_idleparameter fromPyExecutor._check_disagg_transfer_progress_when_idle, along with both call-site arguments and thelocal_need_ctx_check = is_idle or ...expression that consumed it. One read ofis_idlewas left behind:The method now takes only
self, so this raisesNameErroron the path it guards: synchronous (non-async) GEN transfer, single-rank world, outside the gen-only-no-context benchmark. Because the executor loop runs onPyExecutor.worker_thread, an exception escaping there is broadcast to every pending request rather than to one.The guard has no value to restore. Both call sites invoke the method unconditionally, and the removed expression had already folded
is_idleaway, so dropping the term restores the behaviour#17324intended.The same commit left
test_sync_single_rank_ctx_reaps_idle_transfercalling the old five-argument signature, so it fails withTypeError: ... got an unexpected keyword argument 'num_fitting_reqs'. The other six call sites in that file were already updated; this one was missed. Its assertion —_check_disagg_ctx_cache_transfer_status.assert_called_once_with(0)— is what the product fix restores.This is also a lint regression:
ruff-legacyreportsF821 Undefined name 'is_idle'against a baseline recording onlyE712/E721for this file, so Pre-commit Check fails for any PR that touchespy_executor.pyand re-runs after#17324landed.Test Coverage
tests/unittest/_torch/executor/test_py_executor.py— 149 passed (was 148 passed, 1 failed).pre-commit run ruff-legacy --files tensorrt_llm/_torch/pyexecutor/py_executor.pypasses; it fails onmain.PR Checklist
GitHub Bot Help
To see a list of available CI bot commands, please comment
/bot help.Dev Engineer Review
_check_disagg_transfer_progress_when_idleto remove the unboundis_idlereference.NameErrorand resolves the relatedruff-legacyfailure.QA Engineer Review
tests/unittest/_torch/executor/test_py_executor.py.