Skip to content

[Scheduler] Unify per-iteration request intake into ingest_requests() - #38389

Merged
hnyls2002 merged 4 commits into
mainfrom
lsyin/ingest-requests
Sep 8, 2026
Merged

hnyls2002 merged 4 commits into
mainfrom
lsyin/ingest-requests

Conversation

@hnyls2002

@hnyls2002 hnyls2002 commented Sep 8, 2026

Copy link
Copy Markdown
Collaborator

Collapse the recv + dispatch pair duplicated across all 11 scheduler event loops into a single Scheduler.ingest_requests(), so per-iteration input handling has one home.


CI States

Latest PR Test (Base): ❌ Run #34182069082
Latest PR Test (Extra): 🚫 Run #34182068913
Latest PR Test (AMD ROCm 7.2): 🚫 Run #34182069104

@hnyls2002

Copy link
Copy Markdown
Collaborator Author

/tag-and-rerun-ci

@github-actions github-actions Bot added the run-ci label Sep 8, 2026
@hnyls2002

hnyls2002 commented Sep 8, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-test test_pp_cp_rank_offsets.py test_mm_shm_error_consensus.py test_batch_result_processor_mamba_boundary.py test_scheduler_stage_metrics.py test/registered/scheduler/test_scheduler_control.py test/registered/pp/test_pp_single_node.py test/registered/disaggregation/test_disaggregation_basic.py
(2 tries)

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test_batch_result_processor_mamba_boundary.py test_mm_shm_error_consensus.py test_pp_cp_rank_offsets.py test_scheduler_timeouts.py test_scheduler_chunked_req_gate.py test_scheduler_decision_batch_params.py test_scheduler_stage_metrics.py test/registered/scheduler/test_scheduler_control.py test/registered/pp/test_pp_single_node.py test/registered/disaggregation/test_disaggregation_basic.py:

🚀 ubuntu-latest (7 tests): ❌ View workflow run

cd test/ && python3 registered/unit/managers/test_batch_result_processor_mamba_boundary.py
cd test/ && python3 registered/unit/managers/test_mm_shm_error_consensus.py
cd test/ && python3 registered/unit/managers/test_pp_cp_rank_offsets.py
cd test/ && python3 registered/unit/managers/test_scheduler_timeouts.py
cd test/ && python3 registered/unit/managers/test_scheduler_chunked_req_gate.py
cd test/ && python3 registered/unit/managers/test_scheduler_decision_batch_params.py
cd test/ && python3 registered/unit/observability/test_scheduler_stage_metrics.py

🚀 1-gpu-5090 (1 test): ✅ View workflow run

cd test/ && python3 registered/scheduler/test_scheduler_control.py

🚀 4-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/pp/test_pp_single_node.py

🚀 2-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/disaggregation/test_disaggregation_basic.py

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test_pp_cp_rank_offsets.py test_mm_shm_error_consensus.py test_batch_result_processor_mamba_boundary.py test_scheduler_stage_metrics.py test/registered/scheduler/test_scheduler_control.py test/registered/pp/test_pp_single_node.py test/registered/disaggregation/test_disaggregation_basic.py:

🚀 ubuntu-latest (4 tests): ✅ View workflow run

cd test/ && python3 registered/unit/managers/test_pp_cp_rank_offsets.py
cd test/ && python3 registered/unit/managers/test_mm_shm_error_consensus.py
cd test/ && python3 registered/unit/managers/test_batch_result_processor_mamba_boundary.py
cd test/ && python3 registered/unit/observability/test_scheduler_stage_metrics.py

🚀 1-gpu-5090 (1 test): ✅ View workflow run

cd test/ && python3 registered/scheduler/test_scheduler_control.py

🚀 4-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/pp/test_pp_single_node.py

🚀 2-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/disaggregation/test_disaggregation_basic.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant