[hnyls2002]

Readers that collect live requests by hand take them from Scheduler.request_lists().

• Fixes the weight version update missing requests outside the running batches: record_weight_version_change recorded events only on requests in batch snapshots, the waiting queue, the chunked slot, deferred responses and HiSparse staging, so a request waiting for its grammar, in a PD queue, in the dLLM queue or in a parked uOCR window got no weight-version event. It now records on every request in every list.
• Queue gauges and load read their lists from request_lists() by kind: the waiting, grammar and PD prefill gauges, copied in the prefill, decode and idle reports, become one _update_queue_stats; get_loads reads the PD queues by kind and drops three queue getters.

Behavior change: the fix above.

Test plan

• test_records_on_every_request_list: requests in the running, waiting, chunked, grammar and PD sending lists each get the event (the grammar and PD sending ones fail before the fix).
• The unit tests under test/registered/unit/{managers,disaggregation,lora,utils,dllm,observability} pass locally with SGLANG_IS_IN_CI=1, apart from failures the base has too.

---

CI States

Latest PR Test (Base): 🚫 Run #41605782929
Latest PR Test (Extra): ❌ Run #41605782910
Latest PR Test (AMD ROCm 10): ❌ Run #41605782777

Tip

Base CI only covers the core cases, and its workload may not exercise your change. Use /rerun-test to run the tests your change touches, or copy this prompt for an agent:

Find the registered tests this PR affects and run them with /rerun-test, following https://github.com/sgl-project/sglang/blob/main/.agents/skills/rerun-test/SKILL.md

[hnyls2002]

/rerun-test test_metrics.py test_priority_metrics.py registered/disaggregation/test_disaggregation_basic.py test_utils_update_weights.py test_load_snapshot_server.py test_prefill_complete_allocation.py test_disaggregation_optimistic_prefill.py test_update_weights_from_tensor.py test_update_weights_from_distributed.py test_weight_version_spans.py

[github-actions]

🚀 1-gpu-5090 (3 tests): ✅ View workflow run

cd test/ && python3 registered/observability/test_metrics.py
cd test/ && python3 registered/observability/test_priority_metrics.py
cd test/ && python3 registered/rl/test_update_weights_from_tensor.py

🚀 2-gpu-h100 (6 tests): ✅ View workflow run

cd test/ && python3 registered/disaggregation/test_disaggregation_basic.py
cd test/ && python3 registered/scheduler/test_load_snapshot_server.py
cd test/ && python3 registered/e2e/disaggregation/test_prefill_complete_allocation.py
cd test/ && python3 registered/disaggregation/test_disaggregation_optimistic_prefill.py
cd test/ && python3 registered/rl/test_update_weights_from_distributed.py
cd test/ && python3 registered/rl/test_weight_version_spans.py

🚀 1-gpu-h100 (1 test): ❌ View workflow run

cd test/ && python3 registered/model_loading/test_utils_update_weights.py

[claude]

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

_{Tip: disable this comment in your organization's Code Review settings.}