Skip to content

Cherry-pick sampling mask support to sglang-miles - #32108

Merged
guapisolo merged 1 commit into
sgl-project:sglang-milesfrom
hari-harmonic:hari/keep-sampling-mask-sglang-miles
Jul 22, 2026
Merged

guapisolo merged 1 commit into
sgl-project:sglang-milesfrom
hari-harmonic:hari/keep-sampling-mask-sglang-miles

Conversation

@hari-harmonic

@hari-harmonic hari-harmonic commented Jul 22, 2026 •

Copy link
Copy Markdown
Contributor

Cherry-picks #27408 onto sglang-miles.

Original merged PR: #27408
Cherry-picked commit: a909077

Notes:

  • Resolved the disaggregation prefill conflict as a narrow backport: added sampling-mask metadata before the existing sglang-miles unconditional send_kv_chunk.
  • Resolved the scheduler import conflict by keeping sglang-miles's get_global_server_args import and adding the TOP_K_ALL import required by the sampling-mask validation.

Validation:

  • python3 -m compileall -q on the touched prefill/scheduler files after the conflict-resolution adjustment.
  • Earlier python3 -m compileall -q over all touched runtime and test files passed.

CI States

Latest PR Test (Base): ❌ Run #29955836553
Latest PR Test (Extra): ❌ Run #29955836352

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@hari-harmonic
hari-harmonic force-pushed the hari/keep-sampling-mask-sglang-miles branch from 9a72f42 to ef14799 Compare July 22, 2026 20:36
@guapisolo
guapisolo merged commit 955dbcc into sgl-project:sglang-miles Jul 22, 2026
69 of 79 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants