Skip to content

[sgl-router] README: document renderer-scoped input_ids forwarding - #41558

Merged
ShangmingCai merged 1 commit into
kan/sgl-router-forward-allfrom
shangming/router-forwarding-scope-readme
Sep 28, 2026
Merged

ShangmingCai merged 1 commit into
kan/sgl-router-forward-allfrom
shangming/router-forwarding-scope-readme

Conversation

@ShangmingCai

@ShangmingCai ShangmingCai commented Sep 28, 2026 •

Copy link
Copy Markdown
Collaborator

Docs follow-up into #41226.

The README's forwarding section still described the per-shape guard as the contract for every model ("Every other request shape is rendered for routing only … forwarding is enabled shape by shape as parity is verified"), and the V4.1 paragraph still read as if V4.1 forwards. This aligns both with the ForwardingScope behavior #41226 introduces:

  • DeepSeek-V4 forwards every text chat (multimodal and caller input_ids excluded).
  • Unverified renderers (HF Jinja, Kimi-K3) keep the per-shape guard and warn UNVERIFIED at startup.
  • DeepSeek-V4.1 never forwards; routing tokenization keeps working, so SGLANG_DSV41_REASONING_EFFORT still matters for cache-aware routing-hash parity.

No code changes.

🤖 Generated with Claude Code


CI States

Latest PR Test (Base): ✅ Run #36410238441
Latest PR Test (Extra): ❌ Run #36410238153
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.

The forwarding section still described the per-shape guard as the contract
for every model, and the V4.1 paragraph read as if V4.1 forwards. Align both
with the ForwardingScope behavior: V4 forwards all text chats, unverified
renderers stay guarded and warn UNVERIFIED, V4.1 never forwards.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Sep 28, 2026
@ShangmingCai
ShangmingCai merged commit e4c02f3 into kan/sgl-router-forward-all Sep 28, 2026
61 of 65 checks passed
@ShangmingCai
ShangmingCai deleted the shangming/router-forwarding-scope-readme branch September 28, 2026 10:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant