Skip to content

dsv4.1: Rust extension modules for image preprocessing, KV pool names, and PD bootstrap - #39677

Merged
hnyls2002 merged 3 commits into
mainfrom
lsyin/dsv41-rust-ext
Sep 16, 2026
Merged

hnyls2002 merged 3 commits into
mainfrom
lsyin/dsv41-rust-ext

Conversation

@hnyls2002

@hnyls2002 hnyls2002 commented Sep 16, 2026 •

Copy link
Copy Markdown
Collaborator

Lands the Rust side of DeepSeek-V4.1 support ahead of the Python changes.

  • sglang-mm: dsv41 module with resize_patchify for image preprocessing.
  • sglang-radix-tree: PoolName variants for the deepseek_v4_c1/c2 KV pools.
  • sglang-server: optional dsv41_spec_layout on the PD bootstrap route, rejecting a mismatch across prefill ranks. The field is Option with skip_serializing_if, so clients that do not send it see the current wire format unchanged.

Landing this separately keeps the prebuilt-Rust-extension cache key stable for the Python-side changes that follow: the key hashes rust/**, so any PR carrying these files misses the cache and recompiles the extensions on every push.

Verification: cargo test -p sglang-server --lib disaggregation passes 5/5, including the existing route_contract_matches_python_client.


CI States

Latest PR Test (Base): 🚫 Run #35039266154
Latest PR Test (Extra): ❌ Run #35039265916
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.

@hnyls2002

Copy link
Copy Markdown
Collaborator Author

/tag-and-rerun-ci

@github-actions github-actions Bot added the run-ci CI: run the baseline test suite on this PR label Sep 16, 2026
@hnyls2002
hnyls2002 merged commit 2f7d04d into main Sep 16, 2026
152 of 183 checks passed
@hnyls2002
hnyls2002 deleted the lsyin/dsv41-rust-ext branch September 16, 2026 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-ci CI: run the baseline test suite on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant