Repository navigation

Backport DeepSeek V4.1 native support onto SGLang v0.5.20 - #43

Closed

zozyo wants to merge 15 commits into

codex/serving-v0520-upstream-r1from

codex/dsv41-v0520-01-native-support

Commits on Sep 19, 2026
- dsv4.1: Rust extension modules for image preprocessing, KV pool names, and PD bootstrap (#39677)
  
  hnyls2002
  authored and
  zozyo
  committed
  5392a73
- dsv4.1: standalone kernels and Python wrappers (#39646)
  
  hnyls2002
  authored and
  zozyo
  committed
  6842c91
- dsv4.1: Top-k kernels and candidate selection (#39648)
  
  authored and
  zozyo
  committed
  ae829a4
- dsv4.1: communication kernels and wrappers (#39653)
  
  authored and
  zozyo
  committed
  2058fb0
- dsv4.1: compression, KV I/O, and metadata kernels (#39652)
  
  authored and
  zozyo
  committed
  d25d72a
- dsv4.1: candidate indexer library (#39671)
  
  authored and
  zozyo
  committed
  df74a3e
- dsv4.1: RoPE and FP4 packing kernels (#39656)
  
  authored and
  zozyo
  committed
  79a3ac5
- dsv4.1: Hopper FP8 matmul kernels and tuning (#39657)
  
  authored and
  zozyo
  committed
  5919a29
- dsv4.1: mHC computation and compensated projections (#39664)
  
  hnyls2002
  authored and
  zozyo
  committed
  a557657
- dsv4.1: vision tower and image preprocessing (#39668)
  
  authored and
  zozyo
  committed
  d31c3fa
- dsv4.1: chat encoding and tool parsing (#39665)
  
  authored and
  zozyo
  committed
  137f96a
- dsv4.1: Engram module and request history support (#39666)
  
  authored and
  zozyo
  committed
  22d5407
- [DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921)
  
  hnyls2002
  authored and
  zozyo
  committed
  5648185
- [Quant] Serve 32-wide-K ue8m0 block-FP8 linears through the FlashInfer MXFP8 GEMMs (#40039)
  
  hnyls2002
  authored and
  zozyo
  committed
  e533126
- dsv4.1: remaining model and runtime integration (#38798)
  
  authored and
  zozyo
  committed
  9af234a

Navigation Menu

Repository navigation

Backport DeepSeek V4.1 native support onto SGLang v0.5.20 - #43

Backport DeepSeek V4.1 native support onto SGLang v0.5.20#43
zozyo wants to merge 15 commits into
codex/serving-v0520-upstream-r1from
codex/dsv41-v0520-01-native-support

Commits on Sep 19, 2026

dsv4.1: Rust extension modules for image preprocessing, KV pool names, and PD bootstrap (#39677)

dsv4.1: standalone kernels and Python wrappers (#39646)

dsv4.1: Top-k kernels and candidate selection (#39648)

dsv4.1: communication kernels and wrappers (#39653)

dsv4.1: compression, KV I/O, and metadata kernels (#39652)

dsv4.1: candidate indexer library (#39671)

dsv4.1: RoPE and FP4 packing kernels (#39656)

dsv4.1: Hopper FP8 matmul kernels and tuning (#39657)

dsv4.1: mHC computation and compensated projections (#39664)

dsv4.1: vision tower and image preprocessing (#39668)

dsv4.1: chat encoding and tool parsing (#39665)

dsv4.1: Engram module and request history support (#39666)

[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921)

[Quant] Serve 32-wide-K ue8m0 block-FP8 linears through the FlashInfer MXFP8 GEMMs (#40039)

dsv4.1: remaining model and runtime integration (#38798)