feat: SM120 support for DeepSeek-V4 inference#24047

Closed

AliceChenyy wants to merge 3142 commits into

sgl-project:deepseek_v4from

AliceChenyy:sm120-dsv4-enablement

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 30, 2026

[Docs] quick fix delete --enable-dp-attention in sgl-jax (#24052)
JamesBrianD
authored
fix(lora): avoid CUDA graph-breaking scalar assignment in seg_indptr (#23738)
yushengsu-thu
authored
allow requests with exactly context_len total tokens (#22546)

opherlieber
and
yushengsu-thu
authored
fix the compatibility between --moe-dense-tp-size 1 and piecewise cuda graph (#23972)
Qiaolin-Yu
authored
[CI] Remove orphaned test/srt/ascend and test/srt/configs (#24145)
merrymercy
authored
[4/N] Quantization Refactor: AWQ schemes and Kernel call and weight init split (#21126)
Alisehen
authored
[NPU] fix some npu error with OffloaderV2 (#19541)

authored
[AMD] Nightly image release for deepseek v4 (#24155)

yctseng0211
and
bingxche
authored
[Feature] Xiaomi MiMo-V2.5 day0 support (#23811)

authored
ci: add per-host utilization view to runner-utilization report (#24102)
alisonshao
authored
ci: run setup_ld_library_path before install_sglang_kernel (#24141)
alisonshao
authored
[MUSA][19/N] Support qwen series models (#23654)

froststeam
and
zhiguo.qin
authored
Fix KeyError in prepare_lora_batch when lora_ids contains None (#21974)
erikwijmans
authored
[sgl-kernel] Prep for torch 2.11 upgrade and switch PyPI default to cu130 (#24162)

authored
[Bench] Fix bench_serving missing reasoning_content stream chunks (#23954)
JustinTong0323
authored
chore: bump sgl-kernel version to 0.4.2 (#24170)
sglang-bot
authored
Fix LFM2 ShortConv Mamba State Indexing (#23975)
hubertlu-tw
authored
fix: support HybridLinearAttnBackend in TboAttnBackend (#20114)
lawrence-harmonic
authored
ci: add rebase-required mode to check-maintenance action (#23109)

alisonshao
and
Alison Shao
authored
Revert "[ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool" (#24163)

alisonshao
and
Alison Shao
authored
[CI] Publish nightly sglang wheel under both cu129 and cu130 indexes (#24176)

Kangyan-Zhou
and
claude
authored
Revert "ci: add rebase-required mode to check-maintenance action" (#24179)
Kangyan-Zhou
authored
Replace hardcoded CUDA device with get_device() for XPU support (#13599)

kalyank007
and
mingfeima
authored
Use device-agnostic helpers for Mamba tests and core ops (#20234)

authored
ci: temporarily disable multimodal-gen-test-1-b200 (#24174)
alisonshao
authored
feat: implement workflow to sync LMSYS SGLang blog (#23438)
zijiexia
authored
[Test] Add XPU device support to unit tests (#22236)

authored
[Intel GPU] Integrate flash_mla_decode in Intel XPU attention backend (#23557)

authored
spec: gate dp mlp sync with server args (#24177)
happierpig
authored
[Misc] Redirect default sglang nightly wheel to cuda 130 (#24183)
Fridge003
authored
[CI] Skip worker-dependent SMG e2e tests pending runner-image debug (#24166)

Kangyan-Zhou
and
claude
authored

Commits on May 1, 2026

Commits on May 2, 2026

Commits on May 3, 2026

Commits on May 4, 2026

Commits on May 5, 2026

Commits on May 6, 2026

Commits on May 7, 2026

Commits on May 8, 2026