Skip to content

[Model] Add DeepSeek V4.1 support - #38798

Open
hnyls2002 wants to merge 57 commits into
mainfrom
dsv4.1
Open

[Model] Add DeepSeek V4.1 support#38798
hnyls2002 wants to merge 57 commits into
mainfrom
dsv4.1

Conversation

@hnyls2002

@hnyls2002 hnyls2002 commented Sep 10, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Collaborator
  • Add DeepSeek V4.1 support.

CI States

Latest PR Test (Base): ❌ Run #34943712862
Latest PR Test (Extra): ❌ Run #34943712631
Latest PR Test (AMD ROCm 10): ❌ Run #34943712841

@hnyls2002 @ch-wan
@claude @cursoragent @DarkSharpness @ispobock @kpham-sgl @BBuf @yhyang201 @Oasis-Git @Zhichenzzz Ziyi Xu
Add DeepSeek V4.1 Day 0 support
85f8105 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xiaoyu Zhang <xiaoyu.zhang@radixark.ai>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: Zhichen Zeng <zczeng@uw.edu>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
@mintlify

mintlify Bot commented Sep 10, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
lmsysorg 🟢 Ready View Preview Sep 15, 2026, 7:01 AM

💡 Tip: Enable Automations to automatically generate PRs for you.

@Jiminator Jiminator closed this Sep 14, 2026
@Jiminator
Jiminator deleted the dsv4.1 branch September 14, 2026 04:46
@DarkSharpness DarkSharpness mentioned this pull request Sep 14, 2026
Open
5 tasks
DarkSharpness and others added 26 commits September 14, 2026 23:19
@DarkSharpness @claude
[DSV4.1] Record side-stream work right before its join to keep CUDA-g…
0483bb7 
…raph replay on one stream (#39420)

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
@DarkSharpness @claude
[DSV4.1] NVLink collectives, and the DSpark draft head's vocab gather…
75855b4 
… on them (#39414)

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
@DarkSharpness @claude
[DSV4.1] Multi-stream prepare for ratio-1/2 layers, fused ratio-1 ver…
09a578e 
…ify compression, PDL on _q_rope_store (#39445)

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
@hnyls2002
gate compressed pool configs on model ratios
027a4c0
@hnyls2002
move init_trtllm_sparse_buffers back into DSV4AttnMetadata
3781337
@hnyls2002
cuda-graph-max-bs-decode in v4.1 config and e2e test
05c841d
@hnyls2002
dspark pd test: DSV4_REQUEST_STATE
8bd60a9
@hnyls2002
tbo children inherit encoder_swa_replay
f608770
@hnyls2002
skip mm embed in target verify
e3b23e3
@hnyls2002
rust PoolName: deepseek v4 c1/c2 variants
e94a86f
@hnyls2002
swa ratio explicitly-set marker instead of server_args read
d5a5ef9
@hnyls2002
resolve backend prefill-graph hook once in runner init
fc8da20
@hnyls2002
class default for dsv41_spec_layout
345cf00
@hnyls2002
thread vl_correction_bias to MoEGate
f119d67
@hnyls2002
register deepseek_v41 processor as unrouted
da1eba6
@hnyls2002
pool configurator test: cap-mode attrs on dsv4 fixtures
252f8d6
@hnyls2002
rope policy test: q_head_norm on fixture
93728f1
@hnyls2002
shared expert fusion test: v4.1 list fields on config
f3c0951
@hnyls2002
fix dsv4 test fixtures
ca541d2
@hnyls2002
drop overriding duplicate in DSpark draft
aa3533a
@hnyls2002
ruff format v41 detector
cb15598
@hnyls2002
drop dev-time dsv4.1 tests
2cdc6a8
@hnyls2002
move dsv4.1 tests into registered taxonomy
4b6b3f2
@hnyls2002
merge main 2c37b90 (batch 10/10)
82932b4
@hnyls2002
fixture-safe reads for main's dsv4 unit tests
1e9679d
@BBuf
[DSV4.1] Combine DSpark decode and prefill kernel optimizations (#39370)
01d34d7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JustinTong0323 JustinTong0323 Awaiting requested review from JustinTong0323 JustinTong0323 is a code owner
@Ying1123 Ying1123 Awaiting requested review from Ying1123 Ying1123 is a code owner
@merrymercy merrymercy Awaiting requested review from merrymercy merrymercy is a code owner
@Qiaolin-Yu Qiaolin-Yu Awaiting requested review from Qiaolin-Yu Qiaolin-Yu is a code owner
@mickqian mickqian Awaiting requested review from mickqian mickqian is a code owner
@yhyang201 yhyang201 Awaiting requested review from yhyang201 yhyang201 is a code owner
@yuan-luo yuan-luo Awaiting requested review from yuan-luo yuan-luo is a code owner
@HaiShaw HaiShaw Awaiting requested review from HaiShaw HaiShaw is a code owner
@yctseng0211 yctseng0211 Awaiting requested review from yctseng0211 yctseng0211 is a code owner
@fzyzcjy fzyzcjy Awaiting requested review from fzyzcjy fzyzcjy is a code owner
@ispobock ispobock Awaiting requested review from ispobock ispobock is a code owner
@ch-wan ch-wan Awaiting requested review from ch-wan ch-wan is a code owner
@Fridge003 Fridge003 Awaiting requested review from Fridge003 Fridge003 is a code owner
@huangtingwei9988 huangtingwei9988 Awaiting requested review from huangtingwei9988 huangtingwei9988 is a code owner
@stmatengss stmatengss Awaiting requested review from stmatengss stmatengss is a code owner
@xiezhq-hermann xiezhq-hermann Awaiting requested review from xiezhq-hermann xiezhq-hermann is a code owner
@hanming-lu hanming-lu Awaiting requested review from hanming-lu hanming-lu is a code owner
@yizhang2077 yizhang2077 Awaiting requested review from yizhang2077 yizhang2077 is a code owner
@hzh0425 hzh0425 Awaiting requested review from hzh0425 hzh0425 is a code owner
@alphabetc1 alphabetc1 Awaiting requested review from alphabetc1 alphabetc1 is a code owner
@BBuf BBuf Awaiting requested review from BBuf BBuf is a code owner
@Edwardf0t1 Edwardf0t1 Awaiting requested review from Edwardf0t1 Edwardf0t1 is a code owner
@FlamingoPg FlamingoPg Awaiting requested review from FlamingoPg FlamingoPg is a code owner
@AniZpZ AniZpZ Awaiting requested review from AniZpZ AniZpZ is a code owner
@b8zhong b8zhong Awaiting requested review from b8zhong b8zhong is a code owner
@OrangeRedeng OrangeRedeng Awaiting requested review from OrangeRedeng OrangeRedeng is a code owner
@Alisehen Alisehen Awaiting requested review from Alisehen Alisehen is a code owner
@mmangkad mmangkad Awaiting requested review from mmangkad mmangkad is a code owner
@hebiao064 hebiao064 Awaiting requested review from hebiao064 hebiao064 is a code owner
@CatherineSue CatherineSue Awaiting requested review from CatherineSue CatherineSue is a code owner
@slin1237 slin1237 Awaiting requested review from slin1237 slin1237 is a code owner
@ByronHsu ByronHsu Awaiting requested review from ByronHsu ByronHsu is a code owner
@ShangmingCai ShangmingCai Awaiting requested review from ShangmingCai ShangmingCai is a code owner
@Duyi-Wang Duyi-Wang Awaiting requested review from Duyi-Wang Duyi-Wang is a code owner
@sogalin sogalin Awaiting requested review from sogalin sogalin is a code owner
@DarkSharpness DarkSharpness Awaiting requested review from DarkSharpness DarkSharpness is a code owner
@celve celve Awaiting requested review from celve celve is a code owner
@HydraQYH HydraQYH Awaiting requested review from HydraQYH HydraQYH is a code owner
@wisclmy0611 wisclmy0611 Awaiting requested review from wisclmy0611 wisclmy0611 is a code owner
@zijiexia zijiexia Awaiting requested review from zijiexia zijiexia is a code owner
@ping1jing2 ping1jing2 Awaiting requested review from ping1jing2 ping1jing2 is a code owner
@iforgetmyname iforgetmyname Awaiting requested review from iforgetmyname iforgetmyname is a code owner
@whybeyoung whybeyoung Awaiting requested review from whybeyoung whybeyoung is a code owner
@Jialin Jialin Awaiting requested review from Jialin Jialin is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

deepseek documentation Improvements or additions to documentation hicache Hierarchical Caching for SGLang jit-kernel memory-pool npu quant LLM Quantization

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@hnyls2002 @Jiminator @kpham-sgl @DarkSharpness @BBuf @zijiexia @Oasis-Git @rchalamala