Skip to content

[New Model] Support DeepseekV4 #40760

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
zyongye wants to merge 10 commits into from
Closed

[New Model] Support DeepseekV4 #40760

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
434b1bd
SVF support squashed
zyongye Jan 7, 2026
bc34b25
nit
zyongye Apr 24, 2026
4bab47b
[Fix] Always allocate FP8 indexer cache even for FP4 indexer (#225)
ivanium Apr 24, 2026
6f3820e
Avoid CPU-GPU sync (#224)
WoosukKwon Apr 24, 2026
aa11460
add 1024 topk support (#226)
zyongye Apr 24, 2026
3602f14
temporary disable persistent topk for 1024
zyongye Apr 24, 2026
4258ac3
Integrate MegaMoE
WoosukKwon Apr 25, 2026
06e4b4f
Add model change
WoosukKwon Apr 25, 2026
6d244bd
Support dummy loading
WoosukKwon Apr 25, 2026
e8e38e1
free up unused weights
WoosukKwon Apr 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -291,6 +291,7 @@ set(VLLM_EXT_SRC
"csrc/activation_kernels.cu"
"csrc/layernorm_kernels.cu"
"csrc/fused_qknorm_rope_kernel.cu"
"csrc/fused_deepseek_v4_qnorm_rope_kv_insert_kernel.cu"
"csrc/layernorm_quant_kernels.cu"
"csrc/sampler.cu"
"csrc/topk.cu"
Expand Down Expand Up @@ -1026,7 +1027,9 @@ endif()
set(VLLM_MOE_EXT_SRC
"csrc/moe/torch_bindings.cpp"
"csrc/moe/moe_align_sum_kernels.cu"
"csrc/moe/topk_softmax_kernels.cu")
"csrc/moe/topk_softmax_kernels.cu"
"csrc/moe/topk_softplus_sqrt_kernels.cu")


if(VLLM_GPU_LANG STREQUAL "CUDA")
list(APPEND VLLM_MOE_EXT_SRC
Expand Down
Loading