Sync DeepSeek upstream through V4.1 kernels (#221) - #20
Merged
Merged
Conversation
Sync deepseek-ai/FlashMLA main through commit 07a1089, including the DeepSeek V4.1 kernels from deepseek-ai#221 and the reorganized csrc/kernels tree. The upstream history is represented as one commit because the target repository's DCO check requires a valid sign-off on every commit in the pull request. Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Port the V3.2 NVFP4 cache path alongside upstream's generalized V4.1 kernels. Restore optional output forwarding and add quantization and API regression coverage. Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
zyongye
force-pushed
the
sync/upstream-pr-221
branch
from
September 10, 2026 07:09
52eb6a9 to
29b0d03
Compare
Harry-Chen
reviewed
Sep 10, 2026
Harry-Chen
reviewed
Sep 10, 2026
Address review on vllm-project#20: keep the FLASH_MLA_ENABLE_DENSE_BWD and PyInit__flashmla_C comments that the upstream sync dropped from csrc/api/api.cpp, and add a README section summarizing what this fork carries on top of deepseek-ai/FlashMLA (stable ABI, registered operators, optional output buffers, SM90 dense FP8 extension, NVFP4 KV cache, robustness fixes, tests). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Extend the "Changes in the vLLM fork" section with a per-area table of every file that differs from deepseek-ai/FlashMLA@07a1089 and what changed in it, plus the full diffstat and the command to regenerate it. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Harry-Chen
approved these changes
Sep 10, 2026
4 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
deepseek-ai/FlashMLA:mainthrough commit07a1089857b63e74e3133630c02b083b75e8d4b2, including the DeepSeek V4.1 kernels from Add kernels for DeepSeek v4.1 deepseek-ai/FlashMLA#221 and the reorganizedcsrc/kernelstree. The upstream history is represented by one signed sync commit for the target repository's DCO policy.Validation
flash_mla-1.0.0+29b0d03-cp310-abi3-linux_aarch64.whlinto.venv; out-of-tree import registered all 9 operators.Test dependency note
The upstream fused end-to-end reference script was not run locally because its optional
tile_kernelsanddeep_gemmdependencies are not installed. All fused V4/V4.1 sources were included in the successful full extension build.