[Kernel][SM70] Add opt-in DeepSeek V4 FP13 GEMV - #322
Merged
Merged
Conversation
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
yangzhuxinyzx
added a commit
that referenced
this pull request
Aug 26, 2026
Repair #322 on current main, retaining only the measured FP13 kernel and adding tensor-value, CUDA-device, shape, dtype, layout, memory, quality, and rollback safeguards. The production path defaults on without model/checkpoint identity admission. Original-commit: 165ec09 Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Contributor
Author
|
Superseded by merged PR #325 ( |
Contributor
Author
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
yangzhuxinyzx
marked this pull request as ready for review
August 28, 2026 03:26
Contributor
Author
|
审计结论:默认开启且带保护的 FP13 路径已由后续安全实现吸收;该分支已通过修复 PR #372 同步到最新 main,最新完整 pre-commit 通过,且源码树与 main 完全一致。按零差异历史归档合并。 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Add an opt-in packed-FP13 single-token GEMV for the fixed DeepSeek V4 SM70 router/compressor/indexer projections. Packing happens once after loading and retains the original FP16 GEMV fallback.
Test Plan
Test Result
ruff check: passedpy_compile: passedDraft: do not merge until the queued exclusive-GPU and quality gates complete.