Update DeepGEMM tag to point to latest nv-dev branch for sm120 support - #47304
Merged
youkaichao merged 1 commit intoJul 2, 2026
Merged
Conversation
Signed-off-by: mgoin <mgoin64@gmail.com>
mgoin
requested review from
Harry-Chen,
LucasWilkinson and
tlrmchlsmth
as code owners
July 1, 2026 15:43
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
Harry-Chen
approved these changes
Jul 1, 2026
allenh1
pushed a commit
to allenh1/vllm
that referenced
this pull request
Jul 3, 2026
Sync 2026-07-03: picks up Model Runner V2 improvements (motivated by V2 viability reopening via PR#26). Notable: MRV2 scheduler req-slot bugfix (vllm-project#46974), MRV2 spec-decode int32 block-verify overflow fix (vllm-project#47383), MRV2 DSA-indexer prefill warmup for GLM-5.2/DSA (vllm-project#47285), V2-default for dense models (vllm-project#44443 — DSv4 is MoE so stays V1), DeepGEMM tag -> nv-dev a6b593d2 for SM120 (vllm-project#47304), TLI heterogeneous-vocab spec decode (vllm-project#38174), Delete PagedAttention (vllm-project#47361 — no impact, our sparse-MLA runner is a flashinfer symbol), Xqa decode kernels (vllm-project#43232). Conflict: vllm/v1/spec_decode/llm_base_proposer.py (our DSv4 MTP spec_step_idx routing vs upstream TLI) — resolved keeping BOTH: TLI's heterogeneous-vocab branch routed through our _compute_logits(spec_step_idx). Our SM12x stack preserved (persistent_topk, topk.cu, PR#26 padded-Q kernel, dspark, attention, R1 hardening all UNCHANGED); config/vllm.py DSv4->V1 default + DSpark env-control intact.
jakki-amd
pushed a commit
to jakki-amd/vllm
that referenced
this pull request
Jul 6, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com>
lkk12014402
pushed a commit
to lkk12014402/vllm
that referenced
this pull request
Jul 8, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com>
mayuyuace
pushed a commit
to mayuyuace/vllm
that referenced
this pull request
Jul 9, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
4 tasks
philippesic
pushed a commit
to philippesic/vllm-semantic-cache
that referenced
this pull request
Jul 19, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com>
plasticchris
pushed a commit
to plasticchris/vllm
that referenced
this pull request
Jul 20, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com>
1 task
4 tasks
aditi-amd
pushed a commit
to aditi-amd/vllm
that referenced
this pull request
Aug 4, 2026
vllm-project#47304) Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
This PR #43477 landed in vLLM without bumping up our commit tag for DeepGEMM for the SM120 support, which resulted in many failures for models that trigger DeepGEMM kernels i.e. #47169, #47266
For now we should bump the DeepGEMM commit for nv-dev (which includes deepseek-ai/DeepGEMM#324), but this will likely be an ongoing issue if this gets out of sync with upstream main
Test Plan
Test Result
Tested locally on DGX Spark Qwen3-0.6B-FP8. Before it crashes during startup and now it works fine.
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.