Skip to content

feat(cake_mla): add generated Blackwell TRT-LLM MLA decode backend for SM100 and SM103 #4557

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
yyihuang merged 12 commits into from
Sep 25, 2026
Merged

feat(cake_mla): add generated Blackwell TRT-LLM MLA decode backend for SM100 and SM103 #4557

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
698aaf5
feat(mla): add explicit Blackwell TRT-LLM backend
averyhNV Sep 3, 2026
1050299
style(mla): format Blackwell TRT-LLM backend
averyhNV Sep 3, 2026
d0f7675
feat(mla): ship qualified GB300 TRT-LLM MLA generated sources
averyhNV Sep 21, 2026
7473eb2
perf(mla): order persistent CLC work longest-first on GB300
averyhNV Sep 24, 2026
fc50f3f
style(mla): make the TRT-LLM MLA Blackwell backend pass pre-commit
averyhNV Sep 24, 2026
78cfaae
feat(mla): add the SM100 (B200) generated TRT-LLM MLA package
averyhNV Sep 25, 2026
a4031ec
Merge upstream main into codex/cake-trtllm-mla-issue4254
averyhNV Sep 25, 2026
b9de6e0
refactor(cake_mla): give every Cake-owned file the cake_ basename prefix
averyhNV Sep 25, 2026
513caa2
style(cake_mla): wrap the host-path check for ruff format
averyhNV Sep 25, 2026
3120cbb
Merge upstream main into codex/cake-trtllm-mla-issue4254
averyhNV Sep 25, 2026
d13557c
refactor(cake_mla): fold the source-built domain loader into flashinf…
averyhNV Sep 25, 2026
a9a2d35
refactor(cake_mla): select the Blackwell MLA decode backend with back…
averyhNV Sep 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions .pre-commit-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,10 +21,11 @@
# excluded from all hooks so formatting/lint churn doesn't block syncs or alter
# the source-distributed kernel payload.
# The shim/ layers next to them are ours and stay checked.
# The Cake selective-state and Mamba CUDA/host trees, along with frozen KDA
# fallback sources, are byte-faithful generated exports; their SHA-256 digests
# are checked by JIT manifests and must not be rewritten.
exclude: ^(?:csrc/(?:blackwell_msa/|cake_all_gather_matmul/|cake_selective_state_update/(?:cuda|host)/|cake_mamba_ssd_combined/generated/|kda/training_(?:fallback|grouped_row_wg8)_pointer_sm_(?:100a|103a)\.cu)|flashinfer/moe_ep/kernel_src/(?:cutedsl_megamoe|sm90/pull_style_cutedsl_megakernel|sm120/swapab_cutedsl_megakernel)/src/)
# The Cake selective-state and Mamba CUDA/host trees, the TRT-LLM MLA Blackwell
# generated sources, and frozen KDA fallback sources are byte-faithful generated
# exports; their SHA-256 digests are checked by JIT manifests and must not be
# rewritten.
exclude: ^(?:csrc/(?:blackwell_msa/|mla/trtllm_mla_blackwell/generated/|cake_all_gather_matmul/|cake_selective_state_update/(?:cuda|host)/|cake_mamba_ssd_combined/generated/|kda/training_(?:fallback|grouped_row_wg8)_pointer_sm_(?:100a|103a)\.cu)|flashinfer/moe_ep/kernel_src/(?:cutedsl_megamoe|sm90/pull_style_cutedsl_megakernel|sm120/swapab_cutedsl_megakernel)/src/)

repos:
# Standard hooks
Expand Down
Loading
Loading