Skip to content

[None][feat] Support MLA generation in TrtllmGen attention backend - #12606

Merged
yihwang-nv merged 3 commits into
NVIDIA:mainfrom
yihwang-nv:yihwang/trtllm_gen_attn_mla_decode
Apr 3, 2026
Merged

[None][feat] Support MLA generation in TrtllmGen attention backend#12606
yihwang-nv merged 3 commits into
NVIDIA:mainfrom
yihwang-nv:yihwang/trtllm_gen_attn_mla_decode

Disable TRTLLM_ENABLE_TRTLLM_GEN_ATTENTION and run thop.attention path

c5541d1
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 3, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO