Skip to content

[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction#40737

Merged
robertgshaw2-redhat merged 10 commits intovllm-project:mainfrom
the-david-oy:fix/tma-kv-head-stride-degenerate
May 3, 2026
Merged

[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction#40737
robertgshaw2-redhat merged 10 commits intovllm-project:mainfrom
the-david-oy:fix/tma-kv-head-stride-degenerate

Commits

Commits on Apr 24, 2026

Commits on Apr 28, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 3, 2026