[Bugfix] Relax TRTLLM KV cache contiguity assertion for cross-layer layout#34158
Merged
mgoin merged 11 commits intovllm-project:mainfrom Mar 16, 2026
Merged
[Bugfix] Relax TRTLLM KV cache contiguity assertion for cross-layer layout#34158mgoin merged 11 commits intovllm-project:mainfrom
mgoin merged 11 commits intovllm-project:mainfrom