Skip to content

[Feature] Triton INT4 per-token-head KV cache quantization - #40835

Merged
tdoublep merged 72 commits into
vllm-project:mainfrom
JartX:refactor/prefill-fastpath-per-token-head-v2
Jun 24, 2026
Merged

[Feature] Triton INT4 per-token-head KV cache quantization#40835
tdoublep merged 72 commits into
vllm-project:mainfrom
JartX:refactor/prefill-fastpath-per-token-head-v2

Merge branch 'main' into refactor/prefill-fastpath-per-token-head-v2

46a7bb5
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jun 24, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync