Skip to content

[Feature] Triton INT4 / INT2 per-token-head KV cache quantization - #40633

Closed
JartX wants to merge 7 commits into
vllm-project:mainfrom
JartX:feature/int4-int2-per-token-head-v2
Closed

[Feature] Triton INT4 / INT2 per-token-head KV cache quantization#40633
JartX wants to merge 7 commits into
vllm-project:mainfrom
JartX:feature/int4-int2-per-token-head-v2

perf(rdna3): dtype-aware RHT sign caching in _hadamard.py

4d33ce1
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded May 14, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO