[Feature] Triton INT4 per-token-head KV cache quantization - #40835

[Feature] Triton INT4 per-token-head KV cache quantization#40835

tdoublep merged 72 commits into

vllm-project:mainvllm-project/vllm:mainfrom

JartX:refactor/prefill-fastpath-per-token-head-v2JartX/vllm:refactor/prefill-fastpath-per-token-head-v2Copy head branch name to clipboard