Skip to content

[Attention][TurboQuant] Share dequant buffers, eliminate float16_copy#40941

Merged
DarkLight1337 merged 4 commits into
vllm-project:mainfrom
bhoomit:turboquant-backend-optimizations
Apr 27, 2026
Merged

[Attention][TurboQuant] Share dequant buffers, eliminate float16_copy#40941
DarkLight1337 merged 4 commits into
vllm-project:mainfrom
bhoomit:turboquant-backend-optimizations

perf(attn): Share dequant buffers, eliminate float16_copy

5f994a9
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Apr 26, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync