Skip to content

[Bugfix] Enable attn quantization of Llama-4 by correctly permuting scales for rope (int8, fp8) - #34243

Merged
mgoin merged 3 commits into
vllm-project:mainfrom
eldarkurtic:fix-attn-quant-llama4
Feb 11, 2026
Merged

[Bugfix] Enable attn quantization of Llama-4 by correctly permuting scales for rope (int8, fp8)#34243
mgoin merged 3 commits into
vllm-project:mainfrom
eldarkurtic:fix-attn-quant-llama4

Merge branch 'main' into fix-attn-quant-llama4

6710f71
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Feb 10, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync