Skip to content

[Model] Optional FP8 lm_head compression for Llama and Mistral#35696

Open
lucaspirola wants to merge 2 commits into
vllm-project:mainfrom
lucaspirola:feat/fp8-lm-head-compress
Open

[Model] Optional FP8 lm_head compression for Llama and Mistral#35696
lucaspirola wants to merge 2 commits into
vllm-project:mainfrom
lucaspirola:feat/fp8-lm-head-compress

fixup: replace VLLM_FP8_LM_HEAD env var with --fp8-lm-head CLI arg; e…

e156821
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded May 24, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO