Skip to content

[Bugfix] Add bias to SKIP_TENSORS to fix online FP8 for models with biased linears#39666

Closed
alankessler wants to merge 12 commits into
vllm-project:mainfrom
alankessler:fix/fp8-online-bias-loading
Closed

[Bugfix] Add bias to SKIP_TENSORS to fix online FP8 for models with biased linears#39666
alankessler wants to merge 12 commits into
vllm-project:mainfrom
alankessler:fix/fp8-online-bias-loading