[Bugfix] Fix dummy weight for fp8#4916

Merged

pcmoritz merged 4 commits intovllm-project:mainfrom

mzusman:v0.4.2-fp8-dummy-fix

May 20, 2024

Commits on May 19, 2024

Fix dummy weight for fp8
Mor Zusman
committed

Commits on May 20, 2024

Add comment, uniform is not supported in FP8
Mor Zusman
committed
remove torch from comment
Mor Zusman
committed
.to creates a copy and doesn't assign it param.data, changed it so the
Mor Zusman
committed