[Model] Remap FP8 kv_scale in CommandR and DBRX#9174
Merged
comaniac merged 2 commits intovllm-project:mainfrom Oct 9, 2024
hliuca:kv_scale_remap
Merged
[Model] Remap FP8 kv_scale in CommandR and DBRX#9174comaniac merged 2 commits intovllm-project:mainfrom hliuca:kv_scale_remap
comaniac merged 2 commits intovllm-project:mainfrom
hliuca:kv_scale_remap
Commits
Commits on Oct 4, 2024
- committed
