Skip to content

[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100#5238

Merged
simon-mo merged 7 commits intovllm-project:mainfrom
pcmoritz:update-fp8-moe-configs
Jun 5, 2024
Merged

[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100#5238
simon-mo merged 7 commits intovllm-project:mainfrom
pcmoritz:update-fp8-moe-configs

Commits

Commits on Jun 4, 2024

Commits on Jun 5, 2024