[Kernel] Switch fp8 layers to use the CUTLASS kernels#5183
Merged
pcmoritz merged 9 commits intovllm-project:mainfrom Jun 7, 2024
Merged
[Kernel] Switch fp8 layers to use the CUTLASS kernels#5183pcmoritz merged 9 commits intovllm-project:mainfrom
pcmoritz merged 9 commits intovllm-project:mainfrom