Making vLLM compatible with Mistral fp8 weights.#10229
Closed
akllm wants to merge 20 commits intovllm-project:mainfrom
Closed
Making vLLM compatible with Mistral fp8 weights.#10229akllm wants to merge 20 commits intovllm-project:mainfrom
akllm wants to merge 20 commits intovllm-project:mainfrom
