Skip to content

[ROCm][Bugfix] Support FP8 KV cache for NoPE sparse MLA - #57134

Open
amd-dlimpus wants to merge 39 commits into
vllm-project:mainfrom
amd-dlimpus:fix/rocm-nope-fp8-kv-sparse-mla-v2
Open

amd-dlimpus wants to merge 39 commits into
vllm-project:mainfrom
amd-dlimpus:fix/rocm-nope-fp8-kv-sparse-mla-v2