[Perf][ROCm][ROCM_ATTN] Run large fp8 decode batches on the AITER asm paged attention - #3

[Perf][ROCm][ROCM_ATTN] Run large fp8 decode batches on the AITER asm paged attention#3

lishuoshuo-amd wants to merge 1 commit into

base/main-8af2080e7lishuoshuo-amd/vllm:base/main-8af2080e7from

perf/rocm-attn-aiter-asm-decodelishuoshuo-amd/vllm:perf/rocm-attn-aiter-asm-decodeCopy head branch name to clipboard