Repository navigation

[ROCm][Perf][MLA] Add opt-in FlyDSL FP8 prefill attention for AITER MLA - #59124

Open

gbyu-amd wants to merge 5 commits into

vllm-project:mainfrom

gbyu-amd:rocm-k3-flydsl-fp8-prefill

Open

[ROCm][Perf][MLA] Add opt-in FlyDSL FP8 prefill attention for AITER MLA#59124
gbyu-amd wants to merge 5 commits into
vllm-project:mainfrom
gbyu-amd:rocm-k3-flydsl-fp8-prefill

Commits on Oct 14, 2026
- [ROCm][Perf][MLA] Add opt-in FlyDSL FP8 prefill attention for AITER MLA
  
  authored and
  ganyi1996ppo
  committed
  d3e836c
- [ROCm][MLA] Use cross_seqlen=True for FlyDSL FP8 new-token prefill
  
  authored and
  ganyi1996ppo
  committed
  5f131ca
- [ROCm][MLA] Make FlyDSL FP8 prefill a standalone MLA prefill backend
  
  authored and
  ganyi1996ppo
  committed
  5e7b707
- [ROCm][MLA] Address review: quant grid bounds and ASM prefill gating
  
  ganyi1996ppo
  and
  claude
  committed
  87d1ebc
- [ROCm][MLA] Take an optional device capability in the FlyDSL FP8 backend
  
  ganyi1996ppo
  and
  claude
  committed
  cde699e