[ROCm][DSv4] Share AITER decode dequant + fp8-cast buffers across layers (rebased, stacked on #902)#903

Draft

ChuanLi1101 wants to merge 9 commits intoROCm:hexwang/dsv4_adapt_upstreamfrom

ChuanLi1101:chuali/aiter-mla-dsv4-decode-cudagraph-workspace-rebased

Commits on Apr 28, 2026

make kernel compatible with rocm platform

ganyi1996ppo
authored and
whx-sjtu
committed
ref supoort of dsv4
whx-sjtu
committed
[ROCm] Add AITER-accelerated MLA decode for DeepSeek V4 on MI355X
ChuanLi1101
committed
[ROCm] DSv4 AITER decode: always enable, drop env-var flag
ChuanLi1101
committed
[ROCm] DSv4 AITER decode: split q heads at outer level when h_q>32
ChuanLi1101
committed
[ROCm][DSv4] mxfp4.py: add missing RoutingMethodType import
ChuanLi1101
committed
[ROCm][DSv4] Make AITER sparse decode cudagraph-clean

ChuanLi1101
authored and
ChuanLi1101
committed
[ROCm][DSv4] Refresh AITER work plan every step, not just on rebuild
ChuanLi1101
committed
[ROCm][DSv4] Share AITER decode dequant + fp8-cast buffers across layers
ChuanLi1101
committed