[ROCm][Deepseekv4] DeepseekV4 Mi300 support #41451

Draft

ganyi1996ppo wants to merge 17 commits intovllm-project:mainfrom

ROCm:ganyi/dsv4_mi300_support

Commits on May 1, 2026

make kernel compatible with rocm platform

ganyi1996ppo
authored and
whx-sjtu
committed
ref supoort of dsv4
whx-sjtu
committed
remove _old_forward
whx-sjtu
committed
support topk_softplus for all number of experts

tjtanaa
authored and
whx-sjtu
committed
fix formatting

tjtanaa
authored and
whx-sjtu
committed
enable topk_softplus_sqrt

tjtanaavllm
authored and
whx-sjtu
committed
enable fused_deepseek_v4_qnorm_rope_kv_insert

tjtanaavllm
authored and
whx-sjtu
committed
fix review
whx-sjtu
committed
disable multistream for rocm
whx-sjtu
committed
add tilelang as dependency to ensure the mhc module can be imported

tjtanaavllm
authored and
whx-sjtu
committed
revert forward_context
whx-sjtu
committed
fix lint
whx-sjtu
committed
fix compile forever issue
ganyi1996ppo
committed
relocate clang-format off
ganyi1996ppo
committed
mi300 support
ganyi1996ppo
committed
further optimize dsv3.2
ganyi1996ppo
committed
accuracy right
ganyi1996ppo
committed