[ROCm][DeepSeek-V4] WIP: Enable CSA multistream decode#43718

Draft

Fangzhou-Ai wants to merge 21 commits into

vllm-project:mainfrom

Fangzhou-Ai:rocm-dsv4-csa-multistream

Commits on May 27, 2026

Enable ROCm DeepSeek V4 decode multi-stream
vLLM Contributor
committed
Stabilize ROCm DeepSeek V4 benchmark launch
vLLM Contributor
committed
Investigate ROCm DSV4 multi-stream ordering

vLLM Contributor
and
codex
committed
Add ROCm DSV4 stream overlap probe

vLLM Contributor
and
codex
committed
Add ROCm DSV4 CSA multi-stream experiment

vLLM Contributor
and
codex
committed
Enable ROCm DSV4 CSA multistream

vLLM Contributor
and
codex
committed
Clean ROCm DSV4 CSA multistream policy

vLLM Contributor
and
codex
committed
remove rocm-only-related test files
vLLM Contributor
committed
Fix ROCm DSV4 CSA multistream correctness
vLLM Contributor
committed
Resolve ROCm DSV4 multistream rebase drift
vLLM Contributor
committed
Restore rotary embedding helper behavior
vLLM Contributor
committed
Address DeepSeek V4 ROCm review feedback

vLLM Contributor
and
codex
committed
remove env knobs with preset optimal config
vLLM Contributor
committed
remove the repro test
vLLM Contributor
committed
align test cases with current multistream decoding settings
vLLM Contributor
committed
fix test to AMD only path
vLLM Contributor
committed
inline stream creation for ROCm path
vLLM Contributor
committed
clean unused kernel
vLLM Contributor
committed
remove unused kernel
vLLM Contributor
committed
guard CUDA path intact
vLLM Contributor
committed
trim to 2-stream strategy
vLLM Contributor
committed