Improve DeepSeek-V4-Flash throughput on MI300X#16

Closed

fergusfinn wants to merge 8 commits into

port/dsv4-mi300x-bringupfrom

clean-linear-throughput-20260526

Commits on May 27, 2026

DSV4 throughput baseline with MLA and OGS gated off
fergusfinn
committed
Enable static MLA decode metadata: +15.18 output tok/s

Codex
authored and
fergusfinn
committed
Enable direct MLA decode output: +8.74 output tok/s

Codex
authored and
fergusfinn
committed
Enable bf16 projection weight cache: -4.06 output tok/s in e2e noise

Codex
authored and
fergusfinn
committed
Enable dynamic MLA decode launch: +34.16 output tok/s

Codex
authored and
fergusfinn
committed
Enable MXFP4 OGS tile tuning: +106.80 output tok/s

Codex
authored and
fergusfinn
committed
Remove DSV4 profiling and attribution-only controls
fergusfinn
committed

Commits on May 29, 2026

Fix DSV4 ROCm SWA ragged graph buffers
codex
committed