Repository navigation

[ROCm][Perf][DSv4.1] Mono decode layer for DeepSeek-V4.1-Flash on MI355X - #60397

Merged

dllehr-amd merged 19 commits into

vllm-project:mainfrom

Fangzhou-Ai:dsv41-mono-decode-pr

Oct 10, 2026

Merged

[ROCm][Perf][DSv4.1] Mono decode layer for DeepSeek-V4.1-Flash on MI355X#60397
dllehr-amd merged 19 commits into
vllm-project:mainfrom
Fangzhou-Ai:dsv41-mono-decode-pr

Commits on Oct 7, 2026
- [ROCm][Perf][DSv4.1] Mono decode layer for DeepSeek-V4.1-Flash on MI355X
  
  Fangzhou-Ai
  and
  claude
  committed
  daffb81
- [ROCm][Perf][DSv4.1] Mono decode: the FFN launch for the other 10 layers
  
  Fangzhou-Ai
  and
  claude
  committed
  c34f8a8
- [ROCm][DSv4.1] Mono decode: gate on the CDNA version
  
  Fangzhou-Ai
  and
  claude
  committed
  6a35042
- [ROCm][DSv4.1] Mono decode: code spans for index notation in docstrings
  
  Fangzhou-Ai
  and
  claude
  committed
  ced9930
- [ROCm] Rename the mono decode switch to VLLM_ROCM_MONO_DECODE
  
  Fangzhou-Ai
  and
  claude
  committed
  d4acb22
- Merge branch 'main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  authored
  d18f769
Commits on Oct 8, 2026
- Merge branch 'main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  authored
  524bc76
- [ROCm][DSv4.1] Mono decode: a scratch per step width
  
  Fangzhou-Ai
  and
  claude
  committed
  886a5f5
- [ROCm][DSv4.1] Mono decode: TP2 numerics test against vLLM's decode ops
  
  Fangzhou-Ai
  and
  claude
  committed
  e69add8
- Merge branch 'main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  authored
  ba010ab
- [ROCm][DSv4.1] Mono numerics test: enable AITER's MoE in the worker
  
  Fangzhou-Ai
  and
  claude
  committed
  5037c51
- Merge branch 'main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  authored
  73f40ed
Commits on Oct 9, 2026
- [ROCm][DSv4.1] Mono decode: reject deployments the kernels cannot run
  
  Fangzhou-Ai
  and
  claude
  committed
  dea9fa3
- [ROCm][DSv4.1] Mono numerics test: TP4, error bounds, replay stress
  
  Fangzhou-Ai
  and
  claude
  committed
  b9423a8
- Merge branch 'main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  authored
  9a24c32
- [ROCm][DSv4.1] Mono decode: test through the real decoder layers
  
  Fangzhou-Ai
  and
  claude
  committed
  7c69067
- Merge remote-tracking branch 'upstream/main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  committed
  0370567
- [ROCm][DSv4.1] Mono model-level test: TP2 and TP4
  
  Fangzhou-Ai
  and
  claude
  committed
  c25b7e9
- Merge remote-tracking branch 'upstream/main' into dsv41-mono-decode-pr
  Fangzhou-Ai
  committed
  f6b54da

Commits

Commits on Oct 7, 2026

Commits on Oct 8, 2026

Commits on Oct 9, 2026