Repository navigation

[DSV4] Tuned ASM FP8 decode with split plans; HCA on aiter's persistent V4-NM kernel - #2462

Merged

yhl-amd merged 13 commits into

ROCm:mainfrom

yhl-amd:perf/dsv4-hca-persistent-decode

Oct 4, 2026

Merged

[DSV4] Tuned ASM FP8 decode with split plans; HCA on aiter's persistent V4-NM kernel#2462
yhl-amd merged 13 commits into
ROCm:mainfrom
yhl-amd:perf/dsv4-hca-persistent-decode

Commits on Sep 26, 2026
- perf(dsv4): adapt tuned AITER ASM FP8 decode
  yhl-amd
  committed
  b9ba7bb
- style: use functools cache for device arch
  yhl-amd
  committed
  9bf8527
Commits on Sep 27, 2026
- perf(dsv4): steer AITER decode split pick with kv_len_hint
  
  yhl-amd
  and
  claude
  committed
  87521b2
Commits on Sep 28, 2026
- perf(dsv4): pass AITER decode split plans through attention metadata
  
  yhl-amd
  and
  claude
  committed
  2aaa907
- refactor(dsv4): one split-plan path, owned by whoever builds the decode CSR
  
  yhl-amd
  and
  claude
  committed
  94d1b24
Commits on Sep 29, 2026
- [DSV4] Run HCA fp8 decode through aiter's persistent V4-NM kernel
  
  yhl-amd
  and
  claude
  committed
  ac8e09d
- [DSV4] Allocate the persistent HCA workspace at model load on every path
  
  yhl-amd
  and
  claude
  committed
  7d39187
Commits on Oct 3, 2026
- [DSV4] Satisfy ruff in the persistent HCA changes
  
  yhl-amd
  and
  claude
  committed
  c8757bd
Commits on Oct 4, 2026
- Merge main into perf/dsv4-hca-persistent-decode
  
  yhl-amd
  and
  claude
  committed
  b3c3bed
- [DSV4] Fix the non-GPU unit tests for the split-plan and HCA imports
  
  yhl-amd
  and
  claude
  committed
  425f885
- [DSV4] Skip the HCA split plan where the persistent kernel runs; review fixes
  
  yhl-amd
  and
  claude
  committed
  b6f4d7d
- [DSV4] Build decode split plans on the host from one constant table
  
  yhl-amd
  and
  claude
  committed
  a49fc9d
- [DSV4] Describe split plans as plain tuples in the docstrings
  
  yhl-amd
  and
  claude
  committed
  784eb25

Commits

Commits on Sep 26, 2026

Commits on Sep 27, 2026

Commits on Sep 28, 2026

Commits on Sep 29, 2026

Commits on Oct 3, 2026

Commits on Oct 4, 2026