Repository navigation

perf(dsv4): adapt tuned AITER ASM FP8 decode - #2411

Closed

yhl-amd wants to merge 5 commits into

yhl-amd:perf/dsv4-aiter5195-asm-decode

Commits on Sep 26, 2026
- perf(dsv4): adapt tuned AITER ASM FP8 decode
  yhl-amd
  committed
  b9ba7bb
- style: use functools cache for device arch
  yhl-amd
  committed
  9bf8527
Commits on Sep 27, 2026
- perf(dsv4): steer AITER decode split pick with kv_len_hint
  
  yhl-amd
  and
  claude
  committed
  87521b2
Commits on Sep 28, 2026
- perf(dsv4): pass AITER decode split plans through attention metadata
  
  yhl-amd
  and
  claude
  committed
  2aaa907
- refactor(dsv4): one split-plan path, owned by whoever builds the decode CSR
  
  yhl-amd
  and
  claude
  committed
  94d1b24