Repository navigation

[Perf] Optimize rmsnorm/layernorm - #848

Merged

coderfeli merged 29 commits into

mainfrom

cjl/norm_perf

Oct 9, 2026

Merged

[Perf] Optimize rmsnorm/layernorm#848
coderfeli merged 29 commits into
mainfrom
cjl/norm_perf

Commits on Jul 27, 2026
- fix(rmsnorm): use custom eps in quantized forward kernels
  cschenjunlin
  committed
  36bb704
- perf(rmsnorm): extend vec8 coverage in forward kernels
  
  cschenjunlin
  and
  cursoragent
  committed
  bc5d374
- fix(layernorm): use custom eps in forward kernels
  
  cschenjunlin
  and
  cursoragent
  committed
  d6bb83f
- perf(layernorm): extend vec8 coverage in forward kernels
  
  cschenjunlin
  and
  cursoragent
  committed
  0f2d86c
Commits on Jul 29, 2026
- test(rmsnorm): diagnose gfx1201 SmoothQuant scale paths
  
  cschenjunlin
  and
  cursoragent
  committed
  38ba12f
- test(rmsnorm): re-enable SmoothQuant on gfx1201
  
  cschenjunlin
  and
  cursoragent
  committed
  2ab9c00
Commits on Jul 31, 2026
- test(rmsnorm): cover exact gfx1201 SmoothQuant regression
  
  cschenjunlin
  and
  cursoragent
  committed
  d07bf28
- test(rmsnorm): quarantine SmoothQuant on gfx1201
  cschenjunlin
  committed
  6b7a130
- docs(norm): clarify SmoothQuant scale contract
  
  cschenjunlin
  and
  cursoragent
  committed
  85471e6
Commits on Aug 4, 2026
- restore pre-diagnostic SmoothQuant baseline
  cschenjunlin
  committed
  b47a4d0
Commits on Aug 12, 2026
- Merge remote-tracking branch 'origin/main' into cjl/norm_perf
  cschenjunlin
  committed
  2aefe4a
Commits on Aug 18, 2026
- perf(rmsnorm): vectorize unaligned large-N rows
  
  cschenjunlin
  and
  cursoragent
  committed
  39d3897
Commits on Aug 19, 2026
- [Fix] Barrier the LDS scratch reuse between successive block reductions
  cschenjunlin
  committed
  6487994
Commits on Aug 20, 2026
- refactor: separate base and forward shape configurations
  cschenjunlin
  committed
  d42e571
- Merge remote-tracking branch 'origin/main' into cjl/norm_perf
  cschenjunlin
  committed
  b256468
- test: remove gfx1201 quant norm quarantine
  
  cschenjunlin
  and
  cursoragent
  committed
  72aaa42
Commits on Aug 25, 2026
- perf(rmsnorm): restore runtime M dispatch for small N
  
  cschenjunlin
  and
  cursoragent
  committed
  c5c8afd
- perf(rmsnorm): optimize wide BF16 rows on gfx942
  
  cschenjunlin
  and
  cursoragent
  committed
  bbdde41
Commits on Sep 1, 2026
- Remove RMSNorm benchmark script from tracking
  cschenjunlin
  committed
  b98ff76
Commits on Sep 3, 2026
- restore the RNA semantic to RNE
  cschenjunlin
  committed
  cae767d
Commits on Sep 8, 2026
- Merge remote-tracking branch 'origin/main' into cjl/norm_perf
  
  cschenjunlin
  and
  cursoragent
  committed
  7f2b9aa
Commits on Sep 11, 2026
- perf(rmsnorm): dispatch gfx95x BF16 NT cache policy on row count
  
  cschenjunlin
  and
  cursoragent
  committed
  21c0eae
Commits on Sep 17, 2026
- perf(rmsnorm): extend vec8 coverage to fused-add and quant variants
  
  cschenjunlin
  and
  cursoragent
  committed
  cf1151b
- fix(norm): assert the implicit quantized-norm dtype ABI
  
  cschenjunlin
  and
  cursoragent
  committed
  0ad9aff
Commits on Sep 18, 2026
- refactor(norm): load and store single elements by direct indexing
  
  cschenjunlin
  and
  cursoragent
  committed
  9f2357f
Commits on Sep 21, 2026
- fix(norm): anchor the quantized-norm dtype guard to the builder dtype_str
  
  cschenjunlin
  and
  cursoragent
  committed
  fc799d9
Commits on Sep 24, 2026
- docs(norm): resync the LayerNorm and RMSNorm guide sections with the kernels
  
  cschenjunlin
  and
  cursoragent
  committed
  8c63e3b
- Merge branch 'main' into cjl/norm_perf
  jhinpan
  authored
  175cf1c
Commits on Sep 28, 2026
- fix(norm): guard IR assertions against cache-loaded artifacts
  
  cschenjunlin
  and
  cursoragent
  committed
  da396b8

Commits

Commits on Jul 27, 2026

Commits on Jul 29, 2026

Commits on Jul 31, 2026

Commits on Aug 4, 2026

Commits on Aug 12, 2026

Commits on Aug 18, 2026

Commits on Aug 19, 2026

Commits on Aug 20, 2026

Commits on Aug 25, 2026

Commits on Sep 1, 2026

Commits on Sep 3, 2026

Commits on Sep 8, 2026

Commits on Sep 11, 2026

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Sep 21, 2026

Commits on Sep 24, 2026

Commits on Sep 28, 2026