Repository navigation

[FlyDSL] MegaMoEV2: decode/prefill optimizations and Stage1 LDS broadcast race fix - #6127

Merged

yhl-amd merged 18 commits into

ROCm:mainfrom

yhl-amd:perf/megamoe-v2-decode-opts

Oct 5, 2026

Commits on Oct 3, 2026
- perf(mega): MegaMoEV2 opt-in combine masking and tuning hooks
  
  authored and
  yhl-amd
  committed
  579bd76
- fix(mega): key the single-variant Stage1 launcher on its kernel; lighter fixed-slot sync knobs
  
  authored and
  yhl-amd
  committed
  81389ba
- perf(mega): 8-column GEMM1 quant epilogue; Stage2 scatter width knob
  
  authored and
  yhl-amd
  committed
  a8d56bd
- perf(mega): opt-in Stage1/Stage2 experiment knobs (all default off)
  
  authored and
  yhl-amd
  committed
  b019658
- perf(mega): compact dispatch fast copy on by default
  
  authored and
  yhl-amd
  committed
  f181417
- perf(mega): persistent Stage2 (128 CTAs) for fixed-slot buckets below 128
  
  authored and
  yhl-amd
  committed
  a4e7a12
- perf(mega): paired K loop + LDS-DMA A for small fixed-slot GEMM1 buckets
  
  authored and
  yhl-amd
  committed
  4a352a9
- fix(mega): Stage1 block broadcasts get dedicated LDS slots
  
  authored and
  yhl-amd
  committed
  7e13e05
- perf(mega): non-temporal W2 loads for the fixed-slot 256 bucket
  
  authored and
  yhl-amd
  committed
  04fabe7
- style(mega): black the MegaMoE files this series touches
  
  yhl-amd
  and
  claude
  committed
  f7d4c9f
- test(mega): check whole -1 rows under mask_invalid_slots; fixed-slot to MTPR 1024
  
  yhl-amd
  and
  claude
  committed
  3c9e829
- style(mega): satisfy ruff on the MegaMoE files this series touches
  
  yhl-amd
  and
  claude
  committed
  a3ee77e
Commits on Oct 4, 2026
- refactor(mega): drop the experiment and tuning env knobs
  
  yhl-amd
  and
  claude
  committed
  7635e5f
- refactor(mega): drop the AITER_MEGA_TRACE timestamp instrumentation
  
  yhl-amd
  and
  claude
  committed
  ef4d7c0
- refactor(mega): read MegaMoEV2's environment variables from one module
  
  yhl-amd
  and
  claude
  committed
  6f006b9
- style(mega): trim comments, the env table and the pad-row test helpers
  
  yhl-amd
  and
  claude
  committed
  638237d
- refactor(mega): pass the combine mask ids instead of keeping them on the instance
  
  yhl-amd
  and
  claude
  committed
  838153d
- refactor(mega): simplify Stage1/GEMM1 plumbing and share the epilogue store helpers
  
  yhl-amd
  and
  claude
  committed
  984210c

Navigation Menu

Repository navigation

[FlyDSL] MegaMoEV2: decode/prefill optimizations and Stage1 LDS broadcast race fix - #6127

[FlyDSL] MegaMoEV2: decode/prefill optimizations and Stage1 LDS broadcast race fix#6127
yhl-amd merged 18 commits into
ROCm:mainfrom
yhl-amd:perf/megamoe-v2-decode-opts

Commits on Oct 3, 2026

perf(mega): MegaMoEV2 opt-in combine masking and tuning hooks

fix(mega): key the single-variant Stage1 launcher on its kernel; lighter fixed-slot sync knobs

perf(mega): 8-column GEMM1 quant epilogue; Stage2 scatter width knob

perf(mega): opt-in Stage1/Stage2 experiment knobs (all default off)

perf(mega): compact dispatch fast copy on by default

perf(mega): persistent Stage2 (128 CTAs) for fixed-slot buckets below 128

perf(mega): paired K loop + LDS-DMA A for small fixed-slot GEMM1 buckets

fix(mega): Stage1 block broadcasts get dedicated LDS slots

perf(mega): non-temporal W2 loads for the fixed-slot 256 bucket

style(mega): black the MegaMoE files this series touches

test(mega): check whole -1 rows under mask_invalid_slots; fixed-slot to MTPR 1024

style(mega): satisfy ruff on the MegaMoE files this series touches

Commits on Oct 4, 2026

refactor(mega): drop the experiment and tuning env knobs

refactor(mega): drop the AITER_MEGA_TRACE timestamp instrumentation

refactor(mega): read MegaMoEV2's environment variables from one module

style(mega): trim comments, the env table and the pad-row test helpers

refactor(mega): pass the combine mask ids instead of keeping them on the instance

refactor(mega): simplify Stage1/GEMM1 plumbing and share the epilogue store helpers