[RadeonFlow] MXFP4 (a4w4) MoE backend for gfx950 - #3832

Merged

coderfeli merged 110 commits into

mainfrom

dev/randomflow_pr

Jul 9, 2026

Commits on Jun 15, 2026

[PERF] MXFP4 (a4w4) MoE backend for gfx950 (#3470)

ColorsWind
and
ftyghome
authored
fa0763b

Commits on Jun 17, 2026

rename aux dir to moe_aux
Bernard-Liu
committed
b035559

Commits on Jun 18, 2026

Port flydsl a4w4 MoE onto randomflow_pr (coexist with HIP #3470) (#3788)
fsx950223
authored
46ecc44

Commits on Jun 21, 2026

flydsl mxfp4 gemm1/gemm2: raw-pointer (data_ptr i64) ABI
ColorsWind
committed
0a0d0ef
flydsl mxfp4 gemm2: large-M (BM128) optimizations
ColorsWind
committed
6cbec45
flydsl mxfp4 gemm1: hardware exp2 in silu
ColorsWind
committed
b51ec85

Commits on Jun 22, 2026

[RadeonFlow] flydsl mxfp4 a4w4 MoE: bring gemm1/gemm2 to parity with the HIP backend (#3828)
ColorsWind
authored
b242ba6
[RadeonFlow] Integrate HIP Sort/Quant in MoE Pipeline (#3827)
ftyghome
authored
05567f6
lgkmcnt
benenzhu
committed
a595f9e
flydsl mxfp4 gemm2: pipeline fp4-out epilog LDS reads (lgkmcnt -68%, gemm2 846->778us @ M=16384) (#3840)
benenzhu
authored
e90d47f
Merge branch 'main' of github.com:ROCm/aiter into dev/randomflow_pr
benenzhu
committed
ead7f82
mxfp4 moe: route Kimi rows to FlyDSL port + replace kernelName regex with token registry

benenzhu
and
claude
committed
4fd9bca
mxfp4 moe: drop HIP gemm1/gemm2 backend, run gemm exclusively on FlyDSL port

benenzhu
and
claude
committed
ef6046a
Merge pull request #1 from RadeonFlow/radeonflow_pr_flydsl_perf2
ColorsWind
authored
a389c89
flydsl mxfp4 gemm1: prologue vmcnt relax + BM128 scale-first ds_read

ColorsWind
authored and
ftyghome
committed
48ac23b
flydsl mxfp4 gemm2: float fabs/maxnum amax in mxfp4out epilog

ColorsWind
authored and
ftyghome
committed
35d2a30
flydsl mxfp4 moe: gate gemm2 mxfp4-out solely on AITER_MXFP4_INTERMEDIATE
ColorsWind
committed
6376142
Merge dev/randomflow_pr into radeonflow_pr_flydsl_perf (resolve #3861 conflicts)
ftyghome
committed
da4cb4c

Commits on Jun 23, 2026

[RadeonFlow] flydsl mxfp4 a4w4 MoE: improv perf (#3861)

authored
d2d28f0
mxfp4 moe tuner: enumerate the FlyDSL a4w4 port as tuning candidates

benenzhu
and
claude
committed
6a50c71
Merge remote-tracking branch 'rocm/dev/randomflow_pr' into dev/randomflow_pr
benenzhu
committed
5a163cb
mxfp4 moe: fix ruff lint (unused imports/var + lambda-assignment)

benenzhu
and
claude
committed
2fafb5c
mxfp4 moe: apply black formatting

benenzhu
and
claude
committed
38195a0
mxfp4 moe aux: guard gfx950-only fp4-cvt builtin for multi-arch builds

benenzhu
and
claude
committed
f3c44b3
mxfp4 moe: drop dead HIP-era tests + the unused D_INTER=192 shape

benenzhu
and
claude
committed
0ac4ffd
mxfp4 moe: add more shape dispatch
ftyghome
committed
9eb354c
mxfp4 moe: split model dispatch csv files
ftyghome
committed
91c4336
mxfp4 moe: fix a4w4 test weight layout (use a16w4 shuffle for the port)

benenzhu
and
claude
committed
6a580ab
mxfp4 moe configs: normalize guitlv CSV line endings to LF

benenzhu
and
claude
committed
318ae1e
mxfp4 moe: drop test_mxfp4_moe_128k_chunk.py (gfx950-only, fails on MI300X CI shard)

benenzhu
and
claude
committed
b8520c2
Merge branch 'main' into dev/randomflow_pr
coderfeli
authored
2f33c0f
flydsl mxfp4 gemm1: compiler-managed K-loop fence
ftyghome
committed
5fd3ceb
flydsl mxfp4 gemm2: compiler-managed barrier, drop hand-tuned waitcnts
ftyghome
committed
dac7d97
Merge upstream/dev/randomflow_pr into radeonflow_pr_flydsl_perf
ftyghome
committed
c708799
mxfp4 moe: drop orphan gemm_common.hpp; revert jit lineinfo flag
ColorsWind
committed
8814138

Commits on Jun 24, 2026

[RadeonFlow] accu fix + clean (#3884)

authored
499b4e9
chore: merge guitlv csv into fp4 csv
ftyghome
committed
437bcf9
cleanup: remove unnecessary comments
ftyghome
committed
e333923
sort rewrite
benenzhu
committed
66ea2c3
fix: mxfp4 tuned config lock to manually selected ones (#3887)
ftyghome
authored
ff7b819
feat(mxfp4-moe): AOT pre-compile + flyc.compile low-overhead launch for FlyDSL a4w4 MoE (#3888)
coderfeli
authored
c13225c
fix(mxfp4-moe): import fused_moe deps from source modules for AOT

benenzhu
and
claude
committed
9cfa7dd
fix(mxfp4-moe): extract pure kname parsing to avoid JIT load during AOT

benenzhu
and
claude
committed
aff0ca3
fix(mxfp4-moe): make FlyDSL AOT precompile GPU-free

benenzhu
and
claude
committed
7bcee9b
fix: add missing dsv4 shapes
ftyghome
committed
515d90d
Merge remote-tracking branch 'origin/dev/randomflow_pr' into radeonflow_pr_flydsl_perf
ftyghome
committed
c50c3e3
rename kernels and csv to align original style
coderfeli
committed
d82bb7c
style: black-format mxfp4_kname (wrap long ValueError)

coderfeli
and
claude
committed
e54baa4
fix aot
zhangnju
committed
71f5314
Merge remote-tracking branch 'rocm/main' into dev/randomflow_pr2
benenzhu
committed
8ce2969
revert non-kimik2_5 fp4 fmoe CSVs to rocm/main

benenzhu
and
claude
committed
d99e500
feat(mxfp4-moe): enable the mxmoe a4w4 pipeline only for interleave gate mode

coderfeli
and
claude
committed
36efe5b
suport seperate
coderfeli
committed
22d8988
mxfp4 moe: e8m0 scale rounding Even -> RoundUp
ColorsWind
committed
c931100
flydsl mxfp4 gemm1/gemm2: size A_q/A_scale buffer resources from runtime max_sorted
ColorsWind
committed
169eee8
mxfp4 moe test: pin test_moe_2stage to Kimi-K2.5 TP4 a4w4
ColorsWind
committed
b576566
Merge upstream/dev/randomflow_pr into radeonflow_pr_flydsl_perf
ftyghome
committed
2d07af8

Commits on Jun 25, 2026

[RadeonFlow] max_m / round_up fix (#3904)

authored
6d25aea
align shuffle scale
coderfeli
committed
68d493f
Merge remote-tracking branch 'rocm/main' into dev/randomflow_pr2
benenzhu
committed
eb385ab
format
benenzhu
committed
dcfe1b2
flydsl mxfp4 gemm1/gemm2: remove dead MAX_M buffer-size code
ftyghome
committed
0ae49ae
flydsl mxfp4 gemm1/gemm2: move module globals into instantiation params
ftyghome
committed
266255d
flydsl mxfp4 gemm1/gemm2: strip comments and docstrings
ftyghome
committed
e7209f3
flydsl mxfp4 gemm: extract shared helpers into mxfp4_gemm_common
ftyghome
committed
ab78e7c
flydsl mxfp4 gemm1: use DPP for epilog amax cross-lane reduction
ftyghome
committed
22fc814
flydsl mxfp4 gemm2: disable post-misched for BM16 decode kernel
ftyghome
committed
51a8c89
Merge upstream/dev/randomflow_pr into radeonflow_pr_flydsl_perf
ftyghome
committed
b032808
refactor: moe sorting
ftyghome
committed
f55b133
Merge remote-tracking branch 'origin/radeonflow_pr_flydsl_perf' into radeonflow_pr_flydsl_perf
ftyghome
committed
af5366e
Merge remote-tracking branch 'origin/dev/randomflow_pr' into radeonflow_pr_flydsl_perf
ftyghome
committed
ee083f9
format
benenzhu
committed
64fcc96

Commits on Jun 26, 2026

refactor: drop gate_moe in csv dispatch
ftyghome
committed
fbd2a2a
Merge pull request #3952 from RadeonFlow/dev/randomflow_pr
Bernard-Liu
authored
ff1fa90

Commits on Jun 27, 2026

Commits on Jun 28, 2026

Merge pull request #3968 from RadeonFlow/dev/randomflow_pr
Bernard-Liu
authored
d8a837f
format
benenzhu
committed
7631599

Commits on Jun 29, 2026

chore: add BM64 kernel (#3975)
ftyghome
authored
086689f
[RadeonFlow] avoid scatter reduce copy + addXCD swizzle support (#3978)

ColorsWind
and
ftyghome
authored
fa55390
fix: handle empty kernelName and AOT-cover CK-Tile split-K epilogue

benenzhu
and
claude
committed
78f8eee
fix: round silu_and_mul_fq VEC to power of two, cap at 8

benenzhu
and
claude
committed
7d15e55
fix aot
Bernard-Liu
committed
c685033
Merge remote-tracking branch 'rocm/main' into dev/randomflow_pr7
benenzhu
committed
efc3686

Commits on Jun 30, 2026

Commits on Jul 1, 2026

Commits on Jul 2, 2026

add more dsv4 shapes
Bernard-Liu
committed
52eea17
mxmoe support mp&timeout
Bernard-Liu
committed
5adcf05
fix layout bug
Bernard-Liu
committed
6732142
add expert_mask assert
Bernard-Liu
committed
9209b51

Commits on Jul 3, 2026

style: format gemm_moe_tune.py with black

Bernard-Liu
and
cursoragent
committed
dfb43d2
Merge branch 'main' into dev/randomflow_pr

Bernard-Liu
and
cursoragent
committed
e3b4b07
simplify annotations
Bernard-Liu
committed
c0619e9

Commits on Jul 6, 2026

docs: annotate epilogue AOT compile-only stream/swiglu_limit args

benenzhu
and
claude
committed
46dd1d5
Merge remote-tracking branch 'rocm/main' into fix_moe
benenzhu
committed
16dec44
fix ci
benenzhu
committed
238d4ec

Commits on Jul 7, 2026

Merge remote-tracking branch 'rocm/main' into fix_moe
benenzhu
committed
3d0b31e

Commits on Jul 8, 2026

Merge remote-tracking branch 'rocm/main' into fix_moe
benenzhu
committed
aa65f59