Skip to content

perf(flydsl): MXFP4 fused-MoE stage2 optimization for EP prefill #3117

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
inkcherry merged 15 commits into from
May 25, 2026
Merged

perf(flydsl): MXFP4 fused-MoE stage2 optimization for EP prefill #3117

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
2f0cdab
perf(flydsl): MXFP4 fused-MoE stage2 optimization for EP4 prefill
inkcherry May 11, 2026
83ae8ad
compat(flydsl): wrap Python-compile-time conditions with const_expr
inkcherry May 11, 2026
ffb6227
update
inkcherry May 11, 2026
9c255d5
style(flydsl): apply Black formatting
inkcherry May 11, 2026
10495e3
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
coderfeli May 12, 2026
476d788
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 14, 2026
f9984b8
review(flydsl): fix review comments
inkcherry May 14, 2026
04ee79b
review(flydsl): restore stage2 xcd_swizzle + format
inkcherry May 14, 2026
970228a
review(flydsl): fix a8w4 (fp8a + fp4w) microscale gating
inkcherry May 15, 2026
e3f82ec
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 15, 2026
58209c5
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 20, 2026
91a047b
fix(aot/flydsl): default waves_per_eu to None to match runtime cache_tag
inkcherry May 21, 2026
226695d
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 21, 2026
18b5103
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 25, 2026
d4f1753
Merge branch 'main' into coopt/fusemoe-cleanup-v3-pr-ready
inkcherry May 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions aiter/fused_moe.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -795,6 +795,9 @@ def _flydsl_stage2_wrapper(
a2_scale=a2_scale,
sorted_weights=sorted_weights,
sort_block_m=parsed.get("sort_block_m", 0),
waves_per_eu=parsed.get("waves_per_eu", None),
Comment thread
lalala-sh marked this conversation as resolved.
Resolved
use_async_copy=parsed.get("use_async_copy", False),
cu_num_mul=parsed.get("cu_num_mul", 1),
b_nt=parsed.get("b_nt", 0),
persist=parsed.get("persist", None),
bias=bias2,
Expand Down
Loading
Loading