Repository navigation
[FlyDSL] Single-launch decode GEMM: in-kernel blockscale, ragged split-K, small-M tiles, gfx942 #5148
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
johannes-graner
wants to merge
39
commits into
main
Choose a base branch
from
jograner/decode-small-m-SILOTIGER-915
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+1,354
−238
Draft
[FlyDSL] Single-launch decode GEMM: in-kernel blockscale, ragged split-K, small-M tiles, gfx942 #5148
Changes from 2 commits
Commits
Show all changes
39 commits
Select commit
Hold shift + click to select a range
d1f1713
decode small-M split-K preshuffle GEMM (mx128/mxfp4/direct-out sk=1/g…
johannes-graner 906bd1a
Keep FlyDSL AOT collection off gemm_op_a4w4 and cover split-K tests i…
johannes-graner 77c6a19
Remove phantom a4w4 bpreshuffle tune JIT entry and gate mxfp4 split-K…
johannes-graner c9bd61f
Revert config-merge write-back change in jit/core.py.
johannes-graner 11c364f
Merge branch 'main' into jograner/decode-small-m-SILOTIGER-915
johannes-graner 2a252d6
Merge origin/main into decode split-K branch
johannes-graner 9a0e813
Migrate decode FlyDSL utils consumers
johannes-graner f8500b8
Address Copilot review: CI timeout, argparse defaults, assert->raise,…
johannes-graner f1785f5
Merge branch 'main' into jograner/decode-small-m-SILOTIGER-915
johannes-graner 453c0ab
Merge remote-tracking branch 'origin/main' into jograner/decode-small…
johannes-graner 9e68d35
Merge branch 'main' into jograner/decode-small-m-SILOTIGER-915
johannes-graner f5b959c
Remove MXFP4 split-K scope
johannes-graner dc37d85
Move BF16 decode GEMM family to a separate branch; fix tuner import
johannes-graner 53ee6d2
Remove MX128 split-K scale mode
johannes-graner 4905a3b
Gate preshuffle async A-copy on whole-round tile geometry
johannes-graner 3522764
Support ragged split-K in single-launch preshuffle GEMM
johannes-graner 90ac4d5
Add per-128-K blockscale to single-launch preshuffle GEMM (gfx950)
johannes-graner f1404a0
Route FlyDSL a8w8 blockscale dispatch and tuner to single-launch kernel
johannes-graner be5ec23
Delete two-pass FlyDSL split-K family
johannes-graner 01d5599
Broadcast per-tensor scales in FlyDSL preshuffle GEMM launcher
johannes-graner 771668d
Run FlyDSL preshuffle GEMM scale tests on gfx942
johannes-graner ad14d7a
Enable FP8 blockscale on gfx942 in single-launch preshuffle GEMM
johannes-graner 51d29c5
Expand FlyDSL preshuffle tuner candidates for small-M and gfx942 bloc…
johannes-graner 6517a01
Bound synchronous A-to-LDS copy to the tile in preshuffle GEMM
johannes-graner d1a54e2
Merge remote-tracking branch 'origin/main' into jograner/decode-small…
johannes-graner 6e82299
Fix blockscale bpreshuffle tuner CLI and run_config; clean pretune docs
johannes-graner a9c8ac1
Address review cleanups in FlyDSL GEMM dispatch and kernel
johannes-graner 7dc5c8a
Drop unrelated HGEMM policy hunks; finish review doc cleanups
johannes-graner 2427235
Use layout API for blockscale MMA coordinates
johannes-graner 3fe8198
Reject preshuffle tile widths not covered by the MMA loop
johannes-graner a4dec1d
Accept quantizer x-scale layout in blockscale validation
johannes-graner ab02404
Broadcast scalar scales in-kernel; drop per-call scale materialization
johannes-graner 6bd1680
Move preshuffle GEMM scale tests into CI-run operator tests
johannes-graner bdbf279
Merge remote-tracking branch 'origin/main' into jograner/decode-small…
johannes-graner e7d831e
[FlyDSL] preshuffle_gemm: use fx.max instead of removed .maximumf (Fl…
johannes-graner dc3602a
Merge origin/main into decode-small-m
johannes-graner 9d42475
Merge remote-tracking branch 'origin/main' into jograner/decode-small…
johannes-graner fdb3432
Fix pad-K dispatch fallback and tests after main merge
johannes-graner 51f1477
Reject unsupported small tile_n in preshuffle GEMM compile entry
johannes-graner File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.