Skip to content

[FlyDSL] [opt][rope] optimize qk norm rope Ep decoding case specially for T512 #5070

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
junhaha666 merged 17 commits into from
Aug 29, 2026
Merged

[FlyDSL] [opt][rope] optimize qk norm rope Ep decoding case specially for T512 #5070

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
474dd71
perf: TDM prefill bandwidth opt — K=5 occupancy + position prefetch
jli-melchior Aug 26, 2026
7103285
perf: drop TDM prefill rotation to K=4 at small T
jli-melchior Aug 26, 2026
50567c4
docs: erratum for 53d67009b — its perf claims and attribution were wrong
jli-melchior Aug 26, 2026
af88b13
perf+fix: TDM prefill — 8-wave workgroups, and tighten the drain-phas…
jli-melchior Aug 26, 2026
c0655c2
perf(flydsl): optimize qk norm rope decode
Boss2002n Aug 27, 2026
46ee44b
perf: fuse FP8 quant into TDM prefill and tune gfx1250 occupancy
jli-melchior Aug 26, 2026
71e6d97
perf(flydsl): TDM reads KV strided, and drops to K=2 on deep grids
jli-melchior Aug 27, 2026
9508f89
test: runperf script sets PYTHONPATH and prints a combined summary table
jli-melchior Aug 27, 2026
939deca
test(flydsl): make the qk_norm_rope %peak column arch-aware
jli-melchior Aug 28, 2026
e42bb1d
style: apply black to qk_norm_rope_quant.py
jli-melchior Aug 28, 2026
c84fa3d
chore: drop the local perf harness from the repo root
jli-melchior Aug 28, 2026
4623553
perf(flydsl): let the TDM path take the fused SWA write
jli-melchior Aug 28, 2026
a2a9fa1
fix(flydsl): address q_out past 4 GiB in the TDM path
jli-melchior Aug 28, 2026
5b512ca
style: collapse the SWA store guard (ruff SIM102)
jli-melchior Aug 28, 2026
f2f7069
perf(flydsl): halve the TDM workgroup when the grid is too thin
jli-melchior Aug 28, 2026
6de0fb2
Merge branch 'main' into jli/qknorm_rope_ep_opt
jli-melchior Aug 29, 2026
98144e3
style(flydsl): trim the comments this branch added
jli-melchior Aug 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading