Repository navigation
[Triton/Gluon] enable TDM fusion on MXFP4 - #6097
Conversation
🏷️ CI GuideRuns automatically on every PR:
Extended tests (opt-in via labels):
One backend per PR: PR title tags & labels: |
There was a problem hiding this comment.
Copilot review overview
🟡 Changes recommended
The unrelated output-layout change should be separated, and the new comment contains a typo.
Review effort: Balanced
Findings: 1
Open (2)
What changed in this PR
Updates the gfx1250 MXFP4 Gluon GEMM to enable fusion of staged TDM loads.
Changes:
- Groups descriptor updates before four asynchronous TDM loads.
- Adjusts wait counts for fused operations.
- Changes the output staging layout.
| File | Description |
|---|---|
aiter/ops/triton/_gluon_kernels/gfx1250/gemm/basic/gemm_mxfp4.py |
Refactors TDM staging and synchronization for load fusion. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.


Move all descriptors before the four copies then the compiler fuses all TDM copies
o_proj went from 52.45 to 45.2 us in DSR1