Skip to content

Sync upstream through PR #441: fix Mega MoE scheduler ordering #16

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
murphymatt merged 5 commits into from
Sep 15, 2026
Merged

Sync upstream through PR #441: fix Mega MoE scheduler ordering #16

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
1f6f3f3
Fix a race condition where in-flight tensormaps are updated in-place …
dfyz Jul 6, 2026
559d79f
Public release 26/07 (#377)
guyan364 Jul 15, 2026
66081d4
Public Release 26/09 (#432)
zheanxu Sep 10, 2026
78b6900
Fix Mega MoE task info slot release ordering (#441)
zheanxu Sep 14, 2026
c2e49f5
Merge upstream DeepGEMM through PR #441
murphymatt Sep 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions deep_gemm/include/deep_gemm/ptx/ld_st.cuh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,11 @@ struct SM100_U8x8_STSM_T {
}
};

/// Memory ordering
CUTLASS_DEVICE void fence_acq_rel_cta() {
asm volatile("fence.acq_rel.cta;" ::: "memory");
}

/// Shared memory
CUTLASS_DEVICE uint32_t ld_shared(const uint32_t* ptr) {
uint32_t ret;
Expand Down
2 changes: 2 additions & 0 deletions deep_gemm/include/deep_gemm/scheduler/mega_moe.cuh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -246,6 +246,8 @@ struct MegaMoEScheduler {
}

CUTLASS_DEVICE void release_task_info() const {
// Complete metadata reads before the scheduler can overwrite this slot.
ptx::fence_acq_rel_cta();
task_info_empty_barriers[sched_stage_idx ^ 1].arrive(0u);
}

Expand Down
10 changes: 7 additions & 3 deletions docs/fork-upstream-sync.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,12 @@
# Upstream sync through PR #432
# Upstream sync through PR #441

This fork incorporates upstream commit
`66081d4c9c7d7c44f13fea402e5b622aa0f409c2` (Public Release 26/09),
including the preceding July release and tensormap race fix.
`78b69000794d0937b47ae3387eff7663410264d1` (Mega MoE task info slot release
ordering), including Public Release 26/09, the preceding July release, and
the tensormap race fix.

The scheduler completes task metadata reads before signaling that its slot
can be reused. This ordering fix applies to both BF16 and FP8/FP4 Mega MoE.

The fork's GeGLU activation, native MXFP4/BF16 training backward kernels,
activation saves across ring wraps, route-weight and combine modes, strided
Expand Down