feat(determinism): grouped gemm dsrelu deterministic dprob - #521

Merged

Anerudhan merged 15 commits into

NVIDIA:developfrom

ZhiyuLi-Nvidia:zhiyul/grouped-gemm-dsrelu-deterministic-dprob

Aug 17, 2026

Commits on Aug 14, 2026

Add opt-in deterministic dprob to the grouped GEMM dsReLU backward

Zhiyu Li
and
claude
committed
93db633
Check the deterministic dprob path against the reference, and in discrete mode

Zhiyu Li
and
claude
committed
81f4be6
Fix two determinism tests that were skipping instead of running

Zhiyu Li
and
claude
committed
512fdb9
Size the dprob workspace from the scheduler, and follow torch for the default

Zhiyu Li
and
claude
committed
090ca69
Name the 2-CTA tile check, and derive the reordering tolerance from n

Zhiyu Li
and
claude
committed
ba28e5a
Record that the 2-CTA M tile is an ISA constant, not a tuning choice

Zhiyu Li
and
claude
committed
8419c01
Order the dprob reduction against the kernel's stream, and key the slot count

Zhiyu Li
and
claude
committed
60ea287
Fold _uses_2cta_instrs into its only real caller

Zhiyu Li
and
claude
committed
9e38d15
Use a plain tolerance for the det-vs-non-det comparison

Zhiyu Li
and
claude
committed
f0a118b
Extend the determinism flag to dbias, and order the workspaces against the kernel
Zhiyu Li
committed
cf2f767
Check dbias against the reference instead of against the other mode
Zhiyu Li
committed
1ade879
Key the dbias workspace dynamically, and share the stream helpers
Zhiyu Li
committed
b6dc1be
Make the determinism tests capable of failing
Zhiyu Li
committed
88c7fab
Keep the output args mode-invariant, and make the dbias slots bf16
Zhiyu Li
committed
45c077e
Address PR review: dbias cache key, output alloc stream, reduce semantics
Zhiyu Li
committed
f1c3623

Navigation Menu

Uh oh!

feat(determinism): grouped gemm dsrelu deterministic dprob - #521

feat(determinism): grouped gemm dsrelu deterministic dprob#521
Anerudhan merged 15 commits into
NVIDIA:developfrom
ZhiyuLi-Nvidia:zhiyul/grouped-gemm-dsrelu-deterministic-dprob

Commits on Aug 14, 2026

Add opt-in deterministic dprob to the grouped GEMM dsReLU backward

Check the deterministic dprob path against the reference, and in discrete mode

Fix two determinism tests that were skipping instead of running

Size the dprob workspace from the scheduler, and follow torch for the default

Name the 2-CTA tile check, and derive the reordering tolerance from n

Record that the 2-CTA M tile is an ISA constant, not a tuning choice

Order the dprob reduction against the kernel's stream, and key the slot count

Fold _uses_2cta_instrs into its only real caller

Use a plain tolerance for the det-vs-non-det comparison

Extend the determinism flag to dbias, and order the workspaces against the kernel

Check dbias against the reference instead of against the other mode

Key the dbias workspace dynamically, and share the stream helpers

Make the determinism tests capable of failing

Keep the output args mode-invariant, and make the dbias slots bf16

Address PR review: dbias cache key, output alloc stream, reduce semantics