Skip to content

perf(gated_delta_net): fold q/k L2-norm into the gated_delta_rule kernel - #5396

Open
yuchenwang3 wants to merge 1 commit into
NVIDIA:mainfrom
yuchenwang3:fix/gdn-qk-l2norm-in-kernel
Open

perf(gated_delta_net): fold q/k L2-norm into the gated_delta_rule kernel#5396
yuchenwang3 wants to merge 1 commit into
NVIDIA:mainfrom
yuchenwang3:fix/gdn-qk-l2norm-in-kernel

Add opt-in GDN q/k normalization inside the kernel

c47b249
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 19, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO