Skip to content

[dev] perf(moe): Refine gated delta net implementation - #3040

Merged
BestJuly merged 1 commit into
NVIDIA:devfrom
yuzhongw-nvidia:yuzhongw/refine_gdn_impl
Feb 2, 2026
Merged

[dev] perf(moe): Refine gated delta net implementation#3040
BestJuly merged 1 commit into
NVIDIA:devfrom
yuzhongw-nvidia:yuzhongw/refine_gdn_impl

refine gdn impl: (1) use fla conv1d; (2) combine l2norm to query and key

4123fb6
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar