feat(gdn): add FlashInfer K-last SSM layout support for GDN prefill and decode for Hopper#18361

Merged

ispobock merged 64 commits intosgl-project:mainfrom

xutizhou:feat/gdn_mtp

Mar 3, 2026

Commits on Jan 11, 2026

Add CuTe DSL GDN Verify Kernel Implementation
xutizhou
committed

Commits on Jan 12, 2026

feat: optimize K-last SSM layout for MTP in GDN
xutizhou
committed
fix: remove unconditional debug log in forward_decode
xutizhou
committed
fix: wrap all h0_source memory access inside cache_idx >= 0 check to prevent OOB access for padding slots
xutizhou
committed

Commits on Jan 13, 2026

feat: Add CuTe DSL GDN verify kernel for K-last SSM layout
xutizhou
committed

Commits on Jan 14, 2026

Optimize GDN attention backend: reduce GPU-CPU sync and pre-allocate intermediate indices
xutizhou
committed

Commits on Jan 15, 2026

feat(gdn): add tensor logging for K-last vs V-last precision comparison

root
authored and
root
committed
chore: remove debug tensor logging

root
authored and
root
committed
fix: guard k-last decode padding and kv mismatch
xutizhou
committed
perf: move has_prefix_cache computation to init_forward_metadata
xutizhou
committed

Commits on Jan 19, 2026

Commits on Jan 23, 2026

refactor(gdn-verify): simplify shared memory allocation for tensors
xutizhou
committed

Commits on Jan 29, 2026

Commits on Jan 31, 2026

Commits on Feb 3, 2026

Commits on Feb 5, 2026

add flashinfer gdn
xutizhou
committed

Commits on Feb 7, 2026

Commits on Feb 12, 2026

Commits on Feb 26, 2026

Commits on Feb 27, 2026

Commits on Feb 28, 2026

style(gdn): fix black formatting and trailing whitespace in gdn_flashinfer
xutizhou
committed

Commits on Mar 1, 2026

Commits on Mar 2, 2026

Merge remote-tracking branch 'origin/main' into feat/gdn_mtp
xutizhou
committed

Commits on Mar 3, 2026