[AMD] [GLM5] Skip DSA decode indexer when kv_len <= index_topk (dense k-only fast path) - #31324

Merged

HaiShaw merged 16 commits into

sgl-project:mainfrom

Jacob0226:jacob/dsa-decode-skip-indexer

Aug 16, 2026

Commits on Jul 16, 2026

[dense-decode][M1] Extend k-only skip-indexer fast path to DECODE (eager)
Jacob0226
committed
3a3c8df
[dense-decode][M1] add env-gated SGLANG_KONLY_DEBUG marker for decode k-only
Jacob0226
committed
3f27567
[dense-decode][M2a] static SGLANG_DSA_DECODE_DENSE_GRAPH flag for cuda-graph decode k-only (kv_len<=index_topk deployments)
Jacob0226
committed
6240a1c
[dense-decode][Design A] dual dense/sparse decode cuda-graph with host dispatch
Jacob0226
committed
0c41aca
fix: read dense-graph/konly env via EnvBool parser, not raw == "1"

Jacob0226
and
cursoragent
committed
474270e
Merge branch 'main' into jacob/dsa-decode-skip-indexer
1am9trash
authored
dd9679c

Commits on Jul 20, 2026

Commits on Jul 21, 2026

fix(dense-decode): guard seq_lens .max() against empty batch
Jacob0226
committed
27bd826

Commits on Jul 22, 2026

refactor(dense-decode): drop debug/opt-in env flags, auto-enable dual-graph for DSA

Jacob0226
and
cursoragent
committed
4425853

Commits on Jul 24, 2026

Commits on Aug 4, 2026

Merge branch 'main' into jacob/dsa-decode-skip-indexer
Jacob0226
authored
7bcdc30

Commits on Aug 10, 2026

refactor(dense-decode): clarify DSA dual-graph comments and init
Jacob0226
committed
757a091

Commits on Aug 13, 2026

Merge branch 'main' into jacob/dsa-decode-skip-indexer
Jacob0226
authored
c95c257

Commits on Aug 16, 2026

restore orig. comments
HaiShaw
committed
903fe7d