[None][perf] Emission-assisted GVR top-K decode for the DeepSeek V4 indexer - #16953

Open

siyidNV wants to merge 127 commits into

NVIDIA:mainfrom

siyidNV:perf/gvr-emission-topk

Commits on Jul 28, 2026

Commits on Jul 29, 2026

[None][fix] test: seed-row col 6 is the adaptive-skip pass count, not a stray write
siyidNV
committed
58ebe34
[None][perf] Fused indexer->top-k handshake: PDL early release + per-row arrival gating
siyidNV
committed
8af7c59

Commits on Jul 30, 2026

Revert "[None][perf] Fused indexer->top-k handshake: PDL early release + per-row arrival gating"
siyidNV
committed
bc2621b
[None][perf] GVR top-k: take the PDL wait after the prologue, not at entry
siyidNV
committed
b3410e2
[None][perf] GVR P4: filter the fine recursion by value range, not by bin recompute
siyidNV
committed
6949d7f
[None][perf] GVR P4: lane-parallel warp bin sums in both bin searches
siyidNV
committed
d66fa12
[None][perf] GVR P4: classify the scatter by value range too
siyidNV
committed
bdeabeb
Merge branch 'main' into perf/gvr-emission-topk
siyidNV
committed
9ede841
[None][fix] disable the two P4 range-test fast paths (not fp32-exact)
siyidNV
committed
bba4dd4
[None][perf] GVR routing: stay on the stock kernel below 8k context
siyidNV
committed
66cc032
[None][fix] GVR: keep the stock kernel path on upstream behaviour
siyidNV
committed
d2ab3c1
[None][chore] GVR: condense the narrative comment blocks
siyidNV
committed
c65dc31
[None][fix] GVR: drop the const-flag branch shells from the stock path
siyidNV
committed
d697e3d
[None][chore] GVR: put the P1r degenerate rescue behind a const_expr
siyidNV
committed
e3db787
[None][fix] GVR: keep range-test and debug scalars off the stock path
siyidNV
committed
1fe0fee
[None][fix] GVR: let the assist path keep the compacted tail repair
siyidNV
committed
84f8a36
[None][perf] GVR routing: pick the tier from the shape-dependent tax
siyidNV
committed
cf87bf0
[None][fix] GVR routing: cap the list tier at batch 1, measured
siyidNV
committed
52973e6
[None][perf] GVR routing: gate the list tier on emitted volume
siyidNV
committed
a048dfa
[None][perf] GVR routing: widen the list tier, hand over to rungs sooner
siyidNV
committed
dc10a1e
[None][perf] GVR: turn the block-skip prefix on one doubling later
siyidNV
committed
75f89e6
[None][chore] GVR: make the coarse histogram width a knob
siyidNV
committed
cda9b03

Commits on Jul 31, 2026

Commits on Aug 1, 2026

Revert "[None][fix] GVR: keep the P1 refine rescue off the stock path"
siyidNV
committed
0982dc1

Commits on Aug 3, 2026

Commits on Aug 4, 2026

Commits on Aug 5, 2026

[None][perf] GVR: let the scatter hand the tie class to the tail repair
siyidNV
committed
f378bf8

Commits on Aug 6, 2026

[None][perf] GVR: rank the tail class with the block, not one warp
siyidNV
committed
7f823de

Commits on Aug 8, 2026

Commits on Aug 9, 2026

Commits on Aug 11, 2026

Commits on Aug 13, 2026

Commits on Aug 14, 2026

[None][fix] restore the plateau terminal dropped in the main merge
siyidNV
committed
ba1d698

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Commits on Aug 23, 2026

Commits on Aug 24, 2026

[None][test] cover emission-state parking for reused decode slots
siyidNV
committed
4091764

Commits on Aug 25, 2026

[None][chore] address perf-script and test-list review comments
siyidNV
committed
a29d92e

Commits on Aug 27, 2026

Commits on Aug 28, 2026

Commits on Aug 31, 2026

Merge branch 'main' into port
siyidNV
committed
b9513c8
Merge remote-tracking branch 'origin/main' into port
siyidNV
committed
c15f3d9

Commits on Sep 1, 2026