[TRTLLM-35882][feat] cute dsl gvr-topk load-balance optimization - #15304

Merged

yuxianq merged 69 commits into

NVIDIA:mainfrom

limin2021:gvr-topk-load-balance

Jun 24, 2026

Commits on May 20, 2026

Commits on May 21, 2026

Align gvr_topk_decode with CUDA: AddressSpace.gmem + preIdx unroll
limin2021
committed
89edd73
Align block_count_ge with CUDA: 4-way unrolled vec loop (fast-path + tail)
limin2021
committed
b459a8f
Add strided layout + 2-way medium cascade with dtype-aware defaults
limin2021
committed
a01f6c5

Commits on May 25, 2026

Commits on May 26, 2026

Add use_256bit_load and configurable num_threads_per_block
limin2021
committed
44035a5

Commits on May 27, 2026

Commits on May 28, 2026

Commits on May 29, 2026

Skip STG.value path in GVR Top-K when caller only consumes indices
limin2021
committed
3ccd70e
Address PR review on cute_dsl_gvr_topk_decode tests
limin2021
committed
ddd872f
Validate logits.shape[0] divisibility by next_n in GVR op
limin2021
committed
335dd11
Inline N_cols + key info_once on shape signature
limin2021
committed
48d44e2
Mirror kernel N_eff formula in test reference
limin2021
committed
c055ad6

Commits on Jun 1, 2026

Address PR review feedback for GVR Top-K DSL port
limin2021
committed
e219a00
Address second-round PR review for GVR Top-K DSL port
limin2021
committed
d23ba74
Remove unused s_thr_extra smem allocation in GVR Top-K kernel
limin2021
committed
97c47dc

Commits on Jun 3, 2026

Commits on Jun 4, 2026

Commits on Jun 10, 2026

Commits on Jun 11, 2026

Commits on Jun 12, 2026

Commits on Jun 15, 2026

Commits on Jun 16, 2026

Commits on Jun 17, 2026

Commits on Jun 23, 2026

[None][docs] GVR Top-K: update LJF wiring TODO with measured gate (2 * num_sms)
limin2021
committed
0562e62

Commits on Jun 24, 2026

Merge branch 'main' into gvr-topk-load-balance
xxi-nv
authored
9a34a89