Repository navigation

perf(moe): split the topK reduction in small-batch trtllm-gen MoE finalize - #6546

Merged

Vinnie6167 merged 6 commits into

flashinfer-ai:mainfrom

Vinnie6167:trtllm-moe-small-batch-finalize

Oct 19, 2026

Merged

perf(moe): split the topK reduction in small-batch trtllm-gen MoE finalize#6546
Vinnie6167 merged 6 commits into
flashinfer-ai:mainfrom
Vinnie6167:trtllm-moe-small-batch-finalize

Commits on Oct 15, 2026
- perf(moe): split the topK reduction in small-batch trtllm-gen MoE finalize
  
  Vinnie6167
  and
  claude
  committed
  1e74dfa
- perf(moe): keep the previous finalize kernel for topK <= 4
  
  Vinnie6167
  and
  claude
  committed
  2217a7d
Commits on Oct 16, 2026
- perf(moe): read the routing permutation before the PDL wait in small-batch finalize
  
  Vinnie6167
  and
  claude
  committed
  00515ae
- perf(moe): trigger PDL dependents at the start of small-batch finalize
  
  Vinnie6167
  and
  claude
  committed
  951809d
- perf(moe): trigger PDL dependents at the start of the small-batch routing kernels
  
  Vinnie6167
  and
  claude
  committed
  0b174f2
Commits on Oct 18, 2026
- Merge branch 'main' into trtllm-moe-small-batch-finalize
  Vinnie6167
  authored
  50cec0a