Skip to content

fix(inference): preserve valid rows, cached KV, and greedy semantics - #7061

Draft
wdykas wants to merge 3 commits into
NVIDIA:mainfrom
wdykas:fix/dynamic-inference-correctness-edge-cases
Draft

fix(inference): preserve valid rows, cached KV, and greedy semantics#7061
wdykas wants to merge 3 commits into
NVIDIA:mainfrom
wdykas:fix/dynamic-inference-correctness-edge-cases

fix(inference): make FlashInfer greedy sampling deterministic

1f77b0c
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 3, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO