Tensorize dynamic inference mixed sampling (bis) - #2231

Merged

tdene merged 48 commits into

NVIDIA:mainfrom

tdene:tde/mixed_sampling_tensorize

Nov 14, 2025

Commits on Nov 3, 2025

Tensorize the mixed sampling bookkeeping
tdene
committed
65d3879
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
d650f84
Clarify comment
tdene
committed
4f9d4ad
Clean up termination ID code
tdene
committed
1705673
Fix static_sampling in dynamic sampling
tdene
committed
fe97034
Unmerge FlashInfer-related changes
tdene
committed
e2a1af0
Fix outdated tests
tdene
committed
00e67d0
Merge remote-tracking branch 'gh' into tde/mixed_sampling_tensorize
tdene
committed
17c4ae6
lint
tdene
committed
4976e1a
Fix static path
tdene
committed
7abcb10
Fix static controller
tdene
committed
a3200b1

Commits on Nov 4, 2025

Stop hashing SamplingParams directly
tdene
committed
5ad7b57
Ugly context code, but works
tdene
committed
7ccfcbd
Revert "Ugly context code, but works"
tdene
committed
f7aceeb

Commits on Nov 6, 2025

Rework according to reviewer comment
tdene
committed
9d081ea
Move metadata labels out of context
tdene
committed
9541b60
Clean-up
tdene
committed
78f9494
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
f57595a
fixes
tdene
committed
0a7ceed
lint
tdene
committed
fe5713e

Commits on Nov 7, 2025

Pass unit tests
tdene
committed
ec053f6
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
e5c0521
Forgot a clone
tdene
committed
b9eed76
Vectorize the sampling param item()
tdene
committed
e68274c
Cleanup
tdene
committed
3e3f37a
Remove static sampling from dynamic sampling
tdene
committed
b834aff
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
2bd1892

Commits on Nov 10, 2025

Merge remote-tracking branch 'gh/main' into HEAD
tdene
committed
587ef09

Commits on Nov 11, 2025

Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
4b855b5

Commits on Nov 12, 2025

Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
efa7318
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
9a7b305
Address reviewer comments
tdene
committed
45fb086
Address reviewer comments
tdene
committed
566c411
Address reviewer comments
tdene
committed
9779a63
Address reviewer comments
tdene
committed
3aa17ca
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
38dd958
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
04f713b
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
c595258

Commits on Nov 13, 2025

Update golden values for throughput
tdene
committed
be11450
Merge branch 'main' into tde/update_golden
tdene
authored
d27818b
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
790b16d
Merge remote-tracking branch 'gh/tde/update_golden' into HEAD
tdene
committed
01af096
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
2580487
Merge remote-tracking branch 'gh/main' into tde/mixed_sampling_tensorize
tdene
committed
8dfd483
Fix merge issue
tdene
committed
2ed3f22
Fix merge issue (bis)
tdene
committed
916b2c6

Commits on Nov 14, 2025

Fix functional test
tdene
committed
6fb614b
Merge branch 'main' into tde/mixed_sampling_tensorize
tdene
authored
995f8b0