Skip to content

[TRTLLM-12123][feat] Add per-iteration request-aggregate counters to InflightBatchingStats - #13199

Merged
pcastonguay merged 19 commits into
NVIDIA:mainfrom
nv-yna:yna/feat/iter-stats-fpm-mvp
Apr 27, 2026
Merged

[TRTLLM-12123][feat] Add per-iteration request-aggregate counters to InflightBatchingStats#13199
pcastonguay merged 19 commits into
NVIDIA:mainfrom
nv-yna:yna/feat/iter-stats-fpm-mvp

[TRTLLM-12123][feat] Route queued generation-only requests to dedicat…

4995f8f
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 24, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO