Skip to content

[None][perf] bound multimodal request CPU memory in trtllm-serve - #19800

Draft
yechank-nvidia wants to merge 2 commits into
NVIDIA:mainfrom
yechank-nvidia:multimodal-frontend-cpu-admission
Draft

[None][perf] bound multimodal request CPU memory in trtllm-serve#19800
yechank-nvidia wants to merge 2 commits into
NVIDIA:mainfrom
yechank-nvidia:multimodal-frontend-cpu-admission

[None][perf] account multimodal frontend request memory

ee506fb
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs