Skip to content

[TRTLLM-17267][refactor] Move the operational endpoints into serving classes and routers - #21725

Draft
JunyiXu-nv wants to merge 85 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-ops-routers
Draft

JunyiXu-nv wants to merge 85 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-ops-routers

[TRTLLM-17267][test] Pin the Prometheus mount to the LLM role group a…

1ad84f4
Select commit
Loading
Failed to load commit list.