[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils by JunyiXu-nv · Pull Request #21510 · NVIDIA/TensorRT-LLM

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

JunyiXu-nv

committed

b291cca

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

JunyiXu-nv

committed

c9311ab

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

JunyiXu-nv

committed

81b0350

[None][test] Address review of the serve snapshot and layering tests

JunyiXu-nv

committed

2eb184a

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

JunyiXu-nv

committed

5138e15

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

JunyiXu-nv

committed

045a69e

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

JunyiXu-nv

committed

68344ed

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

JunyiXu-nv

committed

9f4a48e

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

JunyiXu-nv

committed

caf3a29

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

JunyiXu-nv

committed

4a6325d

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

JunyiXu-nv

committed

7e29509

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

JunyiXu-nv

committed

d3aacdd

[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils

JunyiXu-nv

committed

2036720

[TRTLLM-17262][refactor] Import the steady clock from tensorrt_llm._utils in the disaggregated client and server

JunyiXu-nv

committed

e2b5f13

[TRTLLM-17262][test] Pin that the disaggregated modules do not import the Responses implementation

JunyiXu-nv

committed

4630b27

Navigation Menu

Repository navigation

[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils - #21510

[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils#21510
JunyiXu-nv wants to merge 15 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-shared-service-types

Commits on Nov 4, 2026

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

[None][test] Address review of the serve snapshot and layering tests

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils

[TRTLLM-17262][refactor] Import the steady clock from tensorrt_llm._utils in the disaggregated client and server

[TRTLLM-17262][test] Pin that the disaggregated modules do not import the Responses implementation