instrument: always-on Prometheus histograms for frontend routing, scheduling, and request-plane ACK (DYN-3401) - #4

Closed

peilii wants to merge 9 commits into

nv-yna:feat/deepseek_v4_aafrom

ai-dynamo:peili/otel-metrics-on-deepseek-v4-aa__DYN-3401

Commits on Jul 6, 2026

instrument: request-plane ACK decode->flush timing (DYN_ACK_TRACE)

nv-yna
authored and
peilii
committed
5541b04
instrument: log event-loop stalls per-runtime + request arrival delay (DYN_ACK_TRACE)

nv-yna
authored and
peilii
committed
0f53c23
instrument: gated prefill lifecycle trace + per-CTX in-flight gauge (DYN_PREFILL_TRACE)

nv-yna
authored and
peilii
committed
5cb9b7d
instrument: mock TRT-LLM KV transfer timeout in disagg mocker workers
peilii
committed
44b3c27
feat: add full-distribution scheduling and ACK-flush metrics
peilii
committed
708f146
feat: emit mock_kv_timeout warn at handoff delay site in mocker
peilii
committed
a7cdd90
instrument: actor mailbox/poll-gap, schedule-compute, pending-age, and tokenize/preprocess histograms
peilii
committed
713eb5b
instrument: mailbox command label, request-plane stage breakdown, worker-state propagation, HTTP-to-preprocess wait
peilii
committed
20fe2c6
feat: always-on Prometheus histograms for frontend routing ops and request-plane ACK
peilii
committed
52889f5