Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
320 commits
Select commit Hold shift + click to select a range
4808d9a
revert(operator): register DGD admission on v1beta1 (#11175)
sttts Jul 3, 2026
aeda23b
fix(ci): OPS-7471 make baked /workspace dirs writable in runtime test…
dmitry-tokarev-nv Jul 3, 2026
4d3f3a1
refactor(validation): make DGD validation structural (#11090)
sttts Jul 6, 2026
3faef7a
fix(operator): remove lws worker gpu pre-validation (#11115)
panpan0000 Jul 6, 2026
e2d72ed
docs(reference): fix NGC release artifact links (#11210)
xianlubird Jul 6, 2026
f8ddb76
fix(recipes): bump Hugging Face Hub helper-job pins to 1.16.4 (#10986)
MatejKosec Jul 6, 2026
272202f
docs(sglang): update HiCache requirements (#11183)
jthomson04 Jul 6, 2026
ff5a3a2
feat(observability): persist forward pass metrics traces (#11110)
jasonqinzhou Jul 6, 2026
94accc7
feat(thunderagent): include HiCache retention capacity (#11185)
ishandhanani Jul 6, 2026
1820df9
perf: Reuse cancellation futures across stream loops (#11149)
jthomson04 Jul 6, 2026
91376af
revert(router): keep session affinity local (#11217)
PeaBrane Jul 6, 2026
d245a5b
docs(sglang): correct session radix availability (#11241)
ishandhanani Jul 6, 2026
155ed0b
fix(runtime): bound endpoint drain + route etcd lease loss through Ru…
nnshah1 Jul 6, 2026
c9f9629
fix(runtime): give event publishers unique discovery identities (#11014)
zhongdaor-nv Jul 6, 2026
d6591c2
perf(llm): avoid cloning jail metrics (#11227)
jthomson04 Jul 6, 2026
b032d7a
chore(deps): bump github.com/containerd/containerd from 1.7.32 to 1.7…
dependabot[bot] Jul 6, 2026
769c6fc
fix(llm): reject unsupported RL fields for responses (#11253)
jthomson04 Jul 6, 2026
1b14f61
fix: populate Message on DGDR Validation success condition (#11261)
hhzhang16 Jul 6, 2026
65af977
chore: update xpu vllm base image to v0.24.0 and update sbom (#11211)
VincyZhang Jul 6, 2026
1fe16eb
fix(frontend): offload prompt tokenization off the async event loop (…
nv-yna Jul 6, 2026
402e4af
fix(sglang): support profile request object API (#11199)
nvpohanh Jul 6, 2026
2cbb62c
fix(frontend): reconcile model registrations (#11092)
MatejKosec Jul 6, 2026
56a7428
fix(gms): rebind non-parameter tensors to private memory after publis…
galletas1712 Jul 6, 2026
33316ff
docs: adopt Fern native localization for Simplified Chinese (#11161)
dagil-nvidia Jul 6, 2026
21043cd
perf: transcode Python request plane directly (#11104)
jthomson04 Jul 6, 2026
7ffed01
chore: Upgrade Rust to latest stable, 1.96.1 (#11260)
grahamking Jul 6, 2026
4824974
ci: gate DynamoCheckpoint deploy tests on snapshot changes only (#11046)
nv-tusharma Jul 6, 2026
56441f0
ci(frontend): increase EPP build timeout (#11284)
jthomson04 Jul 6, 2026
0599d7e
fix(sglang): preserve cached token usage (#10925)
ishandhanani Jul 6, 2026
39c7bcb
test(router): run ZMQ mocker E2E without NATS (#11275)
PeaBrane Jul 7, 2026
762179d
fix(gms): bind snapshot saver threads to CUDA devices (#11272)
galletas1712 Jul 7, 2026
722175e
fix(router): report missing KV event publishers (#11194)
jthomson04 Jul 7, 2026
f30c9db
fix(sglang): support tensor image sizes for multimodal P/D (#11255)
Chokoyo Jul 7, 2026
fb08499
fix(planner): handle zero-traffic metrics (#11294)
tedzhouhk Jul 7, 2026
2d2693d
refactor(router): unify selection service lifecycle (#11298)
PeaBrane Jul 7, 2026
59d6146
fix(router): disclose selected worker in non-KV modes (#11245)
ishandhanani Jul 7, 2026
8d92187
feat(operator): support Grove OnDelete update strategy (#11085)
xianlubird Jul 7, 2026
c42932d
ci: trust maintainer updates to fork PRs (#11122)
saturley-hall Jul 7, 2026
e82096c
fix(recipes): add build tools for ARM recipes on aiperf>=0.8.0 (#11278)
karen-sy Jul 7, 2026
7d12ead
chore: rewrite AGENTS.md, fix skill frontmatter, drop gh-issue-bug (#…
dagil-nvidia Jul 7, 2026
65a9673
fix(event-plane): share one ZMQ context across all sockets (#11246)
joeltg Jul 7, 2026
5013f0c
refactor(vllm): extract multimodal request processor (#11266)
connorcarpenter15 Jul 7, 2026
810fe42
fix: kvbm ci test failure (#11307)
lavanyavijayk Jul 7, 2026
94aa875
fix(operator): prevent DGDR stalls after profiling (#11250)
julienmancuso Jul 7, 2026
2cad61e
fix(operator): avoid duplicate compilation cache mounts (#11264)
julienmancuso Jul 7, 2026
c99b747
docs: fix GitHub stars links that 404 for anonymous readers (#11334)
dagil-nvidia Jul 7, 2026
16e507b
fix(operator): preserve service volume mounts during conversion (#11263)
julienmancuso Jul 7, 2026
b650c53
perf(python): intern request-plane envelope keys (#11331)
jthomson04 Jul 7, 2026
ac5e2a9
feat(operator): add volcano scheduler support for grove (#8225)
xianlubird Jul 7, 2026
3e9c392
feat(vllm): support unified aggregated multimodal (#11267)
connorcarpenter15 Jul 7, 2026
e302855
feat(request-trace): unify payload logging (#11180)
tmonty12 Jul 7, 2026
e1ca5a7
fix(vllm): propagate embedding prompt truncation (#11099)
praateekmahajan Jul 7, 2026
979731d
fix(multimodal): return 4xx for SSRF-blocked media URLs instead of 50…
KrishnanPrash Jul 7, 2026
014f337
perf(gms): share CUDA initialization across tags (#11285)
galletas1712 Jul 7, 2026
a7c327a
fix(profiler): warn when fallback cannot verify SLA (#11338)
tedzhouhk Jul 7, 2026
aa5d30b
feat(router): expose native offloading capacity (#11321)
ishandhanani Jul 7, 2026
36903f6
fix(multimodal): thread trust_remote_code from engine config instead …
nnshah1 Jul 7, 2026
f69c957
fix(operator): fix linter (#11354)
julienmancuso Jul 7, 2026
8283055
perf: small improvement to local monitor performance and hidden-tab t…
keivenchang Jul 7, 2026
284f401
feat(frontend): add per-request image/video/audio count metrics (#11166)
KrishnanPrash Jul 7, 2026
081949a
fix(operator): preserve Grove component kinds before creation (#11314)
galletas1712 Jul 7, 2026
6b91f5b
fix(profiler): remove deprecated AIC WebApp integration (#11342)
tedzhouhk Jul 7, 2026
b4cd3ca
ci: harden Slack notifier against null jobs payload (#11335)
nv-rinig Jul 7, 2026
82953a3
ci: skip sequential GPU tests cleanly when checkout/container init fa…
nv-rinig Jul 7, 2026
44ba389
fix(snapshot): preserve CUDA ordinal mapping for DRA GPUs (#11325)
galletas1712 Jul 7, 2026
1d5293e
feat(vllm): enable unified multimodal embedding cache (#11268)
connorcarpenter15 Jul 7, 2026
f9f7b17
feat(frontend): expose tokenizer cache token metrics (#11353)
jthomson04 Jul 7, 2026
400b2d8
chore(ci): ignore intermittent Bitnami Helm repository 503s (#11370)
julienmancuso Jul 7, 2026
a09289c
fix(test): use matching 2B model for trtllm disagg multimodal test (#…
nv-tusharma Jul 7, 2026
aad60fe
feat(vllm): support unified frontend multimodal processing (#11269)
connorcarpenter15 Jul 7, 2026
156b896
fix(container): install zstandard in sglang runtime image (DYN-3398) …
dagil-nvidia Jul 7, 2026
337c22c
test: add TRT-LLM Qwen3-VL dtype regression coverage (#11292)
knarangN Jul 8, 2026
0a4fc91
feat(vllm): support unified multimodal prefill decode (#11270)
connorcarpenter15 Jul 8, 2026
e429910
docs(observability): update OTLP export docs for endpoint fallback an…
jh-nv Jul 8, 2026
cb05744
feat: integrate cache_salt with KV routing for multi-tenant isolation…
jthomson04 Jul 8, 2026
9f535d1
fix(global-planner): reject scaling when dgd is not ready (#10526)
zidanehuang001 Jul 8, 2026
5a510fe
feat(omni): Enable NIXL connector for vllm OMNI AR/DIT (#10071)
tthakkal Jul 8, 2026
f85e917
chore: bump trtllm to v1.3.0rc20 (#11086)
dynamo-ops Jul 8, 2026
2c7ce4a
test(trtllm): fix multimodal encoder test stub (#11383)
knarangN Jul 8, 2026
2a961bd
fix(planner): gate predicted-load & engine-capacity gauges on through…
jooe0824 Jul 8, 2026
143bf24
fix(gms): defer vLLM publication until after memory profiling (#11302)
galletas1712 Jul 8, 2026
993237e
feat(profiler): apply DGD overrides with the shared Go engine (#11187)
julienmancuso Jul 8, 2026
b0e2230
test(lora): add allocation simulation harness (#8192)
biswapanda Jul 8, 2026
5e9b280
chore: update vllm-omni version to 0.24 to match with vllm version (#…
tthakkal Jul 8, 2026
d7d2fae
feat(power-agent): add DCGM dual actuator (opt-in; NVML remains defau…
kaim-eng Jul 8, 2026
be36b52
feat(router): add exact-worker policy queue lanes (#11363)
ishandhanani Jul 8, 2026
dbf68c1
feat(frontend): make overload rejection status code configurable (#11…
nnshah1 Jul 8, 2026
c3c7e52
fix: Fix guided decoding for force-reasoning parsers (#11205)
indrajit96 Jul 8, 2026
1488735
perf(kv-router): strengthen trace replay benchmarks (#11415)
PeaBrane Jul 8, 2026
867f530
perf: Optimize request path on TCP request plane (#10519)
kthui Jul 8, 2026
98bbd86
fix(benchmarks): run the in-cluster benchmark Job on the frontend ima…
dagil-nvidia Jul 8, 2026
869348b
docs: add DynoSim Apple Silicon and trace-format notes (#11430)
dreamtalen Jul 8, 2026
fe6d7ae
fix(ci): redirect CARGO_HOME to writable path in rust-gpu job (#11433)
nv-rinig Jul 8, 2026
337c5ff
docs: point DEP references to issue-based workflow on ai-dynamo/dynam…
dagil-nvidia Jul 8, 2026
e2f0c3c
fix(sglang): complete unified guided decoding parity (#11422)
connorcarpenter15 Jul 8, 2026
689372a
fix: fix the needs_nixl flag to true when multimodal disagg is enable…
richardhuo-nv Jul 8, 2026
f1de717
ci: extract shared Slack notifier into a reusable workflow (#11365)
nv-rinig Jul 8, 2026
88ddd8a
fix(kv-router): scope KvRouter cancellation to a child token (#11390)
davilu-nvidia Jul 9, 2026
e278632
test(vllm): cover unified guided decoding (#11424)
connorcarpenter15 Jul 9, 2026
0009220
feat(planner): Add kv reads dimension to self-benchmarking grid (#11150)
sachalmalick Jul 9, 2026
a30e7d1
ci: grant actions: read to notify-slack caller jobs (fix reusable-wor…
nv-rinig Jul 9, 2026
abfc082
fix(tests): close gRPC streaming clients (#11446)
jh-nv Jul 9, 2026
cc5cf40
feat(frontend): dispatch forward-compatible /inference/v1/generate re…
furionw Jul 9, 2026
7c84a06
test(validation): unify DCD admission coverage (#11234)
sttts Jul 9, 2026
41ab3a7
feat(trace): convert request traces to SATF (#11375)
ishandhanani Jul 9, 2026
b6fc32f
fix(operator): emit Grove alpha.11 topology constraints (#11405)
julienmancuso Jul 9, 2026
d64f398
fix(operator): generate Helm RBAC from controller markers (#11322)
sttts Jul 9, 2026
68a7912
refactor(validation): make DCD validation structural (#11479)
sttts Jul 9, 2026
2e45e53
docs(trtllm): clarify NVENC requirement for MP4 video output (#11457)
Chokoyo Jul 9, 2026
0ce867f
ci: enforce .agents/skills SKILL.md frontmatter conventions in pre-co…
dagil-nvidia Jul 9, 2026
247d9a4
feat(kv-router): inline sparse CRTC children (#11459)
PeaBrane Jul 9, 2026
be7c5d4
feat(snapshot): add CRIU imageIoMode (O_DIRECT) knob (#11476)
dfeigin-nv Jul 9, 2026
2b6791e
feat(kv-router): rename worker tenancy to routing groups (#11471)
PeaBrane Jul 9, 2026
eca75a4
perf(router): avoid rebuilding blocked lane index (#11484)
jthomson04 Jul 9, 2026
ef5c60b
fix(trtllm): complete unified guided decoding parity (#11423)
connorcarpenter15 Jul 9, 2026
44d4a13
fix(mocker): fall back when AIC memory estimator is unavailable (#11490)
tedzhouhk Jul 9, 2026
1f96b5f
docs(dgdr): document versioned DGD override semantics (#11487)
julienmancuso Jul 9, 2026
eec5d1b
feat(kv-router): add relay-shaped transposed CKF indexer (#11435)
PeaBrane Jul 9, 2026
fd1f1ca
fix: refresh vllm xpu baseline sbom and drop stale entry (#11488)
nv-anants Jul 9, 2026
e7ba0ad
perf(frontend): reduce generate request copies (#11483)
jthomson04 Jul 9, 2026
bb1f038
perf(kv-router): preserve native KV event batches (#11466)
jthomson04 Jul 9, 2026
ee9d0f8
docs(kubernetes): align installation examples with v1.2.1 (#11486)
hdimmfh Jul 9, 2026
80c4cf5
fix(llm): parse config.json with JSON5 when deriving max context leng…
ssojrani-wq Jul 9, 2026
3231e28
feat: enable XPU 2-card serve tests with dedicated runner and device …
VincyZhang Jul 9, 2026
9a221ae
fix(runtime): resync etcd watchers after reconnect (#11146)
michaelfeil Jul 9, 2026
485c298
fix(vllm): reject over-budget max tokens (#11384)
sytianhe Jul 10, 2026
f553c46
feat(frontend): enable tokenizer cache for tiktoken (#11499)
jthomson04 Jul 10, 2026
76b0b64
docs: require KV events for cache-aware routing (#11505)
alec-flowers Jul 10, 2026
2aaabcd
fix(planner): read worker runtime namespace from DGD status (#11352)
tmonty12 Jul 10, 2026
9553701
fix(deps): cap mpmath<1.4 in trtllm extra (DYN-3348) (#11402)
dmitry-tokarev-nv Jul 10, 2026
7fc328a
refactor(operator): stop emitting legacy DGDR conversion annotations …
julienmancuso Jul 10, 2026
de60b0d
feat(request-trace): sink-agnostic HTTP request-header capture via al…
nvyutwu Jul 10, 2026
2ab2760
chore(frontend): update parser and renderer crates (#11535)
rmccorm4 Jul 10, 2026
8acffb5
chore(deps): bump golang.org/x/crypto from 0.50.0 to 0.52.0 in /deplo…
dependabot[bot] Jul 10, 2026
cfdc630
fix(ci): reserve VRAM for CUDA-stream logits adapter test (#11209)
zhongdaor-nv Jul 10, 2026
9738fe1
ci: restore PR reminder write permission (#11538)
saturley-hall Jul 10, 2026
d8dc40a
perf(kv-router): use arena block ownership counts (#11508)
jthomson04 Jul 10, 2026
18b6e7e
feat(llm): route requests through encode workers (#11460)
connorcarpenter15 Jul 10, 2026
c4aa646
ci(checkpoint): add TRTLLM DynamoCheckpoint coverage (#10918)
galletas1712 Jul 10, 2026
4999545
perf(runtime): avoid copying MessagePack event payloads (#11539)
jthomson04 Jul 10, 2026
9629557
perf(kv-router): remove prompt membership hash lookup (#11515)
jthomson04 Jul 10, 2026
f54a166
fix: XPU marker composition for post-merge and nightly (#11519)
VincyZhang Jul 10, 2026
4a22ded
feat(vllm): support unified KV block clearing (#11451)
connorcarpenter15 Jul 10, 2026
28649ca
test(sglang): add diffusion_llada scenario on a new nightly H100 lane…
nv-tusharma Jul 10, 2026
a8c8fe1
feat(sglang): add native gRPC sidecar (#11408)
connorcarpenter15 Jul 11, 2026
e72cf3a
refactor(selection): use `selection_id` as the single reservation id …
jeffreywang88 Jul 11, 2026
d67aee6
feat(multimodal): pluggable vision encoder interface for custom VLMs …
furionw Jul 11, 2026
1570913
fix(router): make rejection thresholds independently opt-in (#11276)
jh-nv Jul 11, 2026
0ee5aa6
perf(llm): reduce ITL metrics overhead (#11569)
jthomson04 Jul 12, 2026
c49abbc
feat: add CODEOWNERS generated as Infrastructure-as-Code (#10715)
dagil-nvidia Jul 12, 2026
b13288e
chore: Support XPU in multimodal embedding cache connector (#9938)
joshuayao Jul 13, 2026
b720811
fix(frontend): map backend invalid arguments to HTTP 400 (#11453)
rmccorm4 Jul 13, 2026
af0dbfe
refactor(operator): lazily converge worker hashes to v2 (#11529)
sttts Jul 13, 2026
857efd2
ci: await PR reminder comment creation (#11545)
saturley-hall Jul 13, 2026
495b028
feat(router): define queue admission strategy API (#11434)
ishandhanani Jul 13, 2026
1dac846
feat: DGD status observability from Grove fields - status reasons fin…
devivasudevan Jul 13, 2026
c6e26c5
feat(compliance): add OSRB CSV diffs to compliance artifacts (#11240)
saturley-hall Jul 13, 2026
9d3f8d4
fix: cover root CLAUDE.md in codeowners and match main/pr triggers (#…
nv-anants Jul 13, 2026
350e27a
docs(kubernetes): document DGD scale-to-zero limitation (#11536)
julienmancuso Jul 13, 2026
6aba2db
feat(sglang): support multiple served model names (#11141)
fengyuli-dev Jul 13, 2026
d09a472
perf(runtime): avoid copying received ZMQ frames (#11574)
jthomson04 Jul 13, 2026
7d2c341
fix(router): disable queueing by default (#11599)
ishandhanani Jul 13, 2026
fa58175
docs(profiler): clarify infeasible SLA behavior (#11612)
tedzhouhk Jul 13, 2026
a89a822
perf(trtllm): skip duplicate text prompt metadata (#11202)
rmccorm4 Jul 13, 2026
0182cd9
docs(planner): align configuration descriptions with behavior (#11613)
tedzhouhk Jul 13, 2026
ed33d4e
feat(snapshot): capture checkpoints via PodSnapshot + node agent (#10…
Ronkahn21 Jul 13, 2026
3db23b6
feat(selection): cache `select()` booking inputs so `create_reservati…
jeffreywang88 Jul 13, 2026
beb91b0
fix(tests): prevent port-forward EADDRINUSE flake in TRTLLM checkpoin…
nv-rinig Jul 13, 2026
8b007ec
test(serve): add sglang disaggregated_router launch scenario (#11442)
nv-tusharma Jul 13, 2026
6033fcb
perf(kv-router): streamline block release cleanup (#11568)
jthomson04 Jul 13, 2026
df7333b
fix: Fix MiniMax M2 forced/named tool calling when reasoning is enabl…
indrajit96 Jul 13, 2026
2bec928
fix(llm): route structured JSON responses to content with reasoning p…
Chokoyo Jul 13, 2026
60586fa
chore(sglang): bump to 0.5.15 (#11596)
ishandhanani Jul 13, 2026
f87a987
fix(tokenspeed): align FlashInfer JIT cache version (#11465)
Aphoh Jul 14, 2026
f06dbd9
revert(vllm): remove worker-side max-token budget rejection (#11564)
rmccorm4 Jul 14, 2026
6184b3f
fix(replay): honor planner replay concurrency (#11633)
tedzhouhk Jul 14, 2026
379a6d8
fix(planner): remove ineffective prefill SLA floor (#11624)
tedzhouhk Jul 14, 2026
41882ae
feat(vllm): make self-benchmark sampling graph aware (#11509)
tedzhouhk Jul 14, 2026
15a6329
fix(profiler): remove invalid AIPerf nvext input (#11629)
tedzhouhk Jul 14, 2026
3ae6df9
feat(gms): introduce VMMDevice abstraction for XPU (Phase 1) (#9788)
zxue2 Jul 14, 2026
4378870
fix(operator): isolate namespaced admission and CRD ownership (#11597)
sttts Jul 14, 2026
362d691
fix(bindings): restore trace context across the Python chat-processor…
renflowerz Jul 14, 2026
ded09d9
refactor(operator): isolate legacy DGDR read compatibility (#11598)
julienmancuso Jul 14, 2026
7f5ad44
docs(sglang): fix broken lychee link in sglang-diffusion.md (#11658)
dmitry-tokarev-nv Jul 14, 2026
90bbdad
feat: inline license/SBOM compliance for planner and operator images …
nv-anants Jul 14, 2026
3a934f8
fix(profiler): auto-inject --trust-remote-code for custom-code HF mod…
ashnamehrotra Jul 14, 2026
b464a9a
feat(trtllm): engine-owned conversation-aware ADP routing (#11609)
krishung5 Jul 14, 2026
5987f1a
chore(codeowners): assign snapshot common code to GMS (#11660)
galletas1712 Jul 14, 2026
8d4d281
fix(snapshot): pin CRIU revision (#11659)
galletas1712 Jul 14, 2026
c6eeb95
fix(snapshot): preserve NCCL P2P setting (#11639)
galletas1712 Jul 14, 2026
9c7fabe
fix(kvbm): disable HMA for incompatible PdConnector children (#11608)
karen-sy Jul 14, 2026
10b311b
fix(observability): migrate Grafana dashboards from deprecated fronte…
peilii Jul 14, 2026
5777e5b
feat: support sglang with global router. (#7897)
huitianbai Jul 14, 2026
8d43c38
feat(sglang): add Python sidecar entrypoint (#11623)
ishandhanani Jul 14, 2026
daca544
chore: upgrade azure/setup-helm from 4.3.0 to 5.0.1 (OPS-7670) (#11676)
dmitry-tokarev-nv Jul 14, 2026
cdfddee
docs(snapshot): update support matrix (#11674)
galletas1712 Jul 14, 2026
cc740aa
chore: update aggregated examples for vllm xpu 0.24.0 (#11229)
joshuayao Jul 14, 2026
0240c71
chore(deps): vllm bump to 0.25.1 (#11606)
karen-sy Jul 14, 2026
0becab0
fix(mocker): model offline attention DP per rank (#11153)
dreamtalen Jul 14, 2026
a6a1744
ci: disable Datadog ITR/code-coverage for subprocess-based tests (#11…
nv-tusharma Jul 14, 2026
e70ff2a
ci: Split Dynamo CI port ranges by workload (#11587)
VincyZhang Jul 14, 2026
337b55f
fix(vllm): bound RL weight-update initialization (#11418)
jthomson04 Jul 14, 2026
c2a0c0f
feat(bindings): expose Client.instances() with instance/transport sna…
nnshah1 Jul 14, 2026
05eb98d
perf(kv-router): compress block tracker prompt paths (#11644)
jthomson04 Jul 15, 2026
4163e04
test(replay): focus AIC capacity coverage on config layer (#11686)
tedzhouhk Jul 15, 2026
af4a0a3
fix(mocker): model MTP prefix block recomputation (#11558)
nealvaidya Jul 15, 2026
e557d78
test: lower cancellation max_tokens for xpu fault tolerance (#11592)
VincyZhang Jul 15, 2026
f9a67cb
fix(trtllm): log deprecation notices so operators see them (#11694)
tanmayv25 Jul 15, 2026
b0b7786
fix(trtllm): size omitted max_tokens for multimodal via expanded prom…
bewestphal Jul 15, 2026
c7acf3a
refactor(codeowners): decouple CODEOWNERS emission from the live tree…
dagil-nvidia Jul 15, 2026
ce068df
fix(vllm): update Qwen3-TTS prompt estimator (#11595)
ptarasiewiczNV Jul 15, 2026
3e32cda
test(trtllm): cap mm_overlap KV pool with token lever, not byte budge…
dmitry-tokarev-nv Jul 15, 2026
ff65df8
fix: add AgentHeaderMapping lookup in session_affinity_header_value()…
GuanLuo Jul 15, 2026
875d2b4
test(vllm): re-enable agg-router and agg-router-approx serve tests (#…
nv-tusharma Jul 15, 2026
ff34e97
fix: make EPP eviction-resistant under node DiskPressure (#11550)
atchernych Jul 15, 2026
d3e815a
fix(trtllm): handle visible stop tokens in unified backend (#11671)
Chokoyo Jul 15, 2026
81b7369
fix(frontend): honor reasoning effort in templates (#11691)
alexeldeib Jul 15, 2026
700228a
feat(multimodal): ThreadedMicroBatcher + batcher-backed AsyncVisionEn…
furionw Jul 15, 2026
6313845
fix(planner): use admitted router demand (#11693)
tedzhouhk Jul 15, 2026
e8c43ff
docs(disaggregated-serving): fix broken aiconfigurator support-matrix…
dmitry-tokarev-nv Jul 15, 2026
73ddd6c
fix: Fix multi-turn reasoning in Kimi (#11653)
indrajit96 Jul 15, 2026
7bdf96a
fix(operator): stop bundling CRDs in the Helm subchart (#11689)
julienmancuso Jul 15, 2026
b01e061
fix(profiler): restore vLLM disaggregation flags in DGDR output (#11710)
julienmancuso Jul 15, 2026
d397b02
feat(kv-router): allow amplified overlap credit (#11714)
PeaBrane Jul 15, 2026
65fba25
feat(router): add live admission request progress (#11615)
ishandhanani Jul 15, 2026
b0c9d0e
test(sglang): cover aggregated OTLP tracing (#11675)
knarangN Jul 15, 2026
0260eb9
refactor(operator): retire legacy DGDR annotation readers (#11663)
julienmancuso Jul 15, 2026
94494d3
fix(profiler): defer aiconfigurator import in replay bench (#11732)
KrishnanPrash Jul 15, 2026
d168e63
fix(frontend): forward request chat_template_kwargs to vLLM template …
KrishnanPrash Jul 16, 2026
1590dc6
fix(trtllm): expose env var to force engine side conversation dp assi…
GuanLuo Jul 16, 2026
f5b1c1c
fix(benchmarks): drop synthetic-only flag from trace runs [DYN-3379] …
PeaBrane Jul 16, 2026
5b08d9a
refactor(operator): centralize feature gates (#11672)
sttts Jul 16, 2026
4cfeba7
chore(runtime): consolidate truthy/bool flag parsing into one helper …
keivenchang Jul 16, 2026
73aa207
feat(recipes): add Inkling (thinkingmachines/Inkling-NVFP4) SGLang ag…
vanshilshah97 Jul 16, 2026
8fb4f24
fix(trtllm): update how to pull engine arg default for TRTLLM API cha…
GuanLuo Jul 16, 2026
4025cb6
chore: bump cudarc version to support CUDA 13.2 build environment (#1…
GuanLuo Jul 16, 2026
f2f1541
docs(recipes): Inkling NVFP4 day-0 recipe page [DYN-3523] (#11749)
BenHamm Jul 16, 2026
cc5e80e
feat(router): sync session affinity across replicas (#11750)
PeaBrane Jul 16, 2026
8c8fa56
test(serve): add aggregated_spec_decoding launch scenario (#11440)
nv-tusharma Jul 16, 2026
cb193f5
fix(event-plane): stop retired ZMQ subscriber pumps (#11730)
zhongdaor-nv Jul 16, 2026
972c4a5
fix(sglang): forward multimodal config and audio inputs (#11747)
milesial Jul 16, 2026
a7ccbcf
fix(frontend): reject nested chat_template in chat_template_args (#11…
KrishnanPrash Jul 16, 2026
de2ad9b
fix(planner): share tick timestamp for observation scheduling (#11784)
tedzhouhk Jul 16, 2026
bb2a734
test(serve): de-flake test_sample_deployment CPU timeout (OPS-7728) (…
dmitry-tokarev-nv Jul 16, 2026
78f7123
perf(kv-router): batch event-plane KV events (#11776)
jthomson04 Jul 16, 2026
ef9de89
build(llm): add optional aws-sdk-s3 behind request-trace-s3 feature
Rafa-Ross Jul 17, 2026
39fff86
test(request-trace): add failing tests for native S3 sink
Rafa-Ross Jul 17, 2026
cdcbf59
refactor(telemetry): extract SegmentSink from JsonlGzipWriter
chethanuk Jul 17, 2026
f3a3888
feat(request-trace): native S3 sink for request-trace records
chethanuk Jul 17, 2026
e8f0c50
test(request-trace): add S3 sink integration replay target
chethanuk Jul 17, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
10 changes: 9 additions & 1 deletion .agents/skills/debug-session/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,16 @@
---
name: debug-session
description: Start a debugging session with worklog file
description: Sets up a structured debugging session for a Dynamo bug — pull the report from a Linear ticket, GitHub issue, or pasted text, capture the environment, create a persistent worklog markdown file, and walk through rebuild, reproduction, and investigation steps. Use when starting to investigate a reported Dynamo bug or regression and the investigation should be tracked in a worklog.
license: Apache-2.0
user-invocable: true
disable-model-invocation: true
metadata:
author: NVIDIA
tags:
- dynamo
- debugging
- worklog
- dev-workflow
---

# Start Debug Session
Expand Down
10 changes: 9 additions & 1 deletion .agents/skills/dep-create/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
---
name: dep-create
description: Create or update Dynamo Enhancement Proposals as GitHub issues, including lightweight DEPs, implementation plans, and retroactive DEPs for ai-dynamo/dynamo.
description: Creates or updates Dynamo Enhancement Proposals as GitHub issues, including lightweight DEPs, implementation plans, and retroactive DEPs for ai-dynamo/dynamo. Use when proposing a feature or architecture change, drafting an implementation plan, or filing a retroactive DEP.
license: Apache-2.0
metadata:
author: NVIDIA
tags:
- dynamo
- dep
- enhancement-proposal
- github
---

# Skill: Create a DEP as a GitHub Issue
Expand Down
10 changes: 9 additions & 1 deletion .agents/skills/dep-status/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
---
name: dep-status
description: Check Dynamo Enhancement Proposal issue status, list DEPs by lifecycle state or area, and find related DEP issues in ai-dynamo/dynamo.
description: Checks Dynamo Enhancement Proposal issue status, lists DEPs by lifecycle state or area, and finds related DEP issues in ai-dynamo/dynamo. Use when asking where a DEP stands or which DEPs exist for an area.
license: Apache-2.0
metadata:
author: NVIDIA
tags:
- dynamo
- dep
- enhancement-proposal
- github
---

# Skill: Check DEP Status
Expand Down
11 changes: 10 additions & 1 deletion .agents/skills/dep-update/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,15 @@
---
name: dep-update
description: Update Dynamo Enhancement Proposal lifecycle state in GitHub, including triage, PIC assignment, review, approval, and status label changes.
description: Updates Dynamo Enhancement Proposal lifecycle state in GitHub, including triage, PIC assignment, review, approval, and status label changes. Use when triaging a new DEP, assigning a PIC, or moving a proposal through review and approval.
license: Apache-2.0
metadata:
author: NVIDIA
tags:
- dynamo
- dep
- enhancement-proposal
- github
- lifecycle
---

# Skill: Update DEP Lifecycle
Expand Down
30 changes: 23 additions & 7 deletions .agents/skills/dynamo-docs/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
---
name: dynamo-docs
description: Add, update, move, or remove content on the Dynamo Fern docs site — standard docs pages, catalog-driven recipe and feature-benchmark pages, examples, recipes, and translations — keeping everything in line with the documentation style guide. Use for any change under docs/, recipes/, or examples/ (new page, edit, section move, rename, removal, recipe/benchmark page, .zh-CN translation, version cut) and whenever content needs its frontmatter, headings, links, callouts, or terminology fixed.
description: Adds, updates, moves, or removes content on the Dynamo Fern docs site — standard docs pages, catalog-driven recipe and feature-benchmark pages, examples, recipes, and translations — keeping everything in line with the documentation style guide. Use for any change under docs/, recipes/, or examples/ (new page, edit, section move, rename, removal, recipe/benchmark page, .zh-CN translation, version cut) and whenever content needs its frontmatter, headings, links, callouts, or terminology fixed.
license: Apache-2.0
metadata:
author: NVIDIA
tags:
- dynamo
- docs
- fern
- style-guide
---

# Dynamo Docs Maintenance
Expand Down Expand Up @@ -317,13 +325,21 @@ Design Docs, Documentation, Hidden Pages. To place a page, match the nearest exi

## Translations and Versioned Navs

- **Chinese translations** mirror the English page as `<name>.zh-CN.md` in the **same directory**,
with the same SPDX header, frontmatter, and heading structure. Translate prose, not code, flags, or
terminology (vLLM / SGLang / TensorRT-LLM stay verbatim). Keep it in sync when the English page
changes, or don't ship it stale.
- **Chinese translations** live at `fern/translations/zh-CN/pages-dev/<path>`, mirroring the
English page at `docs/<path>` (same file name and SPDX header, Chinese frontmatter, no body H1 —
the frontmatter `title` renders the heading, no manual language-switcher links). Fern's native
localization pairs them and adds the header language picker; untranslated pages fall back to
English. Links to translated siblings stay shallow-relative; links to untranslated pages are
deep-relative into `docs/` — count `../` as 4 plus one per directory level of the page under
`pages-dev/` (`getting-started/x.md` → 5, `components/router/x.md` → 6) — so the repo link
checker and GitHub browsing stay valid; the sync workflow rewrites them to site URLs at publish
via `fern/resolve_translation_links.py`. Image refs stay shallow-relative (`../assets/...`) and
are **not** copied into the mirror — Fern resolves them against the base page. Translate prose, not code, flags, or terminology
(vLLM / SGLang / TensorRT-LLM stay verbatim). Keep it in sync when the English page changes,
or don't ship it stale.
- **Versioned navs.** Author only against `docs/` on `main` (the `pages-dev` set). When a release is
cut, the publish step copies `pages-dev/ → pages-vX.Y.Z/` and rewrites nav paths — **never** edit a
`pages-vX.Y.Z/` directory by hand. Write portable paths so the rewrite stays clean.
cut, the publish step builds `pages-vX.Y.Z/` from the tagged `docs/` tree and rewrites nav paths —
**never** edit a `pages-vX.Y.Z/` directory by hand. Write portable paths so the rewrite stays clean.
### Redirects and the version model

The site serves the same nav under three prefixes: **`dev`** (slug `dev`, tracks `main`, regenerated on
Expand Down
73 changes: 0 additions & 73 deletions .agents/skills/gh-issue-bug/SKILL.md

This file was deleted.

12 changes: 10 additions & 2 deletions .agents/skills/graham-code-review/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
---
name: "graham-code-review"
description: "Use this agent when you need a code review in the style of Graham King from the ai-dynamo/dynamo project. This agent embodies Graham's coding standards, review patterns, and technical preferences learned from his PRs and code reviews. Particularly useful for reviewing Rust code, systems-level changes, and code touching the dynamo runtime, networking, or performance-critical paths."
name: graham-code-review
description: Reviews code changes in the style of Graham King's ai-dynamo/dynamo reviews — exacting Rust and systems-level standards covering error handling, tracing discipline, unnecessary clones, async and concurrency correctness, log levels, and minimal diff surface. Use when reviewing Rust changes, code under lib/ or components/src/dynamo, or any performance-critical or networking path that needs a strict senior-engineer review.
license: Apache-2.0
metadata:
author: NVIDIA
tags:
- dynamo
- rust
- code-review
- standards
---

# Graham Code Review
Expand Down
10 changes: 9 additions & 1 deletion .agents/skills/pr-monitor/SKILL.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,16 @@
---
name: pr-monitor
description: Check CI status, analyze failures, and explain skips for a Dynamo PR
description: Runs a CI health check on an ai-dynamo/dynamo pull request — report check status, explain why full CI has or has not triggered, root-cause failed job logs, cross-reference failures against main to separate PR-caused regressions from pre-existing flakes, and flag unexpected skips. Use when asked whether a PR's CI is healthy, why checks are failing or missing, or whether a failure is a flake.
license: Apache-2.0
user-invocable: true
disable-model-invocation: true
metadata:
author: NVIDIA
tags:
- dynamo
- github
- ci
- pull-request
---

# PR CI Monitor
Expand Down
Loading
Loading