feat: add native vLLM gRPC sidecar backend - #11804

Open

biswapanda wants to merge 15 commits into

ai-dynamo:mainfrom

biswapanda:feat/dyn-pi-sidecar-v2

Commits on Aug 2, 2026

chore(v3): rebase generate/MM/metrics foundation onto current main
biswapanda
committed
85d8b61
fix(vllm): drop unused DisaggregationMode import
biswapanda
committed
d007498
feat(rl): advertise protocol-v1 discovery metadata with backward-compatible routes alias
biswapanda
committed
719ea76
fix(rl): fence dirty workers and drop framework-specific discovery metadata
biswapanda
committed
3cd7c72
revert(rl): drop dynamo.vllm backend changes; vllm-rs sidecar is the engine path
biswapanda
committed
9bfb10d
feat(sidecar): integrate native vllm control discovery
biswapanda
committed
255d024
fix(sidecar): bridge token-native generation fields
biswapanda
committed
48d5299
fix(sidecar): accept token id response requests
biswapanda
committed
836e1ee
fix(sidecar): preserve prefix cache versioning
biswapanda
committed
d546aee
fix(frontend): normalize legacy cache salts
biswapanda
committed
117472f
test(sidecar): provide discovery endpoint for component config
biswapanda
committed
c2497f6
feat(sidecar): bridge native LoRA updates
biswapanda
committed
b10fab7
fix(sidecar): tighten LoRA file URI validation
biswapanda
committed
eab6a1e

Commits on Aug 3, 2026

fix(sidecar): forward LoRA routing to vLLM
biswapanda
committed
fc556d9

Commits on Aug 7, 2026

fix(rl): omit workers without bound models
biswapanda
committed
98259c0