Repository navigation

feat(inference): router replay on the V2 runner everywhere - #3830

Merged

samsja merged 6 commits into

mainfrom

feat/router-replay-v2-pd

Oct 14, 2026

Merged

feat(inference): router replay on the V2 runner everywhere#3830
samsja merged 6 commits into
mainfrom
feat/router-replay-v2-pd

Commits on Oct 6, 2026
- feat(inference): router replay with disaggregated P/D on vLLM 0.31
  faresobeid
  committed
  a827863
Commits on Oct 12, 2026
- refactor(inference): send P/D decode routing rows from their first forward
  faresobeid
  committed
  b1b2742
Commits on Oct 13, 2026
- refactor(inference): take the end-anchored routing start from the packed /generate path
  faresobeid
  committed
  978146c
Commits on Oct 14, 2026
- chore(deps): pin vllm-router to v0.2.3
  faresobeid
  committed
  efab8d0
- Merge remote-tracking branch 'origin/main' into feat/router-replay-v2-pd
  faresobeid
  committed
  3396556
- Update inference.md
  faresobeid
  authored
  e586ef8