Repository navigation

[Frontend] Write run-batch responses incrementally instead of at the end - #52505

Merged

DarkLight1337 merged 45 commits into

vllm-project:mainfrom

fangchenli:feat/run-batch-streaming-output

Oct 20, 2026

Merged

[Frontend] Write run-batch responses incrementally instead of at the end#52505
DarkLight1337 merged 45 commits into
vllm-project:mainfrom
fangchenli:feat/run-batch-streaming-output

Commits on Aug 14, 2026
- [Frontend] Write run-batch responses incrementally instead of at the end
  
  fangchenli
  and
  claude
  committed
  6cfee03
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  58b7b29
- [Frontend] Guard run-batch against truncating its own input
  
  fangchenli
  and
  claude
  committed
  4e6fa5f
- [Frontend] Type the run-batch endpoint registry with a TypedDict
  
  fangchenli
  and
  claude
  committed
  9e51b92
- [Frontend] Drop the run-batch submitted-request counter
  
  fangchenli
  and
  claude
  committed
  d5141ec
Commits on Aug 15, 2026
- [Frontend] Drain run-batch responses from a single loop
  
  fangchenli
  and
  claude
  committed
  5faef5d
- [Frontend] Stage unseekable run-batch inputs and tighten the edges
  
  fangchenli
  and
  claude
  committed
  5b0f696
- [Frontend] Test that run-batch honours its inflight bound
  
  fangchenli
  and
  claude
  committed
  cb0edb8
- [Frontend] Cover the remaining run-batch streaming paths
  
  fangchenli
  and
  claude
  committed
  8ac66f2
- [Frontend] Stage descriptor aliases for run-batch inputs
  
  fangchenli
  and
  claude
  committed
  d8533d3
Commits on Aug 16, 2026
- [Frontend] Build the unsupported-URL error from the endpoint registry
  
  fangchenli
  and
  claude
  committed
  47e3073
- [Frontend] Build the supported-endpoint list once per batch
  
  fangchenli
  and
  claude
  committed
  dd4e072
- [Frontend] Describe each batch endpoint by one URL pattern
  
  fangchenli
  and
  claude
  committed
  0ccd29f
- [Frontend] State the batch URL matching rule instead of encoding it
  
  fangchenli
  and
  claude
  committed
  88d72e8
- [Frontend] Keep responses that finished alongside a failed request
  
  fangchenli
  and
  claude
  committed
  f17a22d
- [Frontend] Match batch score and rerank URLs by version prefix
  
  fangchenli
  and
  claude
  committed
  7b74ee3
- [Frontend] Infer batch endpoint versioning from the URL
  
  fangchenli
  and
  claude
  committed
  3b4b52b
- [Doc] Correct the endpoints the batch runner claims to support
  
  fangchenli
  and
  claude
  committed
  da0ae19
Commits on Aug 19, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  417dc97
Commits on Oct 5, 2026
Commits on Oct 6, 2026
Commits on Oct 8, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  c654f95
- [Frontend] Write run-batch responses in input order
  
  fangchenli
  and
  claude
  committed
  a3f69d0
- [Frontend] Harden run-batch input, output checks, and engine failure
  
  fangchenli
  and
  claude
  committed
  1e28b15
- [Frontend] Drop a redundant run-batch test and fix a stale docstring
  
  fangchenli
  and
  claude
  committed
  5dbc1cb
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  5111856
- [Frontend] Detect run-batch URLs by scheme
  
  fangchenli
  and
  claude
  committed
  c1f660a
Commits on Oct 10, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  213ddff
Commits on Oct 12, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  c042556
Commits on Oct 13, 2026
Commits on Oct 14, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  5f6920f
Commits on Oct 16, 2026
- Merge remote-tracking branch 'upstream/main' into feat/run-batch-streaming-output
  fangchenli
  committed
  2008759
- [Frontend] Stop run-batch output at the first dead-engine error
  
  fangchenli
  and
  claude
  committed
  d73fed1
Commits on Oct 17, 2026
Commits on Oct 18, 2026
- Merge branch 'main' into feat/run-batch-streaming-output
  fangchenli
  authored
  9f2aef2
Commits on Oct 19, 2026
- Merge branch 'main' into feat/run-batch-streaming-output
  fangchenli
  authored
  faa8175

Commits

Commits on Aug 14, 2026

Commits on Aug 15, 2026

Commits on Aug 16, 2026

Commits on Aug 19, 2026

Commits on Oct 5, 2026

Commits on Oct 6, 2026

Commits on Oct 8, 2026

Commits on Oct 10, 2026

Commits on Oct 12, 2026

Commits on Oct 13, 2026

Commits on Oct 14, 2026

Commits on Oct 16, 2026

Commits on Oct 17, 2026

Commits on Oct 18, 2026

Commits on Oct 19, 2026