Repository navigation

[Frontend] Scale Omni serving across API processes - #6923

Merged

linyueqian merged 7 commits into

mainfrom

frontend/multi-api-server-scaling

Sep 17, 2026

Commits on Sep 16, 2026
- Rebase multi-API serving on latest main
  Sy0307
  committed
  dc3c7db
- Document multi-API serving tradeoffs in TTS profile
  Sy0307
  committed
  40a000d
- Merge main and preserve multi-API engine and duplex guards
  Sy0307
  committed
  daf91b4
- Fix ROCm diffusion CI platform guard and startup deadlines
  Sy0307
  committed
  ec0feea
- Revert unrelated ROCm CI test and timeout changes
  Sy0307
  committed
  d8458b8
Commits on Sep 17, 2026
- Merge main and preserve multi-API serving mode selection
  Sy0307
  committed
  79c6298
- Merge main and adapt multi-API startup to structured configs
  Sy0307
  committed
  04ae6aa