Repository navigation

[Fix] tokenizer: Isolate and offload regular fast tokenization - #30771

Open

anencore94 wants to merge 9 commits into

sgl-project:mainfrom

anencore94:codex/health-event-loop-starvation

Open

[Fix] tokenizer: Isolate and offload regular fast tokenization#30771
anencore94 wants to merge 9 commits into
sgl-project:mainfrom
anencore94:codex/health-event-loop-starvation

Commits on Sep 8, 2026
- fix(frontend): offload blocking request preprocessing
  anencore94
  committed
  4a5399e
- fix(frontend): serialize request preprocessing
  anencore94
  committed
  54ab772
- test(frontend): keep starvation repro baseline-compatible
  anencore94
  committed
  7813e49
- test(frontend): cover HTTP liveness during preprocessing
  anencore94
  committed
  eae63c5
- test(frontend): queue liveness before preprocessing
  anencore94
  committed
  db8bee8
- test(frontend): adapt liveness tests to current main
  anencore94
  committed
  60a56aa
Commits on Oct 26, 2026
- Merge main and preserve serialized request preprocessing
  anencore94
  committed
  96a3df4
Commits on Nov 1, 2026
- Merge main and narrow offload to remaining regular tokenization path
  anencore94
  committed
  b8d222b
- Isolate fast tokenizer backend for regular offload
  anencore94
  committed
  e0a7285