Repository navigation

[bench] Take each request's prompt length from the server - #39889

Merged

BBuf merged 5 commits into

sgl-project:mainfrom

nvcnvn:fix/multi-turn-prompt-len

Sep 27, 2026

Merged

[bench] Take each request's prompt length from the server#39889
BBuf merged 5 commits into
sgl-project:mainfrom
nvcnvn:fix/multi-turn-prompt-len

Commits on Sep 17, 2026
- [bench] Take each request's prompt length from the server
  
  nvcnvn
  and
  claude
  committed
  06dff11
- chore: moving the test_bench_serving_prompt_len to registered folder
  nvcnvn
  committed
  716598f
Commits on Sep 24, 2026
- [bench] Ask for usage on multi-turn rounds so prompt_tokens arrives
  
  nvcnvn
  and
  claude
  committed
  a2209ca
Commits on Sep 26, 2026
- [bench] Default include_usage inside stream_options; trim the test
  
  nvcnvn
  and
  claude
  committed
  707d7d5
- Merge branch 'main' into fix/multi-turn-prompt-len
  BBuf
  authored
  535a73a