Repository navigation

Stop at max_output_tokens, not one past it - #604

Merged

merceod merged 9 commits into

mainfrom

users/atindra/max-output-tokens

Nov 3, 2026

Merged

Stop at max_output_tokens, not one past it#604
merceod merged 9 commits into
mainfrom
users/atindra/max-output-tokens

Commits on Oct 20, 2026
- Stop decode loops at max_output_tokens, not one past it
  merceod
  committed
  306e1b9
Commits on Nov 3, 2026
- Merge origin/main into users/atindra/max-output-tokens
  merceod
  committed
  bb41b84
- Qwen3-Omni: the decode loop caps count the prefill's token
  merceod
  committed
  5a6ad55
- Qwen3-Omni Talker: count the last prefill's frame in the stop check
  merceod
  committed
  ead7b1f
- Orpheus: the decode cap counts the prefill's token
  merceod
  committed
  c3ac825
- test: the prefill's token plus the decode cap is max_output_tokens
  merceod
  committed
  c5e53b9
- test: drop test_max_output_tokens.py
  merceod
  committed
  6453877
- Qwen3-Omni Talker: the stop check looks only for codec_eos
  merceod
  committed
  9fcfe15
- test: the Talker's cap alone gives the frame budget
  merceod
  committed
  4a78dae