feat(RL): add nvext Tokens-in-Tokens-Out and RL related response protocol and frontend support - #9649

Merged

biswapanda merged 7 commits into

mainfrom

bis/nvext-tito-rl

May 23, 2026

Commits on May 22, 2026

feat(llm): add nvext tokens-in-tokens-out protocol
biswapanda
committed
b31e4fe
fix(llm): address nvext protocol review gaps
biswapanda
committed
3bc7934
fix(llm): avoid prompt logprobs output shape break
biswapanda
committed
650ac6f
fix(llm): keep backend sampling knobs out of public options
biswapanda
committed
dcd3339
fix(llm): bound responses default output tokens
biswapanda
committed
91fecee
fix(llm): preserve dynamic responses output cap
biswapanda
committed
bce8eb2
fix(llm): move omitted max token policy to context
biswapanda
committed
f46b9bf