fix(api): stop the 2000-token safety buffer from inflating usage.prompt_tokens in the client response (#8331) - #8356

fix(api): stop the 2000-token safety buffer from inflating usage.prompt_tokens in the client response (#8331)#8356

diegosouzapw merged 3 commits into

release/v3.8.49cheaper-inference/OmniRoute:release/v3.8.49from

fix/8331-usage-buffer-inflationcheaper-inference/OmniRoute:fix/8331-usage-buffer-inflationCopy head branch name to clipboard