fix(sse): lock the model on a 429 whose RetryInfo wait exceeds the queue budget - #16525

fix(sse): lock the model on a 429 whose RetryInfo wait exceeds the queue budget#16525

diegosouzapw merged 15 commits into

cheaper-inference:release/v3.8.52cheaper-inference/OmniRoute:release/v3.8.52from

shipsfromrio:fix/429-long-retry-lockoutshipsfromrio/OmniRoute:fix/429-long-retry-lockoutCopy head branch name to clipboard