fix(sse): local backends answer 499 while draining instead of 502 - #18134

fix(sse): local backends answer 499 while draining instead of 502#18134

diegosouzapw merged 6 commits into

cheaper-inference:release/v3.8.53cheaper-inference/OmniRoute:release/v3.8.53from

megamen32:feat/local-backends-shutdown-drainmegamen32/OmniRoute:feat/local-backends-shutdown-drainCopy head branch name to clipboard