perf: pre-warm upstream realtime connection pool to cut session-establishment latency - #31163

perf: pre-warm upstream realtime connection pool to cut session-establishment latency#31163

ishaan-berri merged 24 commits into

litellm_internal_stagingBerriAI/litellm:litellm_internal_stagingfrom

litellm_rust_gateway_realtime_poolBerriAI/litellm:litellm_rust_gateway_realtime_poolCopy head branch name to clipboard