Cut chat_completion latency by ~21% by reducing pre-call processing time - #19535

Cut chat_completion latency by ~21% by reducing pre-call processing time#19535

AlexsanderHamir merged 2 commits into

mainBerriAI/litellm:mainfrom

litellm_weekly_perf_goal_00001BerriAI/litellm:litellm_weekly_perf_goal_00001Copy head branch name to clipboard