feat(proxy): enqueued-token rate limiting for batches with refund on completion and cancellation - #37539

feat(proxy): enqueued-token rate limiting for batches with refund on completion and cancellation#37539

mateo-berri merged 9 commits into

litellm_internal_stagingBerriAI/litellm:litellm_internal_stagingfrom

litellm_batch_enqueued_token_limitBerriAI/litellm:litellm_batch_enqueued_token_limitCopy head branch name to clipboard