(router_strategy/) ensure all async functions use async cache methods - #6489

Merged

ishaan-jaff merged 9 commits into

mainfrom

litellm_use_async_checks_get_set_router_strat

Oct 29, 2024

Commits on Oct 29, 2024

fix router strat
ishaan-jaff
committed
ff7d667
use async set / get cache in router_strategy
ishaan-jaff
committed
1fe8f28
add coverage for router strategy
ishaan-jaff
committed
9b3e4a7
fix imports
ishaan-jaff
committed
8affdfe
fix batch_get_cache
ishaan-jaff
committed
1f4b39e
use async methods for least busy
ishaan-jaff
committed
72d1be6
fix least busy use async methods
ishaan-jaff
committed
8724812
fix test_dual_cache_increment
ishaan-jaff
committed
d30cc25
test async_get_available_deployment when routing_strategy="least-busy"
ishaan-jaff
committed
682a612