Skip to content

fix(caching): bound the semantic cache embedding lookup so a dead embedding endpoint can't block requests - #37742

Merged
mateo-berri merged 4 commits into
litellm_internal_stagingfrom
litellm_lit5879_semantic_cache_embedding_timeout
Aug 21, 2026
Merged

fix(caching): bound the semantic cache embedding lookup so a dead embedding endpoint can't block requests#37742
mateo-berri merged 4 commits into
litellm_internal_stagingfrom
litellm_lit5879_semantic_cache_embedding_timeout

chore(constants): drop the redundant comment on the semantic cache de…

d57715b
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Aug 21, 2026 in 0s

94.44% of diff hit (target 69.19%)

View this Pull Request on Codecov

94.44% of diff hit (target 69.19%)