Skip to content

fix(caching): skip the cache past max_messages and keep tool_result text in semantic prompts - #43878

Merged
kerry-berri merged 30 commits into
mainfrom
litellm_semantic_cache_tool_blocks
Oct 7, 2026
Merged

fix(caching): skip the cache past max_messages and keep tool_result text in semantic prompts#43878
kerry-berri merged 30 commits into
mainfrom
litellm_semantic_cache_tool_blocks

style(caching): suppress C901 on the Responses input walker instead o…

580a970
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis succeeded Oct 7, 2026

Performance Gate Passed

✅ 31 untouched benchmarks

Comparing litellm_semantic_cache_tool_blocks (580a970) with main (086bcd2)

Open in CodSpeed
View more details on CodSpeed