[Feat] Cancel upstream LLM request on client disconnect - #25776

Closed

CreateRandom wants to merge 4 commits into

BerriAI:litellm_internal_stagingfrom

CreateRandom:cancel-upstream-on-client-disconnect

Commits on Apr 15, 2026

feat(proxy): cancel upstream LLM request on client disconnect
CreateRandom
committed
26330c8
fix(proxy): address review comments on client disconnect feature
CreateRandom
committed
c5f48cc

Commits on Apr 16, 2026

fix(proxy): skip post_call_failure_hook for 499 client disconnect
CreateRandom
committed
65bed54
style: apply black formatting
CreateRandom
committed
c9c03eb