Skip to content

perf(streaming): cut per-chunk overhead ~30% on Anthropic + Bedrock hot path - #28720

Merged
yassin-berriai merged 1 commit into
litellm_internal_stagingfrom
litellm_fix/LIT-3313-streaming-chunk-overhead
May 28, 2026
Merged

perf(streaming): cut per-chunk overhead ~30% on Anthropic + Bedrock hot path#28720
yassin-berriai merged 1 commit into
litellm_internal_stagingfrom
litellm_fix/LIT-3313-streaming-chunk-overhead

fix: improve bedrock streaming hot path perf

bfb7ea1
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded May 28, 2026 in 1s

96.29% of diff hit (target 69.35%)

View this Pull Request on Codecov

96.29% of diff hit (target 69.35%)