Skip to content

(draft) fix stream memory leak - #6526

Closed
ishaan-jaff wants to merge 14 commits into
mainfrom
litellm_fix_stream_mem_leak_2
Closed

(draft) fix stream memory leak#6526
ishaan-jaff wants to merge 14 commits into
mainfrom
litellm_fix_stream_mem_leak_2

Conversation

@ishaan-jaff

Copy link
Copy Markdown
Contributor

Title

Relevant issues

Type

🆕 New Feature
🐛 Bug Fix
🧹 Refactoring
📖 Documentation
🚄 Infrastructure
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

@vercel

vercel Bot commented Oct 31, 2024

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 31, 2024 0:10am

@ishaan-jaff ishaan-jaff changed the title (fraft) fix stream memory leak (draft) fix stream memory leak Oct 31, 2024
@ghost

ghost commented Nov 1, 2024

Copy link
Copy Markdown

fixed here - #6519

key change was moving the thread.thread to executor.submit/map for custom stream wrapper

@ishaan-berri
ishaan-berri deleted the litellm_fix_stream_mem_leak_2 branch March 26, 2026 21:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant