Skip to content

Fix vllm import - #7224

Merged
2 commits merged into
BerriAI:mainfrom
ivanvykopal:vllm-fix
Dec 14, 2024
Merged

2 commits merged into
BerriAI:mainfrom
ivanvykopal:vllm-fix

Conversation

@ivanvykopal

Copy link
Copy Markdown
Contributor

Title

Bug fix of importing vllm package. The current version for vllm after refactoring does not work.

Relevant issues

I have not found any relevant issue.

Type

🐛 Bug Fix

Changes

Changed file vllm/completion/handler.py and change importing of vllm (Not working from version litellm==1.55)

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

@vercel

vercel Bot commented Dec 14, 2024 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 14, 2024 6:14pm

@ghost
ghost merged commit 553453d into BerriAI:main Dec 14, 2024
@ghost

ghost commented Dec 14, 2024

Copy link
Copy Markdown

Thanks @ivanvykopal

@ghost

ghost commented Dec 14, 2024

Copy link
Copy Markdown

Would welcome a unit test here to prevent future regressions

fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026
* fix: Fix vllm import

* Update handler.py
This pull request was closed.

This branch was successfully deployed

1 active deployment
Preview — 64770298 Deployed Dec 14, 2024 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant