Skip to content

Refactor system architecture#109

Merged
WoosukKwon merged 80 commits intomainfrom
refactor
May 20, 2023
Merged

Refactor system architecture#109
WoosukKwon merged 80 commits intomainfrom
refactor

Conversation

@WoosukKwon
Copy link
Copy Markdown
Collaborator

Should be merged after #81

@WoosukKwon
Copy link
Copy Markdown
Collaborator Author

@zhuohan123 I've implemented the changes we discussed offline and fixed the FastAPI server. PTAL.

Copy link
Copy Markdown
Member

@zhuohan123 zhuohan123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

Copy link
Copy Markdown
Member

@zhuohan123 zhuohan123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

@WoosukKwon WoosukKwon merged commit c3442c1 into main May 20, 2023
@WoosukKwon WoosukKwon deleted the refactor branch May 20, 2023 20:07
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
mht-sharma pushed a commit to mht-sharma/vllm that referenced this pull request Aug 1, 2024
…ample

adding a simple model invocation involving fp8 calculation/storage
iwooook pushed a commit to moreh-dev/vllm that referenced this pull request Nov 29, 2025
* fix ruff

* Ignore ci mypy error

* fix mypy error: fix abstract method in loader

* fix mypy errors

* remove unused method to fix missing parameter error

* address comments

* address comments: fix model input

* Fix merge: long lines
tjtanaa pushed a commit to tjtanaa/vllm that referenced this pull request Jan 29, 2026
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
yma11 pushed a commit to yma11/vllm that referenced this pull request Feb 3, 2026
* update base image, torch and compiler

* update os pacakges

* update

* upgrade os version

* Update ipex to public link

---------

Co-authored-by: Du, Jun <jun.du@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants