Skip to content

Refactor system architecture#82

Merged
WoosukKwon merged 27 commits intomainfrom
refactor-arch
May 9, 2023
Merged

Refactor system architecture#82
WoosukKwon merged 27 commits intomainfrom
refactor-arch

Conversation

@WoosukKwon
Copy link
Copy Markdown
Collaborator

@WoosukKwon WoosukKwon commented May 7, 2023 •
edited
Loading

This PR includes extensive refactoring of the system.

Major changes are:

  • Moved parallel_utils into model_executor
  • Moved simple_frontend to frontend
  • Moved gradio_webserver and test_cli_client to the root
  • Removed plot

@WoosukKwon WoosukKwon requested a review from zhuohan123 May 7, 2023 23:46
This was referenced May 8, 2023
Merged
Merged
@WoosukKwon WoosukKwon merged commit 7c041ab into main May 9, 2023
@WoosukKwon WoosukKwon deleted the refactor-arch branch May 9, 2023 22:30
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
@WoosukKwon
Refactor system architecture (vllm-project#82)
4a90d2c
yukavio pushed a commit to yukavio/vllm that referenced this pull request Jul 3, 2024
@mgoin
Update setup.py (vllm-project#82)
f7bc8bc 
Fix repo link in setup.py
dllehr-amd pushed a commit to dllehr-amd/vllm that referenced this pull request Jul 22, 2024
@HaiShaw
Merge pull request vllm-project#82 from ROCm/charlifu/avoid_tensor_cr…
4a64124 
…eation_before_each_gemm

Charlifu/avoid tensor creation before each gemm
iwooook pushed a commit to moreh-dev/vllm that referenced this pull request Nov 29, 2025
@ppetrovicTT @skhorasganiTT
Device params and Fabric config through override_tt_config (vllm-proj…
b777a5e 
…ect#82)

* Merge tt params into override_tt_config for offline_inference_tt
* Add fabric_config to override_tt_config
* Use override_tt_config for device_params
* Add override_tt_config and TT_LLAMA_TEXT_VER to readme

(cherry picked from commit 2a8debd)
tjtanaa pushed a commit to tjtanaa/vllm that referenced this pull request Jan 29, 2026
@ZJY0516
[Diffusion] Qwen image support (vllm-project#82)
4049f35 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
tianshu-Michael-yu added a commit to tianshu-Michael-yu/vllm that referenced this pull request Feb 13, 2026
@tianshu-Michael-yu
fix: conv_dim should be hidden_size (vllm-project#82)
182952f 
<!-- markdownlint-disable -->
PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT
THE BOTTOM) HAVE BEEN CONSIDERED.

## Purpose

## Test Plan

## Test Result

---
<details>
<summary> Essential Elements of an Effective PR Description Checklist
</summary>

- [ ] The purpose of the PR, such as "Fix some issue (link existing
issues this PR will resolve)".
- [ ] The test plan, such as providing test command.
- [ ] The test results, such as pasting the results comparison before
and after, or e2e results
- [ ] (Optional) The necessary documentation update, such as updating
`supported_models.md` and `examples` for a new model.
- [ ] (Optional) Release notes update. If your change is user facing,
please update the release notes draft in the [Google
Doc](https://docs.google.com/document/d/1YyVqrgX4gHTtrstbq8oWUImOyPCKSGnJ7xtTpmXzlRs/edit?tab=t.0).
</details>

**BEFORE SUBMITTING, PLEASE READ
<https://docs.vllm.ai/en/latest/contributing>** (anything written below
this line will be removed by GitHub Actions)

---------

Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zhuohan123 zhuohan123 Awaiting requested review from zhuohan123

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@WoosukKwon