Repository navigation
Add logo and polish readme - #156
Merged
Merged
Conversation
WoosukKwon
reviewed
Jun 19, 2023
Collaborator
|
I made some suggestions in #159 |
WoosukKwon
approved these changes
Jun 19, 2023
WoosukKwon
left a comment
WoosukKwon
left a comment
Collaborator
There was a problem hiding this comment.
Thanks for your effort.
hongxiayang
pushed a commit
to hongxiayang/vllm
that referenced
this pull request
Feb 13, 2024
yukavio
pushed a commit
to yukavio/vllm
that referenced
this pull request
Jul 3, 2024
Summary: This PR removes the following benchmarking runs, - Sparse 2:4 : prompts 300, qps 1 - Sparse 50 % : prompts 150, qps 0.5 Nightlies that reported flakiness / regression: - https://github.com/neuralmagic/nm-vllm/actions/runs/8444603631/job/23138489705 - https://github.com/neuralmagic/nm-vllm/actions/runs/8475302354/job/23229958270 - https://github.com/neuralmagic/nm-vllm/actions/runs/8486867771/job/23258658412 On the nightlies we trigger a perf. regression alert when the value change is more than 10%. For the cases being removed, the variance is in the range of [10% - 20%] Test: None Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
iwooook
pushed a commit
to moreh-dev/vllm
that referenced
this pull request
Nov 29, 2025
* Fix remaining issues with upstream rebase to Apr 16, add python3.9+ requirement, upgrade torch dependencies Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com> (cherry picked from commit 0854f384f48cd4e8efeeece34ba33c25fea316c0) * Replace custom platform-specific request validation with new version from upstream Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com> (cherry picked from commit 33a33d0b0bb46bbc04910082b4ada69edd07c936) * Add Qwen VL test option to offline_inference_tt.py Signed-off-by: Salar <skhorasgani@tenstorrent.com> * `offline_inference_tt.py`: Add customized input_processor for Qwen2.5-VL; added batch_size test case. * Use local files for testing; update model_name checking to allow passing a model path. * Remove previous hack that injects input_processor in favor of vLLM's cached `get_hf_processor`. * Add support for loading prompts from JSON file for Qwen2.5-VL * Add `Qwen2.5-VL-72B-Instruct` to the list of supported models * Add separate sever example for qwen25-vl * work around device API change * support one user for now * Update offline_inference for Qwen2.5-VL * remove bad merging blobs * remove unintended extra white space * Remove unintended white space * `pre-commit run --show-diff-on-failure --color=always --all-files --hook-stage manual` * Fix linter error * revert to original code for mode name checking. * Fix --measure_perf mode in offline_inference_tt.py * Fix linter error * Update variable name * Fix more linter error * Fix even more linter errors --------- Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com> Signed-off-by: Salar <skhorasgani@tenstorrent.com> Co-authored-by: Salar Hosseini <skhorasgani@tenstorrent.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note: I imported github's default gitignore from here