Skip to content

chore: Push upstream changes#5

Merged
wbrown merged 416 commits intomainfrom
upstream
May 27, 2025
Merged

chore: Push upstream changes#5
wbrown merged 416 commits intomainfrom
upstream

Conversation

@sangstar
Copy link
Collaborator

@sangstar sangstar commented May 27, 2025 •
edited by github-actions bot
Loading

No description provided.

tdoublep and others added 30 commits May 15, 2025 06:39
@tdoublep @LucasWilkinson
[Kernel] [V1] Fix performance regression for triton unified attention (…
01c2233 
…vllm-project#18161)

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@Alexei-V-Ivanov-AMD @DarkLight1337
Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3"…
566ec04 
… in AMD Pipeline (vllm-project#18106)

Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
@hmellor
Improve examples rendering in docs and GitHub (vllm-project#18203)
51ff154 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@schoennenbeck
[Frontend] Fix chat template content format detection (vllm-project#1…
2aa5470 
…8190)

Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
@Abatom
[Bugfix]Change the exception thrown by call_hf_processor from Runtime…
fadb8d5 
…Error to ValueError (vllm-project#18181)

Signed-off-by: Abatom <abzhonghua@gmail.com>
@tjtanaa
[Bugfix] [ROCm]: Remove assertion logic when using AITER fused moe in…
9254052 
… unquantizedMethod to reenable LLama4 BF16 (vllm-project#18205)

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
@NickLucche
[Misc] Avoid cuda graph log when sizes still match (vllm-project#18202)
e3f3aee 
Signed-off-by: NickLucche <nlucches@redhat.com>
@Alexei-V-Ivanov-AMD
Adding "AMD: Tensorizer Test" to amdproduction. (vllm-project#18216)
0b34593
@luccafong
[Bugfix] Fix test_eagle test (vllm-project#18223)
8795eb9 
Signed-off-by: Lucia Fang <fanglu@fb.com>
@LucasWilkinson
[Build] Allow shipping PTX on a per-file basis (vllm-project#18155)
c7852a6 
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@LucasWilkinson
[Bugfix] fix rotary embedding test for _get_padded_tensor_shape (vllm…
4e1c6a0 
…-project#18229)

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@kliuae
[Bugfix][ROCm] Use chunked_prefill_paged_decode as fallback for V1 …
ee659e3 
…attention on ROCm (vllm-project#18093)

Signed-off-by: kf <kuanfu.liu@embeddedllm.com>
@skylee-01
[Model] vLLM v1 supports Medusa (vllm-project#17956)
f4937a5 
Signed-off-by: lisiqi23 <lisiqi23@xiaomi.com>
Signed-off-by: skylee-01 <497627264@qq.com>
Co-authored-by: lisiqi23 <lisiqi23@xiaomi.com>
@hmellor
Allow users to pass arbitrary JSON keys from CLI (vllm-project#18208)
b18201f 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@wseaton
Throw better error for when running into k8s service discovery issue (v…
6b31c84 
…llm-project#18209)

Signed-off-by: Will Eaton <weaton@redhat.com>
@luccafong
[Feature] Support Pipeline Parallism in torchrun SPMD offline inferen…
3d2779c 
…ce for V1 (vllm-project#17827)

Signed-off-by: Lucia Fang <fanglu@fb.com>
@davidxia
[doc] fix multimodal example script (vllm-project#18089)
5c04bb8 
Signed-off-by: David Xia <david@davidxia.com>
@vadiklyutiy
[PERF] Speed up Qwen2.5-VL model by speed up rotary position embedding (
67da572 
vllm-project#17973)

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
@eicherseiji
[Misc] Add Ray Prometheus logger to V1 (vllm-project#17925)
5418176 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
@Isotr0py
[Misc] Consolidate Audio tests into multimodal common generation tests (
390ec88 
vllm-project#18214)

Signed-off-by: Isotr0py <2037008807@qq.com>
@IwakuraRein
use ceil_div in cutlass block scaling shape check (vllm-project#17918)
e23564c
@fxmarty-amd
[Fix] Fix typo in resolve_hf_chat_template (vllm-project#18259)
a5f8c11 
Signed-off-by: Felix Marty <felmarty@amd.com>
@learner0810
[Model] Use autoweightloader for dbrx (vllm-project#18251)
87d8714 
Signed-off-by: learner0810 <zhongjun.li@daocloud.io>
@reidliu41
[Misc][MacOS] fix bfloat16 error (vllm-project#18249)
d3d91b6 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
@njhill
[BugFix] Fix multi async save in MultiConnector (vllm-project#18246)
1db4f47 
Signed-off-by: Nick Hill <nhill@redhat.com>
@njhill
[BugFix] Fix ordering of KVConnector finished send/rcv sets (vllm-pro…
0ceaebf 
…ject#18211)

Signed-off-by: Nick Hill <nhill@redhat.com>
@sangstar
[CI] Assign reviewer to mergify with changes to Tensorizer files (vll…
aef94c6 
…m-project#18278)
@abmfy @mgoin
[Sampler] Adapt to FlashInfer 0.2.3 sampler API (vllm-project#15777)
7fdfa01 
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
@jinzhen-lin
[Bugfix] fix an illegal memory access was encountered of marlin ker…
e73b7df 
…nel + act_order (vllm-project#18245)
@WoosukKwon
[Spec Decode] Don't fall back to V0 when spec decoding is enabled (vl…
fabe89b 
…lm-project#18265)
DarkLight1337 and others added 25 commits May 26, 2025 07:38
@DarkLight1337
[Doc] Move examples and further reorganize user guide (vllm-project#1…
82e2339 
…8666)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@DarkLight1337
[Bugfix] Fix Llama GGUF initialization (vllm-project#18717)
a869bac 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@lgeiger
[V1][Sampler] Improve performance of FlashInfer sampling by sampling …
e7523c2 
…logits instead of probs (vllm-project#18608)
@hmellor
Convert examples to ruff-format (vllm-project#18400)
27bebcd 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@lgeiger
[Model][Gemma3] Simplify image input validation (vllm-project#18710)
0eebd74 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
@reidliu41
[Misc] improve web section group title display (vllm-project#18684)
1f88dbd 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
@Isotr0py
[V1][Quantization] Add CUDA graph compatible v1 GGUF support (vllm-pr…
1f1b1bc 
…oject#18646)

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
@lgeiger
[Model][Gemma3] Cast image pixel values already on CPU (vllm-project#…
b50602d 
…18732)

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
@vllmellm
[FEAT] [ROCm] Upgrade AITER Fused MoE kernels. (vllm-project#18271)
d260f79 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
@DarkLight1337
[Doc] Update OOT model docs (vllm-project#18742)
25a817f 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@DarkLight1337
[Doc] Update reproducibility doc and example (vllm-project#18741)
753944f 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@reidliu41
[Misc] improve docs (vllm-project#18734)
fc6d0c2 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
@almersawi
feat(rocm-support): support mamba2 on rocm (vllm-project#18565)
a547aeb 
Signed-off-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
Co-authored-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
@ldurejko
[Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the …
bbd9a84 
…same name in run-hpu-test.sh (vllm-project#18752)

Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
@calvin0327
[Doc] cleanup deprecated flag for doc (vllm-project#18715)
4693a34 
Signed-off-by: calvin chen <120380290@qq.com>
@maobaolong
Minor fix about MooncakeStoreConnector (vllm-project#18721)
c24b157 
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
@kebe7jun
[Build] fix cpu build missing libtbbmalloc.so (vllm-project#18744)
e0f0ff8 
Signed-off-by: Kebe <mail@kebe7jun.com>
@huangyuxiang03
[BUG FIX] minicpm (vllm-project#18739)
6881107 
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com>
Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
@Zerohertz
[Doc] Convert Sphinx directives ( {class}, {meth}, {attr}, ...)…
a68e293 
… to MkDocs format for better documentation linking (vllm-project#18663)

Signed-off-by: Zerohertz <ohg3417@gmail.com>
@DarkLight1337
[CI/Build] Remove imports of built-in re (vllm-project#18750)
4318c05 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@markmc
[V1][Metrics] Add API for accessing in-memory Prometheus metrics (vll…
06a0338 
…m-project#17010)

Signed-off-by: Mark McLoughlin <markmc@redhat.com>
@cascade812
Disable prefix cache by default for benchmark (vllm-project#18639)
aaa4ac1 
Signed-off-by: cascade812 <cascade812@outlook.com>
@chunxiaozheng
optimize get_kv_cache_torch_dtype (vllm-project#18531)
6b6d496 
Signed-off-by: idellzheng <idellzheng@tencent.com>
@DarkLight1337
[Core] Automatically cast multi-modal input dtype (vllm-project#18756)
696259c 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@mgoin
[Bugfix] Mistral tool calling when content is list (vllm-project#18729)
5873877 
Signed-off-by: mgoin <mgoin64@gmail.com>
@github-actions
Copy link

github-actions bot commented May 27, 2025

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

@sangstar sangstar self-assigned this May 27, 2025
@sangstar sangstar requested a review from wbrown May 27, 2025 19:34
@wbrown wbrown merged commit 5e4f640 into main May 27, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@wbrown wbrown wbrown approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@sangstar sangstar

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.