Skip to content
This repository was archived by the owner on Sep 4, 2025. It is now read-only.

[DO NOT MERGE] Ibm 20241024 roberta#213

Closed
maxdebayser wants to merge 146 commits intoopendatahub-io:mainfrom
maxdebayser:ibm-20241024-roberta
Closed

[DO NOT MERGE] Ibm 20241024 roberta#213
maxdebayser wants to merge 146 commits intoopendatahub-io:mainfrom
maxdebayser:ibm-20241024-roberta

Conversation

@maxdebayser
Copy link
Copy Markdown

@maxdebayser maxdebayser commented Oct 28, 2024

No description provided.

WoosukKwon and others added 30 commits October 14, 2024 15:02
@WoosukKwon
[TPU] Fix TPU SMEM OOM by Pallas paged attention kernel (vllm-project…
473e7b3 
…#9350)
@LunrEclipse
[Frontend] merge beam search implementations (vllm-project#9296)
4d31cd4
@xiangxu-google
[Model] Make llama3.2 support multiple and interleaved images (vllm-p…
f0fe4fe 
…roject#9095)
@tlrmchlsmth
[Bugfix] Clean up some cruft in mamba.py (vllm-project#9343)
169b530
@stevegrubb
[Frontend] Clarify model_type error messages (vllm-project#9345)
44eaa5a
@mgoin
[Doc] Fix code formatting in spec_decode.rst (vllm-project#9348)
8e836d9
@hhzhang16
[Bugfix] Update InternVL input mapper to support image embeds (vllm-p…
55e081f 
…roject#9351)
@njhill
[BugFix] Fix chat API continuous usage stats (vllm-project#9357)
e9d517f
@gracehonv
pass ignore_eos parameter to all benchmark_serving calls (vllm-projec…
5d264f4 
…t#9349)
@mgoin @DarkLight1337
[Misc] Directly use compressed-tensors for checkpoint definitions (vl…
22f8a69 
…lm-project#8909)

Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
@CatherineSue @njhill
[Bugfix] Fix vLLM UsageInfo and logprobs None AssertionError with emp…
ba30942 
…ty token_ids (vllm-project#9034)

Co-authored-by: Nick Hill <nickhill@us.ibm.com>
@LucasWilkinson
[Bugfix][CI/Build] Fix CUDA 11.8 Build (vllm-project#9386)
717a5f8
@mrsalehi @sangho-vision @ywang96
[Bugfix] Molmo text-only input bug fix (vllm-project#9397)
ed92013 
Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
@DarkLight1337
[Misc] Standardize RoPE handling for Qwen2-VL (vllm-project#9250)
7e7eae3
@DarkLight1337
[Model] VLM2Vec, the first multimodal embedding model in vLLM (vllm-p…
7abba39 
…roject#9303)
@DarkLight1337
[CI/Build] Test VLM embeddings (vllm-project#9406)
1de76a0
@DarkLight1337
[Core] Rename input data types (vllm-project#8688)
cee711f
@ywang96 @DarkLight1337
[Misc] Consolidate example usage of OpenAI client for multimodal mode…
59230ef 
…ls (vllm-project#9412)

Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
@Isotr0py
[Model] Support SDPA attention for Molmo vision backbone (vllm-projec…
cf1d62a 
…t#9410)
@patrickvonplaten
Support mistral interleaved attn (vllm-project#9414)
415f76a
@mzusman
[Kernel][Model] Improve continuous batching for Jamba and Mamba (vllm…
fb60ae9 
…-project#9189)
@0xjunhao
[Model][Bugfix] Add FATReLU activation and support for openbmb/MiniCP…
5b8a1fd 
…M-S-1B-sft (vllm-project#9396)
@LiuXiaoxuanPKU
[Performance][Spec Decode] Optimize ngram lookup performance (vllm-pr…
8345045 
…oject#9333)
@russellb
[CI/Build] mypy: Resolve some errors from checking vllm/engine (vllm-…
776dbd7 
…project#9267)

Signed-off-by: Russell Bryant <rbryant@redhat.com>
@tlrmchlsmth
[Bugfix][Kernel] Prevent integer overflow in fp8 dynamic per-token qu…
c3fab5f 
…antize kernel (vllm-project#9425)
@rasmith
[BugFix] [Kernel] Fix GPU SEGV occurring in int8 kernels (vllm-projec…
92d86da 
…t#9391)
@terrytangyuan
Add notes on the use of Slack (vllm-project#9442)
dbfa8d3
@LucasWilkinson
[Kernel] Add Exllama as a backend for compressed-tensors (vllm-projec…
e312e52 
…t#9395)
@DarkLight1337
[Misc] Print stack trace using logger.exception (vllm-project#9461)
390be74
@LucasWilkinson @mgoin
[misc] CUDA Time Layerwise Profiler (vllm-project#8337)
9d30a05 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
mgoin and others added 23 commits October 24, 2024 10:03
@mgoin
[Bugfix][Model] Fix Mllama SDPA illegal memory access for batched mul…
bb01f29 
…ti-image (vllm-project#9626)

Signed-off-by: mgoin <michael@neuralmagic.com>
@mgoin
[Bugfix] Use "vision_model" prefix for MllamaVisionModel (vllm-projec…
b7df53c 
…t#9628)

Signed-off-by: mgoin <michael@neuralmagic.com>
@vrdn-23
[Bugfix]: Make chat content text allow type content (vllm-project#9358)
33bab41 
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
@yma11 @DarkLight1337
[XPU] avoid triton import for xpu (vllm-project#9440)
056a68c 
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
@DarkLight1337
[Bugfix] Fix PP for ChatGLM and Molmo (vllm-project#9422)
836e8ef
@WoosukKwon
[V1][Bugfix] Clean up requests when aborted (vllm-project#9629)
3770071 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
@youkaichao @zhuohan123
[core] simplify seq group code (vllm-project#9569)
4fdc581 
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
@CRZbulabula @youkaichao
[torch.compile] Adding torch compile annotations to some models (vllm…
8a02cd0 
…-project#9639)

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
@jeejeelee
[Kernel] add kernel for FATReLU (vllm-project#9610)
295a061 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
@CRZbulabula @youkaichao
[torch.compile] expanding support and fix allgather compilation (vllm…
ad6f780 
…-project#9637)

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
@DarkLight1337
[Doc] Move additional tips/notes to the top (vllm-project#9647)
b979143
@litianjian
[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA m…
f584549 
…odels (vllm-project#9653)
@hmellor
Increase operation per run limit for "Close inactive issues and PRs" …
de662d3 
…workflow (vllm-project#9661)

Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
@CRZbulabula @youkaichao
[torch.compile] Adding torch compile annotations to some models (vllm…
d27cfbf 
…-project#9641)

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
a92b917 
…20241024

Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 5733
80f94ec 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 6357
9f5b55a 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 9027
ce5eebb 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 9522
8675a9e 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 9625
e949f65 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 9631
7a6d518 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
using adapter version merged with PR vllm-project#172
080973c 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@maxdebayser
Add support for roberta models
019fe81 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
@maxdebayser maxdebayser requested a review from njhill as a code owner October 28, 2024 17:55
@openshift-ci openshift-ci Bot requested review from rpancham and tarukumar October 28, 2024 17:55
@openshift-ci
Copy link
Copy Markdown

openshift-ci Bot commented Oct 28, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: maxdebayser
Once this PR has been reviewed and has the lgtm label, please assign terrytangyuan for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci
Copy link
Copy Markdown

openshift-ci Bot commented Oct 28, 2024 •
edited
Loading

@maxdebayser: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/rocm-pr-image-mirror 019fe81 link true /test rocm-pr-image-mirror
ci/prow/smoke-test 019fe81 link true /test smoke-test

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@maxdebayser maxdebayser deleted the ibm-20241024-roberta branch October 29, 2024 12:26
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@njhill njhill Awaiting requested review from njhill

@rpancham rpancham Awaiting requested review from rpancham

@tarukumar tarukumar Awaiting requested review from tarukumar

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.