Skip to content

Pull requests: vllm-project/vllm

New pull request New
448 Open 4,979 Closed
448 Open 4,979 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Kernel][Triton][AMD] Change default block size for triton_scaled_mm to 128 for 3-5x speedup
#11698 opened Jan 3, 2025 by rasmith Loading…
2
Make detokenization optional in benchmark scripts
#11697 opened Jan 3, 2025 by JArnoldAMD Loading…
1
[Hardware][Apple] MacOs installation setup ci/build documentation Improvements or additions to documentation
#11696 opened Jan 2, 2025 by wallashss Loading…
1
5
Update requirements-tpu.txt to support python 3.9 and 3.11 ci/build
#11695 opened Jan 2, 2025 by mgoin • Draft
1
[V1] Add BlockTable class ready ONLY add when PR is ready to merge/full CI is needed
#11693 opened Jan 2, 2025 by WoosukKwon Loading…
10
Add split_special_tokens to the Tokenize Endpoint frontend
#11691 opened Jan 2, 2025 by ruediste Loading…
1
[Kernel] Move attn_type to Attention.__init__()
#11690 opened Jan 2, 2025 by heheda12345 Loading…
1
[WIP][V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision
#11685 opened Jan 2, 2025 by ywang96 • Draft
6
[Bugfix] add input embedding frontend
#11684 opened Jan 2, 2025 by Bryce1010 Loading…
2
4
k8s-config: Update the secret to use stringData documentation Improvements or additions to documentation
#11679 opened Jan 2, 2025 by surajssd Loading…
1
[torch.compile] Hide KV cache behind torch.compile boundary
#11677 opened Jan 2, 2025 by heheda12345 • Draft
2
[Bugfix][V1] Fix molmo text-only inputs
#11676 opened Jan 2, 2025 by jeejeelee Loading…
12
[Bugfix][SpecDecode] Adjust Eagle model architecture to align with intended design
#11672 opened Jan 1, 2025 by llsj14 Loading…
@LiuXiaoxuanPKU
3
[CI/Build] Update OpenVINO Dockerfile to Ubuntu 24.04 ci/build
#11670 opened Jan 1, 2025 by ruediste Loading…
2
[V1][Model] Add V1 support for Qwen2-VL
#11668 opened Jan 1, 2025 by imkero Loading…
7
[Core] Rank-to-device mapping env var
#11662 opened Dec 31, 2024 by BKitor Loading…
1
[V1] Simplify Shutdown frontend ready ONLY add when PR is ready to merge/full CI is needed
#11659 opened Dec 31, 2024 by robertgshaw2-neuralmagic Loading…
3
log GPU blocks num for MultiprocExecutor
#11656 opened Dec 31, 2024 by WangErXiao Loading…
1
[XPU] Make pp group initilized for pipeline-parallelism
#11648 opened Dec 31, 2024 by ys950902 Loading…
3
[Doc] [1/N] Reorganize Getting Started section documentation Improvements or additions to documentation
#11645 opened Dec 31, 2024 by DarkLight1337 Loading…
2
[Docs] reorganize sponsorship page documentation Improvements or additions to documentation
#11639 opened Dec 30, 2024 by simon-mo Loading…
2
[Kernel] Support MulAndSilu
#11624 opened Dec 30, 2024 by jeejeelee Loading…
6
[Quantization/Parameter] WIP: Replace parameter subclasses with raw nn.Parameter with additional attributes
#11622 opened Dec 30, 2024 by cennn Loading…
1
3
[torch.compile] consider relevant code in compilation cache
#11614 opened Dec 30, 2024 by youkaichao Loading…
6
[Do Not Merge] - LoRA V1 Reference PR needs-rebase
#11613 opened Dec 30, 2024 by varun-sundar-rabindranath • Draft
2
ProTip! Follow long discussions with comments:>50.