[Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 by atalman · Pull Request #48155 · vllm-project/vllm

atalman · 2026-07-09T18:40:17Z

Purpose

Update the PyTorch ecosystem to the released 2.13.0 on the production channel (download.pytorch.org/whl/...). Everything is released, so there are no test-channel index URLs — pure production bump, same approach as the 2.12.1 production PR #45082.

torch: 2.11.0 → 2.13.0
torchvision: 0.26.0 → 0.28.0
triton: 3.6.0 → 3.7.1 (matches torch 2.13.0 Requires-Dist: triton==3.7.1)
torchaudio: stays at 2.11.0 (latest published)
requirements/test/cuda.txt nvidia pins → 2.13.0 deps (cudnn 9.20.0.48, cusparselt 0.8.1, nccl 2.29.7)

torch-2.13 test adaptations (ported from #45731, production-adjusted)

CPU compat test: --enforce-eager instead of TORCH_COMPILE_DISABLE=1 (torch ≥2.12 no longer no-ops it under fullgraph=True).
qwen2audio text-then-audio prompt_embeds: xfail ([vllm] [2.12 regression][multimodal] Qwen2-Audio text-then-audio_embeds: prompt_embeds vs raw-text outputs diverge under --enforce-eager pytorch/pytorch#184431).
qwen2_vl multi-image: cap CPU max_tokens / widen logprobs for torch 2.13 numerical drift ([vllm] [2.13 regression][CPU] qwen2_vl multi-image top-N logprob mismatch (test_multi_image_models[qwen2_vl-test_case40]) pytorch/pytorch#187735).
nixl_ep import: xfail on ABI mismatch pending rebuild against 2.13 ([vllm] [2.13 regression] nixl_ep prebuilt extension fails to load: undefined symbol c10::impl::cow::materialize_cow_storage pytorch/pytorch#187727).

Excluded (per scope)

ROCm: no requirements/build/rocm.txt bump, no Dockerfile.rocm, no install_flash_attn_rocm.sh, no ROCm tests.
s390x (docker/Dockerfile.s390x) and the verify_torch_wheel docker step: excluded from this PR.
Test-channel plumbing from [Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 (test channel) #45731 (/whl/test/ URLs, UV_NO_VERIFY_HASHES, --refresh-package, the CPU Dockerfile.cpu recompile hack, python_only_compile.sh test index, versions.json test base) — not needed now that 2.13.0 is on the production index.

Why not a duplicate

Production-channel follow-up to the test-channel RC PR #45731 (which can be closed once this lands), mirroring how #45082 (2.12.1 prod) followed #42848 (2.12 test).

Test plan

Version + CI-config bump; validated by this PR's CI on the production 2.13.0 wheels. Full vLLM build/test not run locally (needs GPU/CUDA). requirements/test/cuda.txt (pip-compiled) was hand-bumped for the torch ecosystem + changed nvidia pins; regenerate with uv pip compile if the resolver shifts further transitive deps.

AI assistance (Claude) was used for this change.

claude

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

mergify · 2026-07-10T08:58:00Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @atalman.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

PyTorch 2.13.0 is published to the production PyTorch index (download.pytorch.org/whl/...), so this is a pure production-channel version bump -- no test-channel index URLs -- same approach as vllm-project#45082. - torch: 2.11.0 -> 2.13.0 - torchvision: 0.26.0 -> 0.28.0 - triton: 3.6.0 -> 3.7.1 (matches torch 2.13.0 Requires-Dist: triton==3.7.1) - torchaudio: stays at 2.11.0 (latest published torchaudio) torch-2.13 test adaptations ported from the test-channel PR vllm-project#45731 (production-adjusted; ROCm excluded): - CPU compat test: use --enforce-eager instead of TORCH_COMPILE_DISABLE. - xfail qwen2audio text-then-audio prompt_embeds (pytorch/pytorch#184431). - qwen2_vl multi-image: cap CPU max_tokens / widen logprobs for torch 2.13 numerical drift (pytorch/pytorch#187735). - nixl_ep import: xfail on ABI mismatch pending rebuild (pytorch/pytorch#187727). Production-channel follow-up to vllm-project#45731. Co-authored-by: Claude Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>

atalman · 2026-07-14T23:00:50Z

Hi @khluu this signal looks good. We can try to land this ? https://buildkite.com/vllm/ci/builds/78018#_

Two pre-commit hooks failed on the torch 2.13 bump: - pip-compile: requirements/test/cuda.txt was stale (cuda-toolkit==13.0.3 -> 13.0.3.0; nvidia-cuda-nvrtc now also 'via nvidia-cublas'). - validate-docker-versions: docker/versions.json was out of sync after the Dockerfile CUDA_VERSION bump 13.0.2 -> 13.0.3 (flows into CUDA_VERSION, BUILD_BASE_IMAGE, FINAL_BASE_IMAGE). Regenerated from the Dockerfile ARGs. Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>

….1 (vllm-project#48155) Signed-off-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com>

vLLM main moved to torch 2.13.0 / torchvision 0.28.0 in vllm-project/vllm#48155, but tpu-inference has no direct torch pin and the torchvision==0.25.0 pin kept the TPU image on torch 2.10.0+cpu. Align with vLLM by bumping torchvision to 0.28.0 and adding an explicit torch==2.13.0 pin so the version is no longer implicit. Signed-off-by: Qiliang Cui <cuiq@google.com>

vLLM main moved off torch 2.11 (currently 2.13.0 since vllm-project/vllm#48155), while tpu-inference has no direct torch pin and the torchvision==0.25.0 pin kept the TPU image on torch 2.10.0+cpu. torch 2.13 is currently blocked: torchax (all released versions incl. 0.0.14 nightlies) fails at import because torch 2.13 removed the aten.prod.dim_Dimname overload referenced in torchax amp.py. torch 2.12.1 retains the Dimname overloads and torchax 0.0.13 imports cleanly, so move to 2.12.1 now and revisit 2.13 when torchax adapts. torchvision must move in lockstep (0.27.1 hard-pins torch==2.12.1). Signed-off-by: Qiliang Cui <cuiq@google.com>

….1 (vllm-project#48155) Signed-off-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Tej Kiran <kiran.tej@amd.com>

….1 (vllm-project#48155) Signed-off-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Andrey Talman <atalman@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>

vLLM main moved off torch 2.11 (currently 2.13.0 since vllm-project/vllm#48155), while tpu-inference has no direct torch pin and the torchvision==0.25.0 pin kept the TPU image on torch 2.10.0+cpu. torch 2.13 is currently blocked: torchax (all released versions incl. 0.0.14 nightlies) fails at import because torch 2.13 removed the aten.prod.dim_Dimname overload referenced in torchax amp.py. torch 2.12.1 retains the Dimname overloads and torchax 0.0.13 imports cleanly, so move to 2.12.1 now and revisit 2.13 when torchax adapts. torchvision must move in lockstep (0.27.1 hard-pins torch==2.12.1). Signed-off-by: Qiliang Cui <cuiq@google.com> Signed-off-by: dennis yeh <dennis.yeh@cienet.com>

atalman requested review from Harry-Chen, LucasWilkinson, khluu and tlrmchlsmth as code owners July 9, 2026 18:40

claude Bot reviewed Jul 9, 2026

View reviewed changes

mergify Bot added ci/build nvidia labels Jul 9, 2026

github-project-automation Bot added this to NVIDIA Jul 9, 2026

mergify Bot added the cpu Related to CPU backends label Jul 9, 2026

atalman force-pushed the update-pytorch-2.13.0 branch from c382886 to d102fca Compare July 9, 2026 18:49

atalman requested review from AndreasKaratzas, ApostaC, DarkLight1337, NickLucche, aarnphm, ivanium, orozery, robertgshaw2-redhat and ywang96 as code owners July 9, 2026 18:49

mergify Bot added multi-modality Related to multi-modality (#4194) v1 kv-connector labels Jul 9, 2026

atalman force-pushed the update-pytorch-2.13.0 branch from d102fca to 0c49a0f Compare July 9, 2026 18:52

mergify Bot added the needs-rebase label Jul 10, 2026

atalman force-pushed the update-pytorch-2.13.0 branch from 0c49a0f to 9359940 Compare July 13, 2026 22:35

mergify Bot removed the needs-rebase label Jul 13, 2026

atalman force-pushed the update-pytorch-2.13.0 branch from 9359940 to ac3e888 Compare July 13, 2026 22:39

rushabh-46 mentioned this pull request Jul 14, 2026

fix(moe): add metaclass bridge to FusedMoE factory to preserve isinstance() type checks for out-of-tree plugins under PyTorch 2.12.0 #48565

Open

atalman force-pushed the update-pytorch-2.13.0 branch from ac3e888 to ea724aa Compare July 14, 2026 12:55

LucasWilkinson mentioned this pull request Jul 21, 2026

[Attention] Overlap sparse MLA indexer with native streams atalman/vllm#2

Closed

LucasWilkinson added the ready ONLY add when PR is ready to merge/full CI is needed label Jul 22, 2026

vllm-bot merged commit 75ccdf3 into vllm-project:main Jul 23, 2026
239 of 242 checks passed

github-project-automation Bot moved this to Done in NVIDIA Jul 23, 2026

Change72 mentioned this pull request Jul 24, 2026

[CI Failure]: distributed-compile - test_compile_correctness[test_setting3] #49672

Closed

3 tasks

janbernloehr mentioned this pull request Jul 27, 2026

[Bug]: Qwen3.5/Qwen3-Next GDN attention crashes at warmup with torch.compile stride mismatch (expected size 3==3, stride 4097==512) — recurrence of #29014 on splitting_ops boundary #50046

Open

mckornfield mentioned this pull request Jul 27, 2026

chore: move python pin to <=3.14 NVIDIA-NeMo/Safe-Synthesizer#664

Merged

7 tasks

zou3519 mentioned this pull request Jul 28, 2026

[torch 2.13] umbrella issue - vLLM CI failures pytorch/pytorch#187473

Closed

9 tasks

ylangtsou mentioned this pull request Jul 31, 2026

Update torch version to 2.13.0+cpu #50412

Merged

4 tasks

QiliangCui mentioned this pull request Jul 31, 2026

Upgrade torch to 2.12.1 and torchvision to 0.27.1 vllm-project/tpu-inference#3311

Open

swjeong9 mentioned this pull request Aug 13, 2026

Update vLLM to v0.27.1 ddps-lab/vllm-disaggregation#6

Merged

qgallouedec mentioned this pull request Aug 13, 2026

Add support for vLLM 0.27.0 and 0.27.1 huggingface/trl#6742

Merged

oops-oom mentioned this pull request Aug 19, 2026

[BugFix][Kernel] Pass kv_cache_dtype as int to avoid stable-ABI host leak #50870

Closed

Navigation Menu

Uh oh!

Uh oh!

[Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 - #48155

[Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1#48155
vllm-bot merged 2 commits into
vllm-project:mainfrom
atalman:update-pytorch-2.13.0

atalman commented Jul 9, 2026 •

edited

Loading

Uh oh!

claude Bot left a comment

Uh oh!

mergify Bot commented Jul 10, 2026

Uh oh!

atalman commented Jul 14, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Uh oh!

Conversation

atalman commented Jul 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

torch-2.13 test adaptations (ported from #45731, production-adjusted)

Excluded (per scope)

Why not a duplicate

Test plan

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Claude Code Review

Uh oh!

mergify Bot commented Jul 10, 2026

Uh oh!

atalman commented Jul 14, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

atalman commented Jul 9, 2026 •

edited

Loading