[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Isotr0py · 2025-10-15T11:32:38Z

Purpose

Part fo [Feature]: Clean up vllm.utils #26900
Split pytorch related helper functions into single file

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Isotr0py <[email protected]>

mergify · 2025-10-15T15:23:13Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: Isotr0py <[email protected]>

Signed-off-by: isotr0py <[email protected]>

mergify · 2025-10-16T08:47:49Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: isotr0py <[email protected]>

Signed-off-by: Isotr0py <[email protected]>

Signed-off-by: isotr0py <[email protected]>

Signed-off-by: Isotr0py <[email protected]>

mergify · 2025-10-18T13:58:10Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: Isotr0py <[email protected]>

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]> Signed-off-by: Alberto Perdomo <[email protected]>

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <[email protected]> Signed-off-by: Icey <[email protected]> Co-authored-by: MengqingCao <[email protected]>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <[email protected]> Signed-off-by: Icey <[email protected]> Co-authored-by: MengqingCao <[email protected]> Signed-off-by: nwpu-zxr <[email protected]>

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]> Signed-off-by: 0xrushi <[email protected]>

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <[email protected]> Signed-off-by: Icey <[email protected]> Co-authored-by: MengqingCao <[email protected]> Signed-off-by: luolun <[email protected]>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <[email protected]> Signed-off-by: Icey <[email protected]> Co-authored-by: MengqingCao <[email protected]> Signed-off-by: hwhaokun <[email protected]>

Isotr0py and others added 2 commits October 7, 2025 20:59

draft

3765f9f

Signed-off-by: Isotr0py <[email protected]>

Merge branch 'vllm-project:main' into torch-utils

41cd6e9

mergify bot added deepseek Related to DeepSeek models multi-modality Related to multi-modality (#4194) tpu Related to Google TPUs labels Oct 15, 2025

mergify bot assigned sangstar Oct 15, 2025

update mop context

7dffb1e

Signed-off-by: Isotr0py <[email protected]>

mergify bot added the v1 label Oct 15, 2025

mergify bot added the needs-rebase label Oct 15, 2025

Isotr0py added 2 commits October 15, 2025 23:25

update

20876be

Signed-off-by: Isotr0py <[email protected]>

Merge remote-tracking branch 'upstream/main' into torch-utils

ea5ad7a

Signed-off-by: Isotr0py <[email protected]>

mergify bot removed the needs-rebase label Oct 15, 2025

move STR_DTYPE_TO_TORCH_DTYPE and kv_caches utils

a4ac619

Signed-off-by: Isotr0py <[email protected]>

mergify bot added the performance Performance-related issues label Oct 15, 2025

move current_stream

47601ee

Signed-off-by: isotr0py <[email protected]>

mergify bot added the kv-connector label Oct 16, 2025

move cuda_device_count_stateless

7cacad0

Signed-off-by: isotr0py <[email protected]>

mergify bot added the rocm Related to AMD ROCm label Oct 16, 2025

mergify bot added the needs-rebase label Oct 16, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

eaa7a95

Signed-off-by: isotr0py <[email protected]>

mergify bot removed the needs-rebase label Oct 16, 2025

Isotr0py added 2 commits October 16, 2025 21:27

weak_ref_tensors and get_cuda_view_from_cpu_tensor

b97b512

Signed-off-by: isotr0py <[email protected]>

move torch verison helper and ops registration

8648ac2

Signed-off-by: isotr0py <[email protected]>

mergify bot added llama Related to Llama models qwen Related to Qwen models labels Oct 16, 2025

Isotr0py and others added 3 commits October 16, 2025 22:36

rename torch_utils.py to torch.py

b0853f8

Signed-off-by: isotr0py <[email protected]>

fix import

32923fd

Signed-off-by: Isotr0py <[email protected]>

rename back to torch_utils to avoid conflicts

9a78766

Signed-off-by: isotr0py <[email protected]>

Merge remote-tracking branch 'upstream/main' into torch-utils

515c98c

Signed-off-by: Isotr0py <[email protected]>

mergify bot removed the needs-rebase label Oct 18, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

218714e

Signed-off-by: Isotr0py <[email protected]>

mergify bot added the needs-rebase label Oct 18, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

81c925c

Signed-off-by: Isotr0py <[email protected]>

mergify bot removed the needs-rebase label Oct 18, 2025

move kv_cache_dtype_str_to_dtype

2c28a3a

Signed-off-by: Isotr0py <[email protected]>

vllm-bot merged commit 6ac5e06 into vllm-project:main Oct 18, 2025
74 of 76 checks passed

Isotr0py deleted the torch-utils branch October 18, 2025 17:15

dongbo910220 mentioned this pull request Oct 18, 2025

[Chore] Separate out hashing utilities from vllm.utils #27151

Merged

wxsIcey mentioned this pull request Oct 20, 2025

[main] Fix main to vllm newer commit vllm-project/vllm-ascend#3544

Closed

lywa1998 pushed a commit to lywa1998/vllm that referenced this pull request Oct 20, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

dfa953f

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

maobaolong mentioned this pull request Oct 20, 2025

[FIX][Adapt_vllm] Fix ci failed by get_kv_cache_torch_dtype missed LMCache/LMCache#1833

Merged

adabeyta pushed a commit to adabeyta/vllm that referenced this pull request Oct 20, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

47e208d

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

This was referenced Oct 23, 2025

Upgrade to new vllm commit and Refactor DeepSeekV3.2 vllm-project/vllm-ascend#3644

Closed

Upgrade to new vllm commit vllm-project/vllm-ascend#3663

Closed

wxsIcey mentioned this pull request Oct 24, 2025

Upgrade to new vllm commit vllm-project/vllm-ascend#3719

Merged

ilmarkov pushed a commit to neuralmagic/vllm that referenced this pull request Nov 7, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

2bdff5e

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

rtourgeman pushed a commit to rtourgeman/vllm that referenced this pull request Nov 10, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

a200819

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

Zhathw pushed a commit to Zhathw/vllm that referenced this pull request Nov 12, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

c833328

…ct#26908) Signed-off-by: Isotr0py <[email protected]> Signed-off-by: isotr0py <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Uh oh!

Isotr0py commented Oct 15, 2025 •

edited by github-actions bot

Loading

Uh oh!

mergify bot commented Oct 15, 2025

Uh oh!

mergify bot commented Oct 16, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Uh oh!

[Chore] Clean up pytorch helper functions in vllm.utils #26908

[Chore] Clean up pytorch helper functions in vllm.utils #26908

Uh oh!

Conversation

Isotr0py commented Oct 15, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

mergify bot commented Oct 15, 2025

Uh oh!

mergify bot commented Oct 16, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Isotr0py commented Oct 15, 2025 •

edited by github-actions bot

Loading