Skip to content

oproj TP support acl graph#4073

Merged
wangxiyuan merged 6 commits intovllm-project:mainfrom
zzhx1:oproj
Nov 11, 2025
Merged

oproj TP support acl graph#4073
wangxiyuan merged 6 commits intovllm-project:mainfrom
zzhx1:oproj

Conversation

@zzhx1
Copy link
Copy Markdown
Contributor

@zzhx1 zzhx1 commented Nov 9, 2025

What this PR does / why we need it?

Reference #2167 and orpoj TP supports ACL graph.

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Nov 9, 2025

👋 Hi! Thank you for contributing to the vLLM Ascend project. The following points will speed up your PR merge:‌‌

  • A PR should do only one thing, smaller PRs enable faster reviews.
  • Every PR should include unit tests and end-to-end tests ‌to ensure it works and is not broken by other future PRs.
  • Write the commit message by fulfilling the PR description to help reviewer and future developers understand.

If CI fails, you can run linting and testing checks locally according Contributing and Testing.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to enable oproj tensor parallelism for ACL graphs. The change in vllm_ascend/ascend_config.py correctly modifies the condition to allow this feature in any graph mode by checking if eager mode is enforced, instead of checking for a specific graph implementation (torchair). This change is correct, safe, and effectively addresses the goal of the pull request. I have no issues to report.

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
zzhx1 added 4 commits November 9, 2025 20:28
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
@zzhx1
Copy link
Copy Markdown
Contributor Author

zzhx1 commented Nov 10, 2025

@jianzs Please push this PR for merging.

Copy link
Copy Markdown
Collaborator

@jianzs jianzs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jianzs jianzs added ready read for review ready-for-test start test by label for PR labels Nov 10, 2025
@zzhx1
Copy link
Copy Markdown
Contributor Author

zzhx1 commented Nov 11, 2025

@wangxiyuan Please merge this PR, this is a small feature support, no other conflicts.

@wangxiyuan wangxiyuan merged commit 46a41b2 into vllm-project:main Nov 11, 2025
54 of 55 checks passed
luolun pushed a commit to luolun/vllm-ascend that referenced this pull request Nov 19, 2025
### What this PR does / why we need it?
Reference vllm-project#2167 and orpoj TP supports ACL graph.

- vLLM version: v0.11.0
- vLLM main:
vllm-project/vllm@83f478b

---------

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: luolun <luolun1995@cmbchina.com>
hwhaokun pushed a commit to hwhaokun/vllm-ascend that referenced this pull request Nov 19, 2025
### What this PR does / why we need it?
Reference vllm-project#2167 and orpoj TP supports ACL graph.

- vLLM version: v0.11.0
- vLLM main:
vllm-project/vllm@83f478b

---------

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: hwhaokun <haokun0405@163.com>
NSDie pushed a commit to NSDie/vllm-ascend that referenced this pull request Nov 24, 2025
### What this PR does / why we need it?
Reference vllm-project#2167 and orpoj TP supports ACL graph.

- vLLM version: v0.11.0
- vLLM main:
vllm-project/vllm@83f478b

---------

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Signed-off-by: nsdie <yeyifan@huawei.com>
Clorist33 pushed a commit to Clorist33/vllm-ascend that referenced this pull request Dec 10, 2025
### What this PR does / why we need it?
Reference vllm-project#2167 and orpoj TP supports ACL graph.

- vLLM version: v0.11.0
- vLLM main:
vllm-project/vllm@83f478b

---------

Signed-off-by: zzhx1 <zzh_201018@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

module:core module:tests ready read for review ready-for-test start test by label for PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants