Skip to content

[1/4][Refactor] Refactor torchair worker#1885

Merged
wangxiyuan merged 1 commit intovllm-project:mainfrom
wangxiyuan:refactor_torchair_1
Jul 21, 2025
Merged

[1/4][Refactor] Refactor torchair worker#1885
wangxiyuan merged 1 commit intovllm-project:mainfrom
wangxiyuan:refactor_torchair_1

Conversation

@wangxiyuan
Copy link
Copy Markdown
Collaborator

@wangxiyuan wangxiyuan commented Jul 19, 2025

There is a lot torchair specified logic in common code. It results hard code maintenance. We will create a new torchair module to launch torchair related logic there. I plan to add 4 PR.

  1. Refactor worker (this PR)
    • create torchair module and move torchair related code in worker to the new module
  2. Refactor utils
  3. Refactor model_runner
  4. Refactor attention

@codecov
Copy link
Copy Markdown

codecov bot commented Jul 19, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 60.21%. Comparing base (8cfd257) to head (cff3d59).
⚠️ Report is 548 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1885      +/-   ##
==========================================
+ Coverage   60.17%   60.21%   +0.03%     
==========================================
  Files          71       71              
  Lines        7989     7997       +8     
==========================================
+ Hits         4807     4815       +8     
  Misses       3182     3182              
Flag Coverage Δ
unittests 60.21% <100.00%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@wangxiyuan wangxiyuan force-pushed the refactor_torchair_1 branch 2 times, most recently from 54956b1 to e1cdc08 Compare July 21, 2025 00:26
@wangxiyuan
Copy link
Copy Markdown
Collaborator Author

wangxiyuan commented Jul 21, 2025

I just update docstring and ut in new commit. The CI passed here: https://github.com/vllm-project/vllm-ascend/actions/runs/16405875733?pr=1885 No need to run the e2e again.

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
@wangxiyuan
Copy link
Copy Markdown
Collaborator Author

UT passed. Let's merge this in quick

@wangxiyuan wangxiyuan merged commit af56ae3 into vllm-project:main Jul 21, 2025
22 of 30 checks passed
@wangxiyuan wangxiyuan deleted the refactor_torchair_1 branch September 4, 2025 06:53
chopper0126 pushed a commit to chopper0126/vllm-ascend that referenced this pull request Sep 26, 2025
There is a lot torchair specified logic in common code. It results hard
code maintenance. We will create a new torchair module to launch
torchair related logic there. I plan to add 4 PR.

1. Refactor worker (this PR)
- create torchair module and move torchair related code in worker to the
new module
3. Refactor utils
4. Refactor model_runner
5. Refactor attention


- vLLM version: v0.9.2
- vLLM main:
vllm-project/vllm@8188196

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Angazenn pushed a commit to Angazenn/vllm-ascend that referenced this pull request Oct 21, 2025
There is a lot torchair specified logic in common code. It results hard
code maintenance. We will create a new torchair module to launch
torchair related logic there. I plan to add 4 PR.

1. Refactor worker (this PR)
- create torchair module and move torchair related code in worker to the
new module
3. Refactor utils
4. Refactor model_runner
5. Refactor attention


- vLLM version: v0.9.2
- vLLM main:
vllm-project/vllm@8188196

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Clorist33 pushed a commit to Clorist33/vllm-ascend that referenced this pull request Dec 9, 2025
There is a lot torchair specified logic in common code. It results hard
code maintenance. We will create a new torchair module to launch
torchair related logic there. I plan to add 4 PR.

1. Refactor worker (this PR)
- create torchair module and move torchair related code in worker to the
new module
3. Refactor utils
4. Refactor model_runner
5. Refactor attention


- vLLM version: v0.9.2
- vLLM main:
vllm-project/vllm@8188196

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants