Skip to content

[0.13.0][cherry-pick][bugfix] fix bug of triton mrope#6009

Merged
yiz-liu merged 1 commit intovllm-project:releases/v0.13.0from
ichaoren:releases/v0.13.0
Jan 20, 2026
Merged

[0.13.0][cherry-pick][bugfix] fix bug of triton mrope#6009
yiz-liu merged 1 commit intovllm-project:releases/v0.13.0from
ichaoren:releases/v0.13.0

Conversation

@ichaoren
Copy link
Copy Markdown
Contributor

What this PR does / why we need it?

fix pr: 5827
keep same with main branch.

Does this PR introduce any user-facing change?

How was this patch tested?

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to fix a bug in Triton MROPE and align the code with the main branch. The changes refactor the AscendMRotaryEmbedding class, including moving the forward_triton method and updating the condition to use it. However, the review identified two critical issues. First, the einops import was removed, but the library is still used elsewhere in the file, which will lead to a runtime error. Second, the new implementation of forward_triton contains redundant and confusing logic for calculating cos and sin values. I've provided suggestions to fix these issues.

Comment thread vllm_ascend/ops/rotary_embedding.py
Comment thread vllm_ascend/ops/rotary_embedding.py Outdated
Signed-off-by: ichaoren <fengjian5500@163.com>
@wangxiyuan wangxiyuan changed the title [bugfix] fix bug of triton mrope [0.13.0][bugfix] fix bug of triton mrope Jan 20, 2026
@wangxiyuan wangxiyuan changed the title [0.13.0][bugfix] fix bug of triton mrope [0.13.0][cherry-pick][bugfix] fix bug of triton mrope Jan 20, 2026
@yiz-liu yiz-liu added ready read for review ready-for-test start test by label for PR and removed ready-for-test start test by label for PR labels Jan 20, 2026
@yiz-liu yiz-liu merged commit 18eec9d into vllm-project:releases/v0.13.0 Jan 20, 2026
21 checks passed
845473182 pushed a commit to 845473182/vllm-ascend that referenced this pull request Jan 21, 2026
…lm-ascend into FIA_v0.13.0

* 'releases/v0.13.0' of https://github.com/vllm-project/vllm-ascend:
  [0.13.0][Bugfix] Fix setting of `speculative_config.enforce_eager` for dsv32 (vllm-project#5958)
  [v0.13.0][Bugfix] Fix XliteModelRunner init failed when aclgraph is enabled (vllm-project#5887)
  [0.13.0][Bugfix] Fixed an problem related to embeddings sharing (vllm-project#5972)
  [Bugfix]Fixed precision issues caused by pooled request pooling (vllm-project#6057)
  [0.13.0][Bugfix] fix pcp aclgraph qwen FIA bug (vllm-project#6038)
  [0.13.0][cherry-pick][bugfix] fix bug of triton mrope (vllm-project#6009)
  【0.13.0】【bugfix】Resolved memory deallocation failure in the pooling layer under re-computation workloads. (vllm-project#6056)
shaopeng-666 added a commit to shaopeng-666/vllm-ascend that referenced this pull request Jan 21, 2026
shaopeng-666 added a commit to shaopeng-666/vllm-ascend that referenced this pull request Jan 21, 2026
…roject#6009)"

This reverts commit 18eec9d.

Signed-off-by: 李少鹏 <lishaopeng21@huawei.com>
yiz-liu pushed a commit that referenced this pull request Jan 21, 2026
Reverts #6009

Signed-off-by: 李少鹏 <lishaopeng21@huawei.com>
starmountain1997 pushed a commit to starmountain1997/vllm-ascend that referenced this pull request Jan 31, 2026
)

### What this PR does / why we need it?
fix pr: [5827](vllm-project#5827)
keep same with main branch.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

Signed-off-by: ichaoren <fengjian5500@163.com>
starmountain1997 pushed a commit to starmountain1997/vllm-ascend that referenced this pull request Jan 31, 2026
tangtiangu pushed a commit to tangtiangu/jiusi-vllm-ascend that referenced this pull request Feb 24, 2026
)

### What this PR does / why we need it?
fix pr: [5827](vllm-project#5827)
keep same with main branch.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

Signed-off-by: ichaoren <fengjian5500@163.com>
tangtiangu pushed a commit to tangtiangu/jiusi-vllm-ascend that referenced this pull request Feb 24, 2026
tangtiangu pushed a commit to tangtiangu/jiusi-vllm-ascend that referenced this pull request Feb 24, 2026
)

### What this PR does / why we need it?
fix pr: [5827](vllm-project#5827)
keep same with main branch.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

Signed-off-by: ichaoren <fengjian5500@163.com>
tangtiangu pushed a commit to tangtiangu/jiusi-vllm-ascend that referenced this pull request Feb 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready read for review ready-for-test start test by label for PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants