Skip to content

support PCP#25852

Closed
LookAround0301 wants to merge 31 commits intovllm-project:mainfrom
LookAround0301:long_seq_dev
Closed

support PCP#25852
LookAround0301 wants to merge 31 commits intovllm-project:mainfrom
LookAround0301:long_seq_dev

Conversation

@LookAround0301
Copy link
Copy Markdown
Contributor

@LookAround0301 LookAround0301 commented Sep 29, 2025 •
edited by github-actions bot
Loading

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

@LookAround0301
[scheduler] support cp
6a84571 
Signed-off-by: LookAround <lixushi@huawei.com>
@LookAround0301
[bug fix] fix block size bug
4ec01d7 
Signed-off-by: LookAround <lixushi@huawei.com>
@mergify mergify bot added the v1 label Sep 29, 2025
LookAround0301 and others added 13 commits September 29, 2025 21:27
@LookAround0301
[bug fix] fix block size bug
ccb6239 
Signed-off-by: LookAround <lixushi@huawei.com>
@FENP
flashinfer backend support context parallel — decode phase
f064d1a
@FENP
flashinfer backend support context parallel — prefill phase
f649ffd
@pisceskkk @FENP
flashinfer backend support context parallel — custom mask and kv reorg
d604ae3
@FENP
add context_parallel_size to ensure_model_parallel_initialized
c0bbb52
@FENP
bug fix: only update decode seq_lens
3f418de
@pisceskkk @FENP
bug fix: update custom mask calc
817bc28
@LookAround0301 @FENP
[scheduler] support cp
3add9a3 
Signed-off-by: LookAround <lixushi@huawei.com>
@LookAround0301 @FENP
[bug fix] fix block size bug
a85aa69 
Signed-off-by: LookAround <lixushi@huawei.com>
@LookAround0301 @FENP
[bug fix] fix block size bug
880ddbf 
Signed-off-by: LookAround <lixushi@huawei.com>
@pisceskkk
support cp for flashinfer
de86d38 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
Merge remote-tracking branch 'origin/context-parallel-flashinfer' int…
abc6470 
…o long_seq_dev

Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@LookAround0301
[scheduler] support cp
f8afd97 
Signed-off-by: LookAround <lixushi@huawei.com>
@mergify
Copy link
Copy Markdown

mergify bot commented Oct 3, 2025

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @LookAround0301.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify bot added the needs-rebase label Oct 3, 2025
@pisceskkk
disable cudagraph global for cp
901028a 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[Feature] support multi-requests
cf4d3ab 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[typo] remove unused parameters
07f9920 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[ModelRunner] Refactor _update_tokens_for_cp
1407678 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[bugfix] type convert error
b40f23e 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@zhangsicheng5 zhangsicheng5 mentioned this pull request Oct 14, 2025
Merged
5 tasks
@pisceskkk pisceskkk mentioned this pull request Oct 14, 2025
Open
9 tasks
pisceskkk and others added 8 commits October 14, 2025 13:06
@pisceskkk
[flashinfer] Vectorized custom_mask computation
cdf2495 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[bugfix] add cp_world_size&cp_rank to AttentionImpl
50ab73c 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[format] break too long lines and add assert for variables of uncerta…
67b052c 
…in type

Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[format] Rename to distinguish different types of variables
b461a55 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[format] add error for unreachable branch.
c9fd35a 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[Perf] Persist some variables that require round-by-round initializat…
3212997 
…ion.

Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@pisceskkk
[format] isort
51cb1f2 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
@LookAround0301
Merge pull request #3 from pisceskkk/long_seq_dev
9f8290e 
[Feature] support multi-requests
@mergify mergify bot mentioned this pull request Oct 15, 2025
Closed
3 tasks
@FENP
Copy link
Copy Markdown
Contributor

FENP commented Oct 15, 2025

A new open PR #26864 replaces this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@njhill njhill Awaiting requested review from njhill njhill will be requested when the pull request is marked ready for review njhill is a code owner

@heheda12345 heheda12345 Awaiting requested review from heheda12345 heheda12345 will be requested when the pull request is marked ready for review heheda12345 is a code owner

@WoosukKwon WoosukKwon Awaiting requested review from WoosukKwon WoosukKwon will be requested when the pull request is marked ready for review WoosukKwon is a code owner

@robertgshaw2-redhat robertgshaw2-redhat Awaiting requested review from robertgshaw2-redhat robertgshaw2-redhat will be requested when the pull request is marked ready for review robertgshaw2-redhat is a code owner

@ywang96 ywang96 Awaiting requested review from ywang96 ywang96 will be requested when the pull request is marked ready for review ywang96 is a code owner

@alexm-redhat alexm-redhat Awaiting requested review from alexm-redhat alexm-redhat will be requested when the pull request is marked ready for review alexm-redhat is a code owner

@ApostaC ApostaC Awaiting requested review from ApostaC ApostaC will be requested when the pull request is marked ready for review ApostaC is a code owner

@orozery orozery Awaiting requested review from orozery orozery will be requested when the pull request is marked ready for review orozery is a code owner

@mgoin mgoin Awaiting requested review from mgoin mgoin will be requested when the pull request is marked ready for review mgoin is a code owner

@pavanimajety pavanimajety Awaiting requested review from pavanimajety pavanimajety will be requested when the pull request is marked ready for review pavanimajety is a code owner

@vadiklyutiy vadiklyutiy Awaiting requested review from vadiklyutiy vadiklyutiy will be requested when the pull request is marked ready for review vadiklyutiy is a code owner

@LucasWilkinson LucasWilkinson Awaiting requested review from LucasWilkinson LucasWilkinson will be requested when the pull request is marked ready for review LucasWilkinson is a code owner

@MatthewBonanni MatthewBonanni Awaiting requested review from MatthewBonanni MatthewBonanni will be requested when the pull request is marked ready for review MatthewBonanni is a code owner

@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao will be requested when the pull request is marked ready for review youkaichao is a code owner

@tlrmchlsmth tlrmchlsmth Awaiting requested review from tlrmchlsmth tlrmchlsmth will be requested when the pull request is marked ready for review tlrmchlsmth is a code owner

@houseroad houseroad Awaiting requested review from houseroad houseroad will be requested when the pull request is marked ready for review houseroad is a code owner

@hmellor hmellor Awaiting requested review from hmellor hmellor will be requested when the pull request is marked ready for review hmellor is a code owner

@yewentao256 yewentao256 Awaiting requested review from yewentao256 yewentao256 will be requested when the pull request is marked ready for review yewentao256 is a code owner

@ProExpertProg ProExpertProg Awaiting requested review from ProExpertProg ProExpertProg will be requested when the pull request is marked ready for review ProExpertProg is a code owner

Assignees

No one assigned

Labels

needs-rebase v1

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@LookAround0301 @FENP @pisceskkk