[Disaggregated Prefill] P2P Disaggregated Prefill based on llm_datadist#694

Merged

ganyi1996ppo merged 16 commits into

vllm-project:mainfrom

whx-sjtu:p2p_pd_sep

May 1, 2025

Commits on May 1, 2025

rebase1

hw_whx
authored and
whx-sjtu
committed
fix problems with dp proxy and register to dp proxy in worker

hw_whx
authored and
whx-sjtu
committed
fix bugs in model runner

hw_whx
authored and
whx-sjtu
committed
fix rebase problems

hw_whx
authored and
whx-sjtu
committed
fix review problems

hw_whx
authored and
whx-sjtu
committed
enable dummy run for disaggregate prefill

ganyi1996ppo
authored and
whx-sjtu
committed
modify requirements.txt

hw_whx
authored and
whx-sjtu
committed
format issue fix

ganyi1996ppo
authored and
whx-sjtu
committed
change the choosing strategy of P-D device pairs

hw_whx
authored and
whx-sjtu
committed
fix dummy run with the assumption that decode node always get into the same path

ganyi1996ppo
authored and
whx-sjtu
committed
mypy issue fix
ganyi1996ppo
committed
fix for non dp scenario
ganyi1996ppo
committed
fix for non dp scenario
ganyi1996ppo
committed
update the gpu_memory_utilization to 0.8 for mtp test to preventing oom during e2e test
ganyi1996ppo
committed
disable spec decode for ci which may cause oom issue
ganyi1996ppo
committed
disable spec decode for ci which may cause oom issue
ganyi1996ppo
committed