[1/N] Elastic EP Milestone 2#34861

Merged

tlrmchlsmth merged 40 commits intovllm-project:mainfrom

itayalroy:eep_m2_rebase

Feb 28, 2026

Commits on Feb 26, 2026

eep phase: stateless group + CUDA graph support

libertyeagle
authored and
itayalroy
committed
fix precommit

tlrmchlsmth
authored and
itayalroy
committed
require current vllm config to be set in init_model_parallel as well

tlrmchlsmth
authored and
itayalroy
committed
partially handle review comments from cursor

tlrmchlsmth
authored and
itayalroy
committed
use allgather_reducescatter instead of pplx

tlrmchlsmth
authored and
itayalroy
committed
update

tlrmchlsmth
authored and
itayalroy
committed
world_size -> world_size_across_dp for executor selection

tlrmchlsmth
authored and
itayalroy
committed
dummy_weights -> load_dummy_weights and fix cpu model runner

tlrmchlsmth
authored and
itayalroy
committed
fixup

tlrmchlsmth
authored and
itayalroy
committed
set current vllm config in tests

tlrmchlsmth
authored and
itayalroy
committed
more vllm config wrestling

tlrmchlsmth
authored and
itayalroy
committed
More current_vllm_config fixes

tlrmchlsmth
authored and
itayalroy
committed
precommit

tlrmchlsmth
authored and
itayalroy
committed
[CI Fix] Fix tests to set vllm_config before initialize_model_parallel

rtourgeman
authored and
itayalroy
committed
[CI Fix] Fix circular reference between AsyncLLM and output_handler

rtourgeman
authored and
itayalroy
committed
Remove support dynamo
itayalroy
committed
Create a stateless EPLB group for elastic EP
itayalroy
committed
Pass sp_size to FusedMoEParallelConfig.make
itayalroy
committed
Fix eplb is async field name
itayalroy
committed
Fix is_ep_communicator check
itayalroy
committed
Reinit modular kernel on EP scaling events
itayalroy
committed
Implement destroy for DeepEP
itayalroy
committed
Torch recompile on existing ranks after scale up/down
itayalroy
committed
Single api server in test elastic ep
itayalroy
committed
Reduce memory util in test_elastic_ep.py
itayalroy
committed
Force stop ray procs between tests
itayalroy
committed
Defer elastic EP port allocation to after ray.init()
itayalroy
committed
Graceful comm group destruction on scale-down
itayalroy
committed
Move elastic EP standby groups into dedicated module
itayalroy
committed
Deduplicate local_all_ranks calculation
itayalroy
committed
Fix vllm config in tests
itayalroy
committed
Require PP=1 for elastic EP
itayalroy
committed
Fix ZMQ port TOCTOU in MPClient
itayalroy
committed
Revert pplx kernels installation changes
itayalroy
committed
Fix dp weight transfer send/recv mismatch
itayalroy
committed
Remove unused param max_concurrent_workers
itayalroy
committed
Update dp_size in vllm_config used in create_standby_groups
itayalroy
committed
Fixed staged barrier possible race
itayalroy
committed
Fix test_elastic_ep path
itayalroy
committed

Commits on Feb 27, 2026

Merge branch 'main' into eep_m2_rebase
tlrmchlsmth
committed