[Elastic EP] Support Model Runner V2 - #53934

Open

almogtavor wants to merge 29 commits into

vllm-project:mainfrom

almogtavor:mrv2-elastic-ep

Commits on Aug 26, 2026

[Elastic EP] Support Model Runner V2
almogtavor
committed
fb971a6

Commits on Sep 7, 2026

[Elastic EP] Isolate MRV2 warmup state instead of skipping the warmup
almogtavor
committed
3abc725

Commits on Sep 10, 2026

Merge branch 'main' into mrv2-elastic-ep
almogtavor
authored
1e3378f

Commits on Sep 11, 2026

Support elastic EP warmup with reserved slots
almogtavor
committed
f0fad46
Merge branch 'main' into mrv2-elastic-ep
almogtavor
authored
3b98fa0
refactor: improve warmup handling by removing reserved slot configurations and simplifying request state management
almogtavor
committed
4119d7b
Merge branch 'main' into mrv2-elastic-ep
almogtavor
authored
1755262
refactor: enhance request handling and warmup conditions in GPU model runner
almogtavor
committed
fa23c77
refactor: improve logging for request draining in AsyncLLM
almogtavor
committed
6ef02bb
Drop unrelated whitespace, formatting and comment changes in worker and config
almogtavor
committed
babb214
Explain the null block redirect flag on BlockTables
almogtavor
committed
0b3f7dc
Move the dp property comment inside each property and remove dead warmup and commit guards
almogtavor
committed
2921bd9
Move the MRV2 warmup context manager onto EPLBController and drop the dead state snapshots
almogtavor
committed
0097800
Drop the AsyncLLM admission lock and register parallel sampling children before the first engine send
almogtavor
committed
8b5bfee

Commits on Sep 12, 2026

Merge branch 'main' into mrv2-elastic-ep
almogtavor
committed
c1f8042

Commits on Sep 13, 2026

Move preserve_serving_state onto the MRV2 model runner
almogtavor
committed
fbea15a

Commits on Sep 15, 2026

Suppress EPLB stepping during Elastic EP warmup and drop mocked tests
almogtavor
committed
ca7b124

Commits on Sep 18, 2026

Commits on Sep 19, 2026

[Elastic EP] Document the drain assumption of preserve_serving_state
almogtavor
committed
b4de0a5

Commits on Sep 23, 2026

Update vllm/v1/engine/core_client.py

almogtavor
and
njhill
authored
2b339b0

Commits on Sep 24, 2026

Commits on Sep 25, 2026

Update vllm/v1/worker/gpu/model_runner.py

almogtavor
and
njhill
authored
a9ca522
[Elastic EP] Move the MRV2 warmup isolation into eplb_utils
almogtavor
committed
8db0a00