[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments - #44428

Merged

tlrmchlsmth merged 16 commits into

vllm-project:mainfrom

fangyuchu:feature/ft-simplify

Jul 25, 2026

Commits on Jul 25, 2026

Fault Tolerance Framework (#229)

committed
56aca6c
unify param name for nixl and deepep and destroy old cpu_group in retry (#230)
fangyuchu
committed
7f7c375
Surface exception to status
fangyuchu
committed
579be78
change status report mode from pull to push
fangyuchu
committed
397ae14
simplify fault tolerance config args
fangyuchu
committed
c20d2f1
use existing get_all2all_manager implementation
fangyuchu
committed
e5ee323
support tp>1 (#241)
fangyuchu
committed
3ed1aab
Enhance the pass of fault tolerance results (#242)
fangyuchu
committed
89b31e0
clean states for model runner v2
fangyuchu
committed
ced92b5
add support for fault detection throuth mask for model runner v2
fangyuchu
committed
6ee0981
[FT] validate single API server, fix clean_buffers ordering and worker state cleanup
fangyuchu
committed
cac0e6a
[FT] make apply endpoint async and gate recovery by engine status
fangyuchu
committed
90cb72e
add e2e test for fault tolerance
fangyuchu
committed
df0befe
add e2e test for retry recovery
fangyuchu
committed
a44ee3d
refactor e2e tests with concurrent polling and add Buildkite CI config (#250)
fangyuchu
committed
4f6fe58
set cpu timeout to default value of nixl-ep in test (#251)
fangyuchu
committed
5be79f8