fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script - #6695

Merged

GuanLuo merged 11 commits into

mainfrom

Mar 3, 2026

Commits on Mar 3, 2026

fix: fix vLLM config for DP > 1 to specify external (Dynamo) load balancing
GuanLuo
committed
64e4dff
fix: remove data_parallel_rank in generate call
GuanLuo
committed
aa8694d
chore: update script and add global dp to local dp conversion
GuanLuo
committed
4d5746c
fix: StatLoggerFactory creates loggers with given engine_idx (maps to DP rank)
GuanLuo
committed
4446360
fix: register each worker for DP. Each worker is responsible for creating stats logger, KV event publisher for its DP ranks
GuanLuo
committed
60a6238
chore: fix dsr1_dep.sh script KV event port
GuanLuo
committed
b67a2df
chore: add warning message on internal load balancing
GuanLuo
committed
4cdf748
chore: update warning message
GuanLuo
committed
73360c0
style: format
GuanLuo
committed
a68d75d
chore: fix clippy. Change log level
GuanLuo
committed
f0f78cc
chore: style
GuanLuo
committed
e510909