Multi-node multi-instance vLLM via gym eval submit - #2597

Merged

oyilmaz-nvidia merged 92 commits into

mainfrom

onur/ray-service-multi-gpu

Aug 25, 2026

Commits on Jul 22, 2026

feat(orchestration): gym eval submit command
prokotg
committed
4d88403

Commits on Jul 28, 2026

move as much orchestration to a separate module
prokotg
committed
8f7ed77
base class for service type
prokotg
committed
748fd41
mark experimental
prokotg
committed
864a876
validate placements
prokotg
committed
356881c
only single compute with tests
prokotg
committed
743ce41
builder draft; update services
prokotg
committed
b243b9e
make ComputeConfig a desscriminated union
prokotg
committed
7e72d6f
connect to the host; replace gym env wait placeholder with a simple curl
prokotg
committed
6525533
make SlurmExecutor explicitly pyxis based
prokotg
committed
4c56c88
timestamp rundir and redirect logs
prokotg
committed
f1d9683
str-format sbatch script
prokotg
committed
a247be9
introduce a dry-run and improve socket handling
prokotg
committed
a7914f8
add account to slurm config; prefix remote dir
prokotg
committed
8f63fbe
get submit confirmation
prokotg
committed
d5c9b8a
slurm-native log handling; default container for the driver
prokotg
committed
ad69cd6

Commits on Jul 29, 2026

add health check validation
prokotg
committed
473a78f
gym eval run parameter passing yaml > CLI
prokotg
committed
ec63660
move argument passing out of SlurmExecutor
prokotg
committed
5e818bd
separate templating
prokotg
committed
0ae8867
PolicyModel config and synthactic sugar for wiring policy model with duplication back-off
prokotg
committed
be265f3
allow to install on the fly; do not allow extra across api
prokotg
committed
cf8ae94
switch from list to dict for benchmarks; overlap and no container mount home in indiviudla sruns
prokotg
committed
3d7fba1
add preparation stage as well
prokotg
committed
e4f1435
fix hydra force-override
prokotg
committed
a1f681e
add a dummy policy_api_key; change to local copy because we cannot resolve configs properly (?)
prokotg
committed
4d79207
add some more tests
prokotg
committed
8c27a4c
Add in-code doc comments
prokotg
committed
427346e
smarter entrypoint
prokotg
committed
9308727
cleanup tempdirs
prokotg
committed
c7487e9
Merge branch 'main' into tgrzegorzek/orchestration
prokotg
authored
eef3f1f
make CI happy
prokotg
committed
3d0a1ef
add missing spdx headers
prokotg
committed
8ec6fac
linting
prokotg
committed
2daaa18
fix ignored health path
prokotg
committed
be3a1a0
ignore dummy api key
prokotg
committed
2e263ea
linting
prokotg
committed
dd335c3
add exemplary config for orchestration
prokotg
committed
4afa47b

Commits on Aug 5, 2026

Add env variable injection support
oyilmaz-nvidia
committed
4391efb
Resolve merge conflicts
oyilmaz-nvidia
committed
ae0ed71
Fix merge conflicts
oyilmaz-nvidia
committed
b445576
Fix merge conflicts
oyilmaz-nvidia
committed
b3aba0c

Commits on Aug 7, 2026

Commits on Aug 10, 2026

Addressing the reviews
oyilmaz-nvidia
committed
39fb54f
Fix CI secret issue
oyilmaz-nvidia
committed
c688eb3
Merge branch 'main' into onur/orchestration-env-var-injection
oyilmaz-nvidia
authored
1a01216
Fix test issue
oyilmaz-nvidia
committed
e1ced0d
Merge branch 'onur/orchestration-env-var-injection' into onur/orchestration-art-output
oyilmaz-nvidia
committed
8d302aa
Revert output file changes
oyilmaz-nvidia
committed
6f75874
Check the mounts exist or not
oyilmaz-nvidia
committed
c2f6dc9

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 17, 2026

Merge branch 'main' into onur/multi-instance-vllm-service
oyilmaz-nvidia
authored
69f4780
Merge branch 'main' into onur/multi-instance-vllm-service
oyilmaz-nvidia
authored
3c968b5
Add ray based multi node
oyilmaz-nvidia
committed
83577b5

Commits on Aug 18, 2026

Support old ray command
oyilmaz-nvidia
committed
81a2663
Fix the deployment issue
oyilmaz-nvidia
committed
70a9089
Fix the issue
oyilmaz-nvidia
committed
878001b
Add DP support
oyilmaz-nvidia
committed
73e5cbb
Merge branch 'main' into onur/multi-instance-vllm-service
oyilmaz-nvidia
authored
0c426c8
Add number of GPUs check
oyilmaz-nvidia
committed
5d5a327
Merge branch 'main' into onur/multi-instance-vllm-service
oyilmaz-nvidia
authored
32edfef

Commits on Aug 19, 2026

Fix merge conflicts
oyilmaz-nvidia
committed
75bdc09
Remove the multi node pieces from this PR
oyilmaz-nvidia
committed
5b5dddf
merge main
oyilmaz-nvidia
committed
ca9a8b5
Remove the vllm_service type
oyilmaz-nvidia
committed
d82c18d
Merge branch 'main' into onur/multi-instance-vllm-service
oyilmaz-nvidia
authored
cc801f1
Untrack ray_serve multi-node scratch example
oyilmaz-nvidia
committed
25f6e2f
Untrack remaining onur scratch examples
oyilmaz-nvidia
committed
06c6b4f
Fix merge conflicts
oyilmaz-nvidia
committed
3f6cf68
Remove the distributed param
oyilmaz-nvidia
committed
a76b461
Untrack onur scratch examples
oyilmaz-nvidia
committed
098c42c
Add GPU number check
oyilmaz-nvidia
committed
0cdda1b

Commits on Aug 20, 2026

Fix merge conflicts
oyilmaz-nvidia
committed
a03455d

Commits on Aug 24, 2026

Address PR reviews
oyilmaz-nvidia
committed
d1ccb00
Merge branch 'main' into onur/ray-service-multi-gpu
oyilmaz-nvidia
authored
b772583