Multimodal nemo gym compatible grpo pipeline - #3325

Closed

rohitrango wants to merge 18 commits into

mainfrom

rohit/gymv-mm-integration

Commits on Jul 15, 2026

feat(megatron): integrate canonical Nemotron Omni model
aroshanghias-nvd
committed
e099b82

Commits on Jul 16, 2026

feat(multimodal): support Nemotron Omni image batches
aroshanghias-nvd
committed
42e4b35
feat(vllm): support Nemotron Omni generation parity
aroshanghias-nvd
committed
393fe23
feat(nemotron-omni): add Nano GRPO recipes
aroshanghias-nvd
committed
b8f0e97
style(nemotron-omni): apply repository formatting
aroshanghias-nvd
committed
b16217e
docs(nemotron-omni): document Megatron GRPO support
aroshanghias-nvd
committed
31d577b
chore: refresh uv lockfile
aroshanghias-nvd
committed
cbe1333
chore: update Megatron-Bridge pin
aroshanghias-nvd
committed
a2f0c95

Commits on Jul 20, 2026

refactor: generalize multimodal tensor padding
aroshanghias-nvd
committed
df0db31

Commits on Jul 21, 2026

merge commit for backup
rohitrango
committed
b16fca2
sync single-step seems to work
rohitrango
committed
5486b57
update uv
rohitrango
committed
4f6e793
increase seq len
rohitrango
committed
28ba38e
tried tangram env
rohitrango
committed
81f885f

Commits on Jul 22, 2026

async plumbing
rohitrango
committed
aa04447
use 16 generations for better grpo signal
rohitrango
committed
ecf72e4
maintain consistency of chat_template kwargs b/w vllm and HF
rohitrango
committed
cd349d0

Commits on Jul 23, 2026

multi-turn multi-modal tool calling config for reference
rohitrango
committed
7171787