Multimodal nemo gym compatible grpo pipeline

[rohitrango]

What does this PR do ?

Adds multimodal, multiturn sync/async grpo with nemo gym environments.

Currently supports multi-image , multi-turn, tool calling on nemotron omni models (other models not verified).

Also contains some starter scripts.

Issues

List issues that this PR closes (syntax):

Usage

• You can potentially add a usage example below

# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

• Make sure you read and followed Contributor guidelines
• Did you write any new necessary tests?
• Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
• Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

mult prob errors and reward validation on toy environments:

1. polygon naming (list name and color of polygon from 3 images - 2 images shown in turn 1 and 1 image shown in turn 2 via tool calls) - tests multi-turn tool calling capabilities

2. doorkey env (multi-turn, async)

3. tangram (single turn async)

[copy-pr-bot]

Auto-sync is disabled for ready for review pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.