Skip to content

feat(inference): support tensor-parallel Dynamo workers - #3618

Open
biswapanda wants to merge 2 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/dynamo-tp-workers
Open

biswapanda wants to merge 2 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/dynamo-tp-workers

Conversation

@biswapanda

@biswapanda biswapanda commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Accept a strict positive world size from the single discovered Dynamo sidecar while retaining the one-logical-worker constraint.
  • Include world size in the pinned topology identity and reject configured/discovered TP mismatches before NCCL initialization.
  • Initialize the broadcaster with the full inference world size and validate one successful collective result per TP rank.

Validation

  • uv run --frozen pytest tests/unit/inference/test_dynamo.py -q (17 passed)
  • uv run --frozen ruff check src/prime_rl/inference/dynamo.py tests/unit/inference/test_dynamo.py
  • uv run --frozen ruff format --check src/prime_rl/inference/dynamo.py tests/unit/inference/test_dynamo.py
  • TP=2 Qwen3-0.6B + MathEnv completed 3/3 NCCL training steps on the dev GPU pod at a556ad26e; policy versions v0-v3 transferred successfully with zero rollout errors or truncation. The current tip only inlines the unchanged topology tuple and removes its redundant direct test.

@biswapanda
biswapanda marked this pull request as ready for review September 21, 2026 23:00

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant