Skip to content

feat(dynamo): integrate sidecar inference - #3181

Draft
biswapanda wants to merge 9 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/dyn-pi-sidecar-combined-v1-upstream
Draft

feat(dynamo): integrate sidecar inference#3181
biswapanda wants to merge 9 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/dyn-pi-sidecar-combined-v1-upstream

Conversation

@biswapanda

Copy link
Copy Markdown

Summary

This is the integration branch for end-to-end review and validation of the split Prime-RL changes needed by the Dynamo vLLM sidecar path. It combines:

  • vLLM 0.26 token-serving compatibility
  • checkpoint-boundary preservation
  • external-engine rank mapping
  • Dynamo worker discovery
  • native NCCL/NIXL weight transfer
  • filesystem LoRA lifecycle
  • Dynamo example recipes

Split PRs

The split PRs are the intended review and merge path. This draft provides a single branch for integration CI and end-to-end testing and should not be merged independently of that review sequence.

Compatibility

The Dynamo path remains opt-in through dynamo_discovery_url. Existing Prime-RL static, elastic, and Python vLLM paths remain the default. The branch is restacked on current upstream main, including the latest Verifiers and research-environments updates.

Test plan

  • Ruff passed on all changed Python files
  • 37 focused serving, discovery, topology, NCCL/NIXL, LoRA, orchestrator, and config tests passed
  • broader configuration collection reached optional tasksets absent from the reused local environment; Dynamo-specific configuration tests passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant