Skip to content

feat(inference): normalize native routed experts - #3484

Open
biswapanda wants to merge 3 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/routed-experts-transfer
Open

biswapanda wants to merge 3 commits into
PrimeIntellect-ai:mainfrom
biswapanda:feat/routed-experts-transfer

Conversation

@biswapanda

Copy link
Copy Markdown
Contributor

Summary

  • normalize native terminal routed-expert NumPy payloads into Prime-RL's existing replay envelope at the renderer boundary
  • validate base64 size, NumPy headers, exact byte counts, rank-three shape, integer dtype, byte order, and expert-index bounds before allocation or replay
  • preserve the existing legacy dictionary envelope unchanged
  • install the wrapper idempotently in environment workers so trainer replay receives the normalized route data

This is the routed-expert increment following #3481, #3482, and #3483. Until those dependencies merge, this fork PR is cumulative against main; it remains draft until the exact routed-experts Kubernetes gate passes.

Validation

  • Ruff and Python compilation passed on all changed files
  • focused Dynamo adapter and native routed-payload tests: 86 passed
  • independent correctness and security review of bounded NPY parsing and worker-hook behavior
  • the frozen routed source passed local tests and produced Kubernetes binaries; the native preflight and exact five-step routed-expert training gate are pending and are not claimed as passed

Dependencies

@biswapanda
biswapanda force-pushed the feat/routed-experts-transfer branch 7 times, most recently from 0e7ce43 to 767cec3 Compare September 7, 2026 06:48
@biswapanda
biswapanda marked this pull request as ready for review September 8, 2026 06:01
@biswapanda
biswapanda force-pushed the feat/routed-experts-transfer branch from 767cec3 to 5b58a8d Compare September 14, 2026 04:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant