[andrewzyxing]

Overview

Allow the Runtime EPP to install the worker-selection catalog supplied by its binary, including Dynamo's shipped named providers for the stock run(None) path. This extends the documented standalone-only catalog boundary; it was discovered while developing the Runtime EPP/Frontend conformance coverage in #17580.

The configured catalog reaches the existing native routers through their process registry and typed worker roles. Unconfigured routing retains the builtin default; duplicate shipped type names and repeated installation fail explicitly.

Key Changes

49 added production-code lines, excluding tests, comments and blank lines. No new dependency, shared router API, registry global or request-path synchronization.

• Runtime bootstrap: prepare the complete supplied catalog, register shipped named providers, and install it once before discovery/router construction. run uses this mode dispatch; Standalone keeps its existing registry path.
• Classifier boundary: reject configured Runtime request classifiers explicitly. Installing a catalog does not implement their request lifecycle.
• Regression coverage and docs: cover named parameters/default/mode retention, invalid configuration, supplied providers, Standalone pass-through and a process-isolated Runtime bootstrap followed by a real ModelManager Prefill router. Update the custom-policy guides for the Runtime catalog contract.

Validation

Current head: ef340a91dccb1ac69cf7ae143cf9a86dd9e918c1, based on main 7e9dc291b12a8ae66459396725f727924eaa8029.

Fixed-head Linux validation is pending. Initial CI on f339b9e3 reported Rustfmt differences and two E0282 errors in the test-factory closures. Follow-up ef340a91 corrects all reported differences and gives both factories an explicit expected type. No fixed-head formatter, compilation, clippy or test pass is claimed yet. No project commands ran on the Mac mini. The official Linux Rust jobs will validate this public source; a separate CPU run is needed only if those results leave a gap.

Added coverage, not yet executed:

• Shipped named-default parameter snapshots for Aggregated/Prefill/Decode, plus builtin-default and routing-mode controls, unknown types and invalid parameters.
• Duplicate registration, caller-provider retention, Standalone bootstrap and unsupported classifier configuration.
• An isolated libtest child checks an uninstalled UnknownType control, calls the actual Runtime mode bootstrap, constructs a native ModelManager router and observes the Prefill role/model partition, then checks repeated-install failure.

The uninstalled control is not a historical executable baseline run. The host-construction test is not a live Gateway or independent disaggregated routing test. Classifier lifecycle and live Gateway/disaggregated execution remain follow-up work.

Issues and Ongoing Work

Part of #16591 and #16595. This addresses the worker-selection catalog refusal described in #16591; that issue stays open for classifier and request-lifecycle work. Discovered while working on #17580; its conformance changes remain in their separate PR.

• feat(router): add custom worker-selection policy catalog #12536 and feat(epp): run custom selection services through standard bootstrap #12720 established custom catalogs and the standalone EPP bootstrap; this extends the Runtime path.
• feat(router): make worker-selection plugins support host-path routing modes #17712/refactor(router): refactor random/RR/LL/pow-of-2 as builtin plugins #17713 and chore(router): remove power-of-two and plugin-API paths marked for 1.7.0 removal #17899 provide the current builtin routing-mode registry; its default/mode behavior is retained.
• feat(epp): route aggregated requests through the frontend RoutingHost (stacked on #17292) #17293 is the separate RoutingHost/lifecycle integration. This PR keeps the existing Runtime router construction and adds no request lifecycle.
• feat(epp): add role-scoped worker catalogs for standalone disaggregated routing #13756 covers standalone role-scoped worker catalogs; no standalone topology change is included here.

Pull Request Checklist

• I used Dynamo's /pr-checklist skill.

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[github-actions]

👋 Hi andrewzyxing! Thank you for contributing to ai-dynamo/dynamo.

Just a reminder: The NVIDIA Test Github Validation CI runs an essential subset of the testing framework to quickly catch errors.Your PR reviewers may elect to test the changes comprehensively before approving your changes.

🚀

[andrewzyxing]

@ishandhanani @jthomson04 Discovered while developing the Runtime EPP/Frontend conformance coverage in #17580. Please review this Draft's one-time linked-registry installation, typed-role policy consumption and preservation of the builtin default, and confirm that this direction fits the separate RoutingHost work in #17293.

Request-classifier execution remains unsupported in this change. The PR description records the exact scope and validation status.