Skip to content

feat(router): [cherry-pick 1.5.0] ship two-tier worker-selection policy (#14498) - #14901

Merged
nv-nmailhot merged 1 commit into
release/1.5.0from
idhanani/dyn-14498-release-1.5.0
Sep 16, 2026
Merged

nv-nmailhot merged 1 commit into
release/1.5.0from
idhanani/dyn-14498-release-1.5.0

Conversation

@ishandhanani

Copy link
Copy Markdown
Contributor

Summary

Cherry-pick #14498 (e03db5f6ea37919fdd9250eedb9e3bcddb7653b3) into release/1.5.0. Ships the two-tier worker-selection policy, enables custom-policy by default, and includes the original CI and documentation updates.

Resolved Cargo conflicts against the release branch and regenerated the bindings lockfile. The only code adaptation is using the release branch's router_hint_candidates and retain_router_hint_chain field names in the test fixture; production policy logic is unchanged.

Validation

  • cargo test --locked -p dynamo-custom-policy-builtin: 7 passed.
  • Python bindings cargo clippy --locked -- -D warnings, with default features and with --no-default-features: both passed.
  • Rust formatting and pre-commit checks on all changed files: passed.
  • Docs lint: 0 errors. Fern configuration and broken-link checks: passed.
  • No GPU benchmark run for this backport.

…icy (#14498)

Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
(cherry picked from commit e03db5f)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
@github-actions github-actions Bot added feat documentation Improvements or additions to documentation actions labels Sep 16, 2026
@github-actions

Copy link
Copy Markdown
Contributor

@dagil-nvidia
dagil-nvidia marked this pull request as ready for review September 16, 2026 23:19
@dagil-nvidia
dagil-nvidia requested review from a team as code owners September 16, 2026 23:19
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 16, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-09-16T23:22:57.216179Z 3dcc7c4 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@nv-nmailhot
nv-nmailhot merged commit 3507149 into release/1.5.0 Sep 16, 2026
37 of 38 checks passed
@nv-nmailhot
nv-nmailhot deleted the idhanani/dyn-14498-release-1.5.0 branch September 16, 2026 23:43
.expect("a configured instance resolves to a factory");

let partition = RoutingPartitionRef::new("model", "default");
for worker_type in [

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The per-role factory calls duplicate existing registry/config coverage: selected_worker_selection_policy_instances_apply_stage_precedence already verifies YAML stage selection, and resolved_factory_dispatches_role_specific_instances already verifies role dispatch. This built-in provider does not vary behavior by worker type, so one factory construction after resolving the documented YAML preserves the supported contract that the policy type and instance shape are linked and constructible.

🤖 AI Fix

Replace the loop with a single factory invocation for one worker type after the YAML resolution assertion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

actions documentation Improvements or additions to documentation feat size/XL

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants