Skip to content

feat(router): distinguish retained GPU residency from native execution [D04] - #18022

Draft
yifjiang wants to merge 1 commit into
codex/kv-reuse-d02-isolated-migrationfrom
codex/kv-reuse-d04-retained-tier
Draft

yifjiang wants to merge 1 commit into
codex/kv-reuse-d02-isolated-migrationfrom
codex/kv-reuse-d04-retained-tier

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

GpuDirect stays distinct from native Device/G1. Preserve salted roots and GPU MM exclusions across native clears; never credit retained rows as execution hits.

Review slice D04 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d03-planner-parser for a complete incremental review diff of 459 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • GPU capability metadata derive/docs move to D09 with their type. Enum readers and mocker/consolidator cases stay atomic.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added the feat label Nov 4, 2026
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d03-planner-parser branch from 683348f to abe98fe Compare November 4, 2026 07:40
@yifjiang
yifjiang changed the base branch from codex/kv-reuse-d03-planner-parser to codex/kv-reuse-d02-isolated-migration November 4, 2026 07:40
@pull-request-size pull-request-size Bot added size/XL and removed size/L labels Nov 4, 2026
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from d6f1284 to c11132c Compare November 4, 2026 08:16
@pull-request-size pull-request-size Bot added size/L and removed size/XL labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941613819 (attempt 2) on 969eaf638a

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941613819. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from c11132c to eb4033e Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d02-isolated-migration branch from 0880eb3 to da59cf7 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test eb4033e

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d02-isolated-migration branch from da59cf7 to 9b09765 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from eb4033e to 969eaf6 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 969eaf6

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant