Skip to content

fix(router): preserve retained GPU inventory through native clears [D05] - #18023

Draft
yifjiang wants to merge 1 commit into
codex/kv-reuse-d04-retained-tierfrom
codex/kv-reuse-d05-retained-inventory
Draft

yifjiang wants to merge 1 commit into
codex/kv-reuse-d04-retained-tierfrom
codex/kv-reuse-d05-retained-inventory

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Make typed query/recovery results distinguish native clear from independent GPU history, including explicit GPU clear.

Review slice D05 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d04-retained-tier for a complete incremental review diff of 326 additions plus deletions, including tests, documentation and extraction glue.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added fix router Relates to routing, KV-aware routing, etc. labels Nov 4, 2026
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d05-retained-inventory branch from c88685b to ffdef11 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from d6f1284 to c11132c Compare November 4, 2026 08:16
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941615743 (attempt 2) on 1ed8d30eab

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941615743. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from c11132c to eb4033e Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d05-retained-inventory branch from ffdef11 to 85a6b2d Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 85a6b2d

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d04-retained-tier branch from eb4033e to 969eaf6 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d05-retained-inventory branch from 85a6b2d to 1ed8d30 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 1ed8d30

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

fix router Relates to routing, KV-aware routing, etc. size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant