Skip to content

feat(router): configure calibrated opt-in prefix reuse with legacy wire defaults [D08] - #18026

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d07-source-hintsfrom
codex/kv-reuse-d08-calibrated-config
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d07-source-hintsfrom
codex/kv-reuse-d08-calibrated-config

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Independent CPU/GPU costs, validation, settings, and the exact advertisement/checksum projection; in-memory values stay intact. The existing Python binding constructor retains the new Rust defaults until D30 supplies all eight explicit kwargs.

Review slice D08 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d07-source-hints for a complete incremental review diff of 417 additions plus deletions, including tests, documentation and extraction glue.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

A dedicated retained-transfer YAML fixture checks all eight reuse settings. The shared Rust/Python fixture keeps the accepted schema until D30 extends the Python API and shared fixture together.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

At this exact D08 head, all 56 scheduling configuration tests passed, including the dedicated eight-setting fixture and unchanged legacy shared-fixture regression. Full Cargo formatting, all-target router Clippy and isolated indexer/slot feature checks also passed.

@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941629596 (attempt 1) on 942e02b259

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941629596. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d07-source-hints branch from bd81425 to 507f77b Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d08-calibrated-config branch 2 times, most recently from 438a8ac to eeba55d Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d07-source-hints branch from 507f77b to c3368a9 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test eeba55d

…re defaults

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d07-source-hints branch from c3368a9 to a07b8a9 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d08-calibrated-config branch from eeba55d to 942e02b Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 942e02b

@yifjiang yifjiang closed this Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant