Skip to content

feat(kvbm): own CUDA IPC cache banks and balance export lifetimes [D16] - #18034

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d15-fabric-identitiesfrom
codex/kv-reuse-d16-cuda-ipc-owners
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d15-fabric-identitiesfrom
codex/kv-reuse-d16-cuda-ipc-owners

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Typed IPC geometry, owned local access, one-time export consumption and cleanup; no host-payload staging.

Review slice D16 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d15-fabric-identities for a complete incremental review diff of 301 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • Introduce the functional TP1 open_region path here; complete rank/FABRIC validation remains D22.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941663683 (attempt 2) on 9c2fd8a519

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941663683. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d16-cuda-ipc-owners branch from 7ccbd63 to 84b1627 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d15-fabric-identities branch 2 times, most recently from 11b0b2c to b7d2837 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d16-cuda-ipc-owners branch 2 times, most recently from a9205ce to 4022870 Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d15-fabric-identities branch from b7d2837 to 09788de Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d16-cuda-ipc-owners branch from 4022870 to 92047e4 Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d15-fabric-identities branch from 09788de to 91dfab4 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 92047e4

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d16-cuda-ipc-owners branch from 92047e4 to 9c2fd8a Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 9c2fd8a

@yifjiang yifjiang closed this Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant