Skip to content

feat(kvbm): drain GPU transfer jobs before reset and shutdown [D25] - #18043

Draft
yifjiang wants to merge 1 commit into
codex/kv-reuse-d24-gpu-endpoint-ownershipfrom
codex/kv-reuse-d25-gpu-transfer-lifetimes
Draft

yifjiang wants to merge 1 commit into
codex/kv-reuse-d24-gpu-endpoint-ownershipfrom
codex/kv-reuse-d25-gpu-transfer-lifetimes

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

One primary pin spans all rank parts, completion waits for every worker, cleanup is serialized, uncertain native shutdown cannot release live storage.

Review slice D25 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d24-gpu-endpoint-ownership for a complete incremental review diff of 392 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • Typed-envelope and framework-key delivery regressions land with asynchronous transfer processing.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941699952 (attempt 2) on ff0c1f0162

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941699952. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d25-gpu-transfer-lifetimes branch from aaef6b1 to 47a838e Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d24-gpu-endpoint-ownership branch 2 times, most recently from 0a75f9e to 6d04be5 Compare November 4, 2026 08:28
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d25-gpu-transfer-lifetimes branch from 47a838e to 9b58003 Compare November 4, 2026 08:28
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d24-gpu-endpoint-ownership branch from 6d04be5 to b253b02 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d25-gpu-transfer-lifetimes branch 2 times, most recently from 964ce23 to c6bfb00 Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d24-gpu-endpoint-ownership branch from b253b02 to ab1e14f Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d25-gpu-transfer-lifetimes branch from c6bfb00 to 4f425bf Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d24-gpu-endpoint-ownership branch from ab1e14f to 211b7c1 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

1 similar comment
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 4f425bf

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d25-gpu-transfer-lifetimes branch from 4f425bf to ff0c1f0 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test ff0c1f0

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant