Skip to content

feat(kvbm): bind typed CUDA and NVML fabric observation [D18] - #18036

Draft
yifjiang wants to merge 1 commit into
codex/kv-reuse-d17-rank-local-workersfrom
codex/kv-reuse-d18-typed-cuda-fabric
Draft

yifjiang wants to merge 1 commit into
codex/kv-reuse-d17-rank-local-workersfrom
codex/kv-reuse-d18-typed-cuda-fabric

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Correct 64-bit FFI signatures, exact handle kind/size and native observation. This is not a fabric-allocation activation PR.

Review slice D18 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d17-rank-local-workers for a complete incremental review diff of 460 additions plus deletions, including tests, documentation and extraction glue.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

⏹️ Dynamo PR CI cancelled — run 41941673575 (attempt 1) on ada5e7f003

Gate checks: ❌ backend-status-check · ❌ deploy-status-check · ✅ dynamo-status-check

Framework Build Deploy
vLLM ⏹️ 2 ✅ 4 ⏹️ 1 ✅ 3

Failure details

The cancelled jobs exceeded their execution time limits, according to GitHub's job annotations; these were not reported as fail-fast or manual/concurrency cancellations.

⏹️ vllm-runtime-efa / Build multi-arch cuda13.0: cancelled during Build and Push Image; annotation: "The job has exceeded the maximum execution time of 1h0m0s".

⏹️ vllm-dev / Build multi-arch cuda13.0: cancelled during Build and Push Image; annotation: "The job has exceeded the maximum execution time of 1h0m0s".

⏹️ vllm Deploy Test / agg: cancelled during Run Dynamo Deploy Test; annotation: "The job has exceeded the maximum execution time of 25m0s".

For agents
{"pr": 18036, "run_id": 41941673575, "run_attempt": 1, "head_sha": "ada5e7f0034b5e4294bdf77c1c2da8e3091e6fc9", "failures": []}

Posted automatically by Devin for run 41941673575. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 731684c to 9eda452 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d17-rank-local-workers branch from 128bc19 to 744ba69 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 9eda452 to 7eff72f Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d17-rank-local-workers branch from 744ba69 to 254b528 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 7eff72f to e4beb7c Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d17-rank-local-workers branch from 4e1e60a to fe1e047 Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from e4beb7c to 62c981a Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 62c981a

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 62c981a to ada5e7f Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test ada5e7f

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant