Skip to content

[distributed] Minimal independent transfer API — review MVP - #3

Draft
samnordmann wants to merge 2 commits into
snordmann/transfer-review-base-20260917from
snordmann/nixl-transfer-core-v0
Draft

samnordmann wants to merge 2 commits into
snordmann/transfer-review-base-20260917from
snordmann/nixl-transfer-core-v0

Conversation

@samnordmann

@samnordmann samnordmann commented Sep 17, 2026 •

Copy link
Copy Markdown
Owner

User-requested scope: “The goal here is to obtain a mvp prototype that will get technical review.”

AI-assisted, fork-only draft for human technical review.

Minimal independent memory-transfer API: Endpoint, Registration, prepared Catalog and Work. Inject the provider; Core has no NIXL dependency. Includes indexed READ/WRITE, opaque notifications, one host lock and explicit caller-ready/event-wait modes.

Removed compiled helpers, slots, recovery machinery, metadata protocols and unrelated changes. Close permits completed work only; active cancellation/failure recovery is deliberately deferred.

Validation: 8 CPU tests in test/distributed/test_transfer.py passed using the source module over installed Torch 2.9.0. All 6 CPU walkthrough steps ran successfully. No native/GPU, graph or performance-parity claim.

Review question: is this the smallest useful provider-neutral boundary? Compare/converge with upstream #197032 before upstream submission. Human line-by-line review is pending.

Provider: NIXL #3. Consumers: vLLM #2, SGLang #1, verl #1.

Snapshot of the current endpoint-transfer prototype for review in the author's fork. Native GPU performance parity and full end-to-end framework validation remain open; this is not an upstream-ready change.

Assisted-by: OpenAI Codex
Signed-off-by: Samuel Nordmann <snordmann@nvidia.com>
Keep ownership, prepared catalogs, READ/WRITE and explicit readiness. Remove compiled dispatch, recovery machinery and unrelated changes. Success-path prototype only; native validation remains pending.

Assisted-by: OpenAI Codex
Signed-off-by: Samuel Nordmann <snordmann@nvidia.com>
@samnordmann samnordmann changed the title [distributed] Prototype independent endpoint-transfer API [distributed] Minimal independent transfer API — review MVP Sep 17, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant