[Disagg][NIXL] Add staging buffer support for heterogeneous TP KV transfer#22536

Merged

ShangmingCai merged 25 commits into

sgl-project:mainfrom

YAMY1234:feat/nixl-staging-buffer-independent

May 13, 2026

Commits on Apr 7, 2026

[Disagg][NIXL] Add staging buffer support for heterogeneous TP KV transfer
YAMY1234
committed
Fix NIXL staging buffer: use cuMemCreate via custom_mem_pool
YAMY1234
committed
Refactor NIXL staging buffer: reduce code intrusion, align with mooncake pattern
YAMY1234
committed
Decouple NIXL staging from mooncake: use register_fn callback pattern
YAMY1234
committed
Restore original type: ignore, getattr, and is_dummy() conventions
YAMY1234
committed
Unify staging handler: fix is_dummy bug, generalize PrefillStagingStrategy, use StagingRegisterInfo in NIXL
YAMY1234
committed
Remove section divider comments added by refactor
YAMY1234
committed
Rename decode_info -> dst_info for consistency
YAMY1234
committed
Extract _send_kv_for_req to reduce add_transfer_request complexity
YAMY1234
committed

Commits on Apr 8, 2026

Commits on Apr 10, 2026

Commits on Apr 16, 2026

Merge branch 'main' into feat/nixl-staging-buffer-independent
YAMY1234
authored

Commits on Apr 17, 2026

refactor(nixl staging): address review feedback

YAMY1234
and
claude
committed

Commits on May 10, 2026

Merge upstream main into feat/nixl-staging-buffer-async

YAMY1234
and
cursoragent
committed

Commits on May 13, 2026

Merge branch 'main' into feat/nixl-staging-buffer-independent
ShangmingCai
authored