Skip to content

[Unified Cache Linker][3/N]: Add backend-independent linker core - #37151

Merged
hzh0425 merged 1 commit into
sgl-project:mainfrom
hzh0425:external-linker-core
Aug 31, 2026
Merged

hzh0425 merged 1 commit into
sgl-project:mainfrom
hzh0425:external-linker-core

Conversation

@hzh0425

@hzh0425 hzh0425 commented Aug 30, 2026

Copy link
Copy Markdown
Collaborator

Summary

This is the third PR split from #35687.

  • Add the backend-independent external linker interface and tree-side wrapper.
  • Integrate direct load/offload lifecycle hooks into UnifiedRadixCache.
  • Add focused unit tests for linker state and lock handling.

Previous splits: #37091 and #37098.

Test

  • test_unified_cache_linker.py: 11 passed on test-2-sglang.
  • Ruff and Python compilation checks passed.

CI States

Latest PR Test (Base): ⏳ Run #33325476798
Latest PR Test (Extra): 🚫 Run #33325605623
Latest PR Test (AMD ROCm 7.2): ❌ Run #33325476754

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
@hzh0425

hzh0425 commented Aug 30, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-test test/registered/unit/mem_cache/test_unified_cache_linker.py

@github-actions

github-actions Bot commented Aug 30, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test/registered/unit/mem_cache/test_unified_cache_linker.py:

🚀 ubuntu-latest (1 test): ✅ View workflow run

cd test/ && python3 registered/unit/mem_cache/test_unified_cache_linker.py

@hzh0425

hzh0425 commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-group radix_cache/unified_radix_tree

@github-actions

github-actions Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-group radix_cache/unified_radix_tree:

🚀 4-gpu-h100 (4 tests): ✅ View workflow run

cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_hicache_pp_kl.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_cp.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_dsv4.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_mamba.py

🚀 4-gpu-b200 (1 test): ✅ View workflow run

cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_dcp.py

🚀 8-gpu-h200 (3 tests): ✅ View workflow run

cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_dsv4_pp.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_glm52.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_mimo.py

🚀 2-gpu-h100 (2 tests): ✅ View workflow run

cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_full.py
cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_swa.py

🚀 1-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_hybrid_bitexact.py

@hzh0425

hzh0425 commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-test test/registered/unit/mem_cache/test_hiradix_pp_sync_drain.py

@github-actions

github-actions Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test/registered/unit/mem_cache/test_hiradix_pp_sync_drain.py:

🚀 ubuntu-latest (1 test): ✅ View workflow run

cd test/ && python3 registered/unit/mem_cache/test_hiradix_pp_sync_drain.py

@hzh0425

hzh0425 commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator Author
image

@hzh0425
hzh0425 merged commit 5d92e60 into sgl-project:main Aug 31, 2026
325 of 413 checks passed
saturn-acc pushed a commit to saturn-acc/sglang that referenced this pull request Aug 31, 2026
nzr-niu pushed a commit to nzr-niu/sglang that referenced this pull request Sep 1, 2026
RolaoDenthu pushed a commit to RolaoDenthu/sglang that referenced this pull request Sep 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants