[Unified Radix Cache] Complete the tree-core interface boundary - #33580
Merged
merrymercy merged 2 commits intoAug 5, 2026
Merged
merrymercy merged 2 commits into
merrymercy merged 2 commits into
Conversation
Contributor
|
Caution The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased. |
Jialin
marked this pull request as ready for review
August 4, 2026 17:22
Jialin
requested review from
Ying1123,
alphabetc1,
hanming-lu,
hnyls2002,
hzh0425,
ispobock,
merrymercy,
xiezhq-hermann and
yizhang2077
as code owners
August 4, 2026 17:22
Contributor
|
Caution The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased. |
Collaborator
Author
|
/tag-run-ci-label |
Collaborator
Author
|
/tag-and-rerun-ci |
62 tasks
kfhfar
pushed a commit
to kfhfar/sglang
that referenced
this pull request
Aug 7, 2026
saturn-acc
pushed a commit
to saturn-acc/sglang
that referenced
this pull request
Aug 16, 2026
Jianhong-Zhang
pushed a commit
to Jianhong-Zhang/sglang
that referenced
this pull request
Aug 18, 2026
jakki-amd
pushed a commit
to jakki-amd/sglang
that referenced
this pull request
Sep 9, 2026
Atituiset
pushed a commit
to Atituiset/sglang
that referenced
this pull request
Sep 10, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
UnifiedRadixCachestill reaches into Python tree-core implementation details for several operations, which weakens theUnifiedTreeCoreInterfaceabstraction and makes alternate tree-core implementations harder to integrate and maintain.This PR completes the applicable OSS interface boundary while preserving existing Python tree-core behavior.
Modifications
UnifiedTreeCoreInterfacemethods for retrieving the root handle, reading node-local hash values, and evicting excess Mamba path state.The corresponding internal Rust-backend changes are intentionally excluded because that backend has no tracked OSS counterpart.
Accuracy Tests
This is a behavior-preserving interface refactor and does not change model forward computation or expected model outputs.
libcrypto.so.3was unavailable.Speed Tests and Profiling
Not run. This change only redirects existing cache operations through the tree-core interface and adds a one-time initialization log; it does not modify cache algorithms or model execution.
Checklist
Review and Merge Process
/tag-and-rerun-ci,/tag-run-ci-label,/rerun-failed-ci.CI States
Latest PR Test (Base): ❌ Run #30933545094
Latest PR Test (Extra): ❌ Run #30933544005