Skip to content

[HiCache] Supports Indexer layout for NSATokenToKVPoolHost#19912

Merged
xiezhq-hermann merged 5 commits into
sgl-project:mainfrom
antgroup:indexer_host_layout
Mar 10, 2026
Merged

[HiCache] Supports Indexer layout for NSATokenToKVPoolHost#19912
xiezhq-hermann merged 5 commits into
sgl-project:mainfrom
antgroup:indexer_host_layout

Conversation

@huangtingwei9988
Copy link
Copy Markdown
Collaborator

Motivation

Indexer supports layout, preparing for zero-copy to enable HicacheStorage's support for NSA.

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Review Process

  1. Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
  4. After green CI and required approvals, ask Merge Oncalls to merge.

Co-authored-by: hzh0425 <hzh0425@apache.org>
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@huangtingwei9988 huangtingwei9988 marked this pull request as draft March 5, 2026 03:18
@huangtingwei9988 huangtingwei9988 marked this pull request as ready for review March 6, 2026 07:28
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@huangtingwei9988
Copy link
Copy Markdown
Collaborator Author

/tag-run-ci-label

@github-actions github-actions Bot added the run-ci label Mar 6, 2026
@huangtingwei9988 huangtingwei9988 changed the title Supports Indexer layout for NSATokenToKVPoolHost [HiCache]Supports Indexer layout for NSATokenToKVPoolHost Mar 6, 2026
@huangtingwei9988 huangtingwei9988 changed the title [HiCache]Supports Indexer layout for NSATokenToKVPoolHost [HiCache] Supports Indexer layout for NSATokenToKVPoolHost Mar 6, 2026
@huangtingwei9988 huangtingwei9988 added the hicache Hierarchical Caching for SGLang label Mar 6, 2026
@huangtingwei9988 huangtingwei9988 added the ready-to-merge The PR is ready to merge after the CI is green. label Mar 9, 2026
@xiezhq-hermann xiezhq-hermann merged commit 254d3ce into sgl-project:main Mar 10, 2026
360 of 392 checks passed
liubiyongge pushed a commit to liubiyongge/sglang that referenced this pull request Mar 13, 2026
Wangzheee pushed a commit to Wangzheee/sglang that referenced this pull request Mar 21, 2026
00fish0 added a commit to 00fish0/sglang that referenced this pull request Mar 23, 2026
…e_first_direct)

Cherry-picked from:
- 254d3ce [HiCache] Supports Indexer layout for NSATokenToKVPoolHost (sgl-project#19912)
- 8787cf4 Fix the scope of io_backend in NSATokenToKVPoolHost (sgl-project#20327)

These are prerequisites for the NSA L3 storage PR.
JustinTong0323 pushed a commit to JustinTong0323/sglang that referenced this pull request Apr 7, 2026
yhyang201 pushed a commit to yhyang201/sglang that referenced this pull request Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hicache Hierarchical Caching for SGLang ready-to-merge The PR is ready to merge after the CI is green. run-ci

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants