Skip to content

Add IntraNode NVLink configration in PD disaggregation docs#23329

Merged
wisclmy0611 merged 4 commits into
sgl-project:mainfrom
TTThanos:Feature/update-IntraNode-nvlink-docs
May 14, 2026
Merged

Add IntraNode NVLink configration in PD disaggregation docs#23329
wisclmy0611 merged 4 commits into
sgl-project:mainfrom
TTThanos:Feature/update-IntraNode-nvlink-docs

Conversation

@TTThanos
Copy link
Copy Markdown
Contributor

Motivation

Add IntraNode NVLink configuration in PD disaggregation docs:
Users can launch SGlang server by using extra environment variables

export SGLANG_MOONCAKE_CUSTOM_MEM_POOL=INTRA_NODE_NVLINK export MC_INTRANODE_NVLINK=true

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

@TTThanos TTThanos requested a review from wisclmy0611 as a code owner April 21, 2026 06:15
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Apr 21, 2026
@stmatengss
Copy link
Copy Markdown
Collaborator

Please use pre-commit to format codes. docs/advanced_features/pd_disaggregation.md:136: awared ==> awarded

@TTThanos
Copy link
Copy Markdown
Contributor Author

Please use pre-commit to format codes. docs/advanced_features/pd_disaggregation.md:136: awared ==> awarded

Done

@TTThanos
Copy link
Copy Markdown
Contributor Author

Hi Mingyi @wisclmy0611 , thank you for your time and please help to review this PR. 🚀

@wisclmy0611
Copy link
Copy Markdown
Collaborator

Hi @TTThanos Could you pls resolve the conflict? Thanks!

@TTThanos
Copy link
Copy Markdown
Contributor Author

Hi @TTThanos Could you pls resolve the conflict? Thanks!

Hi @wisclmy0611 conflict solved. 😊

@wisclmy0611 wisclmy0611 merged commit 0680f1b into sgl-project:main May 14, 2026
42 checks passed
@315930399
Copy link
Copy Markdown

Hi, if this feature is still not available using docker images?

@TTThanos
Copy link
Copy Markdown
Contributor Author

Hi, if this feature is still not available using docker images?

Yep, I think so. To make sure you can leverage this feature successfully, you may need to git clone Mooncake repo and compile Mooncake enabling intraNode nvlink related cmake flags. :)

Shunkangz pushed a commit to Shunkangz/sglang that referenced this pull request May 27, 2026
…ect#23329)

Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
alphabetc1 pushed a commit to alphabetc1/sglang that referenced this pull request Jun 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants