Skip to content

[env] Make max KV chunk capacity configurable via SGLANG_MAX_KV_CHUNK_CAPACITY#25120

Merged
Fridge003 merged 1 commit into
mainfrom
kp/add-knobs-tune-kv-chunk-capacity
May 13, 2026
Merged

[env] Make max KV chunk capacity configurable via SGLANG_MAX_KV_CHUNK_CAPACITY#25120
Fridge003 merged 1 commit into
mainfrom
kp/add-knobs-tune-kv-chunk-capacity

Conversation

@kpham-sgl
Copy link
Copy Markdown
Collaborator

Motivation

Change hardcoded value in get_max_chunk_capacity into an env var knob

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions github-actions Bot added documentation Improvements or additions to documentation deepseek labels May 13, 2026
@mintlify
Copy link
Copy Markdown
Contributor

mintlify Bot commented May 13, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
lmsysorg 🟢 Ready View Preview May 13, 2026, 2:36 AM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@kpham-sgl
Copy link
Copy Markdown
Collaborator Author

/tag-and-rerun-ci

@Fridge003 Fridge003 merged commit c665ede into main May 13, 2026
140 of 165 checks passed
@Fridge003 Fridge003 deleted the kp/add-knobs-tune-kv-chunk-capacity branch May 13, 2026 05:37
SimonCao1207 pushed a commit to SimonCao1207/sglang that referenced this pull request May 13, 2026
Shunkangz pushed a commit to Shunkangz/sglang that referenced this pull request May 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepseek documentation Improvements or additions to documentation run-ci

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants