Skip to content

ci: switch sglang to prebuilt PyPI wheels (v0.5.11) - #2535

Merged
terrykong merged 7 commits into
mainfrom
kajalj/sglang-prebuilt-wheels
May 29, 2026
Merged

ci: switch sglang to prebuilt PyPI wheels (v0.5.11)#2535
terrykong merged 7 commits into
mainfrom
kajalj/sglang-prebuilt-wheels

Conversation

@kajalj22

@kajalj22 kajalj22 commented May 20, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Upgrade sglang 0.5.10 → 0.5.11 and sglang-kernel 0.4.1 → 0.4.2, switching from source builds to prebuilt PyPI wheels
  • Eliminates the slow sglang-kernel CUDA compilation during Docker builds
  • Possible because sglang v0.5.11 declares torch==2.11.0, matching our torch pin after the vLLM 0.20.0 upgrade in chore: Upgrade vLLM from 0.17.1 to 0.20.0 #2384 (now merged)

Dependency changes (pyproject.toml)

  • Pinned sglang==0.5.11 and sglang-kernel==0.4.2 as regular PyPI deps
  • Removed VCS git source entries for sglang and sglang-kernel from [tool.uv.sources]
  • Removed sglang-kernel from extra-build-variables, no-build-isolation-package, and extra-build-dependencies
  • Removed manual [[tool.uv.dependency-metadata]] sections for sglang and sglang-kernel (uv reads metadata from PyPI directly)
  • Updated override-dependencies comments (flashinfer now aligned between vllm and sglang at 0.6.8.post1)
  • Regenerated uv.lockscikit-build-core dropped, easydict/kernels added, torchao bumped 0.9.0 → 0.17.0

Port fix (sglang_worker.py)

  • sglang v0.5.11 derives grpc_port = port + 10000 and validates <= 65535
  • Added retry loop to cap the server port at 55535 so grpc_port stays valid

CI / test changes

  • Removed SKIP_SGLANG_BUILD=1 from cicd-main.yml — sglang now installs from PyPI, no source compilation to skip
  • Removed python -c "import sglang" guards from test scripts (reverts c45e889) — sglang is always installed

Risks / things to verify

  • CUDA arch compatibility: PyPI sglang-kernel wheels should include sm_90a (Hopper) and sm_100a (Blackwell) — needs runtime validation
  • transformers override: sglang v0.5.11 declares transformers==5.6.0 but our override forces 5.3.0 — needs functional testing
  • xgrammar override: sglang v0.5.11 wants 0.1.32, we override to 0.1.33 for CVE fix
  • torchao bump: sglang v0.5.11 pulls in torchao==0.17.0 (up from 0.9.0) — verify no regressions

Test plan

  • Build Docker image successfully (verify sglang-kernel installs from PyPI, no source compilation)
  • Run sglang unit tests (test_sglang_non_divisible_batch_handling etc.)
  • Run sglang functional/nightly tests (GRPO with sglang inference backend)

🤖 Generated with Claude Code

@kajalj22
kajalj22 requested review from a team as code owners May 20, 2026 17:30
@copy-pr-bot

copy-pr-bot Bot commented May 20, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@kajalj22

Copy link
Copy Markdown
Contributor Author

/ok to test d702b90

@kajalj22 kajalj22 added the CI:L1 Run doctests, unit tests, and functional tests label May 20, 2026
@kajalj22 kajalj22 changed the title deps: switch sglang to prebuilt PyPI wheels (v0.5.11) ci: switch sglang to prebuilt PyPI wheels (v0.5.11) May 20, 2026
@kajalj22
kajalj22 marked this pull request as draft May 20, 2026 17:40
@kajalj22
kajalj22 force-pushed the kajalj/sglang-prebuilt-wheels branch from d702b90 to a0e27d8 Compare May 21, 2026 05:13
@kajalj22

Copy link
Copy Markdown
Contributor Author

/ok to test a0e27d8

@copy-pr-bot

copy-pr-bot Bot commented May 22, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the CI Relating to CI label May 22, 2026
@kajalj22 kajalj22 changed the title ci: switch sglang to prebuilt PyPI wheels (v0.5.11) deps: switch sglang to prebuilt PyPI wheels (v0.5.11) May 22, 2026
@kajalj22
kajalj22 marked this pull request as ready for review May 24, 2026 22:06
@kajalj22
kajalj22 requested a review from a team as a code owner May 24, 2026 22:06
@copy-pr-bot

copy-pr-bot Bot commented May 24, 2026

Copy link
Copy Markdown

Auto-sync is disabled for ready for review pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@kajalj22

Copy link
Copy Markdown
Contributor Author

/ok to test b04b711

@kajalj22

Copy link
Copy Markdown
Contributor Author

/ok to test 03cbabb

@terrykong
terrykong merged commit d25ce82 into main May 29, 2026
39 checks passed
@terrykong
terrykong deleted the kajalj/sglang-prebuilt-wheels branch May 29, 2026 02:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI:L1 Run doctests, unit tests, and functional tests CI Relating to CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants