Bump sglang to v0.5.15 - #1655
Merged
Merged
Conversation
- Dockerfile: SGLANG_IMAGE_TAG v0.5.14 -> v0.5.15, SGLANG_BRANCH sglang-miles -> sglang-miles-v0.5.15 - build.py cu12-x86: SGLANG_IMAGE_TAG v0.5.12-cu129 -> v0.5.15-cu129
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
This comment was marked as resolved.
This comment was marked as resolved.
Sorry, something went wrong.
…pterFromTensorsReqInput
…pr=sglang-miles-v0.5.15
…_update, pull_weights, load_lora_adapter_from_distributed endpoints (v0.5.15 FastAPI)
…in/End/PullWeightsReqOutput) in weight_updater
The final-rollout forced save (should_run_periodic_action) writes a ~220GB megatron dist checkpoint that dominates the 2250s CI timeout (write workers throttled in balance_dirty_pages on overlayfs). Nothing in the smoke test consumes the checkpoint; save/load coverage lives in dedicated tests. save_interval=None disables all saves incl. the forced final one. Also: fixture Pinaster/GLM-5.2_5layer config.json fixed upstream (HF commit 1c74913) — mlp_layer_types/indexer_types trimmed to 5 entries for transformers>=5.12 validate_layer_type.
…obal sglang >= 0.5.15 moved server-args storage into runtime_context; get_global_server_args() no longer reads the legacy module-private _global_server_args that p2p._create_cpu_replica was writing. The trainer-side CPU replica build (get_model -> get_rope -> is_true_on_policy_enabled) then raised 'Global server args is not set yet!'. set_global_server_args_for_scheduler() is the public setter on both v0.5.14 (writes the module global) and v0.5.15 (publishes into runtime_context).
yueming-yuan
requested review from
Shi-Dong,
Zhichenzzz,
fzyzcjy,
maocheng23 and
yushengsu-thu
as code owners
July 14, 2026 22:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
ci-image-tag: bump-sglang-v0.5.15-test
ci-sglang-pr: sglang-miles-v0.5.15
Summary
Bump sglang-miles from v0.5.14 → v0.5.15.
docker/Dockerfile:SGLANG_IMAGE_TAGv0.5.14 → v0.5.15,SGLANG_BRANCHsglang-miles → sglang-miles-v0.5.15docker/build.py(cu12-x86):SGLANG_IMAGE_TAGv0.5.12-cu129 → v0.5.15-cu129sglang branch
sglang-miles-v0.5.15(24 commits rebased onto tag v0.5.15). Notable: dropped #26980 (already upstream in v0.5.15); folded #27750 into the weight-update-sessions commit; kept v0.5.15's upstreamed ComparableWeight comparator incl. the #29623 ue8m0 scale-unpack fix.Testing
Docker build via
docker-build.ymlworkflow_dispatch (variant cu13-x86): https://github.com/radixark/miles/actions/runs/29290296331Notes
yueming-yuan/miles-wheels) left at v0.5.12; building as-is — will revisit if ABI-incompatible with v0.5.15.