Add CodeBuild CI + minimal SGLang overlay - #1
Merged
Merged
Conversation
Scaffold-only Dockerfile lacked pip install; would produce base-only image. Adding minimal overlay: - pip install sglang[all]==0.5.6.post2 - torch/nccl/nvshmem pin guards matching v0.2.5 base Wave 29 will materialize full adapter (sgl-project/sglang#24443) + JIT cache.
Wave 29 prep: - Minimal SGLang 0.5.6.post2 overlay (full adapter TBD) - CodeBuild buildspec + pins.env matching sibling pattern - NCCL/NVSHMEM pin guards for v0.2.5 base Unblocks Plan A Wave 29 cross-node smoke.
dmvevents
added a commit
that referenced
this pull request
May 7, 2026
Previous overlay ran 'pip install sglang[all]' which hard-pins torch==2.9.1 (cu12), silently downgrading nvidia-nvshmem-cu12 over our cu13 pin and breaking deep_ep._C.so ABI (undefined symbol: nvshmem_selected_device_transport). New approach: install sglang with --no-deps, then curate runtime deps minus torch/flashinfer/nvidia-*-cu12. Base's cu13 stack stays untouched. EVIDENCE-LEDGER Wave 7d invariant #1: 'torch silently pins nvidia-nccl + nvidia-nvshmem; never let wrong torch in via transitive deps.' Wave 29 smoke on the old build showed: NCCL cross-node PASS (16-rank all_reduce, 0 XML overflow), deep_ep FAIL. This isolates the issue to the overlay, not the base. Note: flashinfer-python 0.5.3 requires torch 2.9 APIs that torch 2.11 lacks. SGLang features that route through flashinfer FP8 MoE will fall back to another kernel path. Acceptable trade-off for Wave 29 smoke.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Wave 29 prep. Minimal overlay for smoke tests; full sgl-project/sglang#24443 adapter + JIT cache TBD.