Skip to content

[Chore] docker: Add Beam CUDA image (1/8) - #45253

Merged
Fridge003 merged 2 commits into
mainfrom
beam-stack-01-docker
Oct 20, 2026
Merged

Fridge003 merged 2 commits into
mainfrom
beam-stack-01-docker

Conversation

@Jiminator

@Jiminator Jiminator commented Oct 19, 2026 •

Copy link
Copy Markdown
Collaborator

Motivation

Split #44747 into reviewable parts. This is the Beam CUDA Docker image part, position 1 of 8 in the merge order below. Its branch starts from #44747's merge base with main. No other part depends on it or includes it.

Modifications

Adds docker/beam/beam.Dockerfile, a Beam serving image on top of lmsysorg/sglang:v0.5.22, following docker/muse_spark/muse-spark.Dockerfile. It clones the upstream beam branch (pin a commit with BEAM_REF) and installs it without dependencies. It then adds the two pins that branch needs on top of the release: OpenAI 2.8.0 for the Responses shell types and nvidia-cuda-tileiras 13.4.92 for the cuTile router GEMM. The Dynamo and grpcio-tools pins moved to #45292.

docker/Dockerfile is not changed by any part. This image is a stopgap: delete it once Beam runs from the main image.

This part changes 1 file (+31 / -0) beyond the parts its branch carries.

Validation

Merge order

Every part targets main. #44747 stays open, unchanged, as the full reference. Merge in this order:

  1. [Chore] docker: Add Beam CUDA image (1/8) #45253 — Beam CUDA Docker image
  2. [Chore] deps: Bump the OpenAI SDK to 2.8.0 for Responses shell tools (2/8) #45291 — OpenAI SDK 2.8.0, needed by the Responses shell tools in [Feat] parser: Add Beam reasoning, tool calls and response templates (5/7) #45257
  3. [Feat] kernels: Beam model support #45254 — Kernels
  4. [Feat] srt: Add attention, memory and DFlash DP support for Beam (4/8) #45255 — Attention, memory and DFlash DP support
  5. [Feat] beam: Add Beam model, runtime support and checkpoints (4/7) #45256 — Beam model, checkpoints and tests
  6. [Feat] parser: Add Beam reasoning, tool calls and response templates (5/7) #45257 — Beam reasoning, tool calls and response templates (also after [Feat] parser: Enrich chat_parsing streaming events #40478, [Fix] parser: Accept whole-number floats for integer tool arguments #43941 and [Feat] parser: Add checkpoint-driven response-template adapters #40479)
  7. [Chore] deps: Add nvidia-cuda-tileiras for the optional cuTile router #45290 — nvidia-cuda-tileiras, needed by [Perf] beam: Add optional cuTile BF16x3 router GEMM #45361
  8. [Perf] beam: Add optional cuTile BF16x3 router GEMM #45361 — cuTile BF16x3 router GEMM (optional: without it Beam uses the cuBLAS router)

#45292 (Dynamo and grpcio-tools pins for the Beam image) is not in the merge order for now.

🤖 Generated with Claude Code

Add a Beam serving image on top of the v0.5.22 release image. It clones the upstream beam branch and adds the pins that branch needs, without changing docker/Dockerfile.

Split from #44747.
Beam serving does not use Dynamo, and the v0.5.22 release already
resolves grpcio-tools 1.84.0. The pins move to their own PR so they
can be dropped without touching this layer.
@Fridge003
Fridge003 merged commit d69966f into main Oct 20, 2026
103 of 109 checks passed
@Fridge003
Fridge003 deleted the beam-stack-01-docker branch October 20, 2026 20:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants