build(vllm): consume protocol SDKs from Buf - #12980
Draft
connorcarpenter15 wants to merge 14 commits into
Draft
Conversation
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Contributor
connorcarpenter15
force-pushed
the
feat/vllm-sidecar-control-discovery
branch
2 times, most recently
from
August 12, 2026 00:24
b501531 to
9b0962b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
This build layer removes the vendored vLLM protocol and consumes the generated Rust SDKs directly from the Buf Schema Registry.
Details
vllm-project_vllm_community_neoeinstein-prostandvllm-project_vllm_community_neoeinstein-toniccrates for BSR commit7726adbdafb34bda85e25c8fc5e192f4.cargo:tokencredential provider in.cargo/config.toml.BUF_TOKENsecret to Cargo asCARGO_REGISTRIES_BUF_TOKEN="Bearer ..."in pre-merge, nightly, and reusable Rust CI.Authentication
BUF_TOKEN.CARGO_REGISTRIES_BUF_TOKEN="Bearer ${BUF_TOKEN}"or runcargo login --registry buf "Bearer ${BUF_TOKEN}".--secret id=buf_token,env=BUF_TOKEN.Validation
cargo clippy -p dynamo-sidecar-common -p dynamo-vllm-sidecar -p dynamo-vllm-mocker --all-targets -- -D warningscargo fmt --all -- --checkcargo metadata --locked --offline --no-deps --format-version 1pre-commit run check-yaml --files .github/workflows/pre-merge.yml .github/workflows/nightly-ci.yml .github/workflows/dynamo-pipeline.yml--checkpassed for the rendered production image, EPP images, all three sidecars, mocker images, and both source-building recipe images.docker compose config --quietpassed for the authenticated mocker build.Where should the reviewer start?
.cargo/config.tomlandlib/sidecar/vllm/Cargo.tomlfor the authenticated, pinned BSR dependencies.lib/sidecar/common/src/transport.rsfor tonic 0.13/0.14 shared connection handling..github/workflows/pre-merge.yml,.github/actions/docker-remote-build/action.yml, andcontainer/templates/wheel_builder.Dockerfilefor CI and secret-safe image-build credential injection.Related Issues
This PR is NOT linked to an issue: