Repository navigation
fix(sidecar): set the SGLang media fields once - #17980
Conversation
#17653 (SGLang 0.5.23) set GenerateRequest's image_data, video_data and audio_data to empty, and #16203 set the same fields to the forwarded media. Both merged into main, so the struct named each field twice and the SGLang sidecar stopped compiling. Keep the forwarded media. Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
|
No actionable comments were generated in the recent review. Walkthrough
ChangesSGLang media request construction
Estimated code review effort: 2 (Simple) | ~5 minutes Merge Risk:
|
|
Thank you for the fixes! |
Bring in main's fix for the SGLang sidecar build (#17980). Signed-off-by: Karen Chung <karenc@nvidia.com>
Summary
dynamo-sglang-sidecardoes not compile onmain, becauseGenerateRequestsetsimage_data,video_dataandaudio_datatwice inlib/sidecar/sglang/src/protocol.rs.The two edits sit on different lines, so git merged them without a conflict, but Rust rejects a struct literal that names a field twice. This PR removes #17653's three empty placeholders and keeps #16203's forwarded media.
Validation
mainat b0a6bd1 plus this change):cargo check --testspasses forbackend-common, the four sidecars, sidecar-common and the testkit.cargo test -p dynamo-sglang-sidecar --libpassed 128 of 128. Without this change,dynamo-sglang-sidecarfails to compile.mainplus the engine-loss PRs (feat(backend-common): drain and exit the worker when its engine is lost #17727, feat(sidecar): restart the vLLM sidecar when vLLM stops serving #17728, feat(sidecar): restart the SGLang sidecar when SGLang stops serving #17972, feat(sidecar): restart the TensorRT-LLM sidecar when TensorRT-LLM stops serving #17973) passed the sidecar testkit suites locally.Related Issues
Generated with Claude Code