fix: support DGX Spark vLLM routing - #3051
Conversation
|
Caution Review failedFailed to post review comments 📝 WalkthroughWalkthroughThis PR extends local vLLM inference support by introducing a default model constant, adding proxy configuration for local host aliases, updating test coverage for proxy behavior, and documenting a DGX Spark Host deployment example with environment setup and networking guidance. ChangesLocal vLLM Inference Configuration & Proxy Support
Estimated code review effort🎯 2 (Simple) | ⏱️ ~12 minutes
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
✨ Thanks for submitting this PR that fixes support for DGX Spark vLLM routing. This change involves updating the sandbox proxy path and documenting a DGX Spark vLLM setup. |
|
Closing this as superseded. The runtime/model fix from this PR has been narrowed and kept alive in #3013. The broader DGX/vLLM onboarding/documentation pieces are now covered by upstream Net: #3013 is the smaller still-needed patch; this PR is no longer needed. |
Summary
Why
This reproduces the working DGX Spark setup where NemoClaw routes OpenClaw to a host vLLM server while preserving the OpenShell-managed inference.local route for normal provider traffic.
AI assistance
This PR was prepared with Codex assistance. The human operator remains the contributor of record, reviewed the scope, and verified the DGX Spark setup before submission.
Validation
Focused Vitest was not run in the fresh clone because dependencies were not installed.
Summary by CodeRabbit
Documentation
New Features
Improvements