Add the NVIDIA B300 page and the sandboxed-agent demo - #32
Merged
Conversation
Two contributions from NVIDIA that reference each other. platform/nvidia.md — a bf16 concurrency sweep on B300 from 1 to 256 concurrent requests, contributed by Faradawn Yang. NVIDIA confirmed the sweep used one GPU of an eight-card node, which is now stated above the table: it changes how a reader sizes hardware. Reconciled against what this cookbook already established. The model is renamed, the parser flags use the spelling upstream registers, the redundant chat-template flag is dropped, the download command no longer carries angle brackets a shell reads as redirection, and the deploy step is the published container rather than a pip install of an unreleased wheel. NVIDIA's build string stays in the snapshot so the measurements keep their provenance. recipes/sandboxed-agent/ — an agent is told to exfiltrate a credential and upload it. OpenShell keeps the key out of the sandbox and denies the egress, and the model never gets the chance to refuse. Written as a walkthrough pointing at NemoClaw's own docs rather than a copy-paste recipe, which is how NVIDIA suggested framing it, and the status note says as much. Holding NVIDIA's RTX 5090 figure for now. The model card already publishes 233.4 tok/s with DFlash on that card, and the new figure arrived without a quantization or a server, so the two cannot be reconciled yet.
Contributor
Author
|
@sid-rp Could you please review the vLLM + NVIDIA inference server part? |
|
Looks good to me @seyeong-han |
Contributor
|
LGTM |
sid-rp
approved these changes
Aug 13, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two NVIDIA contributions that reference each other: the B300 platform page, and the sandboxed-agent demo it enables.
python platform/validate.pypasses with 0 errors and 0 warnings; every relative link resolves.platform/nvidia.md— B300Contributed by Faradawn Yang, with a bf16 concurrency sweep from 1 to 256 concurrent requests.
The sweep is single-GPU, now confirmed by NVIDIA. The draft said both "fits on a single 8xB300 node" and "no tensor parallelism flags are needed for single-GPU serving"; Anusha confirmed the cluster node has eight cards but only one was used. That's stated above the table, since it changes how a reader sizes hardware.
Reconciled against what this cookbook already established — no new claims:
--tool-call-parser onyx/--reasoning-parser onyxmuse_glimmer--chat-template …onyx.jinjapip install vllm==0.1.dev19055vllm/vllm-openai:muse-glimmercontainerhf download <meta-models/…><…>as redirectionMemory observed: TBDNVIDIA's build string stays in the snapshot and methodology line, so the measurements keep their provenance even though the reader path is the container.
recipes/sandboxed-agent/— the demoAn agent is asked to find a
PRODUCTION_API_KEY, display it, and upload it. OpenShell blocks it in two independent places: credential brokering keeps the raw key outside the sandbox, and deny-by-default network policy refuses the egress. Terminal logs confirm both.Written the way NVIDIA suggested — point at their setup docs, then show the demo as a practical example, with the recording. It is explicitly not a copy-paste recipe, and the status note says so: the setup authority is NemoClaw's own documentation, linked at each step. All four external links verified 200.
Includes the architecture diagram and the 5.2 MB recording. Both filenames were rewritten; the diagram's contents were already clean.
Not included
The RTX 5090 figure (190 tok/s, DFlash on). Holding it for two reasons:
Both differences are probably legitimate — different quantization, server, or prompt set will do it. We just can't say which yet. Worth one more round with NVIDIA rather than shipping two numbers for the same card.