Add DeepSeek-V4 GB300 agentic SGLang recipes - #1
Conversation
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
|
Thanks for porting the six AgentX GB300 agentic recipes from InferenceX#2157. Overall this looks good to merge. Paths / internal-only content Source attribution Resources block Container image Nits (non-blocking) LGTM with the image-version note above as a documentation/repro question, not a blocker. |
[by Codex]
Description
Port the six DeepSeek-V4-Pro GB300 SGLang agentic recipes validated in SemiAnalysisAI/InferenceX#2157:
The recipes use
agenticfor the workload directory instead of a fixed input/output sequence-length label. The/infmax-workspacereferences are container-local paths used by the public InferenceX AgentX harness, not cluster host paths.Validation:
srtctl dry-runfor all six files using NVIDIA/srt-slurm v1.0.25 (3435776)python scripts/update_recipe_table.py(the support matrix was already covered, so it produced no diff)Type of change
Checklist
recipes/<single-node|multi-node>/<model>/<GPU>/<framework>/path.python scripts/update_recipe_table.pyhas been run and the README table is up to date.srtctl dry-runlocally or by CI.