Skip to content
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion inferencex-e2e/configs/nvidia-master.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8845,7 +8845,7 @@ dsv41flash-fp4-b300-vllm-agentic-dspark:
- { tp: 2, ep: 2, dp-attn: true, kv-offloading: dram, kv-offload-backend: { name: vllm-simple }, spec-decoding: mtp, conc-list: [128, 192], router: { name: vllm-router, version: "0.1.14" }, srt-recipe: agentic.yaml }

dsv41flash-fp4-b200-vllm-agentic-dspark:
image: vllm/vllm-openai:nightly-dev-x86_64-cu130-ac9126e58aa7
image: vllm/vllm-openai:v0.32.0@sha256:befccf0e7e4089aa23926bb6f887a85c0d46c2a99e6de5c5ffdf5cb7957c5b34
model: deepseek-ai/DeepSeek-V4.1-Flash
model-prefix: dsv41flash
runner: cluster:b200-nscale
Expand Down
7 changes: 7 additions & 0 deletions inferencex-e2e/perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11210,3 +11210,10 @@
- "Add TP2 points with DRAM KV offload, and adjust the memory settings on the DRAM KV offload points."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/XXX
scenario-type: [agentic-coding]

- config-keys:
- dsv41flash-fp4-b200-vllm-agentic-dspark
description:
- "Update the vLLM image from nightly-dev-x86_64-cu130-ac9126e58aa7 to v0.32.0, pinned by digest."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4523
scenario-type: [agentic-coding]
Loading