Skip to content
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion inferencex-e2e/configs/nvidia-master.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9700,7 +9700,7 @@ dsv41flash-fp4-gb300-dynamo-vllm-agentic-dspark-disagg:

# One serving GPU, stock ARM64 release, native AgentX client and proportional host cache.
qwen3.8next-fp4-gb300-sglang-agentic-mtp:
image: lmsysorg/sglang:v0.5.21-cu130@sha256:1f176b3a1dd1205d2a462ab80ea9fc17769a32e53cb6f3c690efa2dc2c384977
image: lmsysorg/sglang:v0.5.22-cu130@sha256:06441be3de19a816ddbac917535e920cbfc7fc43171abc08417394f43634ffb6
model: nvidia/Qwen3.8-Flash-Next-NVFP4
model-prefix: qwen3.8next
runner: cluster:gb300-nv
Expand Down
7 changes: 7 additions & 0 deletions inferencex-e2e/perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11197,3 +11197,10 @@
- "Balanced TP4 at conc 64 with L2 HiCache (write_back, hicache-size 180 GB per rank), and the scheduler and decode graph batch at 128."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4499
scenario-type: [agentic-coding]

- config-keys:
- qwen3.8next-fp4-gb300-sglang-agentic-mtp
scenario-type: [agentic-coding]
description:
- "Update SGLang image from v0.5.21-cu130 to v0.5.22-cu130."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4512
Loading