Skip to content

Commit 436a4a1

Browse files
committed
Move to using gpt-oss-20b for vllm model and reasoning/tool calling
1 parent 8f66bb8 commit 436a4a1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

helm/vllm/values.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ vllm:
1616
- /bin/sh
1717
- -c
1818
args:
19-
- "vllm serve mistralai/Mistral-7B-Instruct-v0.3 --trust-remote-code --enable-chunked-prefill --max_num_batched_tokens 1024 --enable-auto-tool-choice --tool-call-parser mistral"
19+
- "vllm serve openai/gpt-oss-20b --trust-remote-code --enable-chunked-prefill --enable-auto-tool-choice --tool-call-parser openai --reasoning-parser openai_gptoss"
2020
gpu:
2121
enabled: true
2222
type: "nvidia"

0 commit comments

Comments
 (0)