Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion kubernetes/apps/ai/llmkube/models/qwen36-27b-vllm.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ spec:
modelCache:
claimName: qwen36-27b-vllm-cache
# Use the ROCm nightly with the required AMD kernel support.
image: vllm/vllm-openai-rocm:nightly@sha256:b72e4aca14bae0f853cca1bb71bcf17dae30ef2e2f9ec39485f4da0506383380
image: vllm/vllm-openai-rocm:nightly@sha256:f0a8653e39a9cdc1640654ea5a184bf83caf77fc1439a1a07d1e550e601c7e05
replicas: 0
# Limit concurrent sequence slots to fit the model's cache budget.
parallelSlots: 8
Expand Down