Skip to content

fix(container): update image ghcr.io/ggml-org/llama.cpp (31bca24 ➔ 5b69b5a) #4276

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Tanguille merged 1 commit into from
Jul 31, 2026
Merged

fix(container): update image ghcr.io/ggml-org/llama.cpp (31bca24 ➔ 5b69b5a) #4276

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion kubernetes/apps/ai/llmkube/models/qwen3-embedding.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ spec:
# Native upstream GTT-leak mitigation in LLMKube >=0.9.10; lifetime includes
# startup and model load before this Vulkan embedder is recycled.
maxPodLifetimeSeconds: 86400
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:31bca24d4ecd1ee8decae5d626ae833bb5d34b94ba9d2f308e7cedcd6bb3e247
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:5b69b5a99886b6bdc24c281b9a041c21e0e9d5502018c55098d4b09cac6ee5a4
# Two slots are the Vulkan-safe floor; more interleaving did not improve
# throughput on this compute-bound iGPU. VMCP has its own embedder now.
parallelSlots: 2 # Vulkan warmup hangs at parallel=1 (llama.cpp #24307)
Expand Down
2 changes: 1 addition & 1 deletion kubernetes/apps/ai/llmkube/models/qwen35-2b.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ spec:
modelRef: qwen35-2b
# Must be recent enough for Qwen3.5's GDN (Gated Delta Networks) architecture;
# verified to load `qwen35` and run GDN fully on Vulkan (no CPU fallback).
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:31bca24d4ecd1ee8decae5d626ae833bb5d34b94ba9d2f308e7cedcd6bb3e247
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:5b69b5a99886b6bdc24c281b9a041c21e0e9d5502018c55098d4b09cac6ee5a4
parallelSlots: 2 # Vulkan warmup hangs at parallel=1 (llama.cpp #24307)
contextSize: 16384 # GDN keeps KV tiny, so long ctx is cheap; 16K is plenty for offload
jinja: true # use the model's chat template (correct Qwen3.5 formatting + tool calls)
Expand Down
2 changes: 1 addition & 1 deletion kubernetes/apps/ai/llmkube/models/vmcp-embedding.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ spec:
# Native upstream GTT-leak mitigation in LLMKube >=0.9.10; lifetime includes
# startup and model load before this Vulkan embedder is recycled.
maxPodLifetimeSeconds: 86400
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:31bca24d4ecd1ee8decae5d626ae833bb5d34b94ba9d2f308e7cedcd6bb3e247
image: ghcr.io/ggml-org/llama.cpp:server-vulkan@sha256:5b69b5a99886b6bdc24c281b9a041c21e0e9d5502018c55098d4b09cac6ee5a4
# Vulkan floor is 2 — warmup hangs at parallel=1 (llama.cpp #24307). The iGPU
# is compute-bound, so more slots add interleave, not throughput.
parallelSlots: 2
Expand Down
Loading