chore: bump llama.cpp to b10481; 1.0.10450:0 → 1.0.10481:0 - #25
Open
helix-nine wants to merge 1 commit into
Open
chore: bump llama.cpp to b10481; 1.0.10450:0 → 1.0.10481:0#25helix-nine wants to merge 1 commit into
helix-nine wants to merge 1 commit into
Conversation
Pins ghcr.io/ggml-org/llama.cpp server images to b10573 for all four variants. Upstream publishes server images for only a small, irregular subset of its per-commit releases, so the pin is the newest build GHCR actually has, confirmed for generic, cuda, rocm and vulkan. Every flag the package passes (-hf, -hff, -c, -ngl, --host, --port) is still defined in common/arg.cpp at b10573, so the presets need no change. start-sdk is already at 2.0.9, the current npm latest. The release notes warn that upstream removed the server-side get_datetime tool (ggml-org/llama.cpp#27255). llama-server exits non-zero when --tools names an unknown tool, so a user who listed it in Set Model's extra arguments would otherwise hit a service that will not start.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Bumps the pinned llama.cpp server images from
b10450tob10481, and the package version from1.0.10450:0to1.0.10481:0.b10481is the newest build GHCR has actually published server images for — upstream cuts a GitHub release per merged commit but publishes images for only a small subset, so the pin comes from the GHCR tag list, not the release list. All four variants were confirmed to resolve before pinning:genericghcr.io/ggml-org/llama.cpp:server-b10481nvidiaghcr.io/ggml-org/llama.cpp:server-cuda-b10481rocmghcr.io/ggml-org/llama.cpp:server-rocm-b10481vulkanghcr.io/ggml-org/llama.cpp:server-vulkan-b10481Upstream range
31 builds,
b10450...b10481. Highlights that reach a StartOS user:hipMemGetInfoinstead of inheriting the DGX Spark unified-memory override, which over-promised memory on APUs with a small carveout. Relevant to therocmvariant.get_infotool.No
llama-serverflag changes in the range — the diff ofcommon/arg.cpptouches no option literals, so the-hf/-hff/-c/-nglarguments built by Set Model and the presets instartos/actions/presets.tsare unaffected. No migration needed.No SDK or dependency changes
@start9labs/start-sdkis already pinned at2.0.9, which is the latest published version, and this package has no*-startosgit dependencies — sopackage.jsonandpackage-lock.jsonare untouched.Release notes
Rewritten for this bump in all five locales (
en_US,es_ES,de_DE,pl_PL,fr_FR). They describe only whatb10481adds; the Set Model prefill work announced in1.0.10450:0is not repeated.Test plan
1.0.10481:0is not already published — the registry'sbestforllama-cppis1.0.10450:0.b10481image variants resolve on GHCR (docker manifest inspect).npm run check(tsc) green.make generic— deferred to review, per the monitor cycle's typecheck-only gate.