Skip to content

chore: bump llama.cpp to b10450; 1.0.10438:0 → 1.0.10450:0 - #23

Closed
helix-nine wants to merge 1 commit into
masterfrom
next
Closed

chore: bump llama.cpp to b10450; 1.0.10438:0 → 1.0.10450:0#23
helix-nine wants to merge 1 commit into
masterfrom
next

Conversation

@helix-nine

Copy link
Copy Markdown
Collaborator

Summary

Bumps llama.cpp from build b10438 to b10450 — 12 upstream commits. StartOS version 1.0.10438:01.0.10450:0.

All four image variants were confirmed published on GHCR before pinning (server-, server-cuda-, server-rocm-, server-vulkan- at b10450), with the expected arches (rocm x86-only, the rest amd64+arm64).

Upstream highlights

  • Adds the Kimi-K3 text model family.
  • server: the yield_to_queue thread model was re-designed, improving behaviour under concurrent requests.
  • Vulkan: coopmat1 tuning for Intel Xe, plus fixed gating for a problematic Intel driver version.
  • Built-in chat UI: the API key field is masked so browsers stop offering to save it; MCP tool results now read structuredContent when content is empty.
  • GGUF parsing now checks array types before reading (malformed metadata is rejected rather than misread).
  • --models-dir can load MTP assistant models.
  • Vendored cpp-httplib → 0.53.1 and BoringSSL → 0.20260813.0.

Full commit range: ggml-org/llama.cpp@b10438...b10450

Deprecation checked, no package change needed

Upstream deprecated --mmap / --no-mmap / --mlock / --direct-io in favour of -lm/--load-mode (#26934). They still parse and only emit a warning, so nothing breaks. This package builds its serve args from -hf, -hff, -c, -ngl, --host and --port only, so none of the deprecated flags are used by main.ts or the presets; the release notes mention it for users who pass them via Set Model's extra arguments.

The presets in startos/actions/presets.ts were reviewed against the range — no flag renames or server-API changes affect them.

Other

  • @start9labs/start-sdk is already at the latest published version (2.0.9) — no SDK bump.
  • No *-startos git dependencies, so no dependency refresh.

Test plan

  • npm run check (tsc) — green.
  • Registry checked: latest published is 1.0.10380:0, so 1.0.10450:0 is free.
  • make generic / full build verification left to review, per the monitor-cycle policy.

@MattDHill

Copy link
Copy Markdown
Member

Superseded by #22, which now carries this bump.

#22 (Set Model prefill) and this one both rewrote startos/versions/current.ts, so they could not both land — and shipping them as two releases would have meant 1.0.10438:1 immediately followed by 1.0.10450:0. Cherry-picked 92c6ce8 onto #22 instead (authorship preserved), resolved to this branch's current.ts, and folded the Set Model item into the release notes as its own section. Final version is 1.0.10450:0 with the b10450 upstreamBuild, unchanged from what this PR proposed.

next still carries 92c6ce8, so it will be a no-op once #22 merges — drop it on the next rebase.

@MattDHill MattDHill closed this Aug 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants