feat(setModel): remember selection; bump llama.cpp to b10450; refresh docs - #22
Conversation
…→ 1.0.10438:1
FileHelper.merge only overwrites keys present in the incoming object, so the
flat modelSelection shape left a stale hfRepo/ctx/ngl/extraArgs behind after
switching from Custom to a preset. Nesting them under `custom` clears the lot
in one key, and mirrors the union's own {selection, value} so the prefill maps
straight across instead of restating the input spec's defaults.
The `as 'llama-32-1b'` cast was unnecessary: allVariants is declared
`Record<AllVariantIds, { name: string; spec: any }>`, which widens the prefill
type to `{ selection: string; value: any }`.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
Thanks — the approach is right, and it holds up end to end: I've pushed a commit to your branch rather than send it back — three things: Version bump — this was the blocker. A wrapper-only change needs a downstream revision, so Custom fields now nest under Dropped the Also added a line to
|
Splits the notes into package and upstream sections now that the release carries both, and localises the **Set Model** references that were left in English in the es/de/pl/fr notes — the action name is translated in the UI. Supersedes the standalone 1.0.10438:1 bump earlier in this branch: the upstream version moved, so the downstream revision resets to :0. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
Folded #23 (the b10450 bump) in here — the two both rewrote
|
…UPDATING.md Restructures the README around what an AI support or administering agent needs to answer questions about a running install — layout, file models, actions with their cost and repeat-safety, tasks, limits — and documents `modelSelection` and the Set Model prefill in that structure. Corrects the preset default while in there: `models.find` returns the first entry that fits and the list runs smallest-first, so the form defaults to the smallest preset that fits, not the largest. AGENTS.md drops the "Inspecting a running install" section, which now lives in the shared packaging guide. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
… placeholders The two i18n files were the only unformatted files in `startos` — `prettier --check` was red on master. Both are now byte-for-byte `prettier --write` output of what was committed, so no key text moved and no dictionary index shifted. syncNext.yml matches the copy every other package in the registry carries. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
Pushed the maintainer-side docs and housekeeping that had been sitting uncommitted, so this PR carries the whole release.
|
What
Three things shipping as one release,
1.0.10438:0→1.0.10450:0:current.tsand so the change ships as one version rather than two.AGENTS.mdrefresh, thesyncNextworkflow, and a formatting fix.Why
Useful when tweaking only context length, or checking what the configured custom model is. Previously the form always reopened on the smallest preset that fits the detected memory, whatever was actually running.
Set Model prefill
modelSelectioninstore.jsonholds the chosenselectionplus acustomobject carrying the custom variant's fields; picking a preset clearscustom. Nothing reads it but the action's prefill —serveArgsremains the only thing the daemon sees, so the two can't drift into disagreement about what is running.The field is additive and optional, so there is no migration: an install predating this simply sees the defaults until its next Set Model submit. It lives on the
mainvolume, so it travels with backups likeserveArgsdoes.Upstream highlights (b10438…b10450)
server: theyield_to_queuethread model was re-designed, improving behaviour under concurrent requests.structuredContentwhencontentis empty.--models-dircan load MTP assistant models.cpp-httplib→ 0.53.1 and BoringSSL → 0.20260813.0.Full commit range: ggml-org/llama.cpp@b10438...b10450
All four image variants were confirmed published on GHCR before pinning (
server-,server-cuda-,server-rocm-,server-vulkan-atb10450), with the expected arches — rocm x86-only, the rest amd64+arm64. The reference registry's latest is1.0.10380:0, so1.0.10450:0is free.Deprecation checked, no package change needed. Upstream deprecated
--mmap/--no-mmap/--mlock/--direct-ioin favour of-lm/--load-mode(ggml-org/llama.cpp#26934). They still parse and only emit a warning. This package builds its serve args from-hf,-hff,-c,-ngl,--hostand--portonly, so none of them are used bymain.tsor the presets; the release notes mention it for users who pass them through Set Model's extra arguments. The presets instartos/actions/presets.tswere reviewed against the range — no flag renames or server-API changes affect them.Documentation and housekeeping
README.mdrestructured around what an AI support or administering agent needs to answer questions about a running install: layout, file models, each action with its cost and repeat-safety, tasks, health checks, limits.modelSelectionand the Set Model prefill are documented in that structure. It also corrects the preset default —models.findreturns the first entry that fits and the list runs smallest-first, so the form defaults to the smallest preset that fits, not the largest.AGENTS.mddrops its "Inspecting a running install" section, which now lives in the shared packaging guide, and records the constraints an agent tends to get wrong here (the AMD allowlist, the hour-long health-check grace, the preset sizing convention).UPDATING.mdtable alignment.syncNext.ymladded, matching the copy every other package in the registry carries.startos/—prettier --checkwas red onmaster. Both are now byte-for-byteprettier --writeoutput of what was committed, so no key text moved and no dictionary index shifted.assets/README.mdplaceholder is replaced by a.gitkeep.