Skip to content

WebUI hide models in router mode - #19374

Merged
allozaur merged 4 commits into
ggml-org:masterfrom
crsawyer:webui-hide-model
Feb 19, 2026
Merged

WebUI hide models in router mode#19374
allozaur merged 4 commits into
ggml-org:masterfrom
crsawyer:webui-hide-model

Conversation

@crsawyer

@crsawyer crsawyer commented Feb 5, 2026

Copy link
Copy Markdown
Contributor

When using llama-server with presets in router mode add the ability to completely hide certain models from the WebUI.

Summary

Adding no-webui = true to a model's preset configuration will exclude it from the WebUI.

Why?

I tend to use the preset capability to load a group of models for offline vibe coding, but I don't want my embedding, reranking, and FIM models to be selectable via the WebUI. I also wanted it so that if there is only one available model after filtering, it would be automatically selected. I chose to reuse the no-webui argument for this. So that any model in the preset file that has no-webui = true will be excluded from the WebUI model selection list. This also means that the excluded models cannot be loaded or unloaded via the WebUI.

Example:

models.ini

[*]
ngl = 999
threads = -1

; chat, tools
[gpt-oss-120b]
hf = ggml-org/gpt-oss-120b-GGUF
load-on-startup = true
jinja = true
flash-attn = 1
ubatch-size = 2048
batch-size = 32768
parallel = 2
; ctx-size = 131072*params.n_parallel
ctx-size = 262144
temp = 1.0
;min-p = 0.0
min-p = 0.01
top-p = 1.0
top-k = 0.0
; --- Speculative
spec-type = ngram-mod
spec-ngram-size-n = 24
draft-min = 48
draft-max = 64

; FIM
[Qwen2.5-Coder-7B-Q8_0]
load-on-startup = true
hf = ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF:Q8_0
flash-attn = 1
ubatch-size = 1024
batch-size = 1024
ctx-size = 0
cache-reuse = 256
parallel = 2
; ctx-size = 32768*params.n_parallel
ctx-size = 65536
no-webui = true

; embedding
[Qwen3-Embedding-0.6B]
load-on-startup = true
hf = Qwen/Qwen3-Embedding-0.6B-GGUF:Q8_0
flash-attn = 1
embedding = true
pooling = last
ubatch-size = 8192
verbose-prompt = true
parallel = 2
; ctx-size = 8192*params.n_parallel
ctx-size = 16384
no-webui = true

; reranking
[Qwen3-Reranker-0.6B]
load-on-startup = true
hf = ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF:Q8_0
flash-attn = 1
rerank = true
parallel = 2
; ctx-size = 4096*params.n_parallel
ctx-size = 8192
no-webui = true

And now run it:

llama-server --offline --log-colors on --log-prefix --log-timestamps --no-models-autoload --models-preset models.ini

Note: I haven't tested the ini file as written above. I pre-downloaded the models and use model = modelfile.gguf instead of the listed hf = org/model. Aside from that, this ini file was what I tested against.

Comment thread tools/server/webui/src/lib/components/app/models/ModelsSelector.svelte Outdated

@crsawyer crsawyer left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes applied as requested

@crsawyer
crsawyer requested a review from allozaur February 7, 2026 04:15

@allozaur allozaur left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@crsawyer please rebase this branch and rebuild the webui static output. then we're good to go

@crsawyer
crsawyer requested a review from allozaur February 19, 2026 18:34
@allozaur
allozaur merged commit 10b26ee into ggml-org:master Feb 19, 2026
8 checks passed
@crsawyer
crsawyer deleted the webui-hide-model branch February 20, 2026 05:42
liparetejas pushed a commit to liparetejas/llama.cpp that referenced this pull request Feb 23, 2026
bartowski1182 pushed a commit to bartowski1182/llama.cpp that referenced this pull request Mar 2, 2026
ArberSephirotheca pushed a commit to ArberSephirotheca/llama.cpp that referenced this pull request Mar 3, 2026
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
MrLordCat referenced this pull request in MrLordCat/llama.cpp-rdna-lab Jul 16, 2026
zommiommy pushed a commit to zommiommy/llama.cpp that referenced this pull request Aug 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants