local inference: stricter GGUF requirements, auto detection of tool calling support, fixed thinking output parsing - #9442

Merged

DOsinga merged 13 commits into

mainfrom

jhugo/local-tool-calling-mode

May 27, 2026

Commits on May 27, 2026

Select local tool calling from templates
jh-block
committed
03fc657
Preserve emulated tool history
jh-block
committed
473cf35
Require explicit local chat templates
jh-block
committed
02e8d45
Expose local chat template setting
jh-block
committed
1ae6a20
Trim emulated template stops before streaming
jh-block
committed
d4bd7b6
Make local chat templates explicit
jh-block
committed
46aa3d7
Fix local inference lint failures
jh-block
committed
cbd84af
Relax emulated thinking test chunking
jh-block
committed
219d0d6
Probe tool_use before auto native tools
jh-block
committed
edcd994
Support built-in local chat templates
jh-block
committed
ecabce0
List built-in chat templates in local settings
jh-block
committed
7af6ba1
Select mmproj sidecars from HF metadata
jh-block
committed
36d60ec
Trim template stops in native llama.cpp streaming
jh-block
committed
2a4b42d