tool-call: refactor common chat / tool-call api (+ tests / fixes)#11900

Merged

ochafik merged 43 commits intoggml-org:masterfrom

ochafik:chat-cleanups

Feb 18, 2025

Commits on Feb 15, 2025

address clang-tidy lints
Olivier Chafik
committed
tool-call: massive refactoring
Olivier Chafik
committed
rm minja dep from util & common
Olivier Chafik
committed
move minja to common/minja
Olivier Chafik
committed
Update utils.hpp
Olivier Chafik
committed
add common_chat_tool
Olivier Chafik
committed
force utf8 encoding in get_chat_template
ochafik
committed

Commits on Feb 16, 2025

fix json tools parsing
ochafik
committed
add json tools / messages parsing helpers to common
ochafik
committed
fix common_chat_msgs_parse_oaicompat
ochafik
committed
concat multipart content in legacy template path
ochafik
committed
add name & tool_call_id to common_chat_msg
ochafik
committed
Update test-chat.cpp
ochafik
committed
test & fix json<->msg conversions
ochafik
committed
fix typo
ochafik
committed
fix content part string concat in legacy template branch
ochafik
committed
test tools json conversions
ochafik
committed
test content parts in test-chat
ochafik
committed
fix clang-tidy lints in [test-]chat.*
ochafik
committed
fix deepseek r1 slow test (no longer <think> opening w/ new template)
ochafik
committed
fix lints in test-chat-template.cpp
ochafik
committed
tweak test_calc_result expectations
ochafik
committed
fix double bos/eos jinja avoidance hack (was preventing inner bos/eos tokens)
ochafik
committed
add common_chat_templates_source + rehab server template logs
ochafik
committed
fix msg lints
ochafik
committed
tool-call: allow empty tools w/ auto + grammar
ochafik
committed
fix & test grammar & json_schema w/ & w/o --jinja
ochafik
committed
Update test-chat-template.cpp
ochafik
committed
test & fix array message.content
ochafik
committed
fix links to prepare merge
ochafik
committed
Merge remote-tracking branch 'origin/master' into chat-cleanups
ochafik
committed
fix merge
ochafik
committed
rm trailing spaces
ochafik
committed
Add missing <optional> include to chat.cpp
ochafik
committed
tiny fix: somehow llama_token being defined in an extern c makes it less than a c++ typedef
ochafik
committed
alternative fix for gcc c vs. c++ weirdness
ochafik
committed
add missing <regex> include to test-chat-template
ochafik
committed
Update chat.hpp
ochafik
committed

Commits on Feb 17, 2025

have common_chat_templates_init return a unique_ptr
Olivier Chafik
committed
chat.{hpp -> h}
Olivier Chafik
committed
build common_chat_templates_ptr earlier
Olivier Chafik
committed
use deleter functor for common_chat_templates_ptr
Olivier Chafik
committed

Commits on Feb 18, 2025

Merge remote-tracking branch 'origin/master' into chat-cleanups
Olivier Chafik
committed