Add Tool Calling and Reasoning Token Metadata to `genai_config.json` with Fallback Map - #2215

Merged

Baiju Meswani (baijumeswani) merged 23 commits into

mainfrom

sayanshaw/tool-tags

Jul 27, 2026

Commits on Jun 11, 2026

add initial tool and reasoning tag migration
Sayan Shaw
committed
7cdfc14

Commits on Jun 23, 2026

Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
5a053fe

Commits on Jun 24, 2026

consolidate APIs
Sayan Shaw
committed
476e71e

Commits on Jun 26, 2026

Rename GetGenerationTag -> GetTag per review feedback from Scott
Sayan Shaw
committed
5d13270

Commits on Jun 29, 2026

Clean up temp directory before test to avoid leftover collisions
Sayan Shaw
committed
4da60c4

Commits on Jul 1, 2026

Refactor: store tag token IDs in model section, expose GetTagId API
Sayan Shaw
committed
e1df10c
Merge origin/main into sayanshaw/tool-tags
Sayan Shaw
committed
388b009

Commits on Jul 8, 2026

Refactor: move tag IDs to Tokenizer, rename to bot/eot/bor/eor
Sayan Shaw
committed
f499725
Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
43a695d

Commits on Jul 15, 2026

Address review: simplify fallback, add C#/Java/ObjC/Python bindings
Sayan Shaw
committed
6276e87
Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
2260ede
Fix clang-format in config.cpp switch/case block from main (unrelated)
Sayan Shaw
committed
1cb59fb
Fix phi3 fallback: use <|tool_call|>/<|/tool_call|> (with pipes)
Sayan Shaw
committed
e418c62
Add reasoning fallback entries to qwen2 (covers DeepSeek think tags)
Sayan Shaw
committed
03bce7b

Commits on Jul 22, 2026

Use std::optional for tag IDs, extract fallback to tokenizer_tag_utils, rename tests
Sayan Shaw
committed
4270829
Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
4585871

Commits on Jul 23, 2026

Update comments: getters throw on unsupported, not return -1
Sayan Shaw
committed
c7f6ddf
Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
8933b44

Commits on Jul 24, 2026

Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
90feec9
Standardize fallback map keys to bot/eot/bor/eor
Sayan Shaw
committed
b1a5aff
use fallback IDs, remove TokenToTokenId call, add Config::Defaults constants, clean up table format
Sayan Shaw
committed
b9b8b83

Commits on Jul 27, 2026

Merge branch 'main' of https://github.com/microsoft/onnxruntime-genai into sayanshaw/tool-tags
Sayan Shaw
committed
26086e6
Use Config::Defaults constants in fallback map keys for consistency
Sayan Shaw
committed
46677b9