feat: Add streaming support for Mistral v11 tool format#20503

Closed

sjuxax wants to merge 12 commits intovllm-project:mainfrom

sjuxax:Mistral3.2-tool-call-fix

Commits on Jul 4, 2025

feat: Add streaming support for v11 tool format in Mistral parser

committed
Bring in tests from #19425

avigny
authored and
sjuxax
committed

Commits on Jul 12, 2025

Update vllm/entrypoints/openai/tool_parsers/mistral_tool_parser.py

sjuxax
and
aarnphm
authored
fix: prevent infinite loop in Mistral tool parsing by removing processed tools

sjuxax
and
aider-chat-bot
committed
refactor: improve JSON parsing for Mistral tool calls with robust regex and JSON decoding

sjuxax
and
aider-chat-bot
committed
refactor: Improve quote normalization in tool call parsing to prevent JSON corruption

sjuxax
and
aider-chat-bot
committed
refactor: remove quote normalization from Mistral tool parser

sjuxax
and
aider-chat-bot
committed
refactor: optimize tool call parsing by removing substring operations and using offset-based parsing

sjuxax
and
aider-chat-bot
committed
refactor: Replace `X | Y` union syntax with `Union` for Python 3.9 compatibility

sjuxax
and
aider-chat-bot
committed
feat: add comprehensive tests for Mistral v11 tool format

sjuxax
and
aider-chat-bot
committed

Commits on Jul 13, 2025