fix: avoid crash on zero-arg tool calls in glm4 parser#32321
Conversation
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run You ask your reviewers to trigger select CI tests on top of Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add If you have any questions, please reach out to us on Slack at https://slack.vllm.ai. 🚀 |
Signed-off-by: seekskyworld <djh1813553759@gmail.com>
efed4fc to
01c680a
Compare
…32321) Signed-off-by: seekskyworld <djh1813553759@gmail.com>
…32321) Signed-off-by: seekskyworld <djh1813553759@gmail.com>
…32321) Signed-off-by: seekskyworld <djh1813553759@gmail.com> Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
…32321) Signed-off-by: seekskyworld <djh1813553759@gmail.com>
Audited recent tool parser bug-fix PRs and found that several landed without corresponding test coverage. Added unit tests for each fix to prevent regressions. - Mistral: fast detokenization text detection (PR vllm-project#37209) - Qwen3Coder: malformed XML crash, anyOf double-encoding, speculative decode streaming (PRs vllm-project#36774, vllm-project#36032, vllm-project#35615) - DeepSeekV32: delimiter preservation with fast detokenization, skip_special_tokens adjustment (PR vllm-project#33964) - GLM-4 MoE: zero-argument tool calls, transformers 5.x delimiter handling, Unicode character preservation (PRs vllm-project#32321, vllm-project#31622, vllm-project#30920) - MiniMax M2: anyOf nullable parameter handling for non-null and null values (PR vllm-project#32342) - Step3p5: MTP-style variable-chunk and multi-token streaming (PR vllm-project#33690) - Kimi K2: native tool call ID extraction and multi-turn ID continuity (PR vllm-project#32768) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> Signed-off-by: Ben Browning <bbrownin@redhat.com>
Issue
Summary
Motivation
Nonefor the arg group, which used totrigger a
TypeErrorand drop tool calls.Validation
C:\vllm-venv\Scripts\python -with<tool_call>get_current_time</tool_call>using glm47 parser →
tools_called=True, arguments{}.