[Frontend] Responses api harmony output#24338
[Frontend] Responses api harmony output#24338alecsolder wants to merge 3 commits intovllm-project:mainfrom
Conversation
…es API Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec Solder <alecs@fb.com>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run You ask your reviewers to trigger select CI tests on top of Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add If you have any questions, please reach out to us on Slack at https://slack.vllm.ai. 🚀 |
|
This pull request has merge conflicts that must be resolved before it can be |
Purpose
This PR is meant to optionally expose Harmony messages when using the Responses API. These messages are useful for debugging or understand what exactly a model is doing under the hood. There are concepts in Harmony that to not translate 1:1 with Responses API output (metadata like Harmony channel, or full messages like built in tool call output, etc)
Test Plan
Tested with Unit tests and gpt-oss model
Test Result
(Not done yet, still in draft)