Skip to content

Comments

[Frontend] Responses api harmony output#24338

Closed
alecsolder wants to merge 3 commits intovllm-project:mainfrom
alecsolder:responses_api_harmony_output
Closed

[Frontend] Responses api harmony output#24338
alecsolder wants to merge 3 commits intovllm-project:mainfrom
alecsolder:responses_api_harmony_output

Conversation

@alecsolder
Copy link
Contributor

@alecsolder alecsolder commented Sep 5, 2025

Purpose

This PR is meant to optionally expose Harmony messages when using the Responses API. These messages are useful for debugging or understand what exactly a model is doing under the hood. There are concepts in Harmony that to not translate 1:1 with Responses API output (metadata like Harmony channel, or full messages like built in tool call output, etc)

Test Plan

Tested with Unit tests and gpt-oss model

Test Result

(Not done yet, still in draft)

Alec Solder added 3 commits September 5, 2025 10:17
…es API

Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec Solder <alecs@fb.com>
@mergify mergify bot added the frontend label Sep 5, 2025
@github-actions
Copy link

github-actions bot commented Sep 5, 2025

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors.

You ask your reviewers to trigger select CI tests on top of fastcheck CI.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

If you have any questions, please reach out to us on Slack at https://slack.vllm.ai.

🚀

@mergify
Copy link

mergify bot commented Sep 9, 2025

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @alecsolder.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

frontend gpt-oss Related to GPT-OSS models needs-rebase

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants