Skip to content

feature: Make /v1/responses available in the router to support GPT OSS #690

@sebastiaanvduijn

Description

@sebastiaanvduijn

Describe the feature

make the new openAI recommended endpoint available in the router to streamline the interaction with the latest version of VLLM. openAI does recommend new projects to use the new /v1/responses endpoint. is someone already working on this? if not, happy to start working on this and submit a PR.

Why do you need this feature?

openAI does recommend new projects to use the new /v1/responses endpoint. its already available in VLLM but not yet in the router.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions