proxy: actually add /v1/responses endpoint

[mostlygeek]

ref: #448

Summary by CodeRabbit

• New Features
  • Added a new API endpoint for response handling, secured with the same API key authentication as existing endpoints.
  • Integrates seamlessly with the current inference system for consistent and reliable API behavior.
  • Enables additional response management capabilities for compatible applications.
  • Endpoint: POST /v1/responses

_{✏️ Tip: You can customize this high-level summary in your review settings.}

[coderabbitai]

Walkthrough

Adds a new POST /v1/responses API endpoint to proxy/proxymanager.go protected by the same API key middleware as /v1/chat/completions and delegating to the same proxyInferenceHandler. No other logic or error handling modifications.

Changes

Cohort / File(s)	Summary
New API endpoint route proxy/proxymanager.go	Registers POST /v1/responses endpoint with existing API key middleware and proxyInferenceHandler

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

• proxy: support /v1/images/generations #443: Adds new OpenAI-compatible endpoint routes (/v1/images/generations) to proxy/proxymanager.go using the same pattern of wiring to proxyInferenceHandler.

Pre-merge checks and finishing touches

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title accurately describes the main change: adding the /v1/responses endpoint to the proxy service.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✨ Finishing touches

• 📝 Generate docstrings

---

📜 Recent review details

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 8df5e85 and 10c860e.

📒 Files selected for processing (1)

• proxy/proxymanager.go

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (2)

• GitHub Check: run-tests
• GitHub Check: run-tests

🔇 Additional comments (1)

proxy/proxymanager.go (1)

280-280: Implementation correctly follows the established proxy pattern.

The endpoint is properly wired with API key authentication and uses proxyInferenceHandler, which is the appropriate handler for this proxy—it extracts the model field and routes to the appropriate backend. This is consistent with all other inference endpoints (/v1/chat/completions, /v1/messages, /v1/completions, /v1/embeddings, etc.). The endpoint is already documented in the README.md as a supported endpoint.

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}