Skip to content

feat: Vertex provider and Gemini SDK integration added in HTTP transport#30

Merged
akshaydeo merged 1 commit intomainfrom
05-09-feat_genai_integration_in_http_transports_added
May 12, 2025
Merged

feat: Vertex provider and Gemini SDK integration added in HTTP transport#30
akshaydeo merged 1 commit intomainfrom
05-09-feat_genai_integration_in_http_transports_added

Conversation

@Pratham-Mishra04
Copy link
Copy Markdown
Collaborator

Add Google Gemini API Compatibility Layer

This PR adds support for the Google Gemini API by implementing a compatibility layer that allows Bifrost to handle Gemini API requests. The implementation includes:

  • A new /genai/v1beta/models/{model} endpoint that accepts Gemini API requests
  • Conversion utilities to transform between Gemini and Bifrost request/response formats
  • Support for Vertex AI provider configuration in the example config file
  • An extensible router architecture to allow for additional API compatibility layers

The implementation handles Gemini chat requests, including proper conversion of message formats, tool calls, and function calls between the two APIs. This allows applications built for Gemini to use Bifrost as a drop-in replacement without code changes.

Copy link
Copy Markdown
Collaborator Author

Pratham-Mishra04 commented May 12, 2025

@Pratham-Mishra04 Pratham-Mishra04 force-pushed the 05-09-feat_genai_integration_in_http_transports_added branch from 55aaad7 to d69db48 Compare May 12, 2025 08:45
@Pratham-Mishra04 Pratham-Mishra04 force-pushed the 05-06-feat_vertex_ai_provider_added branch from 59cc5d1 to 2dc0a0d Compare May 12, 2025 08:45
@Pratham-Mishra04 Pratham-Mishra04 force-pushed the 05-09-feat_genai_integration_in_http_transports_added branch from d69db48 to 9cdc85e Compare May 12, 2025 08:50
@akshaydeo akshaydeo marked this pull request as ready for review May 12, 2025 09:04
Comment thread transports/bifrost-http/main.go Outdated
Copy link
Copy Markdown
Contributor

@akshaydeo akshaydeo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added one comment

@Pratham-Mishra04 Pratham-Mishra04 force-pushed the 05-09-feat_genai_integration_in_http_transports_added branch from 9cdc85e to 212c2b4 Compare May 12, 2025 09:57
Copy link
Copy Markdown
Collaborator Author

yes done

Copy link
Copy Markdown
Contributor

akshaydeo commented May 12, 2025

Merge activity

  • May 12, 3:38 PM GMT+5:30: A user started a stack merge that includes this pull request via Graphite.
  • May 12, 3:40 PM GMT+5:30: Graphite rebased this pull request as part of a merge.
  • May 12, 3:41 PM GMT+5:30: @akshaydeo merged this pull request with Graphite.

@akshaydeo akshaydeo changed the base branch from 05-06-feat_vertex_ai_provider_added to graphite-base/30 May 12, 2025 10:09
@akshaydeo akshaydeo changed the base branch from graphite-base/30 to main May 12, 2025 10:09
@akshaydeo akshaydeo force-pushed the 05-09-feat_genai_integration_in_http_transports_added branch from 212c2b4 to 318eb77 Compare May 12, 2025 10:10
@akshaydeo akshaydeo merged commit 4d054c6 into main May 12, 2025
1 check passed
@Pratham-Mishra04 Pratham-Mishra04 deleted the 05-09-feat_genai_integration_in_http_transports_added branch May 13, 2025 20:07
akshaydeo added a commit that referenced this pull request Nov 17, 2025
…ort (#30)

# Add Google Gemini API Compatibility Layer

This PR adds support for the Google Gemini API by implementing a compatibility layer that allows Bifrost to handle Gemini API requests. The implementation includes:

- A new `/genai/v1beta/models/{model}` endpoint that accepts Gemini API requests
- Conversion utilities to transform between Gemini and Bifrost request/response formats
- Support for Vertex AI provider configuration in the example config file
- An extensible router architecture to allow for additional API compatibility layers

The implementation handles Gemini chat requests, including proper conversion of message formats, tool calls, and function calls between the two APIs. This allows applications built for Gemini to use Bifrost as a drop-in replacement without code changes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants