-
Notifications
You must be signed in to change notification settings - Fork 565
prerelease 2 cut #2568
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
prerelease 2 cut #2568
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,19 @@ | ||
| - feat: add model alias support | ||
| - refactor: standardize extra fields handling for all providers | ||
| - feat: add Fireworks AI as a first-class provider (thanks [@ivanetchart](https://github.com/ivanetchart)!) | ||
| - feat: add realtime provider interfaces, schemas, and engine hooks | ||
| - feat: add session log storage and realtime request normalization | ||
| - feat: add per-user OAuth consent flow with identity selection and MCP authentication | ||
| - feat: add IsSet method to EnvVar and improve provider auth validation | ||
| - feat: add support for tracking userId, teamId, customerId, and businessUnitId | ||
| - feat: add prompts plugin with direct key header resolver | ||
| - feat: add embeddings, image gen, edit and variation to bedrock | ||
| - feat: allow path whitelisting from security config | ||
| - fix: auto-redact env-backed values in EnvVar JSON serialization | ||
| - fix: bedrock tool choice conversion to auto | ||
| - fix: MCP tool logs not being captured correctly | ||
| - fix: preserve explicit empty tool parameter schemas for openai passthrough | ||
| - fix: correct SigV4 service name for bedrock agent runtime rerank | ||
| - fix: include raw model ID in list-models output alongside aliases | ||
| - fix: vertex endpoint correction | ||
| - fix: bedrock streaming retry for retryable AWS exceptions and stale connections | ||
| - fix: thinking budget validation for gemini models | ||
| - fix: add empty arguments guard in bedrock utils |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| - feat: add per-user OAuth consent flow with identity selection and MCP authentication | ||
| - feat: add access profiles for fine-grained permission control | ||
| - feat: add user level OAuth for MCP gateway | ||
| - feat: add IsSet method to EnvVar and improve provider auth validation | ||
| - feat: add session log storage and realtime request normalization | ||
| - feat: add support for tracking userId, teamId, customerId, and businessUnitId | ||
| - feat: add prompts plugin with direct key header resolver | ||
| - feat: add Fireworks AI provider support (thanks [@ivanetchart](https://github.com/ivanetchart)!) | ||
| - feat: add sorting and CSV export to virtual keys table | ||
| - feat: allow path whitelisting from security config | ||
| - fix: auto-redact env-backed values in EnvVar JSON serialization | ||
| - fix: MCP tool logs not being captured correctly | ||
| - fix: SQLite migration connections and error handling | ||
| - fix: disable SQLite foreign key checks during migration | ||
| - fix: add retry mechanism to model catalog pricing sync lock | ||
| - fix: increases buffer size for custom plugin installs from URLs |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.3.0 | ||
| 1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1,5 @@ | ||
| - fix: preseve routing rule targets for genai and bedrock paths for vk level provider load balancing | ||
| - feat: add realtime WebSocket, WebRTC, and client secret handlers | ||
| - feat: add access profiles for fine-grained permission control | ||
| - feat: add support for tracking userId, teamId, customerId, and businessUnitId | ||
| - fix: SQLite migration connections and error handling + vk not found message | ||
| - fix: preserve routing rule targets for genai and bedrock paths |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 0.1.0 | ||
| 0.1.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| - feat: add realtime turn logging | ||
| - feat: add support for tracking userId, teamId, customerId, and businessUnitId | ||
| - feat: allow path whitelisting from security config | ||
| - fix: MCP tool logs not being captured correctly |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| - feat: add per-user OAuth consent flow with identity selection and MCP authentication | ||
| - feat: add support for image generation requests | ||
| - feat: add realtime turn logging | ||
| - feat: add support for tracking userId, teamId, customerId, and businessUnitId |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.6.0 | ||
| 1.6.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.2.0 | ||
| 1.2.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,3 @@ | ||
| - feat: add prompts plugin with direct key header resolver | ||
| - feat: add per-user OAuth consent flow with identity selection and MCP authentication | ||
| - feat: add selective message inclusion when committing prompt sessions |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.0.0 | ||
| 1.0.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| - chore: upgraded core to v1.5.1 and framework to v1.3.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0 | ||
| 1.5.1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,15 +1,30 @@ | ||
| - feat: add support for chaining routing rules | ||
| - feat: add routing tree UI to better visualize routing rules | ||
| - feat: add model alias — keys now support a top-level `aliases` field mapping any model name to a provider-specific identifier (Azure deployment names, Bedrock inference profile ARNs, Vertex endpoints, Replicate model slugs, fine-tuned model IDs, etc.). The original model name is preserved and returned alongside the resolved identifier in every response. Breaking changes: see below. | ||
| - fix: preseve routing rule targets for genai and bedrock paths for vk level provider load balancing | ||
| ## ✨ Features | ||
|
|
||
| <Warning> | ||
| **This release contains 4 breaking changes** related to model aliasing. See the [v1.5.0 Migration Guide](/migration-guides/v1.5.0#breaking-change-9-provider-deployments-removed-migrate-to-aliases) for full before/after examples and migration instructions. | ||
| </Warning> | ||
| - **Realtime Support** — Add WebSocket, WebRTC, and client secret handlers with session state management and transport context helpers | ||
| - **Fireworks AI Provider** — Add Fireworks AI as a first-class provider with native completions, responses, embeddings, and image generations (thanks [@ivanetchart](https://github.com/ivanetchart)!) | ||
| - **Per-User OAuth Consent** — Add per-user OAuth consent flow with identity selection and MCP authentication | ||
| - **Prompts Plugin** — New prompts plugin with direct key header resolver and selective message inclusion when committing prompt sessions | ||
| - **Access Profiles** — Add access profiles for fine-grained permission control | ||
| - **Bedrock Embeddings & Image Gen** — Add embeddings, image gen, edit and variation support to Bedrock | ||
| - **EnvVar Improvements** — Add IsSet method to EnvVar and auto-redact env-backed values in JSON serialization | ||
| - **Logging Tracking Fields** — Add support for tracking userId, teamId, customerId, and businessUnitId in logging | ||
| - **Virtual Keys Export** — Add sorting and CSV export to virtual keys table | ||
| - **Path Whitelisting** — Allow path whitelisting from security config | ||
| - **Server Bootstrap Timer** — Add server bootstrap timer for startup diagnostics | ||
|
|
||
| | # | Breaking Change | Affected | | ||
| |---|---|---| | ||
| | [9](/migration-guides/v1.5.0#breaking-change-9-provider-deployments-removed-migrate-to-aliases) | `deployments` removed from `azure_key_config`, `vertex_key_config`, `bedrock_key_config`, `replicate_key_config` — use top-level `aliases` | `config.json` | | ||
| | [9](/migration-guides/v1.5.0#breaking-change-9-provider-deployments-removed-migrate-to-aliases) | `replicate_key_config.deployments` replaced by `replicate_key_config.use_deployments_endpoint` (bool) | `config.json` | | ||
| | [10](/migration-guides/v1.5.0#breaking-change-10-go-sdk-extrafields-model-fields-renamed) | `BifrostResponseExtraFields.ModelRequested` → `OriginalModelRequested` + `ResolvedModelUsed` | Go SDK | | ||
| | [11](/migration-guides/v1.5.0#breaking-change-11-go-sdk-streamaccumulatorresult-field-renamed) | `StreamAccumulatorResult.Model` → `RequestedModel` + `ResolvedModel` | Go SDK | | ||
| ## 🐞 Fixed | ||
|
|
||
| - **Bedrock Tool Choice** — Fix bedrock tool choice conversion to auto | ||
| - **Bedrock Streaming Retries** — Retry retryable AWS exceptions and stale/closed-connection errors in bedrock streaming | ||
| - **Bedrock SigV4 Service** — Correct SigV4 service name for agent runtime rerank | ||
| - **MCP Tool Logs** — Fix MCP tool logs not being captured correctly | ||
| - **Routing Rule Targets** — Preserve routing rule targets for genai and bedrock paths | ||
| - **Provider Budget Duplication** — Fix provider level multiline budget duplication issue | ||
| - **Vertex Endpoint** — Fix vertex endpoint correction | ||
| - **Gemini Thinking Budget** — Fix thinking budget validation for gemini models | ||
| - **SQLite Migrations** — Fix SQLite migration connections, error handling, and disable foreign key checks during migration | ||
| - **Tool Parameter Schemas** — Preserve explicit empty tool parameter schemas for openai passthrough | ||
| - **List Models Output** — Include raw model ID in list-models output alongside aliases | ||
| - **Config Schema** — Fix config schema for bedrock key config | ||
| - **Data Race Fix** — Fix race in data reading from fasthttp request for integrations | ||
| - **Model Listing** — Unify /api/models and /api/models/details listing behavior | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.5.0-prerelease1 | ||
| 1.5.0-prerelease2 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Model alias and routing rule chaining