Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
65 changes: 12 additions & 53 deletions docs/changelogs/v1.5.0-prerelease3.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -19,71 +19,33 @@ description: "v1.5.0-prerelease3 changelog - 2026-04-13"
<Update label="Bifrost(HTTP)" description="1.5.0-prerelease3">
## ✨ Features

- **Object Store Log Store** — Logging plugin's log store can now offload payloads to object storage (S3/GCS/etc.) instead of bloating the database
- **Azure Passthrough** — Azure passthrough support added
- **Mistral OCR** — End-to-end support for the `/v1/ocr` endpoint (Mistral OCR)
- **OpenRouter Embeddings** — Embeddings support added to the OpenRouter provider
- **Redis TLS & Cluster Mode** — TLS and cluster-mode support for Redis; valkey-search query fix
- **Parallel Model Catalog Sync** — Model catalog restructured with parallel syncs for faster startup and refreshes
- **Dashboard CSV & PDF Export** — Export dashboard views to CSV or PDF
- **OpenAPI Security Schemes** — Security schemes added to the OpenAPI spec; virtual key examples updated; API playground now only shows supported auth methods per endpoint
- **Configurable API Docs Base URL** — Base URL for the hosted API documentation is configurable
- **v1.4.x Allow-List Compatibility Mode** — New version-1 compatibility mode preserves v1.4.x allow-list semantics for smoother upgrades
- **OAuth MCP Hints** — OAuth MCP client creation response now includes next-step hints
- **272k Token Tier Pricing** — Pricing support for the 272k token tier
- **Flex & Priority Tier Pricing** — Flex and priority tier pricing (including override fields)
- **UI: Create-Provider Shortcut** — Empty state now links directly to provider creation
- **OAuth MCP** - add next-step hints to OAuth MCP client creation response
- **Azure passthrough** - added azure passthrough support
- **272k token tier** - add 272k token tier pricing support in pricing
- **Flex and priority tier support** - added flex and priority tier support in pricing

## 🐞 Fixed

- **Streaming Post-Hook Race** — Fix race where fasthttp RequestCtx could be recycled before transport post-hooks completed in streaming goroutines; snapshots are now captured eagerly before the handler returns
- **Streaming Blocker** — Fix a streaming blocker in the transport layer
- **Streaming Post-Hook Race** — Fix race condition where fasthttp RequestCtx could be recycled before transport post-hooks complete in streaming goroutines; eagerly captures request/response snapshots before handler returns
- **Async User Values** — Propagate user values through all async inference handlers and job submissions
- **Trace Completer Safety** — Trace completer accepts transport logs as a parameter instead of reading from a potentially recycled context
- **Trace Completer Safety** — Refactor trace completer to accept transport logs as parameter instead of reading from potentially recycled context
- **Async Log Store Exceptions** — Fix exception handling in async log store jobs
- **Model Alias Tracking** — Split `ModelRequested` into `OriginalModelRequested` and `ResolvedModelUsed` for accurate alias resolution tracking
- **MCP Tool Discovery** — Add discovered tools and tool-name mapping columns to MCP clients
- **OAuth Transient Failures** — Don't mark OAuth configs expired on transient network failures
- **OAuth Session Cleanup** — Clean up OAuth sessions on virtual key deletion; fixes an associated race condition
- **Pricing Sync Config** — Correctly apply `pricing_sync_interval` and support env variables in `pricing_url`
- **Key Validation Logging** — Improved key validation error handling and logging
- **DB Deadlock Prevention** — Replace find-then-upsert with atomic `ON CONFLICT` to prevent deadlocks
- **LiteLLM Compat** — LiteLLM compatibility fixes
- **SQLite Migration Fix** — Additional SQLite migration fixes
- **CVE Fixes** — Dependency updates addressing reported CVEs
- **Model Alias Tracking** — Split ModelRequested into OriginalModelRequested and ResolvedModelUsed for accurate model alias resolution tracking
- **MCP Tool Discovery** — Add discovered tools and tool name mapping columns to MCP clients

</Update>
<Update label="Core" description="1.5.2">
- feat: Azure passthrough support
- feat: add end-to-end support for `/v1/ocr` (Mistral OCR)
- feat: add Embeddings in OpenRouter provider
- feat: add 272k token and priority tiers support in pricing
- feat: add flex tier pricing support with flat rate structure
- refactor: split `ModelRequested` into `OriginalModelRequested` and `ResolvedModelUsed` for model alias tracking
- refactor: restructure model catalog with parallel syncs
- refactor: split ModelRequested into OriginalModelRequested and ResolvedModelUsed for model alias tracking
- refactor: simplify Azure passthrough by removing redundant config nil checks
- refactor: simplify Mistral error parsing signature
- refactor: add response backfill methods
- fix: carry `ProviderResponseHeaders` through text completion response conversion
- fix: streaming blocker
- fix: core test fixes
- fix: CVE / package updates
- fix: carry ProviderResponseHeaders through text completion response conversion

</Update>
<Update label="Framework" description="1.3.2">
- feat: add MCP client discovered tools and tool name mapping migration
- feat: object store support for log_store (avoid bloating DB)
- feat: add version 1 compatibility mode for v1.4.x allow-list semantics
- feat: add flex and 272k token tier pricing override fields
- fix: don't mark OAuth config expired on transient network failures
- fix: cleanup OAuth sessions on virtual key deletion and prevent race condition
- fix: replace find-then-upsert with atomic `ON CONFLICT` to prevent deadlocks
- fix: correctly apply `pricing_sync_interval` and support env variables in `pricing_url`
- fix: exception handling in async log store jobs
- fix: migration fix
- refactor: improve key validation error handling and logging
- refactor: model catalog Init API to use `SetShouldSyncGate` method
- refactor: rename `DefaultPricingSyncInterval` to `DefaultSyncInterval`
- refactor: model catalog Init API to use SetShouldSyncGate method
- refactor: rename DefaultPricingSyncInterval to DefaultSyncInterval

</Update>
<Update label="compat" description="0.1.1">
Expand All @@ -99,12 +61,10 @@ description: "v1.5.0-prerelease3 changelog - 2026-04-13"

</Update>
<Update label="litellmcompat" description="0.1.2">
- fix: litellm compat
- chore: upgraded core to v1.5.2 and framework to v1.3.2

</Update>
<Update label="logging" description="1.5.2">
- feat: object store support for log_store (avoid bloating DB)
- chore: upgraded core to v1.5.2 and framework to v1.3.2

</Update>
Expand All @@ -125,7 +85,6 @@ description: "v1.5.0-prerelease3 changelog - 2026-04-13"

</Update>
<Update label="semanticcache" description="1.5.2">
- feat: Redis TLS + cluster mode support; valkey-search query fix
- chore: upgraded core to v1.5.2 and framework to v1.3.2

</Update>
Expand Down
2 changes: 1 addition & 1 deletion docs/contributing/code-conventions.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -321,7 +321,7 @@ make test-all

### TypeScript/React
- Use ESLint configuration from project
- Run Prettier for formatting
- Run `npm run format` for formatting
- Ensure TypeScript compilation succeeds

## Key Principles
Expand Down
4 changes: 2 additions & 2 deletions docs/contributing/setting-up-repo.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ This command will:
1. Install UI dependencies automatically
2. Install Air for hot reloading
3. Set up the Go workspace with local modules
4. Start the Next.js development server (port 3000)
4. Start the Vite development server (port 3000)
5. Start the API server with UI proxy (port 8080)

**Access the application at:** http://localhost:8080
Expand Down Expand Up @@ -350,7 +350,7 @@ make setup-workspace
**UI dependency issues:**
```bash
# Clean and reinstall UI dependencies
rm -rf ui/node_modules ui/.next
rm -rf ui/node_modules
make install-ui
```

Expand Down
78 changes: 18 additions & 60 deletions docs/docs.json
Original file line number Diff line number Diff line change
Expand Up @@ -60,9 +60,7 @@
{
"group": "Overview",
"icon": "book-open-cover",
"pages": [
"overview"
]
"pages": ["overview"]
},
{
"group": "Quick Start",
Expand Down Expand Up @@ -102,16 +100,12 @@
{
"group": "Migration Guides",
"icon": "arrow-up-right-dots",
"pages": [
"migration-guides/v1.5.0"
]
"pages": ["migration-guides/v1.5.0"]
},
{
"group": "SDK Integrations",
"icon": "plug",
"pages": [
"integrations/what-is-an-integration"
]
"pages": ["integrations/what-is-an-integration"]
},
{
"group": "Providers & Guides",
Expand Down Expand Up @@ -184,10 +178,7 @@
{
"group": "Writing Plugins",
"icon": "code",
"pages": [
"plugins/writing-go-plugin",
"plugins/writing-wasm-plugin"
]
"pages": ["plugins/writing-go-plugin", "plugins/writing-wasm-plugin"]
},
"plugins/migration-guide"
]
Expand Down Expand Up @@ -217,18 +208,12 @@
{
"group": "Prompt Repository",
"icon": "folder",
"pages": [
"features/prompt-repository/playground",
"features/prompt-repository/prompts-plugin"
]
"pages": ["features/prompt-repository/playground", "features/prompt-repository/prompts-plugin"]
},
{
"group": "Plugins",
"icon": "puzzle-piece",
"pages": [
"features/plugins/mocker",
"features/plugins/jsonparser"
]
"pages": ["features/plugins/mocker", "features/plugins/jsonparser"]
}
]
},
Expand All @@ -239,16 +224,13 @@
"enterprise/guardrails",
"enterprise/clustering",
"enterprise/adaptive-load-balancing",
"enterprise/user-provisioning",
{
"group": "Advanced Governance",
"icon": "shield-check",
"pages": [
"enterprise/advanced-governance",
"enterprise/rbac"
]
"pages": ["enterprise/advanced-governance", "enterprise/rbac"]
},
"enterprise/mcp-with-fa",
"enterprise/vault-support",
"enterprise/invpc-deployments",
"enterprise/custom-plugins",
"enterprise/audit-logs",
Expand Down Expand Up @@ -286,33 +268,22 @@
{
"group": "OpenAI SDK",
"icon": "openai",
"pages": [
"integrations/openai-sdk/overview",
"integrations/openai-sdk/files-and-batch"
]
"pages": ["integrations/openai-sdk/overview", "integrations/openai-sdk/files-and-batch"]
},
{
"group": "Anthropic SDK",
"icon": "asterisk",
"pages": [
"integrations/anthropic-sdk/overview",
"integrations/anthropic-sdk/files-and-batch"
]
"pages": ["integrations/anthropic-sdk/overview", "integrations/anthropic-sdk/files-and-batch"]
},
{
"group": "Bedrock SDK",
"icon": "aws",
"pages": [
"integrations/bedrock-sdk/overview",
"integrations/bedrock-sdk/files-and-batch"
]
"pages": ["integrations/bedrock-sdk/overview", "integrations/bedrock-sdk/files-and-batch"]
},
{
"group": "GenAI SDK",
"icon": "diamond",
"pages": [
"integrations/genai-sdk/overview"
]
"pages": ["integrations/genai-sdk/overview"]
},
"integrations/litellm-sdk",
"integrations/langchain-sdk",
Expand All @@ -325,7 +296,9 @@
"icon": "id-card",
"pages": [
"enterprise/setting-up-okta",
"enterprise/setting-up-entra"
"enterprise/setting-up-entra",
"enterprise/setting-up-zitadel",
"enterprise/setting-up-google-workspace"
]
},
{
Expand All @@ -338,16 +311,6 @@
"integrations/guardrails/patronus-ai"
]
},
{
"group": "Secret Management (Vaults)",
"icon": "vault",
"pages": [
"integrations/vaults/hashicorp-vault",
"integrations/vaults/aws-secrets-manager",
"integrations/vaults/google-secret-manager",
"integrations/vaults/azure-key-vault"
]
},
{
"group": "Observability",
"icon": "binoculars",
Expand Down Expand Up @@ -467,9 +430,7 @@
{
"tab": "Security",
"icon": "shield",
"pages": [
"security"
]
"pages": ["security"]
},
{
"tab": "Benchmarks",
Expand Down Expand Up @@ -629,10 +590,7 @@
},
{
"group": "September 2025",
"pages": [
"changelogs/v1.2.22",
"changelogs/v1.2.21"
]
"pages": ["changelogs/v1.2.22", "changelogs/v1.2.21"]
}
]
},
Expand Down Expand Up @@ -747,7 +705,7 @@
},
{
"source": "/features/enterprise/scim",
"destination": "/enterprise/setting-up-okta"
"destination": "/enterprise/user-provisioning"
},
{
"source": "/enterprise/intelligent-load-balancing",
Expand Down
Loading
Loading