Skip to content

docs updates#2691

Merged
akshaydeo merged 1 commit intomainfrom
04-14-docs_updates
Apr 13, 2026
Merged

docs updates#2691
akshaydeo merged 1 commit intomainfrom
04-14-docs_updates

Conversation

@akshaydeo
Copy link
Copy Markdown
Contributor

@akshaydeo akshaydeo commented Apr 13, 2026

Summary

This PR adds v1.5.0-prerelease3 release documentation and updates the LiteLLM compatibility plugin to support chat-to-responses conversion and parameter dropping functionality.

Changes

  • Added v1.5.0-prerelease3 changelog with new features including OAuth MCP improvements, Azure passthrough support, 272k token tier pricing, and flex/priority tier support
  • Enhanced LiteLLM compatibility plugin to support chat-to-responses conversion for models that only support responses API (like OpenAI o1-pro)
  • Added parameter dropping functionality to automatically remove unsupported parameters based on model catalog allowlist
  • Updated documentation for the expanded LiteLLM compatibility features with detailed configuration options
  • Fixed API method naming in model catalog documentation (ReloadPricingUpdateSyncConfig)
  • Enhanced Okta setup guide with improved role and group configuration instructions
  • Added new pricing tiers documentation for 272k token context and flex/priority pricing models
  • Updated OpenAPI schema to reflect new compat plugin configuration structure

Type of change

  • Feature
  • Documentation
  • Bug fix
  • Refactor
  • Chore/CI

Affected areas

  • Core (Go)
  • Transports (HTTP)
  • Providers/Integrations
  • Plugins
  • Docs

How to test

Validate the LiteLLM compatibility enhancements:

# Test chat-to-responses conversion
curl -X POST http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer your-key" \
  -d '{
    "model": "o1-pro",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

# Verify compat plugin configuration
curl -X GET http://localhost:8080/v1/config \
  -H "Authorization: Bearer your-admin-key"

Test the model catalog API update:

newConfig := &modelcatalog.Config{
    PricingSyncInterval: 12 * time.Hour,
}
err := modelCatalog.UpdateSyncConfig(ctx, newConfig)

Breaking changes

  • Yes
  • No

The LiteLLM compatibility configuration structure has been updated from a simple boolean to an object with granular controls, but this maintains backward compatibility.

Related issues

Part of the v1.5.0-prerelease3 release cycle with enhanced LiteLLM compatibility and pricing model improvements.

Security considerations

The Okta setup guide includes improved instructions for secure role mapping and API token creation for user provisioning.

Checklist

  • I read docs/contributing/README.md and followed the guidelines
  • I added/updated tests where appropriate
  • I updated documentation where needed
  • I verified builds succeed (Go and UI)
  • I verified the CI pipeline passes locally if applicable

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Apr 13, 2026

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: a236b839-11f0-4f41-9202-72e549a29139

📥 Commits

Reviewing files that changed from the base of the PR and between a8cf690 and 52624e5.

📒 Files selected for processing (10)
  • docs/architecture/framework/model-catalog.mdx
  • docs/changelogs/v1.5.0-prerelease2.mdx
  • docs/changelogs/v1.5.0-prerelease3.mdx
  • docs/docs.json
  • docs/enterprise/setting-up-okta.mdx
  • docs/features/litellm-compat.mdx
  • docs/migration-guides/v1.5.0.mdx
  • docs/openapi/schemas/management/config.yaml
  • docs/providers/custom-pricing.mdx
  • docs/providers/supported-providers/overview.mdx

📝 Walkthrough

Summary by CodeRabbit

  • Documentation

    • Updated Okta setup guide with new prerequisites, custom attribute configuration, and API token requirements.
    • Enhanced LiteLLM compatibility documentation with new conversion types and updated configuration structure.
    • Added v1.5.0-prerelease3 changelog with release notes.
  • New Features

    • Support for 272k token tier pricing.
    • Flex and priority tier pricing options.
    • Chat-to-responses conversion for LiteLLM compatibility.
    • Compatibility mode enabling v1.4.x configuration semantics.
  • Configuration Changes

    • LiteLLM settings migrated to granular compat object with discrete flags.

Walkthrough

This pull request updates documentation and OpenAPI schemas across multiple areas: it replaces enable_litellm_fallbacks configuration with a new compat object structure, adds v1.5.0-prerelease3 changelog entry, restructures Okta setup instructions, expands pricing and LiteLLM compatibility documentation, adds v1.5.0 compatibility mode documentation, and updates framework code examples.

Changes

Cohort / File(s) Summary
LiteLLM Compatibility Configuration
docs/features/litellm-compat.mdx, docs/openapi/schemas/management/config.yaml, docs/providers/supported-providers/overview.mdx
Migrated configuration from boolean enable_litellm_fallbacks to object compat with flags convert_text_to_chat, convert_chat_to_responses, should_drop_params, and should_convert_params; expanded documentation for chat-to-responses conversion feature.
Changelog & Navigation Updates
docs/changelogs/v1.5.0-prerelease2.mdx, docs/changelogs/v1.5.0-prerelease3.mdx, docs/docs.json
Removed breaking changes warnings from v1.5.0-prerelease2; added new v1.5.0-prerelease3 changelog with Bifrost features, fixes, and refactors; updated navigation to include new prerelease page.
Migration & Compatibility Guidance
docs/migration-guides/v1.5.0.mdx
Added "version: 1" compatibility mode documentation explaining deny-by-default override for legacy v1.4.x semantics; removed ollama provider block from migration example.
Pricing & Provider Documentation
docs/providers/custom-pricing.mdx, docs/architecture/framework/model-catalog.mdx
Expanded pricing field reference with flex tier and 272k token tier variants; updated framework code example method call from ReloadPricing to UpdateSyncConfig.
Okta Setup & Enterprise Configuration
docs/enterprise/setting-up-okta.mdx
Restructured Okta integration guide: added role prerequisite, replaced optional authorization server section with custom user attribute creation, simplified groups claim configuration, added Okta API token step, clarified role vs. group assignment precedence.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Poem

🐰 A config refactor, both tidy and bright,
From flags into objects, structured just right,
LiteLLM dances in compat's new dress,
While changelogs flourish—no breaking stress!
Pricing tiers bloom at 272k height,
Our docs hop forward to version's new light. 🌟

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch 04-14-docs_updates

Comment @coderabbitai help to get the list of available commands and usage tips.

@CLAassistant
Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Copy link
Copy Markdown
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@github-actions
Copy link
Copy Markdown
Contributor

🧪 Test Suite Available

This PR can be tested by a repository admin.

Run tests for PR #2691

@akshaydeo akshaydeo marked this pull request as ready for review April 13, 2026 21:32
@akshaydeo akshaydeo merged commit 79a1ab4 into main Apr 13, 2026
15 of 20 checks passed
@akshaydeo akshaydeo deleted the 04-14-docs_updates branch April 13, 2026 21:33
@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps Bot commented Apr 13, 2026

Confidence Score: 5/5

Safe to merge; all findings are minor style/completeness suggestions with no impact on correctness.

All four comments are P2 (style, missing newline, wording, and a missing doc entry for a schema field). None affect correctness or user-facing behavior.

docs/enterprise/setting-up-okta.mdx and docs/features/litellm-compat.mdx have minor style issues.

Important Files Changed

Filename Overview
docs/enterprise/setting-up-okta.mdx Steps renumbered and simplified; dangling "This approach" phrase left after removing Option A/B structure, and missing blank line before horizontal rule in Prerequisites.
docs/features/litellm-compat.mdx Documents new Chat-to-Responses and Drop-Unsupported-Params features; missing newline at EOF and undocumented should_convert_params field present in the OpenAPI schema.
docs/changelogs/v1.5.0-prerelease3.mdx New changelog file for prerelease3; well-structured with features, fixes, and module version bumps.
docs/migration-guides/v1.5.0.mdx Adds version: 1 compatibility mode section and removes an incomplete Ollama example; JSON structure is intact after the removal.
docs/openapi/schemas/management/config.yaml Replaces boolean enable_litellm_fallbacks with structured compat object; additionalProperties: false correctly applied.
docs/providers/custom-pricing.mdx Adds flex tier, priority 200k/272k context, and cache cost fields to pricing reference table; changes are additive and consistent.
docs/changelogs/v1.5.0-prerelease2.mdx Removes breaking-changes table and two feature entries; entries for model alias support were consolidated into prerelease3 changelog.
docs/architecture/framework/model-catalog.mdx Updates ReloadPricing to UpdateSyncConfig in code example, matching the renamed API.
docs/providers/supported-providers/overview.mdx Updates enable_litellm_fallbacks reference to compat.convert_text_to_chat, keeping the note accurate with the new config schema.
docs/docs.json Adds the new prerelease3 changelog to the navigation; ordering is correct (newest first).

Reviews (1): Last reviewed commit: "docs updates" | Re-trigger Greptile


#### Option B: Using Authorization Server Groups Claim

This approach adds the groups claim through your authorization server, providing more flexibility for complex configurations.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Dangling "This approach" reference

After removing Option A / Option B, the opening sentence "This approach adds the groups claim through your authorization server…" has no referent. Readers arriving at this section for the first time won't know what "this approach" means relative to any alternative.

Suggested change
This approach adds the groups claim through your authorization server, providing more flexibility for complex configurations.
Configure the groups claim through your authorization server, which supports flexible configurations and works across Okta plans.

Comment on lines +16 to 17
- Ensure you have created all the [roles in Bifrost](/enterprise/rbac) that you are aiming to map to with Okta.
---
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Missing blank line before horizontal rule

The new prerequisite bullet is immediately followed by --- with no blank line. Some Markdown parsers may render --- as a heading underline (<h2>) for the preceding list item rather than a <hr>.

Suggested change
- Ensure you have created all the [roles in Bifrost](/enterprise/rbac) that you are aiming to map to with Okta.
---
- Ensure you have created all the [roles in Bifrost](/enterprise/rbac) that you are aiming to map to with Okta.
---

- [Fallbacks](/features/fallbacks) - Automatic provider failover
- [Drop-in Replacement](/features/drop-in-replacement) - Use existing SDKs with Bifrost
- [LiteLLM Integration](/integrations/litellm-sdk) - Using LiteLLM SDK with Bifrost
- [LiteLLM Integration](/integrations/litellm-sdk) - Using LiteLLM SDK with Bifrost No newline at end of file
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Missing newline at end of file

The diff shows \ No newline at end of file. Most linters and editors expect a trailing newline.

Suggested change
- [LiteLLM Integration](/integrations/litellm-sdk) - Using LiteLLM SDK with Bifrost
- [LiteLLM Integration](/integrations/litellm-sdk) - Using LiteLLM SDK with Bifrost

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!

Comment on lines 108 to 118
```json
{
"client_config": {
"enable_litellm_fallbacks": true
"compat": {
"convert_text_to_chat": true,
"convert_chat_to_responses": true,
"should_drop_params": true
}
}
}
```
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 should_convert_params not documented

The OpenAPI schema (config.yaml) adds a fourth compat field — should_convert_params — but the JSON config example here and the UI step list only cover three options (convert_text_to_chat, convert_chat_to_responses, should_drop_params). Users who discover the schema field directly won't know what it does or when to enable it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants