v1.4.15 version cut

[akshaydeo]

Summary

This release includes significant improvements to streaming performance, provider integrations, and MCP (Model Context Protocol) functionality. Key highlights include a custom SSE stream reader to reduce burstiness, enhanced Bedrock and Anthropic provider support, and various bug fixes for streaming responses.

Changes

• Custom SSE Stream Reader: Replaced fasthttp's default stream reader with a custom implementation to reduce burstiness in SSE streaming
• Enhanced Provider Support: Added compaction support for Anthropic provider, improved Bedrock API key authentication, and fixed Gemini OpenAI integration
• MCP Improvements: Added config validation for MCP tools and fixed notification status codes
• Performance Optimizations: Implemented dashboard and logs query optimizations, PG query improvements, and removed inefficient map marshals
• Streaming Fixes: Fixed passthrough streaming responses being buffered and included function_call items in streaming output
• Model Catalog: Added model catalog support for better model management

Type of change

• Bug fix
• Feature
• Refactor
• Documentation
• Chore/CI

Affected areas

• Core (Go)
• Transports (HTTP)
• Providers/Integrations
• Plugins
• UI (Next.js)
• Docs

How to test

Validate the streaming improvements and provider integrations:

# Core/Transports
go version
go test ./...

# Test streaming functionality
curl -X POST http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model": "gpt-4", "messages": [{"role": "user", "content": "Hello"}], "stream": true}'

# Test MCP config validation
# Verify config.json validation works with MCP tool configurations

# Test Bedrock authentication
# Verify Bedrock works without requiring bedrock_key_config

New configurable field: max-open-connections for provider domains can be set in configuration.

Screenshots/Recordings

N/A - Backend changes only

Breaking changes

• Yes
• No

Related issues

Multiple community contributions included:

• Streaming fixes by @jasonwells, @majiayu000
• Bedrock improvements by @eliasbiondo, @Edward-Upton
• MCP notification fix by @tcx4c70
• Semantic cache fix by @ragokan

Security considerations

• Improved Bedrock API key authentication handling
• Enhanced MCP config validation to prevent misconfigurations

Checklist

• I read docs/contributing/README.md and followed the guidelines
• I added/updated tests where appropriate
• I updated documentation where needed
• I verified builds succeed (Go and UI)
• I verified the CI pipeline passes locally if applicable

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: e3e59f92-02af-489d-a37c-684ef011d80c

📥 Commits

Reviewing files that changed from the base of the PR and between 13ec943 and 95d593e.

📒 Files selected for processing (24)

• core/changelog.md
• core/version
• framework/changelog.md
• framework/version
• plugins/governance/changelog.md
• plugins/governance/version
• plugins/jsonparser/changelog.md
• plugins/jsonparser/version
• plugins/litellmcompat/changelog.md
• plugins/litellmcompat/version
• plugins/logging/changelog.md
• plugins/logging/version
• plugins/maxim/changelog.md
• plugins/maxim/version
• plugins/mocker/changelog.md
• plugins/mocker/version
• plugins/otel/changelog.md
• plugins/otel/version
• plugins/semanticcache/changelog.md
• plugins/semanticcache/version
• plugins/telemetry/changelog.md
• plugins/telemetry/version
• transports/changelog.md
• transports/version

---

📝 Walkthrough

Summary by CodeRabbit

• New Features

  • Model catalog support; MCP high-volume logs ingestion and config validation
  • Configurable connection pooling per provider; expanded dashboard tabs/graphs (model ranking, cache & MCP usage)

• Bug Fixes

  • Streaming output now includes function calls on completion
  • Improved provider integration behavior (content conversion, Anthropic header handling, Gemini flow)
  • Bedrock auth simplified; token-count fallback; Anthropic compaction; deterministic semantic cache hashing

• Performance

  • Dashboard/logs UI and PostgreSQL query optimizations; SSE stream improvements

Walkthrough

Bumps multiple version files and appends changelog entries across core, framework, transports, and several plugins describing new features and fixes (streaming, provider/network configs, auth, token counting fallbacks, query optimizations, and integrations).

Changes

Cohort / File(s)	Summary
Core core/version, core/changelog.md	Version → 1.4.12; added changelog entries for Anthropic compaction, MCP config.json validation, per-domain max-open-connections, streaming fixes (including function_call in response.completed), Bedrock auth fix, token-count fallback, cross-provider “thinking” conversions, header selection fixes, Gemini OpenAI-compatible flow, removal of map marshaling, PG query optimizations.
Framework framework/version, framework/changelog.md	Version → 1.2.31; added changelog entries: model catalog support, MCP high-volume logs ingestion, dashboard/logs query optimizations, PostgreSQL materialized-view query improvements, name truncation (64 chars), Weaviate upgrade.
Transports transports/version, transports/changelog.md	Version → 1.4.15; added changelog entries for custom SSE stream reader, MCP tool-config validation, configurable connection pooling, dashboard additions, LLM logs/dashboard performance improvements, passthrough streaming fixes, MCP notification status fixes, streaming response.completed behavior, Bedrock auth fix, token-count fallback, provider conversion/header fixes, Gemini integration notes, deterministic semantic-cache mention.
Plugins (versions + changelogs) plugins/governance/{version,changelog.md}, plugins/jsonparser/{version,changelog.md}, plugins/litellmcompat/{version,changelog.md}, plugins/logging/{version,changelog.md}, plugins/mocker/{version,changelog.md}, plugins/otel/{version,changelog.md}, plugins/maxim/{version,changelog.md}, plugins/semanticcache/{version,changelog.md}, plugins/telemetry/{version,changelog.md}	Multiple plugin version bumps and minor changelog additions noting core/framework upgrades or a deterministic-hash fix for semanticcache: governance 1.4.30→1.4.31, jsonparser 1.4.29→1.4.30, litellmcompat 0.0.19→0.0.20, logging 1.4.30→1.4.31, mocker 1.4.29→1.4.30, otel 1.1.29→1.1.30, maxim 1.5.28→1.5.29, semanticcache 1.4.28→1.4.29, telemetry 1.4.30→1.4.31.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Poem

🐇 I nibble lines and bump the tag,
I hop through changelogs, never lag.
Versions raised, the meadow bright,
Tiny fixes snug and tight.
Hooray — the patch hops into light!

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Linked Issues check	⚠️ Warning	The PR addresses version bumps and changelog updates but does not implement Files API support for providers as required by issue #123.	Implement Files API support endpoints and provider integrations (OpenAI, Anthropic) for file uploads as specified in issue #123, or remove the issue link if out of scope for this release.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title 'v1.4.15 version cut' accurately describes the PR's primary objective of bumping versions across multiple modules to v1.4.15.
Description check	✅ Passed	The PR description comprehensively follows the template with all major sections completed: summary, detailed changes, type of change, affected areas, testing instructions, breaking changes flag, related issues, security considerations, and checklist.
Out of Scope Changes check	✅ Passed	All changes consist of version bumps and changelog entries documenting existing improvements, which align with the version cut objective and do not introduce unrelated code changes.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch v1.4.15_cut

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[akshaydeo]

• v1.4.15 version cut #2218 👈 (View in Graphite)
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[github-actions]

🧪 Test Suite Available

This PR can be tested by a repository admin.

Run tests for PR #2218