Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion core/bifrost.go
Original file line number Diff line number Diff line change
Expand Up @@ -1358,10 +1358,14 @@ func (bifrost *Bifrost) getChannelMessage(req schemas.BifrostRequest, reqType Re
msg := bifrost.channelMessagePool.Get().(*ChannelMessage)
msg.BifrostRequest = req
msg.Response = responseChan
msg.ResponseStream = make(chan chan *schemas.BifrostStream, 1) // Initialize the ResponseStream channel
msg.Err = errorChan
msg.Type = reqType

// Conditionally allocate ResponseStream for streaming requests only
if reqType == ChatCompletionStreamRequest {
msg.ResponseStream = make(chan chan *schemas.BifrostStream, 1)
}

return msg
}

Expand Down
2 changes: 2 additions & 0 deletions docs/usage/networking.md
Original file line number Diff line number Diff line change
Expand Up @@ -260,6 +260,8 @@ export NO_PROXY=localhost,127.0.0.1,.company.com

</details>

> Please note that the proxy configuration is not supported for **streaming requests**, and for **Bedrock** and **Vertex** Providers.
Comment thread
akshaydeo marked this conversation as resolved.

---

## ⏱️ Timeout & Retry Configuration
Expand Down
1 change: 1 addition & 0 deletions tests/core-providers/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ This directory contains comprehensive tests for all Bifrost AI providers, ensuri
- **Mistral** - Mistral AI models with vision capabilities
- **Ollama** - Local LLM serving platform
- **Groq** - Groq models
- **SGLang** - SGLang models
Comment thread
akshaydeo marked this conversation as resolved.

## 🏃‍♂️ Running Tests

Expand Down