Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions docs/providers/bedrock_mantle.md
Original file line number Diff line number Diff line change
Expand Up @@ -228,6 +228,25 @@ print(response)
</TabItem>
</Tabs>

### Web search

The GPT-5.4 / GPT-5.5 / GPT-5.6 models on Mantle run web search server side, so pass the tool through `/v1/responses` and Bedrock does the searching

```bash
curl -X POST http://0.0.0.0:4000/v1/responses \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $LITELLM_API_KEY" \
-d '{
"model": "gpt-5.5-mantle",
"input": "What changed in the newest LiteLLM release?",
"tools": [{"type": "web_search"}]
}'
```

The response carries `web_search_call` items showing the queries the model ran, alongside the assistant message

Mantle accepts `function`, `mcp`, `custom`, `namespace`, `tool_search`, and the web search family. Anything else, `image_generation` and `code_interpreter` for instance, is dropped from the request with a warning in the gateway logs rather than failing the call. Web search is a Responses API feature only: `/chat/completions` on Mantle takes function and custom tools alone

## API Key

```python
Expand Down