Skip to content

[Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek) - #9029

Merged
ishaan-jaff merged 13 commits into
mainfrom
litellm_temp_fixes_bedrock_thinking
Mar 7, 2025
Merged

[Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek)#9029
ishaan-jaff merged 13 commits into
mainfrom
litellm_temp_fixes_bedrock_thinking

Conversation

@ishaan-jaff

@ishaan-jaff ishaan-jaff commented Mar 6, 2025

Copy link
Copy Markdown
Contributor

[Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek)

Example config on litellm

Set merge_reasoning_content_in_choices=True on the config

model_list:
  - model_name: bedrock/us.anthropic.claude-3-7-sonnet-20250219-v1:0
    litellm_params:
      model: bedrock/us.anthropic.claude-3-7-sonnet-20250219-v1:0
      thinking: {"type": "enabled", "budget_tokens": 1024}
      max_tokens: 1080
      merge_reasoning_content_in_choices: true

Xnapper-2025-03-06-07 02 11

Relevant issues

Type

🆕 New Feature
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

@vercel

vercel Bot commented Mar 6, 2025

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 7, 2025 2:35am

@codecov

codecov Bot commented Mar 7, 2025

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

📢 Thoughts on this report? Let us know!

fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026
…Deepseek) (BerriAI#9029)

* if merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* stash changes

* working merge_reasoning_content_in_choices with bedrock

* fix litellm_params accessor

* fix streaming handler

* merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* test_bedrock_stream_thinking_content_openwebui

* merge_reasoning_content_in_choices

* fix for _optional_combine_thinking_block_in_choices

* linting error fix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant