Allow configuration to set threshold before request entry in spend log gets truncated

[WilsonSunBritten]

Title

Relevant issues

Fixes #10988

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally, due to local env environments relying on PR passing new unit tests.
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature

Changes

Added a new litellm param of 'max_request_size_before_trunc` for number of characters in a request message before going through the normal truncation process

Tests passing

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
litellm	Ready	Preview	Comment	Aug 28, 2025 11:41pm

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ WilsonSunBritten
❌ Wilson Britten

---

Wilson Britten seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[ishaan-jaff]

suggested using constants instead of litellm_settings

[ishaan-jaff]

instead - can you just make MAX_STRING_LENGTH a constant in constants.py and control it through a .env

that feels cleaner

you can call it something like MAX_STRING_LENGTH_PROMPT_IN_DB

[WilsonSunBritten]

Sure thing. I'll note the big trade-off is control over the max limit size in the db with the current approach, while with this you could end up ~20x larger than what you configure if you have many large sub-prompts in your request. Still for the purposes I'm trying to unblock that works great.

[WilsonSunBritten]

Done and looking good!

[ghost]

can you please document this parameter in config_settings.md? @WilsonSunBritten

[WilsonSunBritten]

can you please document this parameter in config_settings.md? @WilsonSunBritten

@krrishdholakia I have submitted another MR for this here: #14079

[Antoine101]

Thanks for working on that guys! Do you have an idea of when this will be released?