Skip to content

fix(test): clear tokenizer LRU cache for test isolation #21279

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jquinter merged 3 commits into from
Feb 16, 2026
Merged

fix(test): clear tokenizer LRU cache for test isolation #21279

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
5f79bf4
fix(test): clear tokenizer LRU cache for test isolation
jquinter Feb 15, 2026
bae8816
Update tests/test_litellm/litellm_core_utils/test_token_counter.py
jquinter Feb 15, 2026
706792b
refactor: simplify cache clearing to avoid over-engineering
jquinter Feb 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions tests/test_litellm/litellm_core_utils/test_token_counter.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -491,7 +491,20 @@ def test_token_counter():
from litellm.utils import _select_tokenizer_helper, claude_json_str, encoding


# Clear the cache at module load to ensure clean state
_select_tokenizer_helper.cache_clear()


class TestTokenizerSelection(unittest.TestCase):
def setUp(self):
"""Clear the LRU cache before each test method.

The _select_tokenizer_helper function is decorated with @lru_cache,
which can cause cache hits from previous tests when running with
--dist=loadscope (tests from same file run on same worker).
"""
_select_tokenizer_helper.cache_clear()

@patch("litellm.utils.Tokenizer.from_pretrained")
def test_llama3_tokenizer_api_failure(self, mock_from_pretrained):
# Setup mock to raise an error
Expand Down
Loading