Skip to content

fix(huggingface): Endpoint doesn't accept max_new_tokens anymore - #570

Merged
njbrake merged 1 commit into
mainfrom
brake/hf_max
Oct 22, 2025
Merged

njbrake merged 1 commit into
mainfrom
brake/hf_max

Conversation

@njbrake

@njbrake njbrake commented Oct 22, 2025

Copy link
Copy Markdown
Contributor

Description

hf expects max_tokens and no longer accepts max_new_tokens...

PR Type

🆕 New Feature 🐛 Bug Fix 💅 Refactor 📚 Documentation 🚦 Infrastructure ## Relevant issues

Checklist

  • I have added unit tests that prove my fix/feature works
  • New and existing tests pass locally
  • Documentation was updated where necessary
  • I have read and followed the contribution guidelines```

@njbrake

njbrake commented Oct 22, 2025

Copy link
Copy Markdown
Contributor Author

@codecov

codecov Bot commented Oct 22, 2025 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

Files with missing lines Coverage Δ
src/any_llm/providers/huggingface/utils.py 80.35% <ø> (-0.68%) ⬇️

... and 35 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@njbrake
njbrake merged commit 725b960 into main Oct 22, 2025
13 checks passed
@njbrake
njbrake deleted the brake/hf_max branch October 22, 2025 13:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant