fix: include Nous Portal free-tier models in /model picker - #26910
Closed
pinguarmy wants to merge 1 commit into
Closed
fix: include Nous Portal free-tier models in /model picker#26910pinguarmy wants to merge 1 commit into
pinguarmy wants to merge 1 commit into
Conversation
list_authenticated_providers() only loaded the curated (paid) model list for Nous Portal, so the gateway /model picker never showed free models like deepseek-v4-flash and stepfun/step-3.5-flash. The CLI hermes model command already handled this via union_with_portal_free_recommendations() + check_nous_free_tier(), but the shared list_authenticated_providers() used by the gateway did not. Augment the Nous model list in list_authenticated_providers() with the Portal's freeRecommendedModels (for free-tier users) or paidRecommendedModels (for paid-tier users), mirroring the CLI logic.
Collaborator
This was referenced May 19, 2026
Author
|
Closing — this fix is already present in the current codebase. model_switch.py lines 1534-1548 import and use and for the Nous provider in the /model picker. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The gateway
/modelpicker (used in TUI and messaging platforms) doesn't show Nous Portal free-tier models likedeepseek-v4-flashandstepfun/step-3.5-flash. Only the curated paid models appear.The CLI
hermes modelcommand shows them correctly at the bottom under "Available free models", but the gateway picker omits them entirely.Root Cause
list_authenticated_providers()inhermes_cli/model_switch.pyloads the curated Nous model list from the remote catalog but never augments it with the Portal'sfreeRecommendedModels(orpaidRecommendationsfor paid users).The CLI
hermes model(inhermes_cli/main.py) already handles this via:check_nous_free_tier()— detect user tierunion_with_portal_free_recommendations()— add free modelsunion_with_portal_paid_recommendations()— add paid modelsBut
list_authenticated_providers()— which the gateway's/modelcommand uses — doesn't call any of these.Fix
Augment the Nous model list in
list_authenticated_providers()with the Portal's recommended models, mirroring the CLI logic:freeRecommendedModels(so newly-launched free models show up even if the curated list is stale)paidRecommendationsThe augmentation is wrapped in a try/except so network failures or auth issues degrade gracefully to the curated list.
Testing
prompt_toolkitin test env, unrelated)