Skip to content

test(cli): align custom provider probe assertion with api_mode kwarg - #15254

Closed
WadydX wants to merge 1 commit into
NousResearch:mainfrom
WadydX:fix/test-custom-provider-signature-15243
Closed

test(cli): align custom provider probe assertion with api_mode kwarg#15254
WadydX wants to merge 1 commit into
NousResearch:mainfrom
WadydX:fix/test-custom-provider-signature-15243

Conversation

@WadydX

@WadydX WadydX commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Summary

  • update one stale test assertion to match current fetch_api_models call signature
  • keep scope to test-only change in tests/hermes_cli/test_custom_provider_model_switch.py

Root cause

_model_flow_named_custom() now calls:
fetch_api_models(api_key, base_url, timeout=8.0, api_mode=api_mode or None)

The test test_saved_model_still_probes_endpoint still expected a call without api_mode, which causes a false failure.

Validation

  • uv run pytest -q -n 0 tests/hermes_cli/test_custom_provider_model_switch.py::TestCustomProviderModelSwitch::test_saved_model_still_probes_endpoint -vv
  • uv run pytest -q -n 0 tests/hermes_cli/test_custom_provider_model_switch.py
  • uv run pytest -q -n 0 tests/hermes_cli/test_custom_provider_model_switch.py::TestCustomProviderModelSwitch::test_saved_model_still_probes_endpoint tests/hermes_cli/test_plugin_scanner_recursion.py::TestKindField::test_unknown_kind_falls_back_to_standalone tests/hermes_cli/test_provider_config_validation.py::TestNormalizeCustomProviderEntry::test_unknown_keys_logged tests/hermes_cli/test_provider_config_validation.py::TestNormalizeCustomProviderEntry::test_camel_case_warning_logged -vv

Fixes #15243

@alt-glitch alt-glitch added type/test Test coverage or test infrastructure P3 Low — cosmetic, nice to have comp/cli CLI entry point, hermes_cli/, setup wizard labels Apr 24, 2026
@alt-glitch

Copy link
Copy Markdown
Collaborator

Likely duplicate of #15246 — same fix for #15243 (stale fetch_api_models assertion missing api_mode kwarg).

@WadydX

WadydX commented May 11, 2026

Copy link
Copy Markdown
Contributor Author

Closing as duplicate/superseded. This fix path was already covered elsewhere and issue #15243 is now resolved.

@WadydX WadydX closed this May 11, 2026
@WadydX
WadydX deleted the fix/test-custom-provider-signature-15243 branch May 11, 2026 13:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp/cli CLI entry point, hermes_cli/, setup wizard P3 Low — cosmetic, nice to have type/test Test coverage or test infrastructure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: test_custom_provider_model_switch asserts outdated fetch_api_models signature

2 participants