Skip to content

feat: Add OPEN_AI_LLM_TIMEOUT environment variable for LLM timeout - #1019

Closed
Jah-yee wants to merge 1 commit into
NousResearch:mainfrom
Jah-yee:feat/add-timeout-env
Closed

feat: Add OPEN_AI_LLM_TIMEOUT environment variable for LLM timeout#1019
Jah-yee wants to merge 1 commit into
NousResearch:mainfrom
Jah-yee:feat/add-timeout-env

Conversation

@Jah-yee

@Jah-yee Jah-yee commented Mar 12, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds OPEN_AI_LLM_TIMEOUT environment variable to configure LLM timeout
  • Default is 900s (existing behavior) if not set
  • Allows users to override when using local LLM providers like Ollama or LM Studio

Changes

  • run_agent.py: Changed hardcoded timeout to use os.getenv("OPEN_AI_LLM_TIMEOUT", 900.0))

Testing

  • Existing tests should pass (no behavior change when env var is not set)
  • Can be tested by setting OPEN_AI_LLM_TIMEOUT=1800 for 30-minute timeout

Closes #1010

Allows users to override the hardcoded 900s timeout when using
local LLM providers like Ollama or LM Studio.

Fixes NousResearch#1010
@teknium1

Copy link
Copy Markdown
Contributor

Thanks for the PR! This has already been implemented as HERMES_API_TIMEOUT (same default of 900s) in PR #1194 — we went with a provider-agnostic name since it applies to all backends, not just OpenAI. Closing as superseded.

@teknium1 teknium1 closed this Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Add OPEN_AI_LLM_TIMEOUT environment variable

2 participants