Skip to content

docs: add Docker-to-host local LLM connection guide - #7965

Closed
r266-tech wants to merge 1 commit into
NousResearch:mainfrom
r266-tech:docs/docker-local-llm-guide
Closed

docs: add Docker-to-host local LLM connection guide#7965
r266-tech wants to merge 1 commit into
NousResearch:mainfrom
r266-tech:docs/docker-local-llm-guide

Conversation

@r266-tech

Copy link
Copy Markdown
Contributor

Summary

Documents behavior added in #7950 (is_local_endpoint Docker/Podman/Lima DNS support) that was missing from user-facing docs.

docker.md — new section "Connecting to local LLMs on the host":

  • Hostname table for Docker Desktop, Podman, Lima/Colima, and --network=host
  • Config example (hermes model with host.docker.internal URL)
  • Notes that Hermes auto-detects these as local endpoints (relaxed timeouts)

local-llm-on-mac.md — updated Timeouts auto-detection description to mention container-to-host DNS names (host.docker.internal, host.containers.internal, host.lima.internal).

Fixes #7963

Why

Users running Hermes inside Docker with a local LLM on the host (Ollama, llama.cpp, omlx, vLLM) have no docs guidance on which hostname to use or that auto-detection works. localhost from inside Docker points to the container, not the host — this is a common gotcha that the new section addresses directly.

docker.md: add 'Connecting to local LLMs on the host' section with
hostname table (Docker/Podman/Lima) and config example.

local-llm-on-mac.md: update Timeouts auto-detection description to
mention container-to-host DNS names (host.docker.internal, etc.).

Documents behavior added in NousResearch#7950 (is_local_endpoint Docker DNS).

Fixes NousResearch#7963
@alt-glitch alt-glitch added type/docs Documentation improvements P3 Low — cosmetic, nice to have area/docker Docker image, Compose, packaging labels Apr 28, 2026
@alt-glitch

Copy link
Copy Markdown
Collaborator

Note: competing PR #12335 addresses the same docs gap (#7963). One should be closed as duplicate.

@benbarclay

Copy link
Copy Markdown
Collaborator

Thanks @r266-tech — closing as redundant. main's docker.md already documents the full Docker-to-host flow (host.docker.internal, --network host, Ollama), and the container-internal hostnames (Podman/Lima) are covered both in docs and in code (_CONTAINER_LOCAL_SUFFIXES). The competing #12335 was closed unmerged, but the content landed on main regardless. Thanks for the docs contribution.

@benbarclay benbarclay closed this Jun 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/docker Docker image, Compose, packaging P3 Low — cosmetic, nice to have type/docs Documentation improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Docs] docker.md missing local LLM connection guide (host.docker.internal)

3 participants