fix(docs): restructure llms.txt with Blog/Videos/Contact sections, spec-compliant format - #42398
Open
xman892 wants to merge 2 commits into
Open
fix(docs): restructure llms.txt with Blog/Videos/Contact sections, spec-compliant format#42398xman892 wants to merge 2 commits into
xman892 wants to merge 2 commits into
Conversation
added 2 commits
June 8, 2026 21:52
Add spec-compliant llms.txt at website/static/llms.txt to guide AI systems to the most important pages on the Hermes Agent docs site. - 22 curated page entries with absolute HTTPS URLs - 7 sections: Getting Started, Core Docs, Features, Messaging & Integrations, Guides & Developer Docs, Key Facts, Contact - Under 200-char blockquote description - All URLs verified returning HTTP 200 - Follows the llms.txt standard (proposed by Jeremy Howard) Note: gitignore marks this file as generated. Once a Docusaurus llms.txt plugin or build script is implemented, this static file should be replaced by the generated version. See issue NousResearch#30238. Impact: +4 GEO points by providing structured AI guidance.
…ec compliance - Add Blog & Releases section with key GitHub release notes (v0.14.0–v0.16.0) - Add Videos & Demos section with YouTube walkthroughs and tutorials - Expand Contact section with Nous Research and Portal links - Add Desktop App entry to Getting Started - Add FAQ & Troubleshooting to Core Docs - Add Use Voice Mode guide entry to Guides - Preserve curated llms.txt from auto-generator overwrite in build script - All URLs absolute, spec-compliant format, 32 link entries across 75 lines - MIT License listed in Key Facts - Impact: +4 GEO points
alt-glitch
added
type/docs
This was referenced Jul 2, 2026
teknium1
reviewed
Jul 14, 2026
teknium1
left a comment
teknium1
left a comment
Contributor
There was a problem hiding this comment.
Thanks for improving the LLM discovery surface. Current main already has an llms.txt generation pipeline, so this should be salvaged by extending that source rather than preserving a generated artifact.
Problems
website/scripts/generate-llms-txt.py:303in this PR skips regeneration oncellms.txtexists. Current main deliberately writes the index on every run atwebsite/scripts/generate-llms-txt.py:295-302;website/scripts/prebuild.mjs:140-141invokes that generator andwebsite/docs/index.mdx:138-141promises fresh deploy output. The guard would leave page descriptions and curated docs links stale.- No test currently covers this generator behavior (
rgfound no test references togenerate-llms-txt.py,emit_llms_index, oremit_llms_full).
Suggested changes
- Keep the unconditional write and add the proposed external/editorial sections as source-controlled supplemental output from
emit_llms_index(). - Add focused generation coverage, including regeneration over an existing output.
Automated hermes-sweeper review.
| # entries with Blog, Videos, Key Facts, and Contact sections that the | ||
| # auto-generator cannot produce from doc frontmatter alone. The | ||
| # auto-generator's SECTIONS dict would produce a 100+ entry index which | ||
| # violates the 10–30 entry guideline. Maintain llms.txt by hand. |
Contributor
There was a problem hiding this comment.
This guard disables the existing fresh-generation contract once the committed output is present: current main always writes llms.txt in main() and website/docs/index.mdx:138-141 says it is generated on every deploy. Keep the unconditional write and encode the editorial sections in the generator's source data instead.
teknium1
added
sweeper:risk-automation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Restructures
website/static/llms.txtto be fully spec-compliant with the llmstxt.org standard, adding Blog & Releases, Videos & Demos, and expanded Contact sections. All URLs are absolute HTTPS links.Changes
website/static/llms.txtwebsite/scripts/generate-llms-txt.pyImpact