Skip to content

fix(docs-ci): probe the benchmark page at its published slug in the styles check - #13476

Merged
dagil-nvidia merged 1 commit into
mainfrom
dagil/fix-css-check-benchmark-url
Aug 23, 2026
Merged

fix(docs-ci): probe the benchmark page at its published slug in the styles check#13476
dagil-nvidia merged 1 commit into
mainfrom
dagil/fix-css-check-benchmark-url

Conversation

@dagil-nvidia

@dagil-nvidia dagil-nvidia commented Aug 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

Every main-publish run of the Fern Docs workflow has failed its final step, "Verify published pages carry their component CSS", since the RecipeStyles probe was added on Aug 4 (#12339). The probe derived its URL from the page's file path (recipes/feature-benchmarks/llama-3-3-70b-topology), but the nav publishes the section under slug: benchmarks and the page under an explicit slug: llama-3-70b-topology, so the probe 404ed on every execution. Runs that looked green had merely skipped the docs job (non-docs pushes). The failure was masked for two weeks because the step runs after the sync and publish already succeeded.

One-line fix: probe recipes/benchmarks/llama-3-70b-topology, with a comment noting the URL comes from the nav's explicit slugs, not the file path.

Validation

Ran check_published_styles.py against the live site: all six probes pass, including .dynamo-benchmark-grid (6 rules, RecipeStyles) at the corrected URL. The first main publish after this merges should go fully green end to end.

🤖 Generated with Claude Code


Open in Devin Review

Summary by CodeRabbit

  • Documentation
    • Updated the benchmark recipe reference to the current location.
    • Improved the formatting of an allowed-origin error message.

…tyles check

The RecipeStyles probe added in #12339 derived its URL from the page's
file path (recipes/feature-benchmarks/llama-3-3-70b-topology), but the
nav publishes the section as 'benchmarks' and the page under an explicit
'llama-3-70b-topology' slug, so the probe 404ed on every run. Every
main-publish Fern Docs run that executed the check since Aug 4 failed on
it; runs that looked green had skipped the docs job entirely.

Verified against the live site: all six probes pass, including
.dynamo-benchmark-grid (6 rules) at the corrected URL.

Signed-off-by: Dan Gil <dagil@nvidia.com>
@dagil-nvidia
dagil-nvidia requested a review from a team as a code owner August 18, 2026 17:14
@dagil-nvidia

Copy link
Copy Markdown
Collaborator Author

/ok to test bd599fd

@github-actions github-actions Bot added fix documentation Improvements or additions to documentation labels Aug 18, 2026
@coderabbitai

coderabbitai Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: e001247e-f0fa-43fe-8281-b7b8eb806078

📥 Commits

Reviewing files that changed from the base of the PR and between f5802d3 and bd599fd.

📒 Files selected for processing (1)
  • docs/fern/scripts/check_published_styles.py

Included review availability: Your plan includes up to 12 reviews per rolling hour; 10 remain after this review.


Walkthrough

The published style checker now checks the updated benchmark recipe path. It also simplifies disallowed-origin error-message construction and adds spacing after the module docstring.

Changes

Published style checker

Layer / File(s) Summary
Update published style checks
docs/fern/scripts/check_published_styles.py
The benchmark path in CHECKS now uses recipes/benchmarks/llama-3-70b-topology. The disallowed-origin message construction is shorter and preserves its output. A blank line follows the module docstring.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: ⚪ Minimal · up to bd599

The styles check now probes the benchmark page at its published URL, correcting the documented 404 failure without changing product behavior; no actionable merge-blocking risk remains after normal checks and review.

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description explains the failure, fix, and validation, but it omits the required Related Issues section and reviewer-start guidance. Add the required Related Issues section with an issue link or confirmation that no issue is related, and identify where the reviewer should start.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies the docs CI fix and the use of the published benchmark slug.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

Comment @coderabbitai help to get the list of available commands.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@github-actions

Copy link
Copy Markdown
Contributor

@dagil-nvidia
dagil-nvidia enabled auto-merge (squash) August 23, 2026 14:02

@BenHamm BenHamm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving. Verified the diagnosis against the live site rather than the description.

  • The old probe URL, /dynamo/dev/recipes/feature-benchmarks/llama-3-3-70b-topology, returns 404.
  • The new one, /dynamo/dev/recipes/benchmarks/llama-3-70b-topology, returns 200.

So the file-path-derived URL never matched the published slug, and the step could only ever fail. The nav confirms why: the page carries an explicit slug: llama-3-70b-topology distinct from its filename, under a section published as benchmarks rather than the feature-benchmarks directory name.

Worth noting the fix leaves the check meaningful rather than merely green: the page at the corrected URL serves 126 matches for the dynamo-* component classes, so the probe will genuinely assert that the component CSS shipped. A probe that 404s proves nothing; this one now proves the thing it was written to prove.

The second hunk is an unrelated f-string concatenation tidy-up in the same file. Harmless.

CI clean, no unresolved threads. Good catch on the two weeks of masked failures.

@dagil-nvidia
dagil-nvidia merged commit 004cd02 into main Aug 23, 2026
104 checks passed
@dagil-nvidia
dagil-nvidia deleted the dagil/fix-css-check-benchmark-url branch August 23, 2026 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation fix size/XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants