Skip to content

docs: update Fern docs for filter/modifier reorganization (PR #1472) - #1685

Merged
lbliii merged 1 commit into
NVIDIA-NeMo:26.04-stagingfrom
lbliii:lbliii/aegis-classifier-docs
Apr 6, 2026
Merged

docs: update Fern docs for filter/modifier reorganization (PR #1472)#1685
lbliii merged 1 commit into
NVIDIA-NeMo:26.04-stagingfrom
lbliii:lbliii/aegis-classifier-docs

Conversation

@lbliii

@lbliii lbliii commented Mar 31, 2026

Copy link
Copy Markdown
Contributor

Description

Updates all import paths in Fern v26.04 docs to reflect the DocumentFilter and DocumentModifier directory reorganization from PR #1472. That PR restructured nemo_curator/stages/text/filters/ and modifiers/ to avoid eagerly importing heavy dependencies (HuggingFace, fastText, etc.), but only updated the Sphinx docs. This PR brings the Fern docs in sync. Also adds 26.04 release notes for the reorganization.

Closes #1232 (docs follow-up)

Checklist

  • I am familiar with the Contributing Guide.
  • New or Existing tests cover these changes.
  • The documentation is up to date with these changes.

@lbliii
lbliii requested a review from a team as a code owner March 31, 2026 13:41
@lbliii
lbliii requested review from meatybobby and removed request for a team March 31, 2026 13:41
@lbliii
lbliii force-pushed the lbliii/aegis-classifier-docs branch from efc7519 to 55ae580 Compare March 31, 2026 14:15
from nemo_curator.stages.text.modules.score_filter import ScoreFilter
from nemo_curator.filters import WordCountFilter # Example filter
from nemo_curator.stages.text.filters import ScoreFilter
from nemo_curator.stages.text.filters.heuristic import WordCountFilter # Example filter

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm confused, I thought #1472 updated all of the docs too. Did it get overwritten somewhere?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR #1472 updated import paths in the Sphinx docs (docs/), but the Fern v26.04 docs (fern/versions/v26.04/) were initialized from the old Sphinx content before #1472 landed — so the Fern pages still had the stale import paths. Nothing was overwritten; the Fern docs just never received the update. This PR closes that gap.

Also just pushed a fix for one file (data-processing-concepts.mdx) where the heuristic filter sub-path imports were missed — now matches what #1472 established in the Sphinx docs.

@copy-pr-bot

copy-pr-bot Bot commented Apr 6, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

NVIDIA-NeMo#1472)

Update import paths and release notes in Fern v26.04 docs to reflect
the DocumentFilter/DocumentModifier directory restructuring that avoids
eagerly importing heavy dependencies.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants