Skip to content

docs: r1.1.0 release note updates - #1587

Merged
lbliii merged 33 commits into
NVIDIA-NeMo:r1.1.0from
lbliii:llane/r1.1.0-release-note-updates
Mar 23, 2026
Merged

docs: r1.1.0 release note updates#1587
lbliii merged 33 commits into
NVIDIA-NeMo:r1.1.0from
lbliii:llane/r1.1.0-release-note-updates

Conversation

@lbliii

@lbliii lbliii commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@lbliii lbliii self-assigned this Mar 9, 2026
@copy-pr-bot

copy-pr-bot Bot commented Mar 9, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@lbliii
lbliii changed the base branch from main to r1.1.0 March 9, 2026 17:38
pablo-garay and others added 26 commits March 16, 2026 12:03
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Dong Hyuk Chang <thomaschang26@tutanota.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Ao Tang <aot@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Ao Tang <aot@nvidia.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Fix bug in Gliner tutorial

* update readmes

---------

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Dong Hyuk Chang <thomaschang26@tutanota.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…orStage (NVIDIA-NeMo#1350) (NVIDIA-NeMo#1366)

Signed-off-by: Abhinav Garg <abhinavg@stanford.edu>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Abhinav Garg <abhinavg@stanford.edu>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
… tutorial (NVIDIA-NeMo#1380) (NVIDIA-NeMo#1402)

* Update instructions for AWS credentials in ArXiv download and extract tutorial

* ruff

---------

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…DIA-NeMo#1374) (NVIDIA-NeMo#1403)

This reverts commit c4805ae.

Signed-off-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
… Dataset (NVIDIA-NeMo#1416) (NVIDIA-NeMo#1423)

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…0.14 (NVIDIA-NeMo#1429)

* vllm API compatibility fixed

Signed-off-by: Ao Tang <aot@nvidia.com>

* upgrade vllm to 0.14.0

Signed-off-by: Ao Tang <aot@nvidia.com>

* refactor

Signed-off-by: Ao Tang <aot@nvidia.com>

* pyproject update

Signed-off-by: Ao Tang <aot@nvidia.com>

* add protobuf in constraint-dependencies

Signed-off-by: Ao Tang <aot@nvidia.com>

* comment improve

Signed-off-by: Ao Tang <aot@nvidia.com>

* resolve pyproject

Signed-off-by: Ao Tang <aot@nvidia.com>

---------

Signed-off-by: Ao Tang <aot@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Address CVE fixes

* Remove cache of aiohttp from ray

* Update uv lock

* Update cache path

---------

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…IDIA-NeMo#1446)

* Optimize docker layer and uv with no cache

* Add missing slash

* Add comments to dockerfile

---------

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Remove Internvideo2

* more to remove

* fix writer

* Enhance Clip class to include cosmos_embed1_frames and cosmos_embed1_embedding in total size calculation

* remove iv2

---------

Signed-off-by: Ao Tang <aot@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Ao Tang <aot@nvidia.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
)

* Update cve for python-multipart

* Update uv lock

---------

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Co-authored-by: Huy Vu2 <huvu@login-eos02.eos.clusters.nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…VIDIA-NeMo#1468)

* Update vllm to 0.14.1 and override conflict

* Upperbound numpy for Numba compatibility

* Update vllm to 0.15.1

---------

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…A-NeMo#1475)

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…o#1486)

Signed-off-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
NVIDIA-NeMo#1471) (NVIDIA-NeMo#1488)

* Update transformers dependency to exact version 4.55.2 in pyproject.toml and uv.lock to prevent import failures in Cosmos Embed. Downgrade tokenizers version to 0.21.4 for compatibility.

* Update transformers dependency in pyproject.toml and uv.lock to allow versions up to 4.55.2, ensuring compatibility with Cosmos Embed imports.

---------

Signed-off-by: Abhinav Garg <abhinavg@stanford.edu>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Abhinav Garg <abhinavg@stanford.edu>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Update tutorial README

Signed-off-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>

* Update quickstart

Updated sample sentences to provide more detailed feedback.

Signed-off-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>

---------

Signed-off-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
…NVIDIA-NeMo#1499)

* Update tutorial to be more explicit about num_gpus

* fix false positive secret scan

* Hopefully fix the secrets

---------

Signed-off-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* add release notes

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* add more pages

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* add more pages

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* add new sdg docs

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* update remaining files from sdg docs

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* continue adding more changes

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* more video docs

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

* add remaining updates

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>

---------

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Scrub thirdparty aiohttp file from ray

* Address new rc4 CVE

* Apt get for consistency

---------

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* Add feedback to tutorials

* clarify install instructions for classifier tutorials

* byo classifiers

* add descriptions

---------

Signed-off-by: Sarah Yurick <sarahyurick@gmail.com>
Signed-off-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
thomasdhc and others added 4 commits March 16, 2026 12:03
…ck (NVIDIA-NeMo#1511) (NVIDIA-NeMo#1513)

* Refactor video frame extraction to improve PyNvCodec availability check

- Removed the try-except block for importing PyNvcFrameExtractor, simplifying the import logic.
- Updated the condition for initializing the PyNvcFrameExtractor in the VideoFrameExtractionStage to rely solely on the _PYNVC_AVAILABLE flag.
- Adjusted the handling of pixel format conversion in NvVideoDecoder to prepare for future updates to cvcuda.

* Refactor NvVideoDecoder to replace deprecated nvcv_image with cvcuda tensor

- Updated NvVideoDecoder to remove the use of nvcv_image, which is deprecated, and replaced it with cvcuda tensor.
- Adjusted related tensor operations and tests to ensure compatibility with the new cvcuda implementation.

* Update import statements in test_nvcodec_utils.py to include ruff linting rule

- Modified import statements in the test file to include the RUF100 linting rule, ensuring better adherence to coding standards.
- This change enhances the clarity of the import handling tests.

* Update tests/utils/test_nvcodec_utils.py

* Update tests/utils/test_nvcodec_utils.py

---------

Signed-off-by: Abhinav Garg <abhinavg@stanford.edu>
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Abhinav Garg <abhinavg@stanford.edu>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
* docs: isolate release notes and changelog

Signed-off-by: Lawrence Lane <llane@nvidia.com>

* abhinav's feedback

Signed-off-by: Lawrence Lane <llane@nvidia.com>

* feedback

Signed-off-by: Lawrence Lane <llane@nvidia.com>

---------

Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
@lbliii
lbliii force-pushed the llane/r1.1.0-release-note-updates branch from 4890669 to 1e37c13 Compare March 16, 2026 16:04
lbliii added 3 commits March 23, 2026 10:11
Keep PR additions (Megatron/SDG, RayClient, GLiNER) and upstream Gliner bug-fix wording.

Made-with: Cursor
Keep PR additions (Megatron/SDG, RayClient, GLiNER) and upstream Gliner bug-fix wording.

Made-with: Cursor
@greptile-apps

greptile-apps Bot commented Mar 23, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

This PR updates CHANGELOG.md and docs/about/release-notes/index.md for the NeMo Curator 1.1.0 / 26.02 release, adding entries that were missing from the initial drafts.

Changes added:

  • New Megatron Tokenization Pipeline (MegatronTokenizerWriter, .bin/.idx outputs) entry in New Features and the release notes "Text and Synthetic Data Workflows" section
  • New Synthetic Data Generation (SDG / Nemotron-CC workflows) entry alongside the above
  • New RayClient Context Manager entry in the Improvements / Infrastructure sections of both files
  • New GLiNER PII Tutorial entry in the Documentation sections of both files
  • Refined wording of the Bug Fixes line ("Gliner/SDG tutorials" → "Gliner tutorial and SDG workflow bugs")

The additions are consistent with the 1.1.0 feature set described elsewhere in the repository. One minor capitalization inconsistency was found: Gliner (in the Bug Fixes line) vs GLiNER (in the Documentation line and all other references), which is worth correcting for consistency.

Confidence Score: 5/5

  • This is a documentation-only PR with accurate content and no code changes; safe to merge.
  • All changes are additive documentation updates. The single identified issue (GLiNER capitalisation in the Bug Fixes line) is a non-blocking P2 style fix that does not affect correctness or functionality.
  • No files require special attention.

Important Files Changed

Filename Overview
CHANGELOG.md Adds Megatron Tokenization, SDG, and RayClient entries to 1.1.0 section; updates Bug Fixes and Documentation lines — minor "Gliner" vs "GLiNER" capitalization inconsistency within the same file.
docs/about/release-notes/index.md Adds "Text and Synthetic Data Workflows" section, RayClient Context Manager entry, and GLiNER PII Tutorial entry — content is accurate and well-placed; pre-existing "Gliner" in the Bug Fixes section creates a cosmetic inconsistency with the newly added "GLiNER" entry.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    A["1.1.0 Release Notes Update"] --> B["CHANGELOG.md"]
    A --> C["docs/about/release-notes/index.md"]

    B --> B1["New Features\n+ Megatron Tokenization Pipeline\n+ Synthetic Data Generation"]
    B --> B2["Improvements\n+ RayClient Context Manager"]
    B --> B3["Bug Fixes\n~ Gliner/SDG wording refined"]
    B --> B4["Documentation\n+ GLiNER PII Tutorial"]

    C --> C1["New Section: Text & Synthetic Data Workflows\n+ Megatron Tokenization Pipeline\n+ Synthetic Data Generation (SDG)"]
    C --> C2["Infrastructure & Developer Experience\n+ RayClient Context Manager"]
    C --> C3["Documentation Improvements\n+ GLiNER PII Tutorial"]
Loading

Reviews (1): Last reviewed commit: "Merge branch 'llane/r1.1.0-release-note-..." | Re-trigger Greptile

Comment thread CHANGELOG.md
### Bug Fixes

- FastText numpy>2 compatibility, NeMo doc links, ID generator blocking, vLLM video API, Gliner/SDG tutorials, semantic dedup test reliability
- FastText numpy>2 compatibility, NeMo doc links, ID generator blocking, vLLM video API, Gliner tutorial and SDG workflow bugs, semantic dedup test reliability

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Inconsistent "GLiNER" capitalization

The Bug Fixes line uses Gliner (line 29), while the Documentation line added in the same PR uses GLiNER (line 41) — which is the correct product name. This creates a capitalization mismatch within the same file.

The same inconsistency exists in docs/about/release-notes/index.md at line 105 (Fixed Gliner tutorial examples...), although that line is pre-existing and not part of this diff.

Suggested change
- FastText numpy>2 compatibility, NeMo doc links, ID generator blocking, vLLM video API, Gliner tutorial and SDG workflow bugs, semantic dedup test reliability
- FastText numpy>2 compatibility, NeMo doc links, ID generator blocking, vLLM video API, GLiNER tutorial and SDG workflow bugs, semantic dedup test reliability

@lbliii
lbliii enabled auto-merge (squash) March 23, 2026 14:47
@sarahyurick

Copy link
Copy Markdown
Contributor

/ok to test cb3f3bf

@lbliii
lbliii merged commit 8b438be into NVIDIA-NeMo:r1.1.0 Mar 23, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants