Skip to content

Pull requests: NVIDIA/NeMo-Curator

New pull request New
28 Open 232 Closed
28 Open 232 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix missing eps_thresholds parameter
#390 opened Nov 22, 2024 by sarahyurick Loading…
Create separate files for each deduplication class gpuci Run GPU CI/CD on PR
#389 opened Nov 22, 2024 by sarahyurick Loading…
Fix GPU error messages for fuzzy deduplication
#387 opened Nov 22, 2024 by sarahyurick • Draft
1 of 2 tasks
Fuzzy Dedup: Make skipping the False positive check the default enhancement New feature or request gpuci Run GPU CI/CD on PR
#386 opened Nov 21, 2024 by ayushdg Loading…
2 of 3 tasks
Remove max_text_bytes_per_part gpuci Run GPU CI/CD on PR
#385 opened Nov 20, 2024 by sarahyurick Loading…
1
5
Global cache_dir variable for exact, fuzzy, and semantic deduplication gpuci Run GPU CI/CD on PR
#384 opened Nov 19, 2024 by sarahyurick Loading…
3 tasks done
3
Allow users to write to single file
#383 opened Nov 19, 2024 by sarahyurick Loading…
10
Refactor modules to be in a single class and dataframe backend checking
#379 opened Nov 18, 2024 by ryantwolf • Draft
3 tasks
Add blocksize to DocumentDataset.read_* that uses dd.from_map
#374 opened Nov 15, 2024 by praateekmahajan • Draft
3 tasks
1
Synthetic data generation for Retriever Evaluation
#370 opened Nov 14, 2024 by vinay-raman Loading…
3 tasks done
14
ci: Add copyright-check workflow
#369 opened Nov 14, 2024 by ko3n1g Loading…
3 tasks
6
Update to latest Crossfit gpuci Run GPU CI/CD on PR
#365 opened Nov 14, 2024 by VibhuJawa • Draft
Task-Complexity Classifier
#364 opened Nov 13, 2024 by sarahyurick • Draft
1
Multilingual Domain Classifier
#363 opened Nov 13, 2024 by sarahyurick • Draft
2
Type of Speech Classifier
#361 opened Nov 13, 2024 by sarahyurick • Draft
1
Convert translation_example.py into a Jupyter Notebook tutorial
#336 opened Oct 29, 2024 by sarahyurick • Draft
1
Add READMEs to examples/ and nemo_curator/scripts directories
#332 opened Oct 28, 2024 by sarahyurick Loading…
1
1
Add codepath for computing buckets without int conversion enhancement New feature or request gpuci Run GPU CI/CD on PR
#326 opened Oct 25, 2024 by ayushdg Loading…
3 tasks done
1
14
Add support for finetune guard classifier
#325 opened Oct 25, 2024 by VibhuJawa Loading…
8
Dapt data curation tutorial fuzzy and semantic dedupe gpuci Run GPU CI/CD on PR
#322 opened Oct 24, 2024 by ruchaa-apte Loading…
13
Add blocksize to DocumentDataset.read_* that uses dask_cudf.read_*
#285 opened Oct 8, 2024 by praateekmahajan Loading…
3 tasks
25
Added example notebook for translation with ct2 model. documentation Improvements or additions to documentation
#262 opened Sep 25, 2024 by uahmed93 • Draft
3 tasks
19
Added a translation pipeline for ctranslate2 inference
#245 opened Sep 16, 2024 by uahmed93 • Draft
3 tasks
Add support for parallel data curation
#193 opened Aug 8, 2024 by shuoyangd Loading…
3 tasks done
@shuoyangd
50
Fixed bug: changed to correct model name
#186 opened Aug 6, 2024 by ByteWrite Loading…
1 of 3 tasks
@ByteWrite
2
ProTip! Updated in the last three days: updated:>2024-11-21.