Skip to content

Pull requests: NVIDIA/NeMo-Curator

New pull request New
31 Open 356 Closed
31 Open 356 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add option to skip data by adding a flag instead of removing them
#566 opened Feb 22, 2025 by shuoyangd Loading…
1 of 3 tasks
Add a way to pass expected language to FastTextLangId filter
#565 opened Feb 21, 2025 by shuoyangd Loading…
2 of 3 tasks
Improvements for semantic deduplication and DAPT tutorial gpuci Run GPU CI/CD on PR
#564 opened Feb 21, 2025 by sarahyurick Loading…
2
5
Update wiki dump date and few minor updates in single gpu tutorial r0.7.0
#563 opened Feb 21, 2025 by ayushdg Loading…
3 tasks done
Remove minhash conditional for 25.02
#558 opened Feb 18, 2025 by praateekmahajan Loading…
3 tasks
1
3
Minor edits to instructions in readme, requirements, fuzzy and semantic dedupe flags
#548 opened Feb 14, 2025 by ruchaa-apte Loading…
7
Create FastText classifier module
#546 opened Feb 13, 2025 by sarahyurick • Draft
Hard negative mining for Retriever fine-tuning
#523 opened Feb 5, 2025 by vinay-raman Loading…
3 tasks done
Add support for Chinese and Japanese stop words
#507 opened Jan 31, 2025 by sarahyurick Loading…
1
2
Added LookUp error handling during encoding detection.
#502 opened Jan 30, 2025 by ggcr Loading…
Clean up Pandas, cuDF, Dask, and Dask-cuDF DocumentDataset type logic gpuci Run GPU CI/CD on PR
#494 opened Jan 23, 2025 by sarahyurick Loading…
1
Standardize text_field and id_field terminology gpuci Run GPU CI/CD on PR
#485 opened Jan 17, 2025 by sarahyurick Loading…
1
Add nemo-toolkit dependency to gpuCI gpuci Run GPU CI/CD on PR
#480 opened Jan 10, 2025 by sarahyurick Loading…
1
1
Support dask_expr migration into dask.dataframe gpuci Run GPU CI/CD on PR
#477 opened Jan 9, 2025 by rjzamora Loading…
3 tasks
[pre-commit.ci] pre-commit suggestions
#470 opened Jan 7, 2025 by pre-commit-ci bot Loading…
[WIP] Add RAPIDS Nightly to GPU CI gpuci Run GPU CI/CD on PR
#436 opened Dec 17, 2024 by praateekmahajan • Draft
3 tasks
5
Updating the Quick Example
#432 opened Dec 16, 2024 by stsfaroz Loading…
1
Add TrafilaturaExtractor class
#431 opened Dec 13, 2024 by sarahyurick Loading…
1
4
Bump nltk from 3.8.1 to 3.9 in /tutorials/dapt-curation/code dependencies Pull requests that update a dependency file
#429 opened Dec 13, 2024 by dependabot bot Loading…
Fix GPU error messages for fuzzy deduplication gpuci Run GPU CI/CD on PR
#387 opened Nov 22, 2024 by sarahyurick Loading…
2 tasks done
3
Remove max_text_bytes_per_part gpuci Run GPU CI/CD on PR
#385 opened Nov 20, 2024 by sarahyurick • Draft
1
5
Create Cache class for exact, fuzzy, and semantic deduplication gpuci Run GPU CI/CD on PR
#384 opened Nov 19, 2024 by sarahyurick Loading…
4 tasks done
13
Refactor modules to be in a single class and dataframe backend checking
#379 opened Nov 18, 2024 by ryantwolf • Draft
3 tasks
ci: Add copyright-check workflow
#369 opened Nov 14, 2024 by ko3n1g Loading…
3 tasks
6
Convert translation_example.py into a Jupyter Notebook tutorial
#336 opened Oct 29, 2024 by sarahyurick Loading…
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.