Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 26, 2025

• Add KMeans random_state to semantic deduplication configs (#575)

  Show description for e662ac0
  sarahyurick

  authoredFeb 26, 2025
  e662ac0

  Copy full SHA for e662ac0

Commits on Feb 25, 2025

• Fix download_sources for DAPT tutorial (#569)

  Show description for e1abd74
  sarahyurick

  authoredFeb 25, 2025
  e1abd74

  Copy full SHA for e1abd74

• Few minor updates in single gpu tutorial (#563)

  Show description for 0158d93
  ayushdg

  authoredFeb 25, 2025
  0158d93

  Copy full SHA for 0158d93

Commits on Feb 24, 2025

• Improvements for semantic deduplication and DAPT tutorial (#564)

  Show description for 119edd4
  sarahyurick

  authoredFeb 24, 2025
  119edd4

  Copy full SHA for 119edd4

Commits on Feb 19, 2025

• Update get_all_files_paths_under examples to include keep_extensions (#450)

  Show description for 9b1a13c
  sarahyurick

  authoredFeb 19, 2025
  9b1a13c

  Copy full SHA for 9b1a13c

• Fix bugs in retriever sdg notebook (#522)

  Show description for a46fb87
  vinay-raman

  authoredFeb 19, 2025
  a46fb87

  Copy full SHA for a46fb87

Commits on Feb 14, 2025

• Remove install from image tutorial (#549)

  Show description for 7042c2c
  sarahyurick

  authoredFeb 14, 2025
  7042c2c

  Copy full SHA for 7042c2c

• Add notebook to show Fineweb ensemble (#536)

  Show description for 0f0cb31
  

  VibhuJawa

  and

  sarahyurick

  authoredFeb 14, 2025
  0f0cb31

  Copy full SHA for 0f0cb31

Commits on Feb 12, 2025

• Add support for Nemotron-CC EDU classifiers (#518)

  Show description for a7fde15
  sarahyurick

  authoredFeb 12, 2025
  a7fde15

  Copy full SHA for a7fde15

Commits on Feb 11, 2025

• Update fuzzy deduplication section of tutorials to skip false positive check (where applicable) (#511)

  Show description for c4cb682
  

  ayushdg

  and

  sarahyurick

  authoredFeb 11, 2025
  c4cb682

  Copy full SHA for c4cb682

Commits on Feb 7, 2025

• Update model nomenclature (#497)

  Show description for 34a1cc6
  sarahyurick

  authoredFeb 7, 2025
  34a1cc6

  Copy full SHA for 34a1cc6

Commits on Jan 31, 2025

• Fix DAPT tutorial (#503)

  Show description for 75234a9
  sarahyurick

  authoredJan 31, 2025
  75234a9

  Copy full SHA for 75234a9

Commits on Jan 23, 2025

• Create notebook tutorials for distributed data classifiers (#415)

  Show description for cd38de0
  sarahyurick

  authoredJan 23, 2025
  cd38de0

  Copy full SHA for cd38de0

Commits on Jan 17, 2025

• Create separate files for each deduplication class (#409)

  Show description for d1f3842
  sarahyurick

  authoredJan 17, 2025
  d1f3842

  Copy full SHA for d1f3842

Commits on Dec 24, 2024

• Change filename column name to file_name (#449)

  praateekmahajan

  authoredDec 24, 2024
  4fb7f54

  Copy full SHA for 4fb7f54

Commits on Dec 13, 2024

• Adding fuzzy and semantic dedupe (#428)

  Show description for 3c3cc98
  ruchaa-apte

  authoredDec 13, 2024
  3c3cc98

  Copy full SHA for 3c3cc98

• Allow users to write to single file (#383)

  Show description for 079d46f
  sarahyurick

  authoredDec 13, 2024
  079d46f

  Copy full SHA for 079d46f

Commits on Dec 3, 2024

• Add READMEs to examples/ and nemo_curator/scripts directories (#332)

  Show description for d1f52f6
  sarahyurick

  authoredDec 3, 2024
  d1f52f6

  Copy full SHA for d1f52f6

Commits on Nov 27, 2024

• Add support for parallel data curation (#193)

  Show description for 3d14b0d
  

  shuoyangd

  and

  nverma1

  authoredNov 27, 2024
  3d14b0d

  Copy full SHA for 3d14b0d

• Synthetic data generation for Retriever Evaluation (#392)

  Show description for 0f3a9e6
  vinay-raman

  authoredNov 27, 2024
  0f3a9e6

  Copy full SHA for 0f3a9e6

Commits on Nov 21, 2024

• Remove lingering DASK_DATAFRAME__QUERY_PLANNING environment variables (#346)

  Show description for 368bdc5
  sarahyurick

  authoredNov 21, 2024
  368bdc5

  Copy full SHA for 368bdc5

• Add Multiple Model Classification example (#173)

  Show description for 1334f21
  sarahyurick

  authoredNov 21, 2024
  1334f21

  Copy full SHA for 1334f21

Commits on Nov 19, 2024

• Bug fix arg connected comp (#382)

  Show description for 8408a7b
  

  3 peopleauthoredNov 19, 2024
  8408a7b

  Copy full SHA for 8408a7b

Commits on Nov 15, 2024

• Fix broken NeMo dependencies (#372)

  Show description for 363a66b
  sarahyurick

  authoredNov 15, 2024
  363a66b

  Copy full SHA for 363a66b

Commits on Nov 6, 2024

• Semantic deduplication improvements (#327)

  Show description for 01bda47
  sarahyurick

  authoredNov 6, 2024
  01bda47

  Copy full SHA for 01bda47

Commits on Nov 4, 2024

• V0.5.0 forward merge (#340)

  Show description for 5c03c7c
  

  4 peopleauthoredNov 4, 2024
  5c03c7c

  Copy full SHA for 5c03c7c

Commits on Oct 31, 2024

• add tutorials/pretraining-Vietnamese-data-curation (#300)

  Show description for 9ff6aab
  hoangphu7122002

  authoredOct 31, 2024
  9ff6aab

  Copy full SHA for 9ff6aab

Commits on Oct 21, 2024

• [Tutorials] Update the SDG tutorial and expose the inference endpoint (#301)

  Show description for 4ad1a4d
  Maghoumi

  authoredOct 21, 2024
  4ad1a4d

  Copy full SHA for 4ad1a4d

Commits on Oct 16, 2024

• Add links (#306)

  Show description for 8af2545
  yury-tokpanov

  authoredOct 16, 2024
  8af2545

  Copy full SHA for 8af2545

Commits on Oct 15, 2024

• Tutorial for reproducing Zyda2 dataset (#303)

  Show description for 65affd6
  yury-tokpanov

  authoredOct 15, 2024
  65affd6

  Copy full SHA for 65affd6

Commits on Oct 10, 2024

• [Tutorial] Add Pretraining Data Curation Tutorial (#292)

  Show description for f3c5770
  yyu22

  authoredOct 10, 2024
  f3c5770

  Copy full SHA for f3c5770

Commits on Oct 9, 2024

• [Tutorials] Improve the usability of the SDG tutorial's command (#286)

  Show description for cf47c9f
  Maghoumi

  authoredOct 9, 2024
  cf47c9f

  Copy full SHA for cf47c9f

• Remove DASK_DATAFRAME__QUERY_PLANNING environment variable (#270)

  Show description for bf2f8f2
  sarahyurick

  authoredOct 9, 2024
  bf2f8f2

  Copy full SHA for bf2f8f2

Commits on Sep 25, 2024

• Fix 264. Incorrect affinity parameter (#265)

  Show description for 10aaa8a
  miguelusque

  authoredSep 25, 2024
  10aaa8a

  Copy full SHA for 10aaa8a

• Fixing Model Address (#263)

  Show description for eb2225b
  chrisalexiuk-nvidia

  authoredSep 25, 2024
  eb2225b

  Copy full SHA for eb2225b

Pagination

Previous

Next