Code

[Experiment] Train en-ca - Feb 2024#384

Code

Closed

gregtatum wants to merge 25 commits intomainmozilla/translations:mainfrom en_ca_baseline_jan2024mozilla/translations:en_ca_baseline_jan2024Copy head branch name to clipboard

+1,150-248

Commits

Commits on Feb 7, 2024

• Rename "custom" to "local"

  gregtatum

  committed
  409956f

  Copy full SHA for 409956f

• Use zst in the data importer test

  gregtatum

  committed
  b29ff0c

  Copy full SHA for b29ff0c

• Add a test for news crawl importer

  gregtatum

  committed
  82e6963

  Copy full SHA for 82e6963

• Add a tree printing method

  gregtatum

  committed
  01425ca

  Copy full SHA for 01425ca

• Drive-by: Output stderr in run_task

  gregtatum

  committed
  7c9f18b

  Copy full SHA for 7c9f18b

• Add google cloud storage as a dependency

  gregtatum

  committed
  f7edaab

  Copy full SHA for f7edaab

• Remove monolingual downloaders in bash

  gregtatum

  committed
  03692bc

  Copy full SHA for 03692bc

• Add a structured Dataset class

  gregtatum

  committed
  cde4d4d

  Copy full SHA for cde4d4d

• Add a google cloud storage importer and convert download-mono to python

  gregtatum

  committed
  8277d40

  Copy full SHA for 8277d40

• Add assertions for shuffling behavior

  gregtatum

  committed
  ac1f631

  Copy full SHA for ac1f631

Commits on Feb 8, 2024

• en-ca config

  gregtatum

  committed
  2eef2d6

  Copy full SHA for 2eef2d6

• WIP config

  gregtatum

  committed
  09621e8

  Copy full SHA for 09621e8

• Remove .ca.zst

  gregtatum

  committed
  0b9d3a3

  Copy full SHA for 0b9d3a3

• bicleaner - Do not capture the output of the bicleaner command

  gregtatum

  committed
  2886fd4

  Copy full SHA for 2886fd4

• bicleaner - Add more debug logging

  gregtatum

  committed
  0e715da

  Copy full SHA for 0e715da

• bicleaner - Update the bicleaner fallback check

  gregtatum

  committed
  e434e41

  Copy full SHA for e434e41

Commits on Feb 9, 2024

• bicleaner - Check for file existence

  gregtatum

  committed
  9a68974

  Copy full SHA for 9a68974

• bicleaner - Fix pack_path issue

  gregtatum

  committed
  03fe240

  Copy full SHA for 03fe240

Commits on Feb 27, 2024

• Disable student augmentations

  gregtatum

  committed
  819407d

  Copy full SHA for 819407d

• Add curly braces

  gregtatum

  committed
  68428f3

  Copy full SHA for 68428f3

Commits on Feb 28, 2024

• Fork the training scripts

  gregtatum

  committed
  ff53db2

  Copy full SHA for ff53db2

• Remove opustrainer

  gregtatum

  committed
  2a92483

  Copy full SHA for 2a92483

• Fix train_set_prefixes error

  gregtatum

  committed
  871e0d0

  Copy full SHA for 871e0d0

Commits on Feb 29, 2024

• Fix the naming of corpus.enzst to corpus.en.zst

  gregtatum

  committed
  9653b57

  Copy full SHA for 9653b57

• Remove extension from corpus

  gregtatum

  committed
  fdd5de1

  Copy full SHA for fdd5de1