[taskcluster 2024-06-19 00:12:13.112Z] Task ID: PSZdDra8Qc2MJZvbR3orbg
[taskcluster 2024-06-19 00:12:13.112Z] Worker ID: 7015900381869743307
[taskcluster 2024-06-19 00:12:13.112Z] Worker Group: us-central1-a
[taskcluster 2024-06-19 00:12:13.112Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-06-19 00:12:13.112Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-06-19 00:12:13.112Z] Worker Version: 38.0.5
[taskcluster 2024-06-19 00:12:13.112Z] Public IP: 35.225.135.33
[taskcluster 2024-06-19 00:12:13.112Z] Hostname: translations-1-decision-gcp-ba3brv7asfwaepcnw8hpna
[taskcluster 2024-06-19 00:12:13.112Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-06-19 00:12:25.306Z] === Task Starting ===
[setup 2024-06-19T00:12:26.111Z] run-task started in /
[setup 2024-06-19T00:12:26.111Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-push' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --base-rev='a6f0fe1620d631f064ab69ed87cde30617503842' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de' 

[setup 2024-06-19T00:12:26.111Z] Python version: 3.11.2
[vcs 2024-06-19T00:12:26.113Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-06-19T00:12:26.113Z] running as worker:worker
[vcs 2024-06-19T00:12:26.113Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-06-19T00:12:26.116Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/src']
[vcs 2024-06-19T00:12:26.118Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2024-06-19T00:12:27.607Z] executing ['git', 'fetch', 'origin', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:27.843Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:27.846Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:27.854Z] executing ['git', 'checkout', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:27.927Z] Switched to a new branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:12:27.928Z] branch 'escape-hatch-to-put-existing-tasks-in-the-graph' set up to track 'origin/escape-hatch-to-put-existing-tasks-in-the-graph'.
[vcs 2024-06-19T00:12:27.930Z] executing ['git', 'fetch', 'origin', 'a6f0fe1620d631f064ab69ed87cde30617503842']
[vcs 2024-06-19T00:12:28.211Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:28.212Z]  * branch            a6f0fe1620d631f064ab69ed87cde30617503842 -> FETCH_HEAD
[vcs 2024-06-19T00:12:28.227Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:28.481Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:28.481Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:28.490Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:28.723Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:28.724Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:28.736Z] executing ['git', 'checkout', '-f', '-B', 'refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph', '658adc2555649ee219e2ca5a5a3630d7230275de']
[vcs 2024-06-19T00:12:28.875Z] Switched to a new branch 'refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:12:28.876Z] executing ['git', 'submodule', 'init']
[vcs 2024-06-19T00:12:28.900Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-06-19T00:12:28.901Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-06-19T00:12:28.902Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-06-19T00:12:28.903Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-06-19T00:12:28.904Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-06-19T00:12:28.905Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-06-19T00:12:28.908Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-06-19T00:12:28.949Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2024-06-19T00:12:32.654Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2024-06-19T00:12:33.000Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2024-06-19T00:12:33.391Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2024-06-19T00:12:34.592Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2024-06-19T00:12:38.810Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2024-06-19T00:12:39.574Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-06-19T00:12:39.586Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-06-19T00:12:39.597Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-06-19T00:12:39.634Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-06-19T00:12:39.805Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-06-19T00:12:39.828Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-06-19T00:12:39.830Z] cleaning git checkout...
[vcs 2024-06-19T00:12:39.831Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-06-19T00:12:39.837Z] removing []
[vcs 2024-06-19T00:12:39.838Z] successfully cleaned git checkout!
[vcs 2024-06-19T00:12:39.848Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/658adc2555649ee219e2ca5a5a3630d7230275de' title='Built from firefox-translations-training commit 658adc2555649ee219e2ca5a5a3630d7230275de'>658adc2555649ee219e2ca5a5a3630d7230275de</a>
[task 2024-06-19T00:12:39.849Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-push' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --base-rev='a6f0fe1620d631f064ab69ed87cde30617503842' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de' \n"]
[task 2024-06-19T00:12:39.852Z] + cd /builds/worker/checkouts/src
[task 2024-06-19T00:12:39.853Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-06-19T00:12:39.855Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-push --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=escape-hatch-to-put-existing-tasks-in-the-graph --base-rev=a6f0fe1620d631f064ab69ed87cde30617503842 --head-repository=https://github.com/mozilla/firefox-translations-training --head-ref=refs/heads/escape-hatch-to-put-existing-tasks-in-the-graph --head-rev=658adc2555649ee219e2ca5a5a3630d7230275de
[task 2024-06-19T00:12:40.367Z] 2024-06-19 00:12:40,367 - INFO - Loading graph configuration.
[task 2024-06-19T00:12:40.387Z] 2024-06-19 00:12:40,386 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-06-19T00:12:40.389Z] 2024-06-19 00:12:40,387 - INFO - Using Parameters(id=05c26afacaa7) (from defaults)
[task 2024-06-19T00:12:40.392Z] 2024-06-19 00:12:40,391 - INFO - writing artifact file `parameters.yml`
[task 2024-06-19T00:12:40.410Z] 2024-06-19 00:12:40,410 - INFO - writing artifact file `actions.json`
[task 2024-06-19T00:12:40.415Z] 2024-06-19 00:12:40,415 - INFO - Loading kinds
[task 2024-06-19T00:12:40.463Z] 2024-06-19 00:12:40,462 - INFO - Generating full task set
[task 2024-06-19T00:12:40.532Z] 2024-06-19 00:12:40,532 - INFO - Generated 8 tasks for kind dataset
[task 2024-06-19T00:12:40.536Z] 2024-06-19 00:12:40,536 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-06-19T00:12:40.556Z] 2024-06-19 00:12:40,556 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-06-19T00:12:40.559Z] 2024-06-19 00:12:40,559 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-06-19T00:12:40.560Z] 2024-06-19 00:12:40,560 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-06-19T00:12:40.584Z] 2024-06-19 00:12:40,584 - INFO - Generated 4 tasks for kind docker-image
[task 2024-06-19T00:12:40.606Z] 2024-06-19 00:12:40,606 - INFO - Generated 10 tasks for kind fetch
[task 2024-06-19T00:12:40.712Z] 2024-06-19 00:12:40,712 - INFO - Generated 11 tasks for kind toolchain
[task 2024-06-19T00:12:40.721Z] 2024-06-19 00:12:40,721 - INFO - Generated 3 tasks for kind analyze-corpus
[task 2024-06-19T00:12:40.728Z] 2024-06-19 00:12:40,728 - INFO - Generated 2 tasks for kind analyze-mono
[task 2024-06-19T00:12:40.739Z] 2024-06-19 00:12:40,739 - INFO - Generated 3 tasks for kind clean-corpus
[task 2024-06-19T00:12:40.744Z] 2024-06-19 00:12:40,744 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-06-19T00:12:40.755Z] 2024-06-19 00:12:40,755 - INFO - Generated 3 tasks for kind bicleaner
[task 2024-06-19T00:12:40.762Z] 2024-06-19 00:12:40,762 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-06-19T00:12:40.789Z] 2024-06-19 00:12:40,789 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-06-19T00:12:40.796Z] 2024-06-19 00:12:40,796 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-06-19T00:12:40.801Z] 2024-06-19 00:12:40,800 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-06-19T00:12:40.806Z] 2024-06-19 00:12:40,805 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-06-19T00:12:40.811Z] 2024-06-19 00:12:40,811 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-06-19T00:12:40.818Z] 2024-06-19 00:12:40,818 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-06-19T00:12:40.824Z] 2024-06-19 00:12:40,824 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-06-19T00:12:40.829Z] 2024-06-19 00:12:40,829 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-06-19T00:12:40.835Z] 2024-06-19 00:12:40,835 - INFO - Generated 5 tasks for kind tests
[task 2024-06-19T00:12:40.843Z] 2024-06-19 00:12:40,843 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-06-19T00:12:40.852Z] 2024-06-19 00:12:40,852 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-06-19T00:12:40.856Z] 2024-06-19 00:12:40,856 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-06-19T00:12:40.860Z] 2024-06-19 00:12:40,860 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-06-19T00:12:40.866Z] 2024-06-19 00:12:40,866 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-06-19T00:12:40.874Z] 2024-06-19 00:12:40,874 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-06-19T00:12:40.880Z] 2024-06-19 00:12:40,879 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-06-19T00:12:40.884Z] 2024-06-19 00:12:40,884 - INFO - Generated 2 tasks for kind extract-best
[task 2024-06-19T00:12:40.888Z] 2024-06-19 00:12:40,888 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-06-19T00:12:40.894Z] 2024-06-19 00:12:40,894 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-06-19T00:12:40.897Z] 2024-06-19 00:12:40,897 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-06-19T00:12:40.900Z] 2024-06-19 00:12:40,900 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-06-19T00:12:40.904Z] 2024-06-19 00:12:40,904 - INFO - Generated 1 tasks for kind score
[task 2024-06-19T00:12:40.907Z] 2024-06-19 00:12:40,907 - INFO - Generated 1 tasks for kind cefilter
[task 2024-06-19T00:12:40.910Z] 2024-06-19 00:12:40,910 - INFO - Generated 1 tasks for kind shortlist
[task 2024-06-19T00:12:40.913Z] 2024-06-19 00:12:40,913 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-06-19T00:12:40.916Z] 2024-06-19 00:12:40,915 - INFO - Generated 1 tasks for kind train-student
[task 2024-06-19T00:12:40.919Z] 2024-06-19 00:12:40,918 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-06-19T00:12:40.921Z] 2024-06-19 00:12:40,921 - INFO - Generated 1 tasks for kind quantize
[task 2024-06-19T00:12:40.924Z] 2024-06-19 00:12:40,924 - INFO - Generated 1 tasks for kind export
[task 2024-06-19T00:12:40.935Z] 2024-06-19 00:12:40,934 - INFO - Generated 4 tasks for kind evaluate
[task 2024-06-19T00:12:40.938Z] 2024-06-19 00:12:40,938 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-06-19T00:12:40.940Z] 2024-06-19 00:12:40,940 - INFO - Generated 1 tasks for kind all
[task 2024-06-19T00:12:40.947Z] 2024-06-19 00:12:40,947 - INFO - Generated 1 tasks for kind all-pr
[task 2024-06-19T00:12:40.948Z] 2024-06-19 00:12:40,947 - INFO - Generating full task graph
[task 2024-06-19T00:12:40.949Z] 2024-06-19 00:12:40,948 - INFO - Full task graph contains 92 tasks and 273 dependencies
[task 2024-06-19T00:12:40.953Z] 2024-06-19 00:12:40,953 - INFO - writing artifact file `full-task-graph.json`
[task 2024-06-19T00:12:40.975Z] 2024-06-19 00:12:40,974 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-06-19T00:12:40.976Z] 2024-06-19 00:12:40,976 - INFO - Generating target task set
[task 2024-06-19T00:12:40.977Z] 2024-06-19 00:12:40,977 - INFO - Filter filter_target_tasks pruned 77 tasks (15 remain)
[task 2024-06-19T00:12:40.977Z] 2024-06-19 00:12:40,977 - INFO - writing artifact file `target-tasks.json`
[task 2024-06-19T00:12:40.978Z] 2024-06-19 00:12:40,977 - INFO - Generating target task graph
[task 2024-06-19T00:12:40.978Z] 2024-06-19 00:12:40,977 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-06-19T00:12:40.978Z] 2024-06-19 00:12:40,978 - INFO - Generating optimized task graph
[task 2024-06-19T00:12:40.979Z] 2024-06-19 00:12:40,979 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-06-19T00:12:45.705Z] 2024-06-19 00:12:45,705 - INFO - Replaced 23 tasks by index-search (index-search) during optimization.
[task 2024-06-19T00:12:45.706Z] 2024-06-19 00:12:45,706 - INFO - writing artifact file `task-graph.json`
[task 2024-06-19T00:12:45.709Z] 2024-06-19 00:12:45,709 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-06-19T00:12:45.711Z] 2024-06-19 00:12:45,711 - INFO - Creating task with taskId YpoiGQlDShC4yYh-vhLVBA for toolchain-fast-align
[task 2024-06-19T00:12:45.713Z] 2024-06-19 00:12:45,713 - INFO - Creating task with taskId WWvXLssHSA2gacx9oWrnIg for tests-lint
[task 2024-06-19T00:12:45.719Z] 2024-06-19 00:12:45,719 - INFO - Creating task with taskId XMMsbu8xTF-LYyt2WUwCWg for toolchain-extract-lex
[task 2024-06-19T00:12:45.732Z] 2024-06-19 00:12:45,732 - INFO - Creating task with taskId ajXVL8ziT2GpQOCJ56teMA for tests-black
[task 2024-06-19T00:12:45.736Z] 2024-06-19 00:12:45,733 - INFO - Creating task with taskId K3IsoZobT8-PeatZ_T1kKg for tests-taskgraph-definition
[taskcluster 2024-06-19 00:12:46.320Z] === Task Finished ===
[taskcluster 2024-06-19 00:12:48.715Z] Successful task run with exit code: 0 completed in 35.605 seconds