Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude start stage tasks from existing tasks #713

Open
wants to merge 2 commits into
base: release
Choose a base branch
from

Merge branch 'release' into release_stages

5ee461f
Select commit
Loading
Failed to load commit list.
Open

Exclude start stage tasks from existing tasks #713

Merge branch 'release' into release_stages
5ee461f
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-taskgraph-definition succeeded Jul 9, 2024 in 2m 34s

FirefoxCI (pull_request)

Test the full translations_taskgraph to validate the latest changes

Details

View task in Taskcluster
View logs in Taskcluster


[vcs 2024-07-09T19:18:17.994Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-07-09T19:18:17.994Z]  * branch            release_stages -> FETCH_HEAD
[vcs 2024-07-09T19:18:18.001Z] executing ['git', 'checkout', '-f', '-B', 'release_stages', '5ee461fb08b391127e8b58fdacee8a9f4dacf87f']
[vcs 2024-07-09T19:18:18.018Z] Switched to a new branch 'release_stages'
[vcs 2024-07-09T19:18:18.018Z] executing ['git', 'submodule', 'init']
[vcs 2024-07-09T19:18:18.039Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-07-09T19:18:18.136Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-07-09T19:18:18.148Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-07-09T19:18:18.160Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-07-09T19:18:18.189Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-07-09T19:18:18.317Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-07-09T19:18:18.338Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-07-09T19:18:18.338Z] cleaning git checkout...
[vcs 2024-07-09T19:18:18.338Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-07-09T19:18:18.342Z] removing []
[vcs 2024-07-09T19:18:18.342Z] successfully cleaned git checkout!
[vcs 2024-07-09T19:18:18.343Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/5ee461fb08b391127e8b58fdacee8a9f4dacf87f' title='Built from firefox-translations-training commit 5ee461fb08b391127e8b58fdacee8a9f4dacf87f'>5ee461fb08b391127e8b58fdacee8a9f4dacf87f</a>
[task 2024-07-09T19:18:18.343Z] executing ['bash', '-cx', 'task taskgraph-validate']
[task 2024-07-09T19:18:18.344Z] + task taskgraph-validate
[task 2024-07-09T19:18:18.349Z] task: [taskgraph-requirements] poetry run --directory ./taskgraph -- pip3 install -r taskcluster/requirements.txt
[task 2024-07-09T19:18:18.951Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-07-09T19:18:20.330Z] Collecting appdirs==1.4.4 (from -r taskcluster/requirements.txt (line 7))
[task 2024-07-09T19:18:20.402Z]   Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
[task 2024-07-09T19:18:20.446Z] Collecting arrow==1.3.0 (from -r taskcluster/requirements.txt (line 11))
[task 2024-07-09T19:18:20.458Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[task 2024-07-09T19:18:20.476Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 3.7 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.497Z] Collecting binaryornot==0.4.4 (from -r taskcluster/requirements.txt (line 15))
[task 2024-07-09T19:18:20.506Z]   Downloading binaryornot-0.4.4-py2.py3-none-any.whl (9.0 kB)
[task 2024-07-09T19:18:20.541Z] Collecting certifi==2024.2.2 (from -r taskcluster/requirements.txt (line 19))
[task 2024-07-09T19:18:20.552Z]   Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[task 2024-07-09T19:18:20.571Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 9.5 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.594Z] Collecting chardet==5.2.0 (from -r taskcluster/requirements.txt (line 23))
[task 2024-07-09T19:18:20.604Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[task 2024-07-09T19:18:20.623Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 11.1 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.728Z] Collecting charset-normalizer==3.3.2 (from -r taskcluster/requirements.txt (line 27))
[task 2024-07-09T19:18:20.738Z]   Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2024-07-09T19:18:20.751Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.1/142.1 kB 12.2 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.786Z] Collecting click==8.1.7 (from -r taskcluster/requirements.txt (line 119))
[task 2024-07-09T19:18:20.796Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[task 2024-07-09T19:18:20.805Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 12.3 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.835Z] Collecting cookiecutter==2.5.0 (from -r taskcluster/requirements.txt (line 123))
[task 2024-07-09T19:18:20.846Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[task 2024-07-09T19:18:20.871Z] Collecting giturlparse==0.12.0 (from -r taskcluster/requirements.txt (line 127))
[task 2024-07-09T19:18:20.881Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[task 2024-07-09T19:18:20.907Z] Collecting idna==3.6 (from -r taskcluster/requirements.txt (line 131))
[task 2024-07-09T19:18:20.916Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[task 2024-07-09T19:18:20.922Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 17.0 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.951Z] Collecting jinja2==3.1.3 (from -r taskcluster/requirements.txt (line 135))
[task 2024-07-09T19:18:20.964Z]   Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[task 2024-07-09T19:18:20.975Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 13.5 MB/s eta 0:00:00
[task 2024-07-09T19:18:20.998Z] Collecting json-e==4.6.0 (from -r taskcluster/requirements.txt (line 139))
[task 2024-07-09T19:18:21.009Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[task 2024-07-09T19:18:21.044Z] Collecting markdown-it-py==3.0.0 (from -r taskcluster/requirements.txt (line 143))
[task 2024-07-09T19:18:21.053Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[task 2024-07-09T19:18:21.061Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 15.6 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.125Z] Collecting markupsafe==2.1.5 (from -r taskcluster/requirements.txt (line 147))
[task 2024-07-09T19:18:21.135Z]   Downloading MarkupSafe-2.1.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[task 2024-07-09T19:18:21.158Z] Collecting mdurl==0.1.2 (from -r taskcluster/requirements.txt (line 209))
[task 2024-07-09T19:18:21.168Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[task 2024-07-09T19:18:21.189Z] Collecting mozilla-repo-urls==0.1.1 (from -r taskcluster/requirements.txt (line 213))
[task 2024-07-09T19:18:21.200Z]   Downloading mozilla_repo_urls-0.1.1-py3-none-any.whl (6.2 kB)
[task 2024-07-09T19:18:21.241Z] Collecting pygments==2.17.2 (from -r taskcluster/requirements.txt (line 217))
[task 2024-07-09T19:18:21.253Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[task 2024-07-09T19:18:21.323Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 17.3 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.356Z] Collecting python-dateutil==2.8.2 (from -r taskcluster/requirements.txt (line 221))
[task 2024-07-09T19:18:21.366Z]   Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
[task 2024-07-09T19:18:21.382Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 18.1 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.412Z] Collecting python-slugify==8.0.4 (from -r taskcluster/requirements.txt (line 225))
[task 2024-07-09T19:18:21.422Z]   Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[task 2024-07-09T19:18:21.476Z] Collecting pyyaml==6.0.1 (from -r taskcluster/requirements.txt (line 229))
[task 2024-07-09T19:18:21.486Z]   Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
[task 2024-07-09T19:18:21.517Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 24.7 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.540Z] Collecting redo==2.0.4 (from -r taskcluster/requirements.txt (line 284))
[task 2024-07-09T19:18:21.551Z]   Downloading redo-2.0.4-py2.py3-none-any.whl (12 kB)
[task 2024-07-09T19:18:21.604Z] Collecting requests==2.31.0 (from -r taskcluster/requirements.txt (line 288))
[task 2024-07-09T19:18:21.614Z]   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2024-07-09T19:18:21.620Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 15.1 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.710Z] Collecting rich==13.7.0 (from -r taskcluster/requirements.txt (line 294))
[task 2024-07-09T19:18:21.721Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[task 2024-07-09T19:18:21.733Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 24.7 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.759Z] Collecting six==1.16.0 (from -r taskcluster/requirements.txt (line 298))
[task 2024-07-09T19:18:21.768Z]   Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[task 2024-07-09T19:18:21.791Z] Collecting slugid==2.0.0 (from -r taskcluster/requirements.txt (line 302))
[task 2024-07-09T19:18:21.802Z]   Downloading slugid-2.0.0-py2.py3-none-any.whl (8.2 kB)
[task 2024-07-09T19:18:21.838Z] Collecting taskcluster-taskgraph==7.4.0 (from -r taskcluster/requirements.txt (line 306))
[task 2024-07-09T19:18:21.849Z]   Downloading taskcluster_taskgraph-7.4.0-py3-none-any.whl (188 kB)
[task 2024-07-09T19:18:21.857Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 31.7 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.880Z] Collecting taskcluster-urls==13.0.1 (from -r taskcluster/requirements.txt (line 310))
[task 2024-07-09T19:18:21.890Z]   Downloading taskcluster_urls-13.0.1-py3-none-any.whl (10 kB)
[task 2024-07-09T19:18:21.911Z] Collecting text-unidecode==1.3 (from -r taskcluster/requirements.txt (line 315))
[task 2024-07-09T19:18:21.921Z]   Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
[task 2024-07-09T19:18:21.926Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.2/78.2 kB 30.5 MB/s eta 0:00:00
[task 2024-07-09T19:18:21.976Z] Collecting types-python-dateutil==2.8.19.20240106 (from -r taskcluster/requirements.txt (line 319))
[task 2024-07-09T19:18:21.987Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[task 2024-07-09T19:18:22.046Z] Collecting urllib3==2.2.0 (from -r taskcluster/requirements.txt (line 323))
[task 2024-07-09T19:18:22.056Z]   Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[task 2024-07-09T19:18:22.062Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 33.1 MB/s eta 0:00:00
[task 2024-07-09T19:18:22.089Z] Collecting voluptuous==0.14.2 (from -r taskcluster/requirements.txt (line 327))
[task 2024-07-09T19:18:22.099Z]   Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[task 2024-07-09T19:18:22.502Z] Installing collected packages: text-unidecode, taskcluster-urls, slugid, redo, json-e, appdirs, voluptuous, urllib3, types-python-dateutil, six, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, requests, python-dateutil, mozilla-repo-urls, markdown-it-py, jinja2, binaryornot, rich, arrow, cookiecutter, taskcluster-taskgraph
[task 2024-07-09T19:18:24.197Z] Successfully installed appdirs-1.4.4 arrow-1.3.0 binaryornot-0.4.4 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 mozilla-repo-urls-0.1.1 pygments-2.17.2 python-dateutil-2.8.2 python-slugify-8.0.4 pyyaml-6.0.1 redo-2.0.4 requests-2.31.0 rich-13.7.0 six-1.16.0 slugid-2.0.0 taskcluster-taskgraph-7.4.0 taskcluster-urls-13.0.1 text-unidecode-1.3 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-07-09T19:18:24.345Z] 
[task 2024-07-09T19:18:24.345Z] [notice] A new release of pip is available: 24.0 -> 24.1.2
[task 2024-07-09T19:18:24.345Z] [notice] To update, run: pip install --upgrade pip
[task 2024-07-09T19:18:24.473Z] task: [taskgraph-validate] TASKCLUSTER_ROOT_URL="" poetry run --directory ./taskgraph -- taskgraph full
[task 2024-07-09T19:18:25.321Z] 2024-07-09 19:18:25,321 - INFO - Loading graph configuration.
[task 2024-07-09T19:18:25.336Z] 2024-07-09 19:18:25,336 - INFO - Using Parameters(id=de622bc2168b) (from defaults)
[task 2024-07-09T19:18:25.337Z] 2024-07-09 19:18:25,337 - INFO - Loading kinds
[task 2024-07-09T19:18:25.372Z] 2024-07-09 19:18:25,372 - INFO - Generating full task set
[task 2024-07-09T19:18:25.399Z] 2024-07-09 19:18:25,399 - INFO - Generated 8 tasks for kind dataset
[task 2024-07-09T19:18:25.434Z] 2024-07-09 19:18:25,434 - INFO - Generated 4 tasks for kind docker-image
[task 2024-07-09T19:18:25.445Z] 2024-07-09 19:18:25,445 - INFO - Generated 10 tasks for kind fetch
[task 2024-07-09T19:18:25.519Z] 2024-07-09 19:18:25,519 - INFO - Generated 11 tasks for kind toolchain
[task 2024-07-09T19:18:25.522Z] 2024-07-09 19:18:25,522 - INFO - Generated 2 tasks for kind analyze-mono
[task 2024-07-09T19:18:25.526Z] 2024-07-09 19:18:25,526 - INFO - Generated 3 tasks for kind analyze-corpus
[task 2024-07-09T19:18:25.528Z] 2024-07-09 19:18:25,528 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-07-09T19:18:25.533Z] 2024-07-09 19:18:25,533 - INFO - Generated 3 tasks for kind clean-corpus
[task 2024-07-09T19:18:25.537Z] 2024-07-09 19:18:25,537 - INFO - Generated 3 tasks for kind bicleaner
[task 2024-07-09T19:18:25.541Z] 2024-07-09 19:18:25,541 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-07-09T19:18:25.545Z] 2024-07-09 19:18:25,545 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-07-09T19:18:25.549Z] 2024-07-09 19:18:25,548 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-07-09T19:18:25.551Z] 2024-07-09 19:18:25,551 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-07-09T19:18:25.553Z] 2024-07-09 19:18:25,553 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-07-09T19:18:25.555Z] 2024-07-09 19:18:25,555 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-07-09T19:18:25.560Z] 2024-07-09 19:18:25,560 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-07-09T19:18:25.562Z] 2024-07-09 19:18:25,562 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-07-09T19:18:25.565Z] 2024-07-09 19:18:25,565 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-07-09T19:18:25.569Z] 2024-07-09 19:18:25,568 - INFO - Generated 5 tasks for kind tests
[task 2024-07-09T19:18:25.573Z] 2024-07-09 19:18:25,573 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-07-09T19:18:25.577Z] 2024-07-09 19:18:25,576 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-07-09T19:18:25.579Z] 2024-07-09 19:18:25,579 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-07-09T19:18:25.581Z] 2024-07-09 19:18:25,581 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-07-09T19:18:25.585Z] 2024-07-09 19:18:25,584 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-07-09T19:18:25.587Z] 2024-07-09 19:18:25,587 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-07-09T19:18:25.591Z] 2024-07-09 19:18:25,591 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-07-09T19:18:25.595Z] 2024-07-09 19:18:25,595 - INFO - Generated 2 tasks for kind extract-best
[task 2024-07-09T19:18:25.597Z] 2024-07-09 19:18:25,597 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-07-09T19:18:25.601Z] 2024-07-09 19:18:25,601 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-07-09T19:18:25.603Z] 2024-07-09 19:18:25,603 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-07-09T19:18:25.606Z] 2024-07-09 19:18:25,606 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-07-09T19:18:25.608Z] 2024-07-09 19:18:25,608 - INFO - Generated 1 tasks for kind score
[task 2024-07-09T19:18:25.610Z] 2024-07-09 19:18:25,610 - INFO - Generated 1 tasks for kind cefilter
[task 2024-07-09T19:18:25.612Z] 2024-07-09 19:18:25,612 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-07-09T19:18:25.615Z] 2024-07-09 19:18:25,615 - INFO - Generated 1 tasks for kind shortlist
[task 2024-07-09T19:18:25.617Z] 2024-07-09 19:18:25,617 - INFO - Generated 1 tasks for kind train-student
[task 2024-07-09T19:18:25.620Z] 2024-07-09 19:18:25,620 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-07-09T19:18:25.622Z] 2024-07-09 19:18:25,622 - INFO - Generated 1 tasks for kind quantize
[task 2024-07-09T19:18:25.629Z] 2024-07-09 19:18:25,629 - INFO - Generated 4 tasks for kind evaluate
[task 2024-07-09T19:18:25.631Z] 2024-07-09 19:18:25,631 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-07-09T19:18:25.633Z] 2024-07-09 19:18:25,633 - INFO - Generated 1 tasks for kind export
[task 2024-07-09T19:18:25.635Z] 2024-07-09 19:18:25,634 - INFO - Generated 1 tasks for kind all
[task 2024-07-09T19:18:25.637Z] 2024-07-09 19:18:25,637 - INFO - Generated 0 tasks for kind all-pr
[task 2024-07-09T19:18:25.637Z] 2024-07-09 19:18:25,637 - INFO - Generating full task graph
[task 2024-07-09T19:18:25.638Z] 2024-07-09 19:18:25,638 - INFO - Full task graph contains 91 tasks and 261 dependencies
[task 2024-07-09T19:18:25.642Z] Dumping result with parameters from defaults:
[task 2024-07-09T19:18:25.642Z] alignments-backtranslated-ru-en
[task 2024-07-09T19:18:25.642Z] alignments-original-ru-en
[task 2024-07-09T19:18:25.642Z] alignments-student-ru-en
[task 2024-07-09T19:18:25.642Z] all-ru-en-1
[task 2024-07-09T19:18:25.642Z] analyze-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-07-09T19:18:25.642Z] analyze-corpus-opus-ada83_v1-ru-en
[task 2024-07-09T19:18:25.642Z] analyze-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-07-09T19:18:25.642Z] analyze-mono-news-crawl-en-news_2007
[task 2024-07-09T19:18:25.642Z] analyze-mono-news-crawl-ru-news_2008
[task 2024-07-09T19:18:25.642Z] bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-07-09T19:18:25.642Z] bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-07-09T19:18:25.642Z] bicleaner-ai-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-07-09T19:18:25.642Z] bicleaner-model-ru-en
[task 2024-07-09T19:18:25.642Z] build-docker-image-base
[task 2024-07-09T19:18:25.642Z] build-docker-image-test
[task 2024-07-09T19:18:25.642Z] build-docker-image-toolchain-build
[task 2024-07-09T19:18:25.642Z] build-docker-image-train
[task 2024-07-09T19:18:25.642Z] cefilter-ru-en
[task 2024-07-09T19:18:25.642Z] clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-07-09T19:18:25.642Z] clean-corpus-opus-ada83_v1-ru-en
[task 2024-07-09T19:18:25.642Z] clean-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-07-09T19:18:25.642Z] clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-07-09T19:18:25.642Z] clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-07-09T19:18:25.642Z] collect-corpus-ru-en
[task 2024-07-09T19:18:25.642Z] collect-mono-src-ru-en
[task 2024-07-09T19:18:25.642Z] collect-mono-trg-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-flores-dev-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-news-crawl-news_2007-en
[task 2024-07-09T19:18:25.642Z] dataset-news-crawl-news_2008-ru
[task 2024-07-09T19:18:25.642Z] dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-opus-ada83_v1-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-sacrebleu-aug-upper_wmt19-ru-en
[task 2024-07-09T19:18:25.642Z] dataset-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-backward-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-quantized-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-student-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-teacher-ensemble-flores-devtest-ru-en
[task 2024-07-09T19:18:25.642Z] evaluate-teacher-flores-devtest-ru-en-1
[task 2024-07-09T19:18:25.642Z] export-ru-en
[task 2024-07-09T19:18:25.642Z] extract-best-ru-en-1/2
[task 2024-07-09T19:18:25.642Z] extract-best-ru-en-2/2
[task 2024-07-09T19:18:25.642Z] fetch-browsermt-marian
[task 2024-07-09T19:18:25.642Z] fetch-cuda
[task 2024-07-09T19:18:25.642Z] fetch-cuda-11
[task 2024-07-09T19:18:25.642Z] fetch-cyhunspell
[task 2024-07-09T19:18:25.642Z] fetch-extract-lex
[task 2024-07-09T19:18:25.642Z] fetch-fast-align
[task 2024-07-09T19:18:25.642Z] fetch-hunspell
[task 2024-07-09T19:18:25.642Z] fetch-kenlm
[task 2024-07-09T19:18:25.642Z] fetch-marian
[task 2024-07-09T19:18:25.642Z] fetch-preprocess
[task 2024-07-09T19:18:25.642Z] finetune-student-ru-en
[task 2024-07-09T19:18:25.642Z] merge-corpus-ru-en
[task 2024-07-09T19:18:25.642Z] merge-devset-ru-en
[task 2024-07-09T19:18:25.642Z] merge-mono-src-ru
[task 2024-07-09T19:18:25.642Z] merge-mono-trg-en
[task 2024-07-09T19:18:25.642Z] merge-translated-ru-en
[task 2024-07-09T19:18:25.642Z] quantize-ru-en
[task 2024-07-09T19:18:25.642Z] score-ru-en
[task 2024-07-09T19:18:25.642Z] shortlist-ru-en
[task 2024-07-09T19:18:25.642Z] split-corpus-ru-en
[task 2024-07-09T19:18:25.642Z] split-mono-src-ru
[task 2024-07-09T19:18:25.642Z] split-mono-trg-en
[task 2024-07-09T19:18:25.642Z] tests-black
[task 2024-07-09T19:18:25.642Z] tests-lint
[task 2024-07-09T19:18:25.642Z] tests-taskgraph-definition
[task 2024-07-09T19:18:25.642Z] tests-taskgraph-diff
[task 2024-07-09T19:18:25.642Z] tests-test
[task 2024-07-09T19:18:25.642Z] toolchain-browsermt-marian
[task 2024-07-09T19:18:25.642Z] toolchain-cuda-toolkit
[task 2024-07-09T19:18:25.642Z] toolchain-cuda-toolkit-11
[task 2024-07-09T19:18:25.642Z] toolchain-cyhunspell
[task 2024-07-09T19:18:25.642Z] toolchain-extract-lex
[task 2024-07-09T19:18:25.642Z] toolchain-fast-align
[task 2024-07-09T19:18:25.642Z] toolchain-hunspell
[task 2024-07-09T19:18:25.642Z] toolchain-kenlm
[task 2024-07-09T19:18:25.642Z] toolchain-marian
[task 2024-07-09T19:18:25.642Z] toolchain-marian-cpu
[task 2024-07-09T19:18:25.642Z] toolchain-preprocess
[task 2024-07-09T19:18:25.642Z] train-backwards-ru-en
[task 2024-07-09T19:18:25.642Z] train-student-ru-en
[task 2024-07-09T19:18:25.642Z] train-teacher-ru-en-1
[task 2024-07-09T19:18:25.642Z] train-vocab-ru-en
[task 2024-07-09T19:18:25.642Z] translate-corpus-ru-en-1/2
[task 2024-07-09T19:18:25.642Z] translate-corpus-ru-en-2/2
[task 2024-07-09T19:18:25.642Z] translate-mono-src-ru-en-1/2
[task 2024-07-09T19:18:25.642Z] translate-mono-src-ru-en-2/2
[task 2024-07-09T19:18:25.642Z] translate-mono-trg-ru-en-1/2
[task 2024-07-09T19:18:25.642Z] translate-mono-trg-ru-en-2/2
[task 2024-07-09T19:18:25.642Z] 
[taskcluster 2024-07-09 19:18:26.000Z] === Task Finished ===
[taskcluster 2024-07-09 19:18:26.001Z] Successful task run with exit code: 0 completed in 9.149 seconds