Fix taskcluster train scripts #895
Merged
firefoxci-taskcluster / tests-black
succeeded
Oct 22, 2024 in 1m 57s
FirefoxCI (pull_request)
Run tests
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2024-10-22T18:01:33.532Z
Resolved: 2024-10-22T18:02:05.732Z
Task Execution Time: 32 seconds, 200 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2024-10-22 18:01:33.618Z] Task ID: cHf4w8CdRZ-cMT7cZyu0Jg
[taskcluster 2024-10-22 18:01:33.618Z] Worker ID: 7542886199019067075
[taskcluster 2024-10-22 18:01:33.618Z] Worker Group: us-central1-a
[taskcluster 2024-10-22 18:01:33.618Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-10-22 18:01:33.618Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-10-22 18:01:33.618Z] Worker Version: 38.0.5
[taskcluster 2024-10-22 18:01:33.618Z] Public IP: 34.69.136.109
[taskcluster 2024-10-22 18:01:33.618Z] Hostname: translations-1-b-linux-large-gcp-sr22b3fqszowckgwhr9agg
[taskcluster 2024-10-22 18:01:33.618Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-b_oDJTdfTB-X_9bt__lkxQ" -> /builds/worker/checkouts
[taskcluster 2024-10-22 18:01:37.469Z] Downloading artifact "public/image.tar.zst" from task ID: b_oDJTdfTB-X_9bt__lkxQ.
[taskcluster 2024-10-22 18:01:40.534Z] Downloaded artifact successfully.
[taskcluster 2024-10-22 18:01:40.535Z] Downloaded 262.271 mb
[taskcluster 2024-10-22 18:01:40.536Z] Decompressing downloaded image
[taskcluster 2024-10-22 18:01:42.211Z] Loading docker image from downloaded archive.
[taskcluster 2024-10-22 18:01:52.962Z] Image 'public/image.tar.zst' from task 'b_oDJTdfTB-X_9bt__lkxQ' loaded. Using image ID sha256:8fe757d1fbcb86e9c890c5e53eeb308f97bed520893dd67b9273de93f934f086.
[taskcluster 2024-10-22 18:01:53.101Z] === Task Starting ===
[setup 2024-10-22T18:01:54.877Z] run-task started in /builds/worker
[setup 2024-10-22T18:01:54.877Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c task lint-black
[setup 2024-10-22T18:01:54.877Z] Python version: 3.10.12
[cache 2024-10-22T18:01:54.878Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-10-22T18:01:54.879Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-10-22T18:01:54.879Z] volume /builds/worker/checkouts is a cache
[setup 2024-10-22T18:01:54.879Z] running as worker:worker
[vcs 2024-10-22T18:01:54.879Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:01:54.880Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:01:54.882Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-10-22T18:01:55.733Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:01:55.947Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:01:55.947Z] * branch fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:01:55.954Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:01:56.156Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:01:56.156Z] * branch fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:01:56.163Z] executing ['git', 'checkout', '-f', '-B', 'fix_tc_train_args', '2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c']
[vcs 2024-10-22T18:01:56.257Z] Switched to a new branch 'fix_tc_train_args'
[vcs 2024-10-22T18:01:56.258Z] executing ['git', 'submodule', 'init']
[vcs 2024-10-22T18:01:56.276Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:01:56.276Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-10-22T18:01:56.276Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-10-22T18:01:56.277Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-10-22T18:01:56.277Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-10-22T18:01:56.277Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-10-22T18:01:56.277Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:01:56.278Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-10-22T18:01:56.278Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-10-22T18:01:56.298Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:01:57.372Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-10-22T18:01:57.629Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-10-22T18:01:57.912Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-10-22T18:01:58.505Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-10-22T18:01:59.845Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-10-22T18:02:00.249Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:02:01.303Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2024-10-22T18:02:01.716Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-10-22T18:02:01.725Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-10-22T18:02:01.734Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-10-22T18:02:01.758Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-10-22T18:02:01.856Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-10-22T18:02:01.874Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-10-22T18:02:01.935Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-10-22T18:02:01.947Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-10-22T18:02:01.947Z] cleaning git checkout...
[vcs 2024-10-22T18:02:01.947Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-10-22T18:02:01.950Z] removing []
[vcs 2024-10-22T18:02:01.950Z] successfully cleaned git checkout!
[vcs 2024-10-22T18:02:01.952Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c' title='Built from firefox-translations-training commit 2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c'>2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c</a>
[task 2024-10-22T18:02:01.952Z] executing ['bash', '-c', 'task lint-black']
[task 2024-10-22T18:02:01.957Z] task: [poetry-install-*] poetry install --only black --no-root
[task 2024-10-22T18:02:02.359Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-10-22T18:02:02.764Z] Installing dependencies from lock file
[task 2024-10-22T18:02:03.111Z]
[task 2024-10-22T18:02:03.111Z] Package operations: 8 installs, 0 updates, 0 removals
[task 2024-10-22T18:02:03.111Z]
[task 2024-10-22T18:02:03.112Z] - Installing click (8.1.7)
[task 2024-10-22T18:02:03.112Z] - Installing mypy-extensions (1.0.0)
[task 2024-10-22T18:02:03.113Z] - Installing packaging (24.1)
[task 2024-10-22T18:02:03.113Z] - Installing pathspec (0.12.1)
[task 2024-10-22T18:02:03.114Z] - Installing platformdirs (4.2.2)
[task 2024-10-22T18:02:03.114Z] - Installing tomli (2.0.1)
[task 2024-10-22T18:02:03.114Z] - Installing typing-extensions (4.12.2)
[task 2024-10-22T18:02:03.386Z] - Installing black (23.12.1)
[task 2024-10-22T18:02:03.612Z] task: [lint-black] ./utils/tasks/black-check.sh
[task 2024-10-22T18:02:03.613Z] poetry run black . --check --diff
[task 2024-10-22T18:02:04.656Z] All done! ✨ 🍰 ✨
[task 2024-10-22T18:02:04.656Z] 99 files would be left unchanged.
[task 2024-10-22T18:02:04.678Z] The python code formatting is correct.
[taskcluster 2024-10-22 18:02:05.189Z] === Task Finished ===
[taskcluster 2024-10-22 18:02:05.190Z] Successful task run with exit code: 0 completed in 31.573 seconds
Loading