Fix taskcluster train scripts #895
Merged
firefoxci-taskcluster / tests-lint
succeeded
Oct 22, 2024 in 2m 16s
FirefoxCI (pull_request)
Run tests
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2024-10-22T18:01:41.649Z
Resolved: 2024-10-22T18:02:25.205Z
Task Execution Time: 43 seconds, 556 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2024-10-22 18:01:41.690Z] Task ID: I66bakOMQ_-BJv5t6ONQuA
[taskcluster 2024-10-22 18:01:41.690Z] Worker ID: 5561255741106050755
[taskcluster 2024-10-22 18:01:41.690Z] Worker Group: us-west1-b
[taskcluster 2024-10-22 18:01:41.690Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-10-22 18:01:41.690Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-10-22 18:01:41.690Z] Worker Version: 38.0.5
[taskcluster 2024-10-22 18:01:41.690Z] Public IP: 35.247.96.98
[taskcluster 2024-10-22 18:01:41.690Z] Hostname: translations-1-b-linux-large-gcp-l54cvjyzss2azl0c83eybw
[taskcluster 2024-10-22 18:01:41.690Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-b_oDJTdfTB-X_9bt__lkxQ" -> /builds/worker/checkouts
[taskcluster 2024-10-22 18:01:45.696Z] Downloading artifact "public/image.tar.zst" from task ID: b_oDJTdfTB-X_9bt__lkxQ.
[taskcluster 2024-10-22 18:01:48.550Z] Downloaded artifact successfully.
[taskcluster 2024-10-22 18:01:48.550Z] Downloaded 262.271 mb
[taskcluster 2024-10-22 18:01:48.551Z] Decompressing downloaded image
[taskcluster 2024-10-22 18:01:50.411Z] Loading docker image from downloaded archive.
[taskcluster 2024-10-22 18:02:04.099Z] Image 'public/image.tar.zst' from task 'b_oDJTdfTB-X_9bt__lkxQ' loaded. Using image ID sha256:8fe757d1fbcb86e9c890c5e53eeb308f97bed520893dd67b9273de93f934f086.
[taskcluster 2024-10-22 18:02:04.227Z] === Task Starting ===
[setup 2024-10-22T18:02:06.619Z] run-task started in /builds/worker
[setup 2024-10-22T18:02:06.619Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c task lint-ruff
[setup 2024-10-22T18:02:06.619Z] Python version: 3.10.12
[cache 2024-10-22T18:02:06.620Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-10-22T18:02:06.620Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-10-22T18:02:06.620Z] volume /builds/worker/checkouts is a cache
[setup 2024-10-22T18:02:06.620Z] running as worker:worker
[vcs 2024-10-22T18:02:06.621Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:02:06.622Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:02:06.624Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-10-22T18:02:08.007Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:02:08.463Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:02:08.463Z] * branch fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:02:08.471Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:02:08.772Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:02:08.772Z] * branch fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:02:08.780Z] executing ['git', 'checkout', '-f', '-B', 'fix_tc_train_args', '2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c']
[vcs 2024-10-22T18:02:08.787Z] Switched to a new branch 'fix_tc_train_args'
[vcs 2024-10-22T18:02:08.787Z] executing ['git', 'submodule', 'init']
[vcs 2024-10-22T18:02:08.808Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:02:08.808Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-10-22T18:02:08.809Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-10-22T18:02:08.809Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-10-22T18:02:08.809Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-10-22T18:02:08.809Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-10-22T18:02:08.810Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:02:08.810Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-10-22T18:02:08.811Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-10-22T18:02:08.833Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:02:10.353Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-10-22T18:02:10.743Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-10-22T18:02:11.089Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-10-22T18:02:11.760Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-10-22T18:02:13.758Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-10-22T18:02:14.196Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:02:15.860Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2024-10-22T18:02:16.332Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-10-22T18:02:16.342Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-10-22T18:02:16.353Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-10-22T18:02:16.381Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-10-22T18:02:16.497Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-10-22T18:02:16.517Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-10-22T18:02:16.590Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-10-22T18:02:16.604Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-10-22T18:02:16.605Z] cleaning git checkout...
[vcs 2024-10-22T18:02:16.605Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-10-22T18:02:16.608Z] removing []
[vcs 2024-10-22T18:02:16.609Z] successfully cleaned git checkout!
[vcs 2024-10-22T18:02:16.610Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c' title='Built from firefox-translations-training commit 2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c'>2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c</a>
[task 2024-10-22T18:02:16.610Z] executing ['bash', '-c', 'task lint-ruff']
[task 2024-10-22T18:02:16.618Z] task: [poetry-install-*] poetry install --only lint --no-root
[task 2024-10-22T18:02:17.056Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-10-22T18:02:17.534Z] Installing dependencies from lock file
[task 2024-10-22T18:02:17.930Z]
[task 2024-10-22T18:02:17.931Z] Package operations: 34 installs, 1 update, 0 removals
[task 2024-10-22T18:02:17.931Z]
[task 2024-10-22T18:02:17.931Z] - Installing frozenlist (1.4.1)
[task 2024-10-22T18:02:17.932Z] - Installing idna (3.8)
[task 2024-10-22T18:02:17.932Z] - Installing multidict (6.0.5)
[task 2024-10-22T18:02:17.932Z] - Installing smmap (5.0.1)
[task 2024-10-22T18:02:18.192Z] - Installing aiohappyeyeballs (2.4.0)
[task 2024-10-22T18:02:18.192Z] - Installing aiosignal (1.3.1)
[task 2024-10-22T18:02:18.194Z] - Installing async-timeout (4.0.3)
[task 2024-10-22T18:02:18.195Z] - Installing certifi (2024.7.4)
[task 2024-10-22T18:02:18.197Z] - Installing attrs (24.2.0)
[task 2024-10-22T18:02:18.198Z] - Installing charset-normalizer (2.0.12)
[task 2024-10-22T18:02:18.198Z] - Installing gitdb (4.0.11)
[task 2024-10-22T18:02:18.199Z] - Installing six (1.16.0)
[task 2024-10-22T18:02:18.200Z] - Installing urllib3 (1.26.19)
[task 2024-10-22T18:02:18.201Z] - Installing yarl (1.9.4)
[task 2024-10-22T18:02:18.398Z] - Installing aiohttp (3.10.5)
[task 2024-10-22T18:02:18.399Z] - Installing appdirs (1.4.4)
[task 2024-10-22T18:02:18.400Z] - Installing click (8.1.7)
[task 2024-10-22T18:02:18.401Z] - Installing docker-pycreds (0.4.0)
[task 2024-10-22T18:02:18.403Z] - Installing mohawk (1.1.0)
[task 2024-10-22T18:02:18.404Z] - Installing gitpython (3.1.43)
[task 2024-10-22T18:02:18.406Z] - Installing protobuf (3.19.0)
[task 2024-10-22T18:02:18.407Z] - Installing python-dateutil (2.9.0.post0)
[task 2024-10-22T18:02:18.408Z] - Installing requests (2.26.0)
[task 2024-10-22T18:02:18.410Z] - Installing psutil (6.0.0)
[task 2024-10-22T18:02:18.413Z] - Installing pyyaml (6.0.2)
[task 2024-10-22T18:02:18.414Z] - Installing sentry-sdk (2.13.0)
[task 2024-10-22T18:02:18.417Z] - Installing taskcluster-urls (13.0.1)
[task 2024-10-22T18:02:18.417Z] - Downgrading setuptools (75.1.0 -> 74.0.0)
[task 2024-10-22T18:02:18.422Z] - Installing setproctitle (1.3.3)
[task 2024-10-22T18:02:18.424Z] - Installing slugid (2.0.0)
[task 2024-10-22T18:02:19.813Z] - Installing numpy (1.26.4)
[task 2024-10-22T18:02:19.813Z] - Installing taskcluster (56.0.3)
[task 2024-10-22T18:02:19.814Z] - Installing wandb (0.16.1)
[task 2024-10-22T18:02:21.058Z] - Installing ruff (0.1.15)
[task 2024-10-22T18:02:21.343Z] - Installing translations-parser (0.1.0 /builds/worker/checkouts/vcs/tracking)
[task 2024-10-22T18:02:22.804Z] task: [lint-ruff] poetry run ruff --version
[task 2024-10-22T18:02:23.296Z] ruff 0.1.15
[task 2024-10-22T18:02:23.296Z] task: [lint-ruff] poetry run ruff check .
[taskcluster 2024-10-22 18:02:24.760Z] === Task Finished ===
[taskcluster 2024-10-22 18:02:24.760Z] Successful task run with exit code: 0 completed in 43.071 seconds
Loading