[taskcluster 2024-10-22 18:39:57.485Z] Task ID: ZJ0BCWn4Rmesuz7PI_snNA
[taskcluster 2024-10-22 18:39:57.485Z] Worker ID: 6868397010072522708
[taskcluster 2024-10-22 18:39:57.485Z] Worker Group: us-central1-b
[taskcluster 2024-10-22 18:39:57.485Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-10-22 18:39:57.485Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2024-10-22 18:39:57.485Z] Worker Version: 38.0.5
[taskcluster 2024-10-22 18:39:57.485Z] Public IP: 34.132.120.51
[taskcluster 2024-10-22 18:39:57.485Z] Hostname: translations-1-b-linux-large-gcp-300gb-vorxoxbdt8kgbdpvihotmw
[taskcluster 2024-10-22 18:39:57.485Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-WhHlxCxnQYW05fB1pTTteQ" -> /builds/worker/checkouts

[taskcluster 2024-10-22 18:40:00.178Z] Downloading artifact "public/image.tar.zst" from task ID: WhHlxCxnQYW05fB1pTTteQ.
[taskcluster 2024-10-22 18:40:03.228Z] Downloaded artifact successfully.
[taskcluster 2024-10-22 18:40:03.229Z] Downloaded 258.512 mb
[taskcluster 2024-10-22 18:40:03.230Z] Decompressing downloaded image
[taskcluster 2024-10-22 18:40:05.156Z] Loading docker image from downloaded archive.
[taskcluster 2024-10-22 18:40:36.959Z] Image 'public/image.tar.zst' from task 'WhHlxCxnQYW05fB1pTTteQ' loaded.  Using image ID sha256:502a53cc11fc8a59c0ca778225c5a4e38adf93683b8d4000d345029404ff6cf9.
[taskcluster 2024-10-22 18:40:37.115Z] === Task Starting ===
[setup 2024-10-22T18:40:37.432Z] run-task started in /builds/worker
[setup 2024-10-22T18:40:37.432Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c zstd -d --rm $MOZ_FETCHES_DIR/*.zst && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/translate/bestbleu.py -i "$MOZ_FETCHES_DIR/file.2.nbest" -r "$MOZ_FETCHES_DIR/file.2.ref" -o $TASK_WORKDIR/artifacts/file.2.nbest.out -m bleu
[setup 2024-10-22T18:40:37.432Z] Python version: 3.10.12
[cache 2024-10-22T18:40:37.434Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-10-22T18:40:37.434Z] volume /builds/worker/checkouts is a cache
[setup 2024-10-22T18:40:37.434Z] running as worker:worker
[vcs 2024-10-22T18:40:37.434Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:40:37.436Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-10-22T18:40:37.437Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-10-22T18:40:38.304Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:40:38.481Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:40:38.481Z]  * branch            fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:40:38.488Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'fix_tc_train_args']
[vcs 2024-10-22T18:40:38.679Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:40:38.679Z]  * branch            fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:40:38.686Z] executing ['git', 'checkout', '-f', '-B', 'fix_tc_train_args', '2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c']
[vcs 2024-10-22T18:40:38.790Z] Switched to a new branch 'fix_tc_train_args'
[vcs 2024-10-22T18:40:38.791Z] executing ['git', 'submodule', 'init']
[vcs 2024-10-22T18:40:38.813Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:40:38.813Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-10-22T18:40:38.814Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-10-22T18:40:38.815Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-10-22T18:40:38.815Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-10-22T18:40:38.816Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-10-22T18:40:38.816Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:40:38.817Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-10-22T18:40:38.817Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-10-22T18:40:38.840Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:40:39.990Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-10-22T18:40:40.253Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-10-22T18:40:40.555Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-10-22T18:40:41.195Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-10-22T18:40:42.626Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-10-22T18:40:43.064Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:40:44.219Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2024-10-22T18:40:44.618Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-10-22T18:40:44.629Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-10-22T18:40:44.639Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-10-22T18:40:44.666Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-10-22T18:40:44.780Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-10-22T18:40:44.800Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-10-22T18:40:44.876Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-10-22T18:40:44.891Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-10-22T18:40:44.891Z] cleaning git checkout...
[vcs 2024-10-22T18:40:44.891Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-10-22T18:40:44.895Z] removing []
[vcs 2024-10-22T18:40:44.895Z] successfully cleaned git checkout!
[vcs 2024-10-22T18:40:44.896Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c' title='Built from firefox-translations-training commit 2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c'>2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c</a>
[setup 2024-10-22T18:40:44.896Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-10-22T18:40:44.896Z] fetching artifacts
[fetches 2024-10-22T18:40:44.896Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OKehpaxNSAyoHgMCmUseRw/artifacts/public/build/file.2.ref.zst to /builds/worker/fetches/file.2.ref.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/awJSO0rgS3uGL8-oUN4SlA/artifacts/public/build/file.2.nbest.zst to /builds/worker/fetches/file.2.nbest.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OKehpaxNSAyoHgMCmUseRw/artifacts/public/build/file.2.ref.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/awJSO0rgS3uGL8-oUN4SlA/artifacts/public/build/file.2.nbest.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/awJSO0rgS3uGL8-oUN4SlA/artifacts/public/build/file.2.nbest.zst resolved to 47393 bytes with sha256 a1482129628ac8e581bf824745f5d1b574e5dc020a7226cf47dfab8cfda61616 in 0.160s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/awJSO0rgS3uGL8-oUN4SlA/artifacts/public/build/file.2.nbest.zst
Extracting /builds/worker/fetches/file.2.nbest.zst to /builds/worker/fetches
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OKehpaxNSAyoHgMCmUseRw/artifacts/public/build/file.2.ref.zst resolved to 17797 bytes with sha256 b596caa1789d66eb72164110fcd3e9c9f0f359b62bca1baa47e130ab6ca9d4e4 in 0.168s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OKehpaxNSAyoHgMCmUseRw/artifacts/public/build/file.2.ref.zst
Extracting /builds/worker/fetches/file.2.ref.zst to /builds/worker/fetches
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.17032026200000416, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-10-22T18:40:45.152Z] finished fetching artifacts
[task 2024-10-22T18:40:45.152Z] executing ['bash', '-c', 'zstd -d --rm $MOZ_FETCHES_DIR/*.zst && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/translate/bestbleu.py -i "$MOZ_FETCHES_DIR/file.2.nbest" -r "$MOZ_FETCHES_DIR/file.2.ref" -o $TASK_WORKDIR/artifacts/file.2.nbest.out -m bleu']
[task 2024-10-22T18:40:45.155Z] 
[task 2024-10-22T18:40:45.156Z] Decompress:  1/ 2 files. Current: ...ile.2.nbest.zst : 0 MB...    
[task 2024-10-22T18:40:45.157Z]                                                                                
[task 2024-10-22T18:40:45.157Z] 
[task 2024-10-22T18:40:45.157Z]                                                                                
[task 2024-10-22T18:40:45.157Z] 2 files decompressed : 1014329 bytes total 
[fetches 2024-10-22T18:40:45.570Z] removing /builds/worker/fetches
[fetches 2024-10-22T18:40:45.571Z] finished
[taskcluster 2024-10-22 18:40:46.278Z] === Task Finished ===
[taskcluster 2024-10-22 18:40:46.529Z] Successful task run with exit code: 0 completed in 49.045 seconds