[taskcluster 2024-10-22T18:23:14.397Z] Worker Type (translations-1/b-linux-large-gcp-1tb-32-256-d2g) settings:
[taskcluster 2024-10-22T18:23:14.397Z]   {
[taskcluster 2024-10-22T18:23:14.397Z]     "config": {
[taskcluster 2024-10-22T18:23:14.397Z]       "deploymentId": ""
[taskcluster 2024-10-22T18:23:14.397Z]     },
[taskcluster 2024-10-22T18:23:14.397Z]     "generic-worker": {
[taskcluster 2024-10-22T18:23:14.397Z]       "engine": "multiuser",
[taskcluster 2024-10-22T18:23:14.397Z]       "go-arch": "amd64",
[taskcluster 2024-10-22T18:23:14.397Z]       "go-os": "linux",
[taskcluster 2024-10-22T18:23:14.397Z]       "go-version": "go1.22.2",
[taskcluster 2024-10-22T18:23:14.397Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v64.3.0",
[taskcluster 2024-10-22T18:23:14.397Z]       "revision": "b66b6614b9b79077f1bfc78f97afb8c25c0c4b30",
[taskcluster 2024-10-22T18:23:14.397Z]       "source": "https://github.com/taskcluster/taskcluster/commits/b66b6614b9b79077f1bfc78f97afb8c25c0c4b30",
[taskcluster 2024-10-22T18:23:14.397Z]       "version": "64.3.0"
[taskcluster 2024-10-22T18:23:14.397Z]     },
[taskcluster 2024-10-22T18:23:14.397Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-gui-googlecompute-2024-08-22t22-48-09z",
[taskcluster 2024-10-22T18:23:14.397Z]     "instance-id": "2992928408347497463",
[taskcluster 2024-10-22T18:23:14.397Z]     "instance-type": "projects/887720501152/machineTypes/n2-highmem-32",
[taskcluster 2024-10-22T18:23:14.397Z]     "local-ipv4": "10.138.1.141",
[taskcluster 2024-10-22T18:23:14.397Z]     "project-id": "fxci-production-level1-workers",

...(158 lines hidden)...

[vcs 2024-10-22T18:23:30.291Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-10-22T18:23:30.291Z]  * branch            fix_tc_train_args -> FETCH_HEAD
[vcs 2024-10-22T18:23:30.297Z] executing ['git', 'checkout', '-f', '-B', 'fix_tc_train_args', '2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c']
[vcs 2024-10-22T18:23:30.394Z] Switched to a new branch 'fix_tc_train_args'
[vcs 2024-10-22T18:23:30.394Z] executing ['git', 'submodule', 'init']
[vcs 2024-10-22T18:23:30.415Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:23:30.416Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-10-22T18:23:30.417Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-10-22T18:23:30.417Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-10-22T18:23:30.418Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-10-22T18:23:30.418Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-10-22T18:23:30.419Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-10-22T18:23:30.419Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-10-22T18:23:30.420Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-10-22T18:23:30.441Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:23:31.550Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-10-22T18:23:31.946Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-10-22T18:23:32.358Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-10-22T18:23:33.426Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-10-22T18:23:35.555Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-10-22T18:23:36.981Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-10-22T18:23:38.166Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2024-10-22T18:23:38.803Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-10-22T18:23:38.816Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-10-22T18:23:38.829Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-10-22T18:23:38.855Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-10-22T18:23:38.956Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-10-22T18:23:38.977Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-10-22T18:23:39.041Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-10-22T18:23:39.058Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-10-22T18:23:39.058Z] cleaning git checkout...
[vcs 2024-10-22T18:23:39.058Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-10-22T18:23:39.061Z] removing []
[vcs 2024-10-22T18:23:39.061Z] successfully cleaned git checkout!
[vcs 2024-10-22T18:23:39.062Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c' title='Built from firefox-translations-training commit 2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c'>2d0fb8cf64a76c1014ef9eeac29bbe483d5f3b6c</a>
[setup 2024-10-22T18:23:39.063Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-10-22T18:23:39.063Z] fetching artifacts
[fetches 2024-10-22T18:23:39.063Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KLqKD5jeRhqciLg3OwUmxQ/artifacts/public/build/corpus.priors to /builds/worker/fetches/corpus.priors
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XfwhWuzvRbSrLLnsG1PA7w/artifacts/public/build/mono.ru.zst to /builds/worker/fetches/mono.ru.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KLqKD5jeRhqciLg3OwUmxQ/artifacts/public/build/corpus.priors
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XfwhWuzvRbSrLLnsG1PA7w/artifacts/public/build/mono.ru.zstattempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WiBO_F9QQsiiI-0ZI0vNEA/artifacts/public/build/mono.en.zst to /builds/worker/fetches/mono.en.zst

attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WiBO_F9QQsiiI-0ZI0vNEA/artifacts/public/build/mono.en.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EBhuRvmXRg-JQpAJoHsgsA/artifacts/public/build/fast-align.tar.zst to /builds/worker/fetches/fast-align.tar.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EBhuRvmXRg-JQpAJoHsgsA/artifacts/public/build/fast-align.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WiBO_F9QQsiiI-0ZI0vNEA/artifacts/public/build/mono.en.zst resolved to 36641 bytes with sha256 a50ca093ad501914eba9bb21a8dd3d6e654fdb67bd2ceb8ea90d80c27b6005eb in 0.041s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WiBO_F9QQsiiI-0ZI0vNEA/artifacts/public/build/mono.en.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EBhuRvmXRg-JQpAJoHsgsA/artifacts/public/build/fast-align.tar.zst resolved to 722752 bytes with sha256 f3b22724daab04267d54ff010187e6014c149ed32da9a2f5d3be9800d3bbdbac in 0.052s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EBhuRvmXRg-JQpAJoHsgsA/artifacts/public/build/fast-align.tar.zst
Extracting /builds/worker/fetches/fast-align.tar.zst to /builds/worker/fetches
/builds/worker/fetches/fast-align.tar.zst extracted in 0.007s
Removing /builds/worker/fetches/fast-align.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XfwhWuzvRbSrLLnsG1PA7w/artifacts/public/build/mono.ru.zst resolved to 1420 bytes with sha256 60c99a1d71ceeecf5e308e06d03c06630166129d710f84e43d7eeb58e3c8fc29 in 0.151s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XfwhWuzvRbSrLLnsG1PA7w/artifacts/public/build/mono.ru.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KLqKD5jeRhqciLg3OwUmxQ/artifacts/public/build/corpus.priors resolved to 257875 bytes with sha256 892d1b8baaea9c1987cb1fef5a7e0e0a995f4db1b445beef9ffc23d772ae5495 in 0.154s
Extracting /builds/worker/fetches/corpus.priors to /builds/worker/fetches
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.17597306999999773, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-10-22T18:23:39.307Z] finished fetching artifacts
[task 2024-10-22T18:23:39.307Z] executing ['bash', '-c', 'pip3 install --upgrade pip setuptools && pip3 install -r $VCS_PATH/pipeline/alignments/requirements/alignments.txt && export BIN=$MOZ_FETCHES_DIR && export PATH=$PATH:$MOZ_FETCHES_DIR && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/alignments/align.py --corpus_src=$MOZ_FETCHES_DIR/mono.ru.zst --corpus_trg=$MOZ_FETCHES_DIR/mono.en.zst --output_path=$TASK_WORKDIR/artifacts/mono.aln.zst --tokenization=moses --priors_input_path=$MOZ_FETCHES_DIR/corpus.priors']
[task 2024-10-22T18:23:39.575Z] WARNING: The directory '/builds/worker/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
[task 2024-10-22T18:23:39.575Z] Defaulting to user installation because normal site-packages is not writeable
[task 2024-10-22T18:23:39.594Z] Requirement already satisfied: pip in /usr/lib/python3/dist-packages (22.0.2)
[task 2024-10-22T18:23:39.733Z] Collecting pip
[task 2024-10-22T18:23:39.809Z]   Downloading pip-24.2-py3-none-any.whl (1.8 MB)
[task 2024-10-22T18:23:39.978Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 10.8 MB/s eta 0:00:00
[task 2024-10-22T18:23:39.987Z] Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (59.6.0)
[task 2024-10-22T18:23:40.238Z] Collecting setuptools
[task 2024-10-22T18:23:40.248Z]   Downloading setuptools-75.2.0-py3-none-any.whl (1.2 MB)
[task 2024-10-22T18:23:40.309Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 21.0 MB/s eta 0:00:00
[task 2024-10-22T18:23:40.431Z] Installing collected packages: setuptools, pip
[task 2024-10-22T18:23:41.583Z] Successfully installed pip-24.2 setuptools-75.2.0
[task 2024-10-22T18:23:41.883Z] WARNING: The directory '/builds/worker/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
[task 2024-10-22T18:23:41.884Z] Defaulting to user installation because normal site-packages is not writeable
[task 2024-10-22T18:23:42.019Z] Collecting certifi==2024.7.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 7))
[task 2024-10-22T18:23:42.045Z]   Downloading certifi-2024.7.4-py3-none-any.whl (162 kB)
[task 2024-10-22T18:23:42.147Z] Collecting charset-normalizer==3.3.2 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 11))
[task 2024-10-22T18:23:42.156Z]   Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2024-10-22T18:23:42.372Z] Collecting cython==3.0.9 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 103))
[task 2024-10-22T18:23:42.381Z]   Downloading Cython-3.0.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB)
[task 2024-10-22T18:23:42.422Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 89.4 MB/s eta 0:00:00
[task 2024-10-22T18:23:42.511Z] Collecting eflomal==1.0.0b1 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 163))
[task 2024-10-22T18:23:42.520Z]   Downloading eflomal-1.0.0b1.tar.gz (102 kB)
[task 2024-10-22T18:23:42.532Z]   Installing build dependencies: started
[task 2024-10-22T18:23:46.315Z]   Installing build dependencies: finished with status 'done'
[task 2024-10-22T18:23:46.316Z]   Getting requirements to build wheel: started
[task 2024-10-22T18:23:47.310Z]   Getting requirements to build wheel: finished with status 'done'
[task 2024-10-22T18:23:47.311Z]   Preparing metadata (pyproject.toml): started
[task 2024-10-22T18:23:47.753Z]   Preparing metadata (pyproject.toml): finished with status 'done'
[task 2024-10-22T18:23:47.770Z] Collecting idna==3.8 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 166))
[task 2024-10-22T18:23:47.778Z]   Downloading idna-3.8-py3-none-any.whl (66 kB)
[task 2024-10-22T18:23:47.930Z] Collecting numpy==1.26.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 170))
[task 2024-10-22T18:23:47.942Z]   Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
[task 2024-10-22T18:23:47.989Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 406.7 MB/s eta 0:00:00
[task 2024-10-22T18:23:48.060Z] Collecting opus-fast-mosestokenizer==0.0.8.5 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 208))
[task 2024-10-22T18:23:48.069Z]   Downloading opus_fast_mosestokenizer-0.0.8.5-cp310-cp310-manylinux1_x86_64.whl (837 kB)
[task 2024-10-22T18:23:48.074Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 837.2/837.2 kB 194.9 MB/s eta 0:00:00
[task 2024-10-22T18:23:48.109Z] Collecting requests==2.31.0 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 223))
[task 2024-10-22T18:23:48.117Z]   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2024-10-22T18:23:48.183Z] Collecting tqdm==4.66.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 227))
[task 2024-10-22T18:23:48.191Z]   Downloading tqdm-4.66.4-py3-none-any.whl (78 kB)
[task 2024-10-22T18:23:48.233Z] Collecting urllib3==2.2.2 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 231))
[task 2024-10-22T18:23:48.241Z]   Downloading urllib3-2.2.2-py3-none-any.whl (121 kB)
[task 2024-10-22T18:23:48.264Z] WARNING: The candidate selected for download or install is a yanked version: 'eflomal' candidate (version 1.0.0b1 at https://files.pythonhosted.org/packages/1d/cc/2cdf9c90a6bd8fd7323b47bf5a60fe738bfe8465844a2136b0543f5094e8/eflomal-1.0.0b1.tar.gz (from https://pypi.org/simple/eflomal/))
[task 2024-10-22T18:23:48.264Z] Reason for being yanked: <none given>
[task 2024-10-22T18:23:48.265Z] Building wheels for collected packages: eflomal
[task 2024-10-22T18:23:48.265Z]   Building wheel for eflomal (pyproject.toml): started
[task 2024-10-22T18:23:52.472Z]   Building wheel for eflomal (pyproject.toml): finished with status 'done'
[task 2024-10-22T18:23:52.474Z]   Created wheel for eflomal: filename=eflomal-1.0.0b1-cp310-cp310-linux_x86_64.whl size=319769 sha256=a9e7201a659960b26237c94177cb6b3c41306287c3aef43b64af6321e0cbacb9
[task 2024-10-22T18:23:52.474Z]   Stored in directory: /tmp/pip-ephem-wheel-cache-y0ofydhr/wheels/b4/0c/55/4a2c6f00793a0d2fdaef4376b8cb3d9c6ae8df16366d6e31d1
[task 2024-10-22T18:23:52.476Z] Successfully built eflomal
[task 2024-10-22T18:23:52.514Z] Installing collected packages: urllib3, tqdm, opus-fast-mosestokenizer, numpy, idna, cython, charset-normalizer, certifi, requests, eflomal
[task 2024-10-22T18:23:57.559Z] Successfully installed certifi-2024.7.4 charset-normalizer-3.3.2 cython-3.0.9 eflomal-1.0.0b1 idna-3.8 numpy-1.26.4 opus-fast-mosestokenizer-0.0.8.5 requests-2.31.0 tqdm-4.66.4 urllib3-2.2.2
[task 2024-10-22T18:23:57.865Z] [alignments] Running with arguments: ['/builds/worker/checkouts/vcs/pipeline/alignments/align.py', '--corpus_src=/builds/worker/fetches/mono.ru.zst', '--corpus_trg=/builds/worker/fetches/mono.en.zst', '--output_path=/builds/worker/artifacts/mono.aln.zst', '--tokenization=moses', '--priors_input_path=/builds/worker/fetches/corpus.priors']
[task 2024-10-22T18:23:57.867Z] [alignments] Starting generating alignments.
[task 2024-10-22T18:23:57.867Z] [alignments] Decompressing file /builds/worker/fetches/mono.ru.zst
[task 2024-10-22T18:23:57.868Z] 
[task 2024-10-22T18:23:57.869Z] /fetches/mono.ru.zst : 0 MB...     
[task 2024-10-22T18:23:57.869Z]                                                                                
[task 2024-10-22T18:23:57.869Z] /builds/worker/fetches/mono.ru.zst: 30132 bytes 
[task 2024-10-22T18:23:57.869Z] [alignments] Decompressing file /builds/worker/fetches/mono.en.zst
[task 2024-10-22T18:23:57.870Z] 
[task 2024-10-22T18:23:57.870Z] /fetches/mono.en.zst : 0 MB...     
[task 2024-10-22T18:23:57.870Z]                                                                                
[task 2024-10-22T18:23:57.870Z] /builds/worker/fetches/mono.en.zst: 82745 bytes 
[task 2024-10-22T18:23:57.871Z] [tokenizer] Tokenizing /builds/worker/fetches/mono.ru with Moses tokenizer
[task 2024-10-22T18:23:57.899Z] 
[task 2024-10-22T18:23:58.059Z] 0it [00:00, ?it/s]
[task 2024-10-22T18:23:58.059Z] 901it [00:00, 5607.28it/s]
[task 2024-10-22T18:23:58.059Z] [tokenizer] Tokenizing /builds/worker/fetches/mono.en with Moses tokenizer
[task 2024-10-22T18:23:58.085Z] 
[task 2024-10-22T18:23:58.252Z] 0it [00:00, ?it/s]
[task 2024-10-22T18:23:58.252Z] 901it [00:00, 5372.86it/s]
[task 2024-10-22T18:23:58.322Z] [alignments] Splitting corpus into parts
[task 2024-10-22T18:23:58.509Z] [alignments] Processing part aa
[task 2024-10-22T18:23:58.509Z] [alignments] Using provided priors: /builds/worker/fetches/corpus.priors
[task 2024-10-22T18:23:58.509Z] [alignments] Calculating alignments...
[task 2024-10-22T18:23:58.516Z] [eflomal] Prepared 901 sentences for alignment
[task 2024-10-22T18:23:58.517Z] [eflomal] Reading lexical priors...
[task 2024-10-22T18:23:58.530Z] [eflomal] 29 (of 4714) pairs of lexical priors used
[task 2024-10-22T18:23:58.531Z] /builds/worker/.local/lib/python3.10/site-packages/eflomal/bin/eflomal -m 3 -s /tmp/tmpd7_v1u97 -t /tmp/tmpbk_m_r_c -n 3 -N 0.2 -1 41 -2 41 -3 167 -f /builds/worker/artifacts/tmp_aln/aln.fwd.aa -r /builds/worker/artifacts/tmp_aln/aln.rev.aa -p /tmp/tmp9jexmes_
[task 2024-10-22T18:23:58.533Z] Read texts (901 sentences): 0.001 s
[task 2024-10-22T18:23:58.533Z] Vocabulary sizes are 101 (source), 4449 (target)
[task 2024-10-22T18:23:58.535Z] Created alignment structures: 0.001 s
[task 2024-10-22T18:23:58.537Z] Randomized alignment: 0.002 s
[task 2024-10-22T18:23:58.537Z] Aligning with model 1 (41 iterations)
[task 2024-10-22T18:23:58.539Z] Created alignment structures: 0.005 s
[task 2024-10-22T18:23:58.540Z] Randomized alignment: 0.001 s
[task 2024-10-22T18:23:58.540Z] Aligning with model 1 (41 iterations)
[task 2024-10-22T18:23:58.558Z] Done: 0.021 s
[task 2024-10-22T18:23:58.558Z] Aligning with model 2 (41 iterations)
[task 2024-10-22T18:23:58.566Z] Done: 0.025 s
[task 2024-10-22T18:23:58.566Z] Aligning with model 2 (41 iterations)
[task 2024-10-22T18:23:58.585Z] Done: 0.026 s
[task 2024-10-22T18:23:58.585Z] Aligning with model 3 (167 iterations)
[task 2024-10-22T18:23:58.608Z] Done: 0.043 s
[task 2024-10-22T18:23:58.608Z] Aligning with model 3 (167 iterations)
[task 2024-10-22T18:23:58.715Z] Done: 0.131 s
[task 2024-10-22T18:23:58.718Z] Final argmax iteration: 0.002 s
[task 2024-10-22T18:23:58.718Z] Writing alignments to /builds/worker/artifacts/tmp_aln/aln.fwd.aa for 901 sentencess
[task 2024-10-22T18:23:58.835Z] Done: 0.227 s
[task 2024-10-22T18:23:58.839Z] Final argmax iteration: 0.003 s
[task 2024-10-22T18:23:58.839Z] Writing alignments to /builds/worker/artifacts/tmp_aln/aln.rev.aa for 901 sentencess
[task 2024-10-22T18:23:58.841Z] [alignments] Merging alignments: ['/builds/worker/artifacts/tmp_aln/aln.fwd.aa']
[task 2024-10-22T18:23:58.842Z] [alignments] Merging alignments: ['/builds/worker/artifacts/tmp_aln/aln.rev.aa']
[task 2024-10-22T18:23:58.843Z] [alignments] Symmetrizing alignments...
[task 2024-10-22T18:23:58.847Z] [alignments] Remapping alignments to whitespace tokenization
[task 2024-10-22T18:23:58.883Z] 
[task 2024-10-22T18:23:58.896Z] 0it [00:00, ?it/s]
[task 2024-10-22T18:23:58.896Z] 901it [00:00, 71158.17it/s]
[task 2024-10-22T18:23:58.902Z] [alignments] Compressing final alignments
[task 2024-10-22T18:23:58.904Z] 
[task 2024-10-22T18:23:58.904Z]                                                                                
[task 2024-10-22T18:23:58.904Z] Read :  0 /  0 MB ==> 38%
[task 2024-10-22T18:23:58.904Z]                                                                                
[task 2024-10-22T18:23:58.904Z] /builds/worker/artifacts/tmp_aln/aln.remapped : 38.03%   (  5585 =>   2124 bytes, /builds/worker/artifacts/tmp_aln/aln.remapped.zst) 
[task 2024-10-22T18:23:58.905Z] [alignments] Finished generating alignments.
[fetches 2024-10-22T18:23:58.926Z] removing /builds/worker/fetches
[fetches 2024-10-22T18:23:58.927Z] finished
+ exit_code=0
+ podman cp taskcontainer:/builds/worker/artifacts artifact0
+ podman rm taskcontainer
e8849e55b48f90aff940a71dfda233045c8687cd14842980d1faaddb4a6839e9
+ exit 0
[taskcluster 2024-10-22T18:24:02.129Z]    Exit Code: 0
[taskcluster 2024-10-22T18:24:02.129Z]    User Time: 9.258731s
[taskcluster 2024-10-22T18:24:02.129Z]  Kernel Time: 3.849891s
[taskcluster 2024-10-22T18:24:02.129Z]    Wall Time: 40.124299448s
[taskcluster 2024-10-22T18:24:02.129Z]       Result: SUCCEEDED
[taskcluster 2024-10-22T18:24:02.129Z] === Task Finished ===
[taskcluster 2024-10-22T18:24:02.129Z] Task Duration: 40.124603448s
[taskcluster 2024-10-22T18:24:02.156Z] Uploading artifact public/build/mono.aln.zst from file /task_172962130378040/artifact0/mono.aln.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-01-20T18:00:07.443Z
[taskcluster 2024-10-22T18:24:02.290Z] [mounts] Preserving cache: Moving "/task_172962130378040/cache0" to "caches/cO52drlYRr641SwdmLRcVg"
[taskcluster 2024-10-22T18:24:02.303Z] [mounts] Denying task_172962130378040 access to 'caches/cO52drlYRr641SwdmLRcVg'
[taskcluster 2024-10-22T18:24:02.423Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-01-20T18:00:07.443Z