Fix taskcluster train scripts #895
Merged
firefoxci-taskcluster / tests-test
succeeded
Oct 22, 2024 in 9m 13s
FirefoxCI (pull_request)
Run tests
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2024-10-22T18:01:48.290Z
Resolved: 2024-10-22T18:09:21.011Z
Task Execution Time: 7 minutes, 32 seconds, 721 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2024-10-22 18:01:48.335Z] Task ID: IdpZvu39Q1WgsZ3k4ev3Ng
[taskcluster 2024-10-22 18:01:48.335Z] Worker ID: 2228929820324681411
[taskcluster 2024-10-22 18:01:48.335Z] Worker Group: us-central1-f
[taskcluster 2024-10-22 18:01:48.335Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-10-22 18:01:48.335Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-10-22 18:01:48.335Z] Worker Version: 38.0.5
[taskcluster 2024-10-22 18:01:48.335Z] Public IP: 34.172.24.27
[taskcluster 2024-10-22 18:01:48.335Z] Hostname: translations-1-b-linux-large-gcp-jwdp3ejmspkynh55nzx9ca
[taskcluster 2024-10-22 18:01:48.335Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-b_oDJTdfTB-X_9bt__lkxQ" -> /builds/worker/checkouts
[taskcluster 2024-10-22 18:01:52.248Z] Downloading artifact "public/image.tar.zst" from task ID: b_oDJTdfTB-X_9bt__lkxQ.
[taskcluster 2024-10-22 18:01:57.251Z] Download Progress: 62.53%
[taskcluster 2024-10-22 18:02:01.755Z] Downloaded artifact successfully.
[taskcluster 2024-10-22 18:02:01.755Z] Downloaded 262.271 mb
[taskcluster 2024-10-22 18:02:01.755Z] Decompressing downloaded image
[taskcluster 2024-10-22 18:02:03.624Z] Loading docker image from downloaded archive.
[taskcluster 2024-10-22 18:02:17.898Z] Image 'public/image.tar.zst' from task 'b_oDJTdfTB-X_9bt__lkxQ' loaded. Using image ID sha256:8fe757d1fbcb86e9c890c5e53eeb308f97bed520893dd67b9273de93f934f086.
[taskcluster 2024-10-22 18:02:18.062Z] === Task Starting ===
[setup 2024-10-22T18:02:19.802Z] run-task started in /builds/worker
[setup 2024-10-22T18:02:19.802Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c export BIN=$MOZ_FETCHES_DIR && export MARIAN=$MOZ_FETCHES_DIR && task test
...(175 lines hidden)...
[task 2024-10-22T18:02:48.946Z] - Installing requests-mock (1.12.1)
[task 2024-10-22T18:02:48.949Z] - Installing sacrebleu (2.0.0)
[task 2024-10-22T18:02:48.951Z] - Installing sh (2.0.7)
[task 2024-10-22T18:02:48.952Z] - Installing taskcluster-taskgraph (10.0.2)
[task 2024-10-22T18:02:48.954Z] - Installing websocket-client (1.8.0)
[task 2024-10-22T18:02:48.957Z] - Installing zstandard (0.22.0)
[task 2024-10-22T18:02:49.641Z] Installing /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/tests/__init__.py over existing file
[task 2024-10-22T18:02:51.241Z] - Installing translations-parser (0.1.0 /builds/worker/checkouts/vcs/tracking)
[task 2024-10-22T18:02:52.322Z] - Installing translations-taskgraph (0.1.0 /builds/worker/checkouts/vcs/taskcluster)
[task 2024-10-22T18:02:53.551Z] task: [test] PYTHONPATH="$(pwd):$(pwd)/taskcluster/scripts/pipeline" poetry run pytest -vv
[task 2024-10-22T18:02:54.573Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.19) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
[task 2024-10-22T18:02:54.573Z] warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[task 2024-10-22T18:02:54.656Z] ============================= test session starts ==============================
[task 2024-10-22T18:02:54.656Z] platform linux -- Python 3.10.12, pytest-7.4.3, pluggy-1.5.0 -- /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/bin/python
[task 2024-10-22T18:02:54.656Z] cachedir: .pytest_cache
[task 2024-10-22T18:02:54.656Z] rootdir: /builds/worker/checkouts/vcs
[task 2024-10-22T18:02:54.656Z] configfile: pyproject.toml
[task 2024-10-22T18:02:54.656Z] testpaths: tests
[task 2024-10-22T18:02:54.656Z] plugins: requests-mock-1.12.1
[task 2024-10-22T18:02:57.430Z] collecting ... collected 157 items
[task 2024-10-22T18:02:57.430Z]
[task 2024-10-22T18:03:24.484Z] tests/test_alignments.py::test_teacher_original_alignments PASSED [ 0%]
[task 2024-10-22T18:03:27.360Z] tests/test_alignments.py::test_teacher_backtranslated_alignments PASSED [ 1%]
[task 2024-10-22T18:03:30.133Z] tests/test_alignments.py::test_student_alignments PASSED [ 1%]
[task 2024-10-22T18:03:33.209Z] tests/test_alignments.py::test_shortlist PASSED [ 2%]
[task 2024-10-22T18:03:33.211Z] tests/test_aln_mapping.py::test_remap_indices[Hi-expected_idx_map0] PASSED [ 3%]
[task 2024-10-22T18:03:33.213Z] tests/test_aln_mapping.py::test_remap_indices[Hello, world!-expected_idx_map1] PASSED [ 3%]
[task 2024-10-22T18:03:33.215Z] tests/test_aln_mapping.py::test_remap_indices[Hello, world!-expected_idx_map2] PASSED [ 4%]
[task 2024-10-22T18:03:33.216Z] tests/test_aln_mapping.py::test_remap_indices[Hello, half-world and welcome!-expected_idx_map3] PASSED [ 5%]
[task 2024-10-22T18:03:33.217Z] tests/test_aln_mapping.py::test_remap_indices[Hello - world!-expected_idx_map4] PASSED [ 5%]
[task 2024-10-22T18:03:33.218Z] tests/test_aln_mapping.py::test_remap_indices[Hello,- world!-expected_idx_map5] PASSED [ 6%]
[task 2024-10-22T18:03:33.220Z] tests/test_aln_mapping.py::test_remap_indices[\u201cI will not,\u201d retorted the Witch, \u201cfor it is now my shoe, and not yours.\u201d-expected_idx_map6] PASSED [ 7%]
[task 2024-10-22T18:03:48.932Z] tests/test_analyze.py::test_analyze_mono PASSED [ 7%]
[task 2024-10-22T18:03:51.582Z] tests/test_analyze.py::test_analyze_corpus PASSED [ 8%]
[task 2024-10-22T18:03:51.597Z] tests/test_bicleaner.py::test_model_download[en-pt-en-pt] PASSED [ 8%]
[task 2024-10-22T18:03:51.611Z] tests/test_bicleaner.py::test_model_download[pt-en-en-pt] PASSED [ 9%]
[task 2024-10-22T18:03:51.624Z] tests/test_bicleaner.py::test_model_download[ru-en-en-xx] PASSED [ 10%]
[task 2024-10-22T18:03:51.636Z] tests/test_bicleaner.py::test_model_download[en-ru-en-xx] PASSED [ 10%]
[task 2024-10-22T18:03:51.639Z] tests/test_command_runner.py::test_run_pipeline[test_case0-True] PASSED [ 11%]
[task 2024-10-22T18:03:51.642Z] tests/test_command_runner.py::test_run_pipeline[test_case0-False] PASSED [ 12%]
[task 2024-10-22T18:03:51.646Z] tests/test_command_runner.py::test_run_pipeline[test_case1-True] PASSED [ 12%]
[task 2024-10-22T18:03:51.650Z] tests/test_command_runner.py::test_run_pipeline[test_case1-False] PASSED [ 13%]
[task 2024-10-22T18:03:51.653Z] tests/test_command_runner.py::test_run_pipeline[test_case2-True] PASSED [ 14%]
[task 2024-10-22T18:03:51.657Z] tests/test_command_runner.py::test_run_pipeline[test_case2-False] PASSED [ 14%]
[task 2024-10-22T18:03:51.773Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[even-distribution] PASSED [ 15%]
[task 2024-10-22T18:03:51.883Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[small-content-at-start] PASSED [ 15%]
[task 2024-10-22T18:03:51.993Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[large-content-at-start] PASSED [ 16%]
[task 2024-10-22T18:03:52.248Z] tests/test_common_datasets.py::test_shuffle_in_temp_files PASSED [ 17%]
[task 2024-10-22T18:03:52.249Z] tests/test_common_datasets.py::test_weak_string_set PASSED [ 17%]
[task 2024-10-22T18:03:52.757Z] tests/test_common_downloads.py::test_read_lines_remote[-lines.txt.gz] PASSED [ 18%]
[task 2024-10-22T18:03:53.265Z] tests/test_common_downloads.py::test_read_lines_remote[-lines.txt.zst] PASSED [ 19%]
[task 2024-10-22T18:03:53.773Z] tests/test_common_downloads.py::test_read_lines_remote[-lines.txt] PASSED [ 19%]
[task 2024-10-22T18:03:54.281Z] tests/test_common_downloads.py::test_read_lines_remote[?no-mime-type-lines.txt.gz] PASSED [ 20%]
[task 2024-10-22T18:03:54.789Z] tests/test_common_downloads.py::test_read_lines_remote[?no-mime-type-lines.txt.zst] PASSED [ 21%]
[task 2024-10-22T18:03:55.297Z] tests/test_common_downloads.py::test_read_lines_remote[?no-mime-type-lines.txt] PASSED [ 21%]
[task 2024-10-22T18:03:55.299Z] tests/test_common_downloads.py::test_read_lines_local[lines.txt.gz] PASSED [ 22%]
[task 2024-10-22T18:03:55.300Z] tests/test_common_downloads.py::test_read_lines_local[lines.txt.zst] PASSED [ 22%]
[task 2024-10-22T18:03:55.302Z] tests/test_common_downloads.py::test_read_lines_local[lines.txt] PASSED [ 23%]
[task 2024-10-22T18:03:55.304Z] tests/test_common_downloads.py::test_read_lines_local_multiple PASSED [ 24%]
[task 2024-10-22T18:03:55.306Z] tests/test_common_downloads.py::test_compress_file[gz-False] PASSED [ 24%]
[task 2024-10-22T18:03:55.307Z] tests/test_common_downloads.py::test_compress_file[zst-True] PASSED [ 25%]
[task 2024-10-22T18:03:55.309Z] tests/test_common_downloads.py::test_decompress_file[gz-False] PASSED [ 26%]
[task 2024-10-22T18:03:55.311Z] tests/test_common_downloads.py::test_decompress_file[zst-True] PASSED [ 26%]
[task 2024-10-22T18:06:06.869Z] tests/test_data_importer.py::test_basic_corpus_import[mtdata-Neulab-tedtalks_test-1-eng-rus] PASSED [ 27%]
[task 2024-10-22T18:06:07.512Z] tests/test_data_importer.py::test_basic_corpus_import[opus-ELRC-3075-wikipedia_health_v1] PASSED [ 28%]
[task 2024-10-22T18:06:08.307Z] tests/test_data_importer.py::test_basic_corpus_import[flores-dev] PASSED [ 28%]
[task 2024-10-22T18:06:10.662Z] tests/test_data_importer.py::test_basic_corpus_import[sacrebleu-wmt19] PASSED [ 29%]
[task 2024-10-22T18:06:12.180Z] tests/test_data_importer.py::test_basic_corpus_import[url-gcp_pytest-dataset_a0017e] PASSED [ 29%]
[task 2024-10-22T18:06:12.330Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-en] PASSED [ 30%]
[task 2024-10-22T18:06:12.475Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-ru] PASSED [ 31%]
[task 2024-10-22T18:06:12.622Z] tests/test_data_importer.py::test_mono_source_import[url-en] PASSED [ 31%]
[task 2024-10-22T18:06:12.772Z] tests/test_data_importer.py::test_mono_source_import[url-ru] PASSED [ 32%]
[task 2024-10-22T18:06:12.925Z] tests/test_data_importer.py::test_mono_hplt[ru] PASSED [ 33%]
[task 2024-10-22T18:06:13.076Z] tests/test_data_importer.py::test_mono_hplt[en] PASSED [ 33%]
[task 2024-10-22T18:06:13.654Z] tests/test_data_importer.py::test_specific_augmentation[upper] PASSED [ 34%]
[task 2024-10-22T18:06:14.196Z] tests/test_data_importer.py::test_specific_augmentation[title] PASSED [ 35%]
[task 2024-10-22T18:06:14.940Z] tests/test_data_importer.py::test_specific_augmentation[typos] PASSED [ 35%]
[task 2024-10-22T18:06:15.482Z] tests/test_data_importer.py::test_specific_augmentation[noise] PASSED [ 36%]
[task 2024-10-22T18:06:16.981Z] tests/test_data_importer.py::test_specific_augmentation[inline-noise] PASSED [ 36%]
[task 2024-10-22T18:06:18.506Z] tests/test_data_importer.py::test_augmentation_mix PASSED [ 37%]
[task 2024-10-22T18:07:51.562Z] tests/test_eval.py::test_evaluate[evaluate-backward-sacrebleu-wmt09-en-ru] PASSED [ 38%]
[task 2024-10-22T18:07:51.759Z] tests/test_eval.py::test_evaluate[evaluate-finetuned-student-sacrebleu-wmt09-en-ru] PASSED [ 38%]
[task 2024-10-22T18:07:51.958Z] tests/test_eval.py::test_evaluate[evaluate-teacher-ensemble-sacrebleu-wmt09-en-ru] PASSED [ 39%]
[task 2024-10-22T18:07:52.157Z] tests/test_eval.py::test_evaluate[evaluate-quantized-sacrebleu-wmt09-en-ru] PASSED [ 40%]
[task 2024-10-22T18:08:23.838Z] tests/test_eval.py::test_evaluate_comet[evaluate-student-sacrebleu-wmt09-en-ru] PASSED [ 40%]
[task 2024-10-22T18:08:23.840Z] tests/test_filters.py::test_generate_filters[default-en-ru] PASSED [ 41%]
[task 2024-10-22T18:08:23.842Z] tests/test_filters.py::test_generate_filters[default-fr-en] PASSED [ 42%]
[task 2024-10-22T18:08:23.844Z] tests/test_filters.py::test_generate_filters[default-fr-en-elrc] PASSED [ 42%]
[task 2024-10-22T18:08:23.846Z] tests/test_filters.py::test_generate_filters[lang-ru-en] PASSED [ 43%]
[task 2024-10-22T18:08:23.848Z] tests/test_filters.py::test_generate_filters[lang-backward] PASSED [ 43%]
[task 2024-10-22T18:08:23.849Z] tests/test_filters.py::test_generate_filters[dataset-ru-en] PASSED [ 44%]
[task 2024-10-22T18:08:23.851Z] tests/test_filters.py::test_generate_filters[dataset-fr-en] PASSED [ 45%]
[task 2024-10-22T18:08:23.853Z] tests/test_filters.py::test_generate_filters[override-with-default-ru-en-elrc] PASSED [ 45%]
[task 2024-10-22T18:08:23.855Z] tests/test_filters.py::test_generate_filters[override-with-default-fr-en-unpc] PASSED [ 46%]
[task 2024-10-22T18:08:23.859Z] tests/test_find_corpus.py::test_opus PASSED [ 47%]
[task 2024-10-22T18:08:23.862Z] tests/test_find_corpus.py::test_opus_download_url PASSED [ 47%]
[task 2024-10-22T18:08:31.135Z] tests/test_find_corpus.py::test_mtdata PASSED [ 48%]
[task 2024-10-22T18:08:31.148Z] tests/test_find_corpus.py::test_sacrebleu PASSED [ 49%]
[task 2024-10-22T18:08:39.818Z] tests/test_merge_corpus.py::test_merge_corpus[corpus] PASSED [ 49%]
[task 2024-10-22T18:08:39.959Z] tests/test_merge_corpus.py::test_merge_corpus[devset] PASSED [ 50%]
[task 2024-10-22T18:08:40.098Z] tests/test_merge_corpus.py::test_merge_devset_trimmed[corpus] PASSED [ 50%]
[task 2024-10-22T18:08:40.238Z] tests/test_merge_corpus.py::test_merge_devset_trimmed[devset] PASSED [ 51%]
[task 2024-10-22T18:08:40.400Z] tests/test_merge_mono.py::test_merge_mono[src-en] PASSED [ 52%]
[task 2024-10-22T18:08:40.564Z] tests/test_merge_mono.py::test_merge_mono[trg-ru] PASSED [ 52%]
[task 2024-10-22T18:08:41.072Z] tests/test_preflight_check.py::test_artifacts PASSED [ 53%]
[task 2024-10-22T18:08:41.586Z] tests/test_preflight_check.py::test_task_group PASSED [ 54%]
[task 2024-10-22T18:08:42.128Z] tests/test_preflight_check.py::test_task_graph PASSED [ 54%]
[task 2024-10-22T18:08:42.638Z] tests/test_preflight_check.py::test_task_graph_open PASSED [ 55%]
[task 2024-10-22T18:08:42.961Z] tests/test_split_collect.py::test_split_collect_mono PASSED [ 56%]
[task 2024-10-22T18:08:43.431Z] tests/test_split_collect.py::test_split_collect_corpus PASSED [ 56%]
[task 2024-10-22T18:08:51.129Z] tests/test_split_corpus.py::test_split_mono[src-en] PASSED [ 57%]
[task 2024-10-22T18:08:51.260Z] tests/test_split_corpus.py::test_split_mono[trg-ru] PASSED [ 57%]
[task 2024-10-22T18:08:51.520Z] tests/test_split_corpus.py::test_split_corpus PASSED [ 58%]
[task 2024-10-22T18:08:51.559Z] tests/test_spm_vocab.py::test_no_vocab_size PASSED [ 59%]
[task 2024-10-22T18:08:51.596Z] tests/test_spm_vocab.py::test_none_vocab_size PASSED [ 59%]
[task 2024-10-22T18:08:51.633Z] tests/test_spm_vocab.py::test_vocab_fully_specified PASSED [ 60%]
[task 2024-10-22T18:08:51.637Z] tests/test_spm_vocab.py::test_non_multiples_eight PASSED [ 61%]
[task 2024-10-22T18:08:51.711Z] tests/test_tracking_cli.py::test_taskcluster PASSED [ 61%]
[task 2024-10-22T18:08:52.299Z] tests/test_tracking_cli.py::test_experiments_marian_1_10 PASSED [ 62%]
[task 2024-10-22T18:08:52.583Z] tests/test_tracking_cli.py::test_experiments_marian_1_12 PASSED [ 63%]
[task 2024-10-22T18:08:52.628Z] tests/test_tracking_cli.py::test_taskcluster_wandb_initialization_failure PASSED [ 63%]
[task 2024-10-22T18:08:52.689Z] tests/test_tracking_cli.py::test_taskcluster_wandb_log_failures PASSED [ 64%]
[task 2024-10-22T18:08:52.734Z] tests/test_tracking_cli.py::test_taskcluster_wandb_disabled PASSED [ 64%]
[task 2024-10-22T18:08:52.735Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_aug-title_devtest-lt-en-1_2-parsed_values0] PASSED [ 65%]
[task 2024-10-22T18:08:52.737Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-quantized-mtdata_aug-mix_Neulab-tedtalks_eng-lit-lt-en-parsed_values1] PASSED [ 66%]
[task 2024-10-22T18:08:52.738Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-finetune-teacher-sacrebleu-wmt19-lt-en-2_2-parsed_values2] PASSED [ 66%]
[task 2024-10-22T18:08:52.739Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-lt-en-parsed_values3] PASSED [ 67%]
[task 2024-10-22T18:08:52.740Z] tests/test_tracking_utils.py::test_parse_task_label[train-student-en-hu-parsed_values4] PASSED [ 68%]
[task 2024-10-22T18:08:52.741Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-ensemble_mtdata_Neulab-tedtalks_test-1-eng-nld-parsed_values5] PASSED [ 68%]
[task 2024-10-22T18:08:52.743Z] tests/test_tracking_utils.py::test_parse_task_label[eval_student-finetuned_flores_devtest-parsed_values6] PASSED [ 69%]
[task 2024-10-22T18:08:52.744Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-base0_flores_devtest-parsed_values7] PASSED [ 70%]
[task 2024-10-22T18:08:52.745Z] tests/test_tracking_utils.py::test_parse_task_label[train-backwards-en-ca-parsed_values8] PASSED [ 70%]
[task 2024-10-22T18:08:52.746Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-1/2-parsed_values9] PASSED [ 71%]
[task 2024-10-22T18:08:52.747Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ensemble-parsed_values10] PASSED [ 71%]
[task 2024-10-22T18:08:52.748Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-parsed_values11] PASSED [ 72%]
[task 2024-10-22T18:08:52.750Z] tests/test_tracking_utils.py::test_parse_task_label[train-finetune-student-ru-en-parsed_values12] PASSED [ 73%]
[task 2024-10-22T18:08:52.751Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ru-en-1-parsed_values13] PASSED [ 73%]
[task 2024-10-22T18:08:52.752Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-backward-url-gcp_pytest-dataset_a0017e-en-ru-parsed_values14] PASSED [ 74%]
[task 2024-10-22T18:08:52.753Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ast-en-1-parsed_values15] PASSED [ 75%]
[task 2024-10-22T18:08:52.754Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-ast-en-parsed_values16] PASSED [ 75%]
[task 2024-10-22T18:08:52.756Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-devtest-ru-en-1-parsed_values17] PASSED [ 76%]
[task 2024-10-22T18:08:52.757Z] tests/test_tracking_utils.py::test_parse_labels_on_full_taskgraph PASSED [ 77%]
[task 2024-10-22T18:08:52.758Z] tests/test_tracking_utils.py::test_build_task_name[task_tags0-values0] PASSED [ 77%]
[task 2024-10-22T18:08:52.760Z] tests/test_tracking_utils.py::test_build_task_name[task_tags1-values1] PASSED [ 78%]
[task 2024-10-22T18:08:52.761Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-mix_devtest-parsed_values0] PASSED [ 78%]
[task 2024-10-22T18:08:52.762Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-title_devtest-parsed_values1] PASSED [ 79%]
[task 2024-10-22T18:08:52.763Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-title-strict_devtest-parsed_values2] PASSED [ 80%]
[task 2024-10-22T18:08:52.764Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-typos_devtest-parsed_values3] PASSED [ 80%]
[task 2024-10-22T18:08:52.765Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-upper_devtest-parsed_values4] PASSED [ 81%]
[task 2024-10-22T18:08:52.766Z] tests/test_tracking_utils.py::test_gcp_metric[flores_aug-upper-strict_devtest-parsed_values5] PASSED [ 82%]
[task 2024-10-22T18:08:52.768Z] tests/test_tracking_utils.py::test_gcp_metric[flores_devtest-parsed_values6] PASSED [ 82%]
[task 2024-10-22T18:08:52.769Z] tests/test_tracking_utils.py::test_gcp_metric[mtdata_aug-mix_Neulab-tedtalks_test-1-eng-lit-parsed_values7] PASSED [ 83%]
[task 2024-10-22T18:08:52.770Z] tests/test_tracking_utils.py::test_gcp_metric[mtdata_Neulab-tedtalks_test-1-eng-lit-parsed_values8] PASSED [ 84%]
[task 2024-10-22T18:08:52.771Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_aug-mix_wmt19-parsed_values9] PASSED [ 84%]
[task 2024-10-22T18:08:52.772Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_aug-title-strict_wmt19-parsed_values10] PASSED [ 85%]
[task 2024-10-22T18:08:52.773Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_aug-title_wmt19-parsed_values11] PASSED [ 85%]
[task 2024-10-22T18:08:52.774Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_aug-typos_wmt19-parsed_values12] PASSED [ 86%]
[task 2024-10-22T18:08:52.776Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_aug-upper-strict_wmt19-parsed_values13] PASSED [ 87%]
[task 2024-10-22T18:08:52.777Z] tests/test_tracking_utils.py::test_gcp_metric[sacrebleu_wmt19-parsed_values14] PASSED [ 87%]
[task 2024-10-22T18:08:52.778Z] tests/test_tracking_utils.py::test_wrong_gcp_metric[devtest] PASSED [ 88%]
[task 2024-10-22T18:08:52.779Z] tests/test_tracking_utils.py::test_wrong_gcp_metric[tc_Tatoeba-Challenge-v2021-08-07] PASSED [ 89%]
[task 2024-10-22T18:08:52.780Z] tests/test_tracking_utils.py::test_wrong_gcp_metric[test] PASSED [ 89%]
[task 2024-10-22T18:08:52.783Z] tests/test_train_taskcluster.py::test_all_args_forwarded[required_only] PASSED [ 90%]
[task 2024-10-22T18:08:52.785Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_pretrained_model] PASSED [ 91%]
[task 2024-10-22T18:08:52.788Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_extra_params] PASSED [ 91%]
[task 2024-10-22T18:08:52.791Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation] PASSED [ 92%]
[task 2024-10-22T18:08:52.794Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation_with_pretrained_model] PASSED [ 92%]
[task 2024-10-22T18:08:52.799Z] tests/test_train_taskcluster.py::test_autocontinue[run_1_continues_run_0] PASSED [ 93%]
[task 2024-10-22T18:08:52.804Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_1] PASSED [ 94%]
[task 2024-10-22T18:08:52.808Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_0] PASSED [ 94%]
[task 2024-10-22T18:08:52.813Z] tests/test_train_taskcluster.py::test_autocontinue[run_3_continues_run_1] PASSED [ 95%]
[task 2024-10-22T18:08:52.816Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs] PASSED [ 96%]
[task 2024-10-22T18:08:52.820Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs_preserves_pretrained_model_mode] PASSED [ 96%]
[task 2024-10-22T18:08:52.823Z] tests/test_train_taskcluster.py::test_autocontinue[artifacts_are_404] PASSED [ 97%]
[task 2024-10-22T18:09:04.607Z] tests/test_training.py::test_train_student_mocked PASSED [ 98%]
[task 2024-10-22T18:09:13.094Z] tests/test_training.py::test_train_student PASSED [ 98%]
[task 2024-10-22T18:09:14.644Z] tests/test_training.py::test_train_backwards_mocked PASSED [ 99%]
[task 2024-10-22T18:09:18.533Z] tests/test_training.py::test_train_teacher_mocked PASSED [100%]
[task 2024-10-22T18:09:18.533Z]
[task 2024-10-22T18:09:18.533Z] =============================== warnings summary ===============================
[task 2024-10-22T18:09:18.533Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11
[task 2024-10-22T18:09:18.533Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
[task 2024-10-22T18:09:18.533Z] import pkg_resources
[task 2024-10-22T18:09:18.534Z]
[task 2024-10-22T18:09:18.534Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:3154
[task 2024-10-22T18:09:18.534Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:3154: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
[task 2024-10-22T18:09:18.534Z] Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
[task 2024-10-22T18:09:18.534Z] declare_namespace(pkg)
[task 2024-10-22T18:09:18.534Z]
[task 2024-10-22T18:09:18.534Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/analytics/sentry.py:90
[task 2024-10-22T18:09:18.534Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/analytics/sentry.py:90: SentryHubDeprecationWarning: `sentry_sdk.Hub` is deprecated and will be removed in a future major release. Please consult our 1.x to 2.x migration guide for details on how to migrate `Hub` usage to the new API: https://docs.sentry.io/platforms/python/migration/1.x-to-2.x
[task 2024-10-22T18:09:18.534Z] self.hub = sentry_sdk.Hub(client)
[task 2024-10-22T18:09:18.534Z]
[task 2024-10-22T18:09:18.534Z] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2024-10-22T18:09:18.534Z] ================= 157 passed, 3 warnings in 383.88s (0:06:23) ==================
[fetches 2024-10-22T18:09:19.963Z] removing /builds/worker/fetches
[fetches 2024-10-22T18:09:20.142Z] finished
[taskcluster 2024-10-22 18:09:20.483Z] === Task Finished ===
[taskcluster 2024-10-22 18:09:20.483Z] Successful task run with exit code: 0 completed in 452.15 seconds
Loading