Override the existing_tasks explicitly provided in the action's input #683
firefoxci-taskcluster / Decision Task (pull-request)
succeeded
Jun 19, 2024 in 1m 33s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-06-19 00:12:53.661Z] Task ID: eFVgXuROR3qqGzf7_iz-Fg
[taskcluster 2024-06-19 00:12:53.661Z] Worker ID: 7015900381869743307
[taskcluster 2024-06-19 00:12:53.661Z] Worker Group: us-central1-a
[taskcluster 2024-06-19 00:12:53.661Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-06-19 00:12:53.661Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-06-19 00:12:53.661Z] Worker Version: 38.0.5
[taskcluster 2024-06-19 00:12:53.661Z] Public IP: 35.225.135.33
[taskcluster 2024-06-19 00:12:53.661Z] Hostname: translations-1-decision-gcp-ba3brv7asfwaepcnw8hpna
[taskcluster 2024-06-19 00:12:53.661Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
[taskcluster 2024-06-19 00:12:54.369Z] === Task Starting ===
[setup 2024-06-19T00:12:54.734Z] run-task started in /
[setup 2024-06-19T00:12:54.734Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='release' --base-rev='121c853713224965bb121079b5179378fe8723b3' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de'
[setup 2024-06-19T00:12:54.734Z] Python version: 3.11.2
[vcs 2024-06-19T00:12:54.736Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-06-19T00:12:54.737Z] running as worker:worker
[vcs 2024-06-19T00:12:54.737Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-06-19T00:12:54.742Z] executing ['git', 'fetch', 'origin', 'release']
[vcs 2024-06-19T00:12:54.969Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:54.969Z] * branch release -> FETCH_HEAD
[vcs 2024-06-19T00:12:54.978Z] executing ['git', 'checkout', 'release']
[vcs 2024-06-19T00:12:55.118Z] Switched to a new branch 'release'
[vcs 2024-06-19T00:12:55.118Z] branch 'release' set up to track 'origin/release'.
[vcs 2024-06-19T00:12:55.119Z] executing ['git', 'fetch', 'origin', '121c853713224965bb121079b5179378fe8723b3']
[vcs 2024-06-19T00:12:55.367Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.369Z] * branch 121c853713224965bb121079b5179378fe8723b3 -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.375Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:55.603Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.603Z] * branch escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.611Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:55.835Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.836Z] * branch escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.842Z] executing ['git', 'checkout', '-f', '-B', 'escape-hatch-to-put-existing-tasks-in-the-graph', '658adc2555649ee219e2ca5a5a3630d7230275de']
[vcs 2024-06-19T00:12:55.850Z] Switched to and reset branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:12:55.851Z] Your branch is up to date with 'origin/escape-hatch-to-put-existing-tasks-in-the-graph'.
[vcs 2024-06-19T00:12:55.851Z] executing ['git', 'submodule', 'init']
[vcs 2024-06-19T00:12:55.876Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-06-19T00:12:55.913Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-06-19T00:12:55.920Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-06-19T00:12:55.927Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-06-19T00:12:55.934Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-06-19T00:12:55.946Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-06-19T00:12:55.952Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-06-19T00:12:55.953Z] cleaning git checkout...
[vcs 2024-06-19T00:12:55.953Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-06-19T00:12:55.958Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-06-19T00:12:55.960Z] successfully cleaned git checkout!
[vcs 2024-06-19T00:12:55.962Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/658adc2555649ee219e2ca5a5a3630d7230275de' title='Built from firefox-translations-training commit 658adc2555649ee219e2ca5a5a3630d7230275de'>658adc2555649ee219e2ca5a5a3630d7230275de</a>
[task 2024-06-19T00:12:55.962Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='release' --base-rev='121c853713224965bb121079b5179378fe8723b3' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de' \n"]
[task 2024-06-19T00:12:55.964Z] + cd /builds/worker/checkouts/src
[task 2024-06-19T00:12:55.964Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-06-19T00:12:55.965Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=release --base-rev=121c853713224965bb121079b5179378fe8723b3 --head-repository=https://github.com/mozilla/firefox-translations-training --head-ref=escape-hatch-to-put-existing-tasks-in-the-graph --head-rev=658adc2555649ee219e2ca5a5a3630d7230275de
[task 2024-06-19T00:12:56.314Z] 2024-06-19 00:12:56,313 - INFO - Loading graph configuration.
[task 2024-06-19T00:12:56.331Z] 2024-06-19 00:12:56,331 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-06-19T00:12:56.332Z] 2024-06-19 00:12:56,331 - INFO - Using Parameters(id=48db70e0b736) (from defaults)
[task 2024-06-19T00:12:56.334Z] 2024-06-19 00:12:56,334 - INFO - writing artifact file `parameters.yml`
[task 2024-06-19T00:12:56.347Z] 2024-06-19 00:12:56,347 - INFO - writing artifact file `actions.json`
[task 2024-06-19T00:12:56.350Z] 2024-06-19 00:12:56,350 - INFO - Loading kinds
[task 2024-06-19T00:12:56.382Z] 2024-06-19 00:12:56,382 - INFO - Generating full task set
[task 2024-06-19T00:12:56.434Z] 2024-06-19 00:12:56,434 - INFO - Generated 8 tasks for kind dataset
[task 2024-06-19T00:12:56.437Z] 2024-06-19 00:12:56,437 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-06-19T00:12:56.454Z] 2024-06-19 00:12:56,454 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-06-19T00:12:56.456Z] 2024-06-19 00:12:56,455 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-06-19T00:12:56.457Z] 2024-06-19 00:12:56,456 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-06-19T00:12:56.475Z] 2024-06-19 00:12:56,475 - INFO - Generated 4 tasks for kind docker-image
[task 2024-06-19T00:12:56.489Z] 2024-06-19 00:12:56,488 - INFO - Generated 10 tasks for kind fetch
[task 2024-06-19T00:12:56.552Z] 2024-06-19 00:12:56,552 - INFO - Generated 11 tasks for kind toolchain
[task 2024-06-19T00:12:56.559Z] 2024-06-19 00:12:56,559 - INFO - Generated 3 tasks for kind analyze-corpus
[task 2024-06-19T00:12:56.565Z] 2024-06-19 00:12:56,565 - INFO - Generated 2 tasks for kind analyze-mono
[task 2024-06-19T00:12:56.574Z] 2024-06-19 00:12:56,574 - INFO - Generated 3 tasks for kind clean-corpus
[task 2024-06-19T00:12:56.577Z] 2024-06-19 00:12:56,577 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-06-19T00:12:56.583Z] 2024-06-19 00:12:56,582 - INFO - Generated 3 tasks for kind bicleaner
[task 2024-06-19T00:12:56.587Z] 2024-06-19 00:12:56,587 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-06-19T00:12:56.610Z] 2024-06-19 00:12:56,610 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-06-19T00:12:56.615Z] 2024-06-19 00:12:56,615 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-06-19T00:12:56.618Z] 2024-06-19 00:12:56,617 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-06-19T00:12:56.621Z] 2024-06-19 00:12:56,620 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-06-19T00:12:56.624Z] 2024-06-19 00:12:56,624 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-06-19T00:12:56.629Z] 2024-06-19 00:12:56,629 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-06-19T00:12:56.633Z] 2024-06-19 00:12:56,633 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-06-19T00:12:56.636Z] 2024-06-19 00:12:56,636 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-06-19T00:12:56.640Z] 2024-06-19 00:12:56,640 - INFO - Generated 5 tasks for kind tests
[task 2024-06-19T00:12:56.646Z] 2024-06-19 00:12:56,646 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-06-19T00:12:56.652Z] 2024-06-19 00:12:56,651 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-06-19T00:12:56.654Z] 2024-06-19 00:12:56,654 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-06-19T00:12:56.657Z] 2024-06-19 00:12:56,657 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-06-19T00:12:56.661Z] 2024-06-19 00:12:56,661 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-06-19T00:12:56.664Z] 2024-06-19 00:12:56,664 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-06-19T00:12:56.669Z] 2024-06-19 00:12:56,669 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-06-19T00:12:56.673Z] 2024-06-19 00:12:56,673 - INFO - Generated 2 tasks for kind extract-best
[task 2024-06-19T00:12:56.676Z] 2024-06-19 00:12:56,676 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-06-19T00:12:56.680Z] 2024-06-19 00:12:56,680 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-06-19T00:12:56.683Z] 2024-06-19 00:12:56,683 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-06-19T00:12:56.686Z] 2024-06-19 00:12:56,686 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-06-19T00:12:56.689Z] 2024-06-19 00:12:56,689 - INFO - Generated 1 tasks for kind score
[task 2024-06-19T00:12:56.692Z] 2024-06-19 00:12:56,691 - INFO - Generated 1 tasks for kind cefilter
[task 2024-06-19T00:12:56.694Z] 2024-06-19 00:12:56,694 - INFO - Generated 1 tasks for kind shortlist
[task 2024-06-19T00:12:56.697Z] 2024-06-19 00:12:56,697 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-06-19T00:12:56.700Z] 2024-06-19 00:12:56,700 - INFO - Generated 1 tasks for kind train-student
[task 2024-06-19T00:12:56.703Z] 2024-06-19 00:12:56,703 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-06-19T00:12:56.706Z] 2024-06-19 00:12:56,706 - INFO - Generated 1 tasks for kind quantize
[task 2024-06-19T00:12:56.709Z] 2024-06-19 00:12:56,709 - INFO - Generated 1 tasks for kind export
[task 2024-06-19T00:12:56.716Z] 2024-06-19 00:12:56,716 - INFO - Generated 4 tasks for kind evaluate
[task 2024-06-19T00:12:56.719Z] 2024-06-19 00:12:56,719 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-06-19T00:12:56.721Z] 2024-06-19 00:12:56,721 - INFO - Generated 1 tasks for kind all
[task 2024-06-19T00:12:56.725Z] 2024-06-19 00:12:56,725 - INFO - Generated 1 tasks for kind all-pr
[task 2024-06-19T00:12:56.726Z] 2024-06-19 00:12:56,725 - INFO - Generating full task graph
[task 2024-06-19T00:12:56.726Z] 2024-06-19 00:12:56,726 - INFO - Full task graph contains 92 tasks and 273 dependencies
[task 2024-06-19T00:12:56.730Z] 2024-06-19 00:12:56,730 - INFO - writing artifact file `full-task-graph.json`
[task 2024-06-19T00:12:56.752Z] 2024-06-19 00:12:56,752 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-06-19T00:12:56.754Z] 2024-06-19 00:12:56,754 - INFO - Generating target task set
[task 2024-06-19T00:12:56.754Z] 2024-06-19 00:12:56,754 - INFO - Filter filter_target_tasks pruned 75 tasks (17 remain)
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,754 - INFO - writing artifact file `target-tasks.json`
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,755 - INFO - Generating target task graph
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,755 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-06-19T00:12:56.756Z] 2024-06-19 00:12:56,756 - INFO - Generating optimized task graph
[task 2024-06-19T00:12:56.759Z] 2024-06-19 00:12:56,759 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-06-19T00:13:18.219Z] 2024-06-19 00:13:18,219 - INFO - Replaced 85 tasks by index-search (index-search) during optimization.
[task 2024-06-19T00:13:18.220Z] 2024-06-19 00:13:18,220 - INFO - writing artifact file `task-graph.json`
[task 2024-06-19T00:13:18.222Z] 2024-06-19 00:13:18,222 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-06-19T00:13:18.228Z] 2024-06-19 00:13:18,225 - INFO - Creating task with taskId Qpzfr4DFQqyvr5yMZ3YaNQ for tests-lint
[task 2024-06-19T00:13:18.228Z] 2024-06-19 00:13:18,227 - INFO - Creating task with taskId Cm2s6uQiTwCsui30P0s63A for tests-taskgraph-diff
[task 2024-06-19T00:13:18.233Z] 2024-06-19 00:13:18,230 - INFO - Creating task with taskId SeLlM5CwQ8mZzCVA_DDyvg for tests-taskgraph-definition
[task 2024-06-19T00:13:18.234Z] 2024-06-19 00:13:18,234 - INFO - Creating task with taskId ORUFruRkS_iIY1IFRJUNfA for all-pr-ru-en-1
[task 2024-06-19T00:13:18.237Z] 2024-06-19 00:13:18,236 - INFO - Creating task with taskId NLIriRv8QRWd92RmPTOTRA for tests-black
[taskcluster 2024-06-19 00:13:19.094Z] === Task Finished ===
[taskcluster 2024-06-19 00:13:21.222Z] Successful task run with exit code: 0 completed in 27.561 seconds
Loading