Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Override the existing_tasks explicitly provided in the action's input #683

Merged
merged 3 commits into from
Jun 19, 2024

Merge branch 'release' into escape-hatch-to-put-existing-tasks-in-the…

658adc2
Select commit
Loading
Failed to load commit list.
Merged

Override the existing_tasks explicitly provided in the action's input #683

Merge branch 'release' into escape-hatch-to-put-existing-tasks-in-the…
658adc2
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Jun 19, 2024 in 1m 33s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-06-19 00:12:53.661Z] Task ID: eFVgXuROR3qqGzf7_iz-Fg
[taskcluster 2024-06-19 00:12:53.661Z] Worker ID: 7015900381869743307
[taskcluster 2024-06-19 00:12:53.661Z] Worker Group: us-central1-a
[taskcluster 2024-06-19 00:12:53.661Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-06-19 00:12:53.661Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-06-19 00:12:53.661Z] Worker Version: 38.0.5
[taskcluster 2024-06-19 00:12:53.661Z] Public IP: 35.225.135.33
[taskcluster 2024-06-19 00:12:53.661Z] Hostname: translations-1-decision-gcp-ba3brv7asfwaepcnw8hpna
[taskcluster 2024-06-19 00:12:53.661Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-06-19 00:12:54.369Z] === Task Starting ===
[setup 2024-06-19T00:12:54.734Z] run-task started in /
[setup 2024-06-19T00:12:54.734Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='release' --base-rev='121c853713224965bb121079b5179378fe8723b3' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de' 

[setup 2024-06-19T00:12:54.734Z] Python version: 3.11.2
[vcs 2024-06-19T00:12:54.736Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-06-19T00:12:54.737Z] running as worker:worker
[vcs 2024-06-19T00:12:54.737Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-06-19T00:12:54.742Z] executing ['git', 'fetch', 'origin', 'release']
[vcs 2024-06-19T00:12:54.969Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:54.969Z]  * branch            release    -> FETCH_HEAD
[vcs 2024-06-19T00:12:54.978Z] executing ['git', 'checkout', 'release']
[vcs 2024-06-19T00:12:55.118Z] Switched to a new branch 'release'
[vcs 2024-06-19T00:12:55.118Z] branch 'release' set up to track 'origin/release'.
[vcs 2024-06-19T00:12:55.119Z] executing ['git', 'fetch', 'origin', '121c853713224965bb121079b5179378fe8723b3']
[vcs 2024-06-19T00:12:55.367Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.369Z]  * branch            121c853713224965bb121079b5179378fe8723b3 -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.375Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:55.603Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.603Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.611Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:12:55.835Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:12:55.836Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:12:55.842Z] executing ['git', 'checkout', '-f', '-B', 'escape-hatch-to-put-existing-tasks-in-the-graph', '658adc2555649ee219e2ca5a5a3630d7230275de']
[vcs 2024-06-19T00:12:55.850Z] Switched to and reset branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:12:55.851Z] Your branch is up to date with 'origin/escape-hatch-to-put-existing-tasks-in-the-graph'.
[vcs 2024-06-19T00:12:55.851Z] executing ['git', 'submodule', 'init']
[vcs 2024-06-19T00:12:55.876Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-06-19T00:12:55.913Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-06-19T00:12:55.920Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-06-19T00:12:55.927Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-06-19T00:12:55.934Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-06-19T00:12:55.946Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-06-19T00:12:55.952Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-06-19T00:12:55.953Z] cleaning git checkout...
[vcs 2024-06-19T00:12:55.953Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-06-19T00:12:55.958Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-06-19T00:12:55.960Z] successfully cleaned git checkout!
[vcs 2024-06-19T00:12:55.962Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/658adc2555649ee219e2ca5a5a3630d7230275de' title='Built from firefox-translations-training commit 658adc2555649ee219e2ca5a5a3630d7230275de'>658adc2555649ee219e2ca5a5a3630d7230275de</a>
[task 2024-06-19T00:12:55.962Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='release' --base-rev='121c853713224965bb121079b5179378fe8723b3' --head-repository='https://github.com/mozilla/firefox-translations-training' --head-ref='escape-hatch-to-put-existing-tasks-in-the-graph' --head-rev='658adc2555649ee219e2ca5a5a3630d7230275de' \n"]
[task 2024-06-19T00:12:55.964Z] + cd /builds/worker/checkouts/src
[task 2024-06-19T00:12:55.964Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-06-19T00:12:55.965Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=release --base-rev=121c853713224965bb121079b5179378fe8723b3 --head-repository=https://github.com/mozilla/firefox-translations-training --head-ref=escape-hatch-to-put-existing-tasks-in-the-graph --head-rev=658adc2555649ee219e2ca5a5a3630d7230275de
[task 2024-06-19T00:12:56.314Z] 2024-06-19 00:12:56,313 - INFO - Loading graph configuration.
[task 2024-06-19T00:12:56.331Z] 2024-06-19 00:12:56,331 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-06-19T00:12:56.332Z] 2024-06-19 00:12:56,331 - INFO - Using Parameters(id=48db70e0b736) (from defaults)
[task 2024-06-19T00:12:56.334Z] 2024-06-19 00:12:56,334 - INFO - writing artifact file `parameters.yml`
[task 2024-06-19T00:12:56.347Z] 2024-06-19 00:12:56,347 - INFO - writing artifact file `actions.json`
[task 2024-06-19T00:12:56.350Z] 2024-06-19 00:12:56,350 - INFO - Loading kinds
[task 2024-06-19T00:12:56.382Z] 2024-06-19 00:12:56,382 - INFO - Generating full task set
[task 2024-06-19T00:12:56.434Z] 2024-06-19 00:12:56,434 - INFO - Generated 8 tasks for kind dataset
[task 2024-06-19T00:12:56.437Z] 2024-06-19 00:12:56,437 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-06-19T00:12:56.454Z] 2024-06-19 00:12:56,454 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-06-19T00:12:56.456Z] 2024-06-19 00:12:56,455 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-06-19T00:12:56.457Z] 2024-06-19 00:12:56,456 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-06-19T00:12:56.475Z] 2024-06-19 00:12:56,475 - INFO - Generated 4 tasks for kind docker-image
[task 2024-06-19T00:12:56.489Z] 2024-06-19 00:12:56,488 - INFO - Generated 10 tasks for kind fetch
[task 2024-06-19T00:12:56.552Z] 2024-06-19 00:12:56,552 - INFO - Generated 11 tasks for kind toolchain
[task 2024-06-19T00:12:56.559Z] 2024-06-19 00:12:56,559 - INFO - Generated 3 tasks for kind analyze-corpus
[task 2024-06-19T00:12:56.565Z] 2024-06-19 00:12:56,565 - INFO - Generated 2 tasks for kind analyze-mono
[task 2024-06-19T00:12:56.574Z] 2024-06-19 00:12:56,574 - INFO - Generated 3 tasks for kind clean-corpus
[task 2024-06-19T00:12:56.577Z] 2024-06-19 00:12:56,577 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-06-19T00:12:56.583Z] 2024-06-19 00:12:56,582 - INFO - Generated 3 tasks for kind bicleaner
[task 2024-06-19T00:12:56.587Z] 2024-06-19 00:12:56,587 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-06-19T00:12:56.610Z] 2024-06-19 00:12:56,610 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-06-19T00:12:56.615Z] 2024-06-19 00:12:56,615 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-06-19T00:12:56.618Z] 2024-06-19 00:12:56,617 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-06-19T00:12:56.621Z] 2024-06-19 00:12:56,620 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-06-19T00:12:56.624Z] 2024-06-19 00:12:56,624 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-06-19T00:12:56.629Z] 2024-06-19 00:12:56,629 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-06-19T00:12:56.633Z] 2024-06-19 00:12:56,633 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-06-19T00:12:56.636Z] 2024-06-19 00:12:56,636 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-06-19T00:12:56.640Z] 2024-06-19 00:12:56,640 - INFO - Generated 5 tasks for kind tests
[task 2024-06-19T00:12:56.646Z] 2024-06-19 00:12:56,646 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-06-19T00:12:56.652Z] 2024-06-19 00:12:56,651 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-06-19T00:12:56.654Z] 2024-06-19 00:12:56,654 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-06-19T00:12:56.657Z] 2024-06-19 00:12:56,657 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-06-19T00:12:56.661Z] 2024-06-19 00:12:56,661 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-06-19T00:12:56.664Z] 2024-06-19 00:12:56,664 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-06-19T00:12:56.669Z] 2024-06-19 00:12:56,669 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-06-19T00:12:56.673Z] 2024-06-19 00:12:56,673 - INFO - Generated 2 tasks for kind extract-best
[task 2024-06-19T00:12:56.676Z] 2024-06-19 00:12:56,676 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-06-19T00:12:56.680Z] 2024-06-19 00:12:56,680 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-06-19T00:12:56.683Z] 2024-06-19 00:12:56,683 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-06-19T00:12:56.686Z] 2024-06-19 00:12:56,686 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-06-19T00:12:56.689Z] 2024-06-19 00:12:56,689 - INFO - Generated 1 tasks for kind score
[task 2024-06-19T00:12:56.692Z] 2024-06-19 00:12:56,691 - INFO - Generated 1 tasks for kind cefilter
[task 2024-06-19T00:12:56.694Z] 2024-06-19 00:12:56,694 - INFO - Generated 1 tasks for kind shortlist
[task 2024-06-19T00:12:56.697Z] 2024-06-19 00:12:56,697 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-06-19T00:12:56.700Z] 2024-06-19 00:12:56,700 - INFO - Generated 1 tasks for kind train-student
[task 2024-06-19T00:12:56.703Z] 2024-06-19 00:12:56,703 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-06-19T00:12:56.706Z] 2024-06-19 00:12:56,706 - INFO - Generated 1 tasks for kind quantize
[task 2024-06-19T00:12:56.709Z] 2024-06-19 00:12:56,709 - INFO - Generated 1 tasks for kind export
[task 2024-06-19T00:12:56.716Z] 2024-06-19 00:12:56,716 - INFO - Generated 4 tasks for kind evaluate
[task 2024-06-19T00:12:56.719Z] 2024-06-19 00:12:56,719 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-06-19T00:12:56.721Z] 2024-06-19 00:12:56,721 - INFO - Generated 1 tasks for kind all
[task 2024-06-19T00:12:56.725Z] 2024-06-19 00:12:56,725 - INFO - Generated 1 tasks for kind all-pr
[task 2024-06-19T00:12:56.726Z] 2024-06-19 00:12:56,725 - INFO - Generating full task graph
[task 2024-06-19T00:12:56.726Z] 2024-06-19 00:12:56,726 - INFO - Full task graph contains 92 tasks and 273 dependencies
[task 2024-06-19T00:12:56.730Z] 2024-06-19 00:12:56,730 - INFO - writing artifact file `full-task-graph.json`
[task 2024-06-19T00:12:56.752Z] 2024-06-19 00:12:56,752 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-06-19T00:12:56.754Z] 2024-06-19 00:12:56,754 - INFO - Generating target task set
[task 2024-06-19T00:12:56.754Z] 2024-06-19 00:12:56,754 - INFO - Filter filter_target_tasks pruned 75 tasks (17 remain)
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,754 - INFO - writing artifact file `target-tasks.json`
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,755 - INFO - Generating target task graph
[task 2024-06-19T00:12:56.755Z] 2024-06-19 00:12:56,755 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-06-19T00:12:56.756Z] 2024-06-19 00:12:56,756 - INFO - Generating optimized task graph
[task 2024-06-19T00:12:56.759Z] 2024-06-19 00:12:56,759 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-06-19T00:13:18.219Z] 2024-06-19 00:13:18,219 - INFO - Replaced 85 tasks by index-search (index-search) during optimization.
[task 2024-06-19T00:13:18.220Z] 2024-06-19 00:13:18,220 - INFO - writing artifact file `task-graph.json`
[task 2024-06-19T00:13:18.222Z] 2024-06-19 00:13:18,222 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-06-19T00:13:18.228Z] 2024-06-19 00:13:18,225 - INFO - Creating task with taskId Qpzfr4DFQqyvr5yMZ3YaNQ for tests-lint
[task 2024-06-19T00:13:18.228Z] 2024-06-19 00:13:18,227 - INFO - Creating task with taskId Cm2s6uQiTwCsui30P0s63A for tests-taskgraph-diff
[task 2024-06-19T00:13:18.233Z] 2024-06-19 00:13:18,230 - INFO - Creating task with taskId SeLlM5CwQ8mZzCVA_DDyvg for tests-taskgraph-definition
[task 2024-06-19T00:13:18.234Z] 2024-06-19 00:13:18,234 - INFO - Creating task with taskId ORUFruRkS_iIY1IFRJUNfA for all-pr-ru-en-1
[task 2024-06-19T00:13:18.237Z] 2024-06-19 00:13:18,236 - INFO - Creating task with taskId NLIriRv8QRWd92RmPTOTRA for tests-black
[taskcluster 2024-06-19 00:13:19.094Z] === Task Finished ===
[taskcluster 2024-06-19 00:13:21.222Z] Successful task run with exit code: 0 completed in 27.561 seconds