Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Override the existing_tasks explicitly provided in the action's input #683

Merged
merged 3 commits into from
Jun 19, 2024

Merge branch 'release' into escape-hatch-to-put-existing-tasks-in-the…

658adc2
Select commit
Loading
Failed to load commit list.
Merged

Override the existing_tasks explicitly provided in the action's input #683

Merge branch 'release' into escape-hatch-to-put-existing-tasks-in-the…
658adc2
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-taskgraph-diff succeeded Jun 19, 2024 in 1m 44s

FirefoxCI (pull_request)

Create diffs of taskgraphs vs. base revision.

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-06-19 00:14:49.756Z] Task ID: Cm2s6uQiTwCsui30P0s63A
[taskcluster 2024-06-19 00:14:49.756Z] Worker ID: 8751292539272666209
[taskcluster 2024-06-19 00:14:49.756Z] Worker Group: us-central1-a
[taskcluster 2024-06-19 00:14:49.756Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-06-19 00:14:49.756Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-06-19 00:14:49.756Z] Worker Version: 38.0.5
[taskcluster 2024-06-19 00:14:49.756Z] Public IP: 34.46.25.227
[taskcluster 2024-06-19 00:14:49.756Z] Hostname: translations-1-b-linux-large-gcp-cbvu69uht0ecnc3lzeyq7a
[taskcluster 2024-06-19 00:14:49.756Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-ICHLHLzFSqmyskDpzDi7lQ" -> /builds/worker/checkouts

[taskcluster 2024-06-19 00:14:50.138Z] Image 'public/image.tar.zst' from task 'ICHLHLzFSqmyskDpzDi7lQ' loaded.  Using image ID sha256:61a68527dda14bc76c4eb7ac283959995b7e2067e0bc3e2e4ecb4dcbac64016c.
[taskcluster 2024-06-19 00:14:50.186Z] === Task Starting ===
[setup 2024-06-19T00:14:50.435Z] run-task started in /builds/worker
[setup 2024-06-19T00:14:50.435Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -cx task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff
[setup 2024-06-19T00:14:50.435Z] Python version: 3.10.12
[cache 2024-06-19T00:14:50.436Z] cache /builds/worker/checkouts exists; requirements: gid=1000 uid=1000 version=1
[volume 2024-06-19T00:14:50.437Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-06-19T00:14:50.437Z] volume /builds/worker/checkouts is a cache
[setup 2024-06-19T00:14:50.437Z] running as worker:worker
[vcs 2024-06-19T00:14:50.437Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-06-19T00:14:50.438Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:14:50.639Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:14:50.639Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:14:50.645Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:14:50.856Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:14:50.856Z]  * branch            escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:14:50.862Z] executing ['git', 'checkout', '-f', '-B', 'escape-hatch-to-put-existing-tasks-in-the-graph', '658adc2555649ee219e2ca5a5a3630d7230275de']
[vcs 2024-06-19T00:14:50.927Z] Switched to a new branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:14:50.928Z] executing ['git', 'submodule', 'init']
[vcs 2024-06-19T00:14:50.946Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-06-19T00:14:51.029Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-06-19T00:14:51.039Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-06-19T00:14:51.049Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-06-19T00:14:51.074Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-06-19T00:14:51.187Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-06-19T00:14:51.204Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-06-19T00:14:51.205Z] cleaning git checkout...
[vcs 2024-06-19T00:14:51.205Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-06-19T00:14:51.207Z] removing []
[vcs 2024-06-19T00:14:51.207Z] successfully cleaned git checkout!
[vcs 2024-06-19T00:14:51.208Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/658adc2555649ee219e2ca5a5a3630d7230275de' title='Built from firefox-translations-training commit 658adc2555649ee219e2ca5a5a3630d7230275de'>658adc2555649ee219e2ca5a5a3630d7230275de</a>
[task 2024-06-19T00:14:51.208Z] executing ['bash', '-cx', 'task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff']
[task 2024-06-19T00:14:51.210Z] + task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff
[task 2024-06-19T00:14:51.215Z] task: [taskgraph-requirements] poetry run --directory ./taskgraph -- pip3 install -r taskcluster/requirements.txt
[task 2024-06-19T00:14:51.748Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-06-19T00:14:52.985Z] Collecting appdirs==1.4.4 (from -r taskcluster/requirements.txt (line 7))
[task 2024-06-19T00:14:53.157Z]   Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
[task 2024-06-19T00:14:53.204Z] Collecting arrow==1.3.0 (from -r taskcluster/requirements.txt (line 11))
[task 2024-06-19T00:14:53.247Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[task 2024-06-19T00:14:53.303Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.328Z] Collecting binaryornot==0.4.4 (from -r taskcluster/requirements.txt (line 15))
[task 2024-06-19T00:14:53.372Z]   Downloading binaryornot-0.4.4-py2.py3-none-any.whl (9.0 kB)
[task 2024-06-19T00:14:53.415Z] Collecting certifi==2024.2.2 (from -r taskcluster/requirements.txt (line 19))
[task 2024-06-19T00:14:53.458Z]   Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[task 2024-06-19T00:14:53.510Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.1 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.537Z] Collecting chardet==5.2.0 (from -r taskcluster/requirements.txt (line 23))
[task 2024-06-19T00:14:53.581Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[task 2024-06-19T00:14:53.598Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 12.7 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.704Z] Collecting charset-normalizer==3.3.2 (from -r taskcluster/requirements.txt (line 27))
[task 2024-06-19T00:14:53.748Z]   Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2024-06-19T00:14:53.758Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.1/142.1 kB 17.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.796Z] Collecting click==8.1.7 (from -r taskcluster/requirements.txt (line 119))
[task 2024-06-19T00:14:53.840Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[task 2024-06-19T00:14:53.847Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 16.4 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.881Z] Collecting cookiecutter==2.5.0 (from -r taskcluster/requirements.txt (line 123))
[task 2024-06-19T00:14:53.925Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[task 2024-06-19T00:14:53.956Z] Collecting giturlparse==0.12.0 (from -r taskcluster/requirements.txt (line 127))
[task 2024-06-19T00:14:54.000Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[task 2024-06-19T00:14:54.032Z] Collecting idna==3.6 (from -r taskcluster/requirements.txt (line 131))
[task 2024-06-19T00:14:54.076Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[task 2024-06-19T00:14:54.082Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 14.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.117Z] Collecting jinja2==3.1.3 (from -r taskcluster/requirements.txt (line 135))
[task 2024-06-19T00:14:54.160Z]   Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[task 2024-06-19T00:14:54.170Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 17.2 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.221Z] Collecting json-e==4.6.0 (from -r taskcluster/requirements.txt (line 139))
[task 2024-06-19T00:14:54.268Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[task 2024-06-19T00:14:54.308Z] Collecting markdown-it-py==3.0.0 (from -r taskcluster/requirements.txt (line 143))
[task 2024-06-19T00:14:54.352Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[task 2024-06-19T00:14:54.359Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 16.0 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.426Z] Collecting markupsafe==2.1.5 (from -r taskcluster/requirements.txt (line 147))
[task 2024-06-19T00:14:54.470Z]   Downloading MarkupSafe-2.1.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[task 2024-06-19T00:14:54.500Z] Collecting mdurl==0.1.2 (from -r taskcluster/requirements.txt (line 209))
[task 2024-06-19T00:14:54.543Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[task 2024-06-19T00:14:54.591Z] Collecting mozilla-repo-urls==0.1.1 (from -r taskcluster/requirements.txt (line 213))
[task 2024-06-19T00:14:54.635Z]   Downloading mozilla_repo_urls-0.1.1-py3-none-any.whl (6.2 kB)
[task 2024-06-19T00:14:54.679Z] Collecting pygments==2.17.2 (from -r taskcluster/requirements.txt (line 217))
[task 2024-06-19T00:14:54.722Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[task 2024-06-19T00:14:54.794Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 16.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.831Z] Collecting python-dateutil==2.8.2 (from -r taskcluster/requirements.txt (line 221))
[task 2024-06-19T00:14:54.876Z]   Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
[task 2024-06-19T00:14:54.882Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 67.6 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.915Z] Collecting python-slugify==8.0.4 (from -r taskcluster/requirements.txt (line 225))
[task 2024-06-19T00:14:54.959Z]   Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[task 2024-06-19T00:14:55.018Z] Collecting pyyaml==6.0.1 (from -r taskcluster/requirements.txt (line 229))
[task 2024-06-19T00:14:55.062Z]   Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
[task 2024-06-19T00:14:55.075Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 68.0 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.104Z] Collecting redo==2.0.4 (from -r taskcluster/requirements.txt (line 284))
[task 2024-06-19T00:14:55.148Z]   Downloading redo-2.0.4-py2.py3-none-any.whl (12 kB)
[task 2024-06-19T00:14:55.201Z] Collecting requests==2.31.0 (from -r taskcluster/requirements.txt (line 288))
[task 2024-06-19T00:14:55.245Z]   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2024-06-19T00:14:55.250Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 21.8 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.342Z] Collecting rich==13.7.0 (from -r taskcluster/requirements.txt (line 294))
[task 2024-06-19T00:14:55.386Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[task 2024-06-19T00:14:55.392Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 59.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.425Z] Collecting six==1.16.0 (from -r taskcluster/requirements.txt (line 298))
[task 2024-06-19T00:14:55.469Z]   Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[task 2024-06-19T00:14:55.497Z] Collecting slugid==2.0.0 (from -r taskcluster/requirements.txt (line 302))
[task 2024-06-19T00:14:55.541Z]   Downloading slugid-2.0.0-py2.py3-none-any.whl (8.2 kB)
[task 2024-06-19T00:14:55.611Z] Collecting taskcluster-taskgraph==7.4.0 (from -r taskcluster/requirements.txt (line 306))
[task 2024-06-19T00:14:55.655Z]   Downloading taskcluster_taskgraph-7.4.0-py3-none-any.whl (188 kB)
[task 2024-06-19T00:14:55.662Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 35.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.690Z] Collecting taskcluster-urls==13.0.1 (from -r taskcluster/requirements.txt (line 310))
[task 2024-06-19T00:14:55.734Z]   Downloading taskcluster_urls-13.0.1-py3-none-any.whl (10 kB)
[task 2024-06-19T00:14:55.763Z] Collecting text-unidecode==1.3 (from -r taskcluster/requirements.txt (line 315))
[task 2024-06-19T00:14:55.806Z]   Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
[task 2024-06-19T00:14:55.812Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.2/78.2 kB 20.7 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.867Z] Collecting types-python-dateutil==2.8.19.20240106 (from -r taskcluster/requirements.txt (line 319))
[task 2024-06-19T00:14:55.910Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[task 2024-06-19T00:14:55.969Z] Collecting urllib3==2.2.0 (from -r taskcluster/requirements.txt (line 323))
[task 2024-06-19T00:14:56.013Z]   Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[task 2024-06-19T00:14:56.018Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 38.8 MB/s eta 0:00:00
[task 2024-06-19T00:14:56.049Z] Collecting voluptuous==0.14.2 (from -r taskcluster/requirements.txt (line 327))
[task 2024-06-19T00:14:56.093Z]   Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[task 2024-06-19T00:14:56.454Z] Installing collected packages: text-unidecode, taskcluster-urls, slugid, redo, json-e, appdirs, voluptuous, urllib3, types-python-dateutil, six, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, requests, python-dateutil, mozilla-repo-urls, markdown-it-py, jinja2, binaryornot, rich, arrow, cookiecutter, taskcluster-taskgraph
[task 2024-06-19T00:14:57.967Z] Successfully installed appdirs-1.4.4 arrow-1.3.0 binaryornot-0.4.4 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 mozilla-repo-urls-0.1.1 pygments-2.17.2 python-dateutil-2.8.2 python-slugify-8.0.4 pyyaml-6.0.1 redo-2.0.4 requests-2.31.0 rich-13.7.0 six-1.16.0 slugid-2.0.0 taskcluster-taskgraph-7.4.0 taskcluster-urls-13.0.1 text-unidecode-1.3 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-06-19T00:14:58.259Z] task: [taskgraph-diff] TASKCLUSTER_ROOT_URL="" poetry run --directory ./taskgraph -- taskgraph full --json --parameters "taskcluster/test/params" --output-file "/builds/worker/artifacts/taskgraph.diff" --diff "121c853713224965bb121079b5179378fe8723b3"
[task 2024-06-19T00:14:59.002Z] Generating full_task_graph @ escape-hatch-to-put-existing-tasks-in-the-graph
[task 2024-06-19T00:14:59.910Z] Note: switching to '121c853713224965bb121079b5179378fe8723b3'.
[task 2024-06-19T00:14:59.910Z] 
[task 2024-06-19T00:14:59.910Z] You are in 'detached HEAD' state. You can look around, make experimental
[task 2024-06-19T00:14:59.910Z] changes and commit them, and you can discard any commits you make in this
[task 2024-06-19T00:14:59.910Z] state without impacting any branches by switching back to a branch.
[task 2024-06-19T00:14:59.910Z] 
[task 2024-06-19T00:14:59.910Z] If you want to create a new branch to retain commits you create, you may
[task 2024-06-19T00:14:59.910Z] do so (now or later) by using -c with the switch command. Example:
[task 2024-06-19T00:14:59.910Z] 
[task 2024-06-19T00:14:59.910Z]   git switch -c <new-branch-name>
[task 2024-06-19T00:14:59.910Z] 
[task 2024-06-19T00:14:59.911Z] Or undo this operation with:
[task 2024-06-19T00:14:59.911Z] 
[task 2024-06-19T00:14:59.911Z]   git switch -
[task 2024-06-19T00:14:59.911Z] 
[task 2024-06-19T00:14:59.911Z] Turn off this advice by setting config variable advice.detachedHead to false
[task 2024-06-19T00:14:59.911Z] 
[task 2024-06-19T00:14:59.911Z] HEAD is now at 121c853 Bump memory for shortlist (#685)
[task 2024-06-19T00:14:59.912Z] Generating full_task_graph @ 121c85371322
[task 2024-06-19T00:15:00.828Z] Previous HEAD position was 121c853 Bump memory for shortlist (#685)
[task 2024-06-19T00:15:00.828Z] Switched to branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[task 2024-06-19T00:15:00.831Z] Dumping result with parameters from small-ru-en:
[task 2024-06-19T00:15:00.838Z] Dumping result with parameters from large-lt-en:
[task 2024-06-19T00:15:00.838Z] See '/builds/worker/.cache/taskgraph/log/vcs' for logs
[task 2024-06-19T00:15:00.838Z] Files full_task_graph@121c85371322 and full_task_graph@escape-hatch-to-put-existing-tasks-in-the-graph are identical
[task 2024-06-19T00:15:00.838Z] 
[task 2024-06-19T00:15:00.838Z] 
[task 2024-06-19T00:15:00.838Z] Files full_task_graph@121c85371322 and full_task_graph@escape-hatch-to-put-existing-tasks-in-the-graph are identical
[task 2024-06-19T00:15:00.838Z] 
[task 2024-06-19T00:15:00.838Z] 
[taskcluster 2024-06-19 00:15:01.256Z] === Task Finished ===
[taskcluster 2024-06-19 00:15:01.256Z] Successful task run with exit code: 0 completed in 11.501 seconds