Override the existing_tasks explicitly provided in the action's input #683
firefoxci-taskcluster / tests-taskgraph-diff
succeeded
Jun 19, 2024 in 1m 44s
FirefoxCI (pull_request)
Create diffs of taskgraphs vs. base revision.
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-06-19 00:14:49.756Z] Task ID: Cm2s6uQiTwCsui30P0s63A
[taskcluster 2024-06-19 00:14:49.756Z] Worker ID: 8751292539272666209
[taskcluster 2024-06-19 00:14:49.756Z] Worker Group: us-central1-a
[taskcluster 2024-06-19 00:14:49.756Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-06-19 00:14:49.756Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-06-19 00:14:49.756Z] Worker Version: 38.0.5
[taskcluster 2024-06-19 00:14:49.756Z] Public IP: 34.46.25.227
[taskcluster 2024-06-19 00:14:49.756Z] Hostname: translations-1-b-linux-large-gcp-cbvu69uht0ecnc3lzeyq7a
[taskcluster 2024-06-19 00:14:49.756Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-ICHLHLzFSqmyskDpzDi7lQ" -> /builds/worker/checkouts
[taskcluster 2024-06-19 00:14:50.138Z] Image 'public/image.tar.zst' from task 'ICHLHLzFSqmyskDpzDi7lQ' loaded. Using image ID sha256:61a68527dda14bc76c4eb7ac283959995b7e2067e0bc3e2e4ecb4dcbac64016c.
[taskcluster 2024-06-19 00:14:50.186Z] === Task Starting ===
[setup 2024-06-19T00:14:50.435Z] run-task started in /builds/worker
[setup 2024-06-19T00:14:50.435Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -cx task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff
[setup 2024-06-19T00:14:50.435Z] Python version: 3.10.12
[cache 2024-06-19T00:14:50.436Z] cache /builds/worker/checkouts exists; requirements: gid=1000 uid=1000 version=1
[volume 2024-06-19T00:14:50.437Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-06-19T00:14:50.437Z] volume /builds/worker/checkouts is a cache
[setup 2024-06-19T00:14:50.437Z] running as worker:worker
[vcs 2024-06-19T00:14:50.437Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-06-19T00:14:50.438Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:14:50.639Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:14:50.639Z] * branch escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:14:50.645Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'escape-hatch-to-put-existing-tasks-in-the-graph']
[vcs 2024-06-19T00:14:50.856Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-06-19T00:14:50.856Z] * branch escape-hatch-to-put-existing-tasks-in-the-graph -> FETCH_HEAD
[vcs 2024-06-19T00:14:50.862Z] executing ['git', 'checkout', '-f', '-B', 'escape-hatch-to-put-existing-tasks-in-the-graph', '658adc2555649ee219e2ca5a5a3630d7230275de']
[vcs 2024-06-19T00:14:50.927Z] Switched to a new branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[vcs 2024-06-19T00:14:50.928Z] executing ['git', 'submodule', 'init']
[vcs 2024-06-19T00:14:50.946Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-06-19T00:14:51.029Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-06-19T00:14:51.039Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-06-19T00:14:51.049Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-06-19T00:14:51.074Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-06-19T00:14:51.187Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-06-19T00:14:51.204Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-06-19T00:14:51.205Z] cleaning git checkout...
[vcs 2024-06-19T00:14:51.205Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-06-19T00:14:51.207Z] removing []
[vcs 2024-06-19T00:14:51.207Z] successfully cleaned git checkout!
[vcs 2024-06-19T00:14:51.208Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/658adc2555649ee219e2ca5a5a3630d7230275de' title='Built from firefox-translations-training commit 658adc2555649ee219e2ca5a5a3630d7230275de'>658adc2555649ee219e2ca5a5a3630d7230275de</a>
[task 2024-06-19T00:14:51.208Z] executing ['bash', '-cx', 'task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff']
[task 2024-06-19T00:14:51.210Z] + task taskgraph-diff BASE_REV=121c853713224965bb121079b5179378fe8723b3 OUTPUT_FILE=/builds/worker/artifacts/taskgraph.diff
[task 2024-06-19T00:14:51.215Z] task: [taskgraph-requirements] poetry run --directory ./taskgraph -- pip3 install -r taskcluster/requirements.txt
[task 2024-06-19T00:14:51.748Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-06-19T00:14:52.985Z] Collecting appdirs==1.4.4 (from -r taskcluster/requirements.txt (line 7))
[task 2024-06-19T00:14:53.157Z] Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
[task 2024-06-19T00:14:53.204Z] Collecting arrow==1.3.0 (from -r taskcluster/requirements.txt (line 11))
[task 2024-06-19T00:14:53.247Z] Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[task 2024-06-19T00:14:53.303Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.328Z] Collecting binaryornot==0.4.4 (from -r taskcluster/requirements.txt (line 15))
[task 2024-06-19T00:14:53.372Z] Downloading binaryornot-0.4.4-py2.py3-none-any.whl (9.0 kB)
[task 2024-06-19T00:14:53.415Z] Collecting certifi==2024.2.2 (from -r taskcluster/requirements.txt (line 19))
[task 2024-06-19T00:14:53.458Z] Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[task 2024-06-19T00:14:53.510Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.1 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.537Z] Collecting chardet==5.2.0 (from -r taskcluster/requirements.txt (line 23))
[task 2024-06-19T00:14:53.581Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[task 2024-06-19T00:14:53.598Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 12.7 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.704Z] Collecting charset-normalizer==3.3.2 (from -r taskcluster/requirements.txt (line 27))
[task 2024-06-19T00:14:53.748Z] Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2024-06-19T00:14:53.758Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.1/142.1 kB 17.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.796Z] Collecting click==8.1.7 (from -r taskcluster/requirements.txt (line 119))
[task 2024-06-19T00:14:53.840Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[task 2024-06-19T00:14:53.847Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 16.4 MB/s eta 0:00:00
[task 2024-06-19T00:14:53.881Z] Collecting cookiecutter==2.5.0 (from -r taskcluster/requirements.txt (line 123))
[task 2024-06-19T00:14:53.925Z] Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[task 2024-06-19T00:14:53.956Z] Collecting giturlparse==0.12.0 (from -r taskcluster/requirements.txt (line 127))
[task 2024-06-19T00:14:54.000Z] Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[task 2024-06-19T00:14:54.032Z] Collecting idna==3.6 (from -r taskcluster/requirements.txt (line 131))
[task 2024-06-19T00:14:54.076Z] Downloading idna-3.6-py3-none-any.whl (61 kB)
[task 2024-06-19T00:14:54.082Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 14.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.117Z] Collecting jinja2==3.1.3 (from -r taskcluster/requirements.txt (line 135))
[task 2024-06-19T00:14:54.160Z] Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[task 2024-06-19T00:14:54.170Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 17.2 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.221Z] Collecting json-e==4.6.0 (from -r taskcluster/requirements.txt (line 139))
[task 2024-06-19T00:14:54.268Z] Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[task 2024-06-19T00:14:54.308Z] Collecting markdown-it-py==3.0.0 (from -r taskcluster/requirements.txt (line 143))
[task 2024-06-19T00:14:54.352Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[task 2024-06-19T00:14:54.359Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 16.0 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.426Z] Collecting markupsafe==2.1.5 (from -r taskcluster/requirements.txt (line 147))
[task 2024-06-19T00:14:54.470Z] Downloading MarkupSafe-2.1.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[task 2024-06-19T00:14:54.500Z] Collecting mdurl==0.1.2 (from -r taskcluster/requirements.txt (line 209))
[task 2024-06-19T00:14:54.543Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[task 2024-06-19T00:14:54.591Z] Collecting mozilla-repo-urls==0.1.1 (from -r taskcluster/requirements.txt (line 213))
[task 2024-06-19T00:14:54.635Z] Downloading mozilla_repo_urls-0.1.1-py3-none-any.whl (6.2 kB)
[task 2024-06-19T00:14:54.679Z] Collecting pygments==2.17.2 (from -r taskcluster/requirements.txt (line 217))
[task 2024-06-19T00:14:54.722Z] Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[task 2024-06-19T00:14:54.794Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 16.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.831Z] Collecting python-dateutil==2.8.2 (from -r taskcluster/requirements.txt (line 221))
[task 2024-06-19T00:14:54.876Z] Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
[task 2024-06-19T00:14:54.882Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 67.6 MB/s eta 0:00:00
[task 2024-06-19T00:14:54.915Z] Collecting python-slugify==8.0.4 (from -r taskcluster/requirements.txt (line 225))
[task 2024-06-19T00:14:54.959Z] Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[task 2024-06-19T00:14:55.018Z] Collecting pyyaml==6.0.1 (from -r taskcluster/requirements.txt (line 229))
[task 2024-06-19T00:14:55.062Z] Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
[task 2024-06-19T00:14:55.075Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 68.0 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.104Z] Collecting redo==2.0.4 (from -r taskcluster/requirements.txt (line 284))
[task 2024-06-19T00:14:55.148Z] Downloading redo-2.0.4-py2.py3-none-any.whl (12 kB)
[task 2024-06-19T00:14:55.201Z] Collecting requests==2.31.0 (from -r taskcluster/requirements.txt (line 288))
[task 2024-06-19T00:14:55.245Z] Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2024-06-19T00:14:55.250Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 21.8 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.342Z] Collecting rich==13.7.0 (from -r taskcluster/requirements.txt (line 294))
[task 2024-06-19T00:14:55.386Z] Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[task 2024-06-19T00:14:55.392Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 59.3 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.425Z] Collecting six==1.16.0 (from -r taskcluster/requirements.txt (line 298))
[task 2024-06-19T00:14:55.469Z] Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[task 2024-06-19T00:14:55.497Z] Collecting slugid==2.0.0 (from -r taskcluster/requirements.txt (line 302))
[task 2024-06-19T00:14:55.541Z] Downloading slugid-2.0.0-py2.py3-none-any.whl (8.2 kB)
[task 2024-06-19T00:14:55.611Z] Collecting taskcluster-taskgraph==7.4.0 (from -r taskcluster/requirements.txt (line 306))
[task 2024-06-19T00:14:55.655Z] Downloading taskcluster_taskgraph-7.4.0-py3-none-any.whl (188 kB)
[task 2024-06-19T00:14:55.662Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 35.9 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.690Z] Collecting taskcluster-urls==13.0.1 (from -r taskcluster/requirements.txt (line 310))
[task 2024-06-19T00:14:55.734Z] Downloading taskcluster_urls-13.0.1-py3-none-any.whl (10 kB)
[task 2024-06-19T00:14:55.763Z] Collecting text-unidecode==1.3 (from -r taskcluster/requirements.txt (line 315))
[task 2024-06-19T00:14:55.806Z] Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
[task 2024-06-19T00:14:55.812Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.2/78.2 kB 20.7 MB/s eta 0:00:00
[task 2024-06-19T00:14:55.867Z] Collecting types-python-dateutil==2.8.19.20240106 (from -r taskcluster/requirements.txt (line 319))
[task 2024-06-19T00:14:55.910Z] Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[task 2024-06-19T00:14:55.969Z] Collecting urllib3==2.2.0 (from -r taskcluster/requirements.txt (line 323))
[task 2024-06-19T00:14:56.013Z] Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[task 2024-06-19T00:14:56.018Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 38.8 MB/s eta 0:00:00
[task 2024-06-19T00:14:56.049Z] Collecting voluptuous==0.14.2 (from -r taskcluster/requirements.txt (line 327))
[task 2024-06-19T00:14:56.093Z] Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[task 2024-06-19T00:14:56.454Z] Installing collected packages: text-unidecode, taskcluster-urls, slugid, redo, json-e, appdirs, voluptuous, urllib3, types-python-dateutil, six, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, requests, python-dateutil, mozilla-repo-urls, markdown-it-py, jinja2, binaryornot, rich, arrow, cookiecutter, taskcluster-taskgraph
[task 2024-06-19T00:14:57.967Z] Successfully installed appdirs-1.4.4 arrow-1.3.0 binaryornot-0.4.4 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 mozilla-repo-urls-0.1.1 pygments-2.17.2 python-dateutil-2.8.2 python-slugify-8.0.4 pyyaml-6.0.1 redo-2.0.4 requests-2.31.0 rich-13.7.0 six-1.16.0 slugid-2.0.0 taskcluster-taskgraph-7.4.0 taskcluster-urls-13.0.1 text-unidecode-1.3 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-06-19T00:14:58.259Z] task: [taskgraph-diff] TASKCLUSTER_ROOT_URL="" poetry run --directory ./taskgraph -- taskgraph full --json --parameters "taskcluster/test/params" --output-file "/builds/worker/artifacts/taskgraph.diff" --diff "121c853713224965bb121079b5179378fe8723b3"
[task 2024-06-19T00:14:59.002Z] Generating full_task_graph @ escape-hatch-to-put-existing-tasks-in-the-graph
[task 2024-06-19T00:14:59.910Z] Note: switching to '121c853713224965bb121079b5179378fe8723b3'.
[task 2024-06-19T00:14:59.910Z]
[task 2024-06-19T00:14:59.910Z] You are in 'detached HEAD' state. You can look around, make experimental
[task 2024-06-19T00:14:59.910Z] changes and commit them, and you can discard any commits you make in this
[task 2024-06-19T00:14:59.910Z] state without impacting any branches by switching back to a branch.
[task 2024-06-19T00:14:59.910Z]
[task 2024-06-19T00:14:59.910Z] If you want to create a new branch to retain commits you create, you may
[task 2024-06-19T00:14:59.910Z] do so (now or later) by using -c with the switch command. Example:
[task 2024-06-19T00:14:59.910Z]
[task 2024-06-19T00:14:59.910Z] git switch -c <new-branch-name>
[task 2024-06-19T00:14:59.910Z]
[task 2024-06-19T00:14:59.911Z] Or undo this operation with:
[task 2024-06-19T00:14:59.911Z]
[task 2024-06-19T00:14:59.911Z] git switch -
[task 2024-06-19T00:14:59.911Z]
[task 2024-06-19T00:14:59.911Z] Turn off this advice by setting config variable advice.detachedHead to false
[task 2024-06-19T00:14:59.911Z]
[task 2024-06-19T00:14:59.911Z] HEAD is now at 121c853 Bump memory for shortlist (#685)
[task 2024-06-19T00:14:59.912Z] Generating full_task_graph @ 121c85371322
[task 2024-06-19T00:15:00.828Z] Previous HEAD position was 121c853 Bump memory for shortlist (#685)
[task 2024-06-19T00:15:00.828Z] Switched to branch 'escape-hatch-to-put-existing-tasks-in-the-graph'
[task 2024-06-19T00:15:00.831Z] Dumping result with parameters from small-ru-en:
[task 2024-06-19T00:15:00.838Z] Dumping result with parameters from large-lt-en:
[task 2024-06-19T00:15:00.838Z] See '/builds/worker/.cache/taskgraph/log/vcs' for logs
[task 2024-06-19T00:15:00.838Z] Files full_task_graph@121c85371322 and full_task_graph@escape-hatch-to-put-existing-tasks-in-the-graph are identical
[task 2024-06-19T00:15:00.838Z]
[task 2024-06-19T00:15:00.838Z]
[task 2024-06-19T00:15:00.838Z] Files full_task_graph@121c85371322 and full_task_graph@escape-hatch-to-put-existing-tasks-in-the-graph are identical
[task 2024-06-19T00:15:00.838Z]
[task 2024-06-19T00:15:00.838Z]
[taskcluster 2024-06-19 00:15:01.256Z] === Task Finished ===
[taskcluster 2024-06-19 00:15:01.256Z] Successful task run with exit code: 0 completed in 11.501 seconds
Loading