GH Actions (docker): Run a job for "make build-local" first, cache image for job "make build"

[mkoeppe]

Follow up from #32703, where this was implemented for macOS.

Here we implement it for the docker-based workflows
via incremental builds (#34228) on top of previous stages pushed to ghcr.io

Depends on #34115
Depends on #34228

CC: @tobiasdiez @dimpase

Component: porting

Author: Matthias Koeppe

Branch/Commit: 5713937

Reviewer: Dima Pasechnik

Issue created by migration from https://trac.sagemath.org/ticket/33062

[mkoeppe]

Dependencies: #30933, #33103, #33140

[mkoeppe]

Description changed:

--- 
+++ 
@@ -1,8 +1,7 @@
 Follow up from #32703, where this was implemented for macOS.
 
-Here we implement it for the `docker`-based workflows.
-
-References
-- https://evilmartians.com/chronicles/build-images-on-github-actions-with-docker-layer-caching
+Here we implement it for the `docker`-based workflows by Docker layer caching via ghcr.io
 
 
+
+

[mkoeppe]

Changed dependencies from #30933, #33103, #33140 to #33103, #33140, #33222

[mkoeppe]

Changed dependencies from #33103, #33140, #33222 to #33103, #33140

[mkoeppe]

Description changed:

--- 
+++ 
@@ -2,6 +2,6 @@
 
 Here we implement it for the `docker`-based workflows by Docker layer caching via ghcr.io
 
+(split out from #33222)
 
 
-

[mkoeppe]

Branch: u/mkoeppe/gh_actions__docker___run_a_job_for__make_build_local__first__cache_image_for_job__make_build_

[mkoeppe]

Description changed:

--- 
+++ 
@@ -2,6 +2,26 @@
 
 Here we implement it for the `docker`-based workflows by Docker layer caching via ghcr.io
 
+To use:
+
+```
+$ DOCKER_BUILDKIT=1 EXTRA_CACHE_FROM_REPOSITORIES=ghcr.io/mkoeppe/sage/ tox -e docker-ubuntu-focal-standard
+ => [internal] load metadata for docker.io/library/ubuntu:focal                                                                                                                                                      0.0s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-bootstrapped:dev                                                                                                      1.3s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-system-packages:9.6.beta0-133-gc9c7d9f8d9                                                                        1.6s
+ => importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets-pre:dev                                                                                                        2.4s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-configured:9.6.beta0-133-gc9c7d9f8d9                                                                                  1.6s
+ => importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-configured:dev                                                                                                              2.5s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets-pre:9.6.beta0-133-gc9c7d9f8d9                                                                            1.6s
+ => importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets:dev                                                                                                            2.4s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets:9.6.beta0-133-gc9c7d9f8d9                                                                                1.4s
+ => importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets-optional:dev                                                                                                   2.4s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-targets-optional:9.6.beta0-133-gc9c7d9f8d9                                                                       1.4s
+ => importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-with-system-packages:dev                                                                                                    2.4s
+ => ERROR importing cache manifest from ghcr.io/mkoeppe/sage/sage-docker-ubuntu-focal-standard-bootstrapped:9.6.beta0-133-gc9c7d9f8d9                                                                                1.5s
+```
+
+
 (split out from #33222)
 
 

[mkoeppe]

Last 10 new commits:

531cd14	Merge #33103
51191fe	.github/workflows/tox.yml (local-macos): Fix filtering of experimental packages
12f88cf	.github/workflows/tox.yml (local-macos): Group optional/experimental package builds into fewer jobs
49236dd	tox.ini: Add local-macos-python3_pythonorg-python3.9 etc., refactor CONFIG_CONFIGURE_ARGS_1=...--with-python
1fcdc91	tox.ini: Updates for macos and manylinux from #31396
41ec3aa	tox.ini: Reindent
d7066aa	Merge #33140
98a5bae	Merge tag '9.6.beta0' into t/33062/gh_actions__docker___run_a_job_for__make_build_local__first__cache_image_for_job__make_build_
c446d33	.github/workflows, src/doc/en/developer/portability_testing.rst: Switch from docker.pkg.github.com to ghcr.io
c9c7d9f	tox.ini (docker): Support Docker build layer caching

[mkoeppe]

Commit: c9c7d9f

[mkoeppe]

Description changed:

--- 
+++ 
@@ -2,7 +2,7 @@
 
 Here we implement it for the `docker`-based workflows by Docker layer caching via ghcr.io
 
-To use:
+To use for local builds via tox:
 
 ```
 $ DOCKER_BUILDKIT=1 EXTRA_CACHE_FROM_REPOSITORIES=ghcr.io/mkoeppe/sage/ tox -e docker-ubuntu-focal-standard

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

e56bf3e	.github/workflows/tox.yml: Integrate optional and experimental runs here
c830cdb	.github/workflows/ci-{linux,macos}.yml: Split from tox.yml

[sagetrac-git]

Changed commit from c9c7d9f to c830cdb

[mkoeppe]

Description changed:

--- 
+++ 
@@ -24,4 +24,5 @@
 
 (split out from #33222)
 
+We reorganize the CI workflows: `ci-linux.yml` and `ci-macos.yml` replace `tox.yml`, `tox-optional.yml`, `tox-experimental.yml`. 
 

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

Reviewer: https://github.com/mkoeppe/sage/actions/runs/1804137820