[build] Cross compile docker images

[jbudz]

This adds a new flag to scripts/build, --docker-cross-compile. This flag will attempt to create docker images for both amd64 and arm64 using docker's buildx environment - https://docs.docker.com/buildx/working-with-bux/.

The primary use case we are trying to support is building ARM64 images from AMD64. We use GCP on CI, and GCP does not support ARM architectures yet.

By default this is off to maintain backwards compatibility with our current build workflow. QEMU needs to be setup on the local environment to support cross compilation, which is outside the scope of our build scripts.

TODO

• apt-get install qemu-user-static

Testing

apt-get install qemu-user-static

# Verify ARM64 and AMD64 are supported platforms:
docker buildx inspect --bootstrap

yarn build --docker-cross-compile

[elasticmachine]

Pinging @elastic/kibana-operations (Team:Operations)

[spalger]

Ran the build on a remote-dev instance, loaded the arm64 build and the aarch64 docker image to a graviton instance and they both seemed to work great. LGTM

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: cfddf02
• Storybooks Preview
• Webpack Bundle Analyzer

Metrics [docs]

✅ unchanged

History

• 💛 Build #33057 was flaky e34e417
• 💔 Build #33036 failed a734d8e
• 💔 Build #33012 failed 0a73165
• 💛 Build #32856 was flaky df87f06
• 💔 Build #32685 failed b724ab5
• 💔 Build #32665 failed 8669358

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[kibanamachine]

💔 All backports failed

Status	Branch	Result
❌	7.17	Backport failed because of merge conflicts You might need to backport the following PRs to 7.17: - [ci] Verify docker contexts (#122897)

Manual backport

To create the backport manually run:

node scripts/backport --pr 128272

Questions ?

Please refer to the Backport tool documentation

[kuisathaverat]

@spalger @jbudz the change in this PR force to use buildx always even though you do not want to cross compile Docker images other than x86_64

npm install -g yarn
yarn kbn clean
yarn kbn bootstrap --prefer-offline --no-audit --link-duplicates

# build Linux package
node scripts/build

# build docker images
node scripts/build --skip-initialize --skip-generic-folders --skip-platform-folders --skip-archives --docker-images --skip-docker-contexts

cause the following error

[2022-03-24T15:03:34.403Z]    │ info $ ./build_docker.sh
[2022-03-24T15:03:34.974Z]    │ info 20.04: Pulling from library/ubuntu
[2022-03-24T15:03:34.974Z]    │ info Digest: sha256:bea6d19168bbfd6af8d77c2cc3c572114eb5d113e6f422573c93cb605a0e2ffb
[2022-03-24T15:03:34.974Z]    │ info Status: Image is up to date for ubuntu:20.04
[2022-03-24T15:03:34.974Z]    │ info docker.io/library/ubuntu:20.04
[2022-03-24T15:03:34.975Z]    │ info Docker pull successful.
[2022-03-24T15:03:34.975Z]    │ info Building: kibana-cloud-docker
[2022-03-24T15:03:34.975Z]    │ info unknown flag: --platform
[2022-03-24T15:03:34.975Z]    │ info See 'docker --help'.

[jbudz]

@kuisathaverat I have a fix up at #128560.

[kuisathaverat]

On our end, we have included buildx in our Kibana Docker image builder on Friday