Skip to content

[v12] Add Docker Hub login to Drone's Kubernetes pipelines#23958

Merged
wadells merged 5 commits intobranch/v12from
walt/v12-dockerhub-login
Apr 3, 2023
Merged

[v12] Add Docker Hub login to Drone's Kubernetes pipelines#23958
wadells merged 5 commits intobranch/v12from
walt/v12-dockerhub-login

Conversation

@wadells
Copy link
Copy Markdown
Contributor

@wadells wadells commented Apr 1, 2023

Backports #23956
Backports #23957

Summary

After moving Drone to AWS, we're seeing image pulls get rate limited because they're all coming from the same IP (an AWS NAT gateway). To avoid the rate limiting on AWS, we refactor pipelines to cache/reuse images where possible, as well as add authentication to Docker Hub pulls.

Related Issues & PRs

Contributes to https://github.com/gravitational/SecOps/issues/285

See the orginal PRs to master for more context.

Testing

This is undergoing final testing at:

These tests are based off 12.1.5 -- so they should be fully clean.

tcsc and others added 5 commits April 2, 2023 10:13
After moving Drone to AWS, we're seeing image pulls get rate limited
because they're all coming from the same IP (an AWS NAT gateway).

To avoid this, we refactor pipelines to cache/reuse images where
possible, as well as add authentication to dockerhub pulls.
This is useful for making private test builds.
We don't actually consistently want these in all places.  E.g. parallel
pipelines cannot share a volumeRefDockerConfig, as they'll stop on each
others login information.
A shared volume results in the different steps racing against each
other.
We don't actually pull from dockerhub in these steps.
@wadells wadells force-pushed the walt/v12-dockerhub-login branch from 2270c22 to 69c1002 Compare April 2, 2023 17:14
@public-teleport-github-review-bot
Copy link
Copy Markdown

@wadells - this PR will require admin approval to merge due to its size. Consider breaking it up into a series smaller changes.

@wadells
Copy link
Copy Markdown
Contributor Author

wadells commented Apr 2, 2023

All green on the test builds. Merging!

@wadells wadells added this pull request to the merge queue Apr 2, 2023
Merged via the queue into branch/v12 with commit 2efe276 Apr 3, 2023
@wadells wadells deleted the walt/v12-dockerhub-login branch April 3, 2023 00:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants