Skip to content

[v10] Add Docker Hub login to Drone's Kubernetes pipelines#23972

Merged
wadells merged 5 commits intobranch/v10from
walt/v10-dockerhub-login
Apr 3, 2023
Merged

[v10] Add Docker Hub login to Drone's Kubernetes pipelines#23972
wadells merged 5 commits intobranch/v10from
walt/v10-dockerhub-login

Conversation

@wadells
Copy link
Copy Markdown
Contributor

@wadells wadells commented Apr 2, 2023

Backports #23956
Backports #23957

Summary

After moving Drone to AWS, we're seeing image pulls get rate limited because they're all coming from the same IP (an AWS NAT gateway). To avoid the rate limiting on AWS, we refactor pipelines to cache/reuse images where possible, as well as add authentication to Docker Hub pulls.

Related Issues & PRs

Contributes to https://github.com/gravitational/SecOps/issues/285

See the orginal PRs to master for more context.

Testing

This is undergoing final testing at:

These tests are based off the most recent branch/v10 so I'll be watching to see if they flush out unrelated issues, since there hasn't been a release in ~130 commits.

tcsc and others added 4 commits April 2, 2023 10:29
After moving Drone to AWS, we're seeing image pulls get rate limited
because they're all coming from the same IP (an AWS NAT gateway).

To avoid this, we refactor pipelines to cache/reuse images where
possible, as well as add authentication to dockerhub pulls.
This is useful for making private test builds.
We don't actually consistently want these in all places.  E.g. parallel
pipelines cannot share a volumeRefDockerConfig, as they'll stop on each
others login information.
A shared volume results in the different steps racing against each
other.
@public-teleport-github-review-bot
Copy link
Copy Markdown

@wadells - this PR will require admin approval to merge due to its size. Consider breaking it up into a series smaller changes.

@github-actions github-actions Bot added application-access audit-log Issues related to Teleports Audit Log bpf Used to bugs with bpf and enhanced session recording. database-access Database access related issues and PRs desktop-access documentation helm kubernetes-access machine-id rdp rfd Request for Discussion size/xl tctl tctl - Teleport admin tool tsh tsh - Teleport's command line tool for logging into nodes running Teleport. ui labels Apr 2, 2023
@wadells wadells changed the base branch from master to branch/v10 April 2, 2023 18:26
@wadells wadells added backport size/lg and removed documentation ui kubernetes-access tsh tsh - Teleport's command line tool for logging into nodes running Teleport. tctl tctl - Teleport admin tool rdp bpf Used to bugs with bpf and enhanced session recording. helm audit-log Issues related to Teleports Audit Log application-access rfd Request for Discussion database-access Database access related issues and PRs desktop-access machine-id size/xl labels Apr 2, 2023
@wadells
Copy link
Copy Markdown
Contributor Author

wadells commented Apr 3, 2023

Builds are green! Merging.

@wadells wadells enabled auto-merge April 3, 2023 01:35
We don't actually pull from dockerhub in these steps.
@wadells wadells force-pushed the walt/v10-dockerhub-login branch from 2dfdbee to 855b247 Compare April 3, 2023 01:39
@wadells wadells added this pull request to the merge queue Apr 3, 2023
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Apr 3, 2023
@wadells wadells added this pull request to the merge queue Apr 3, 2023
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Apr 3, 2023
@wadells wadells added this pull request to the merge queue Apr 3, 2023
Merged via the queue into branch/v10 with commit 7bfbf3b Apr 3, 2023
@wadells wadells deleted the walt/v10-dockerhub-login branch April 3, 2023 03:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants