Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up multi-image operations #485

Merged
merged 3 commits into from
Feb 13, 2023

Conversation

evankanderson
Copy link
Contributor

@evankanderson evankanderson commented Feb 13, 2023

Fixes #483

It turns out that if you pass a fresh keychain into ggcr, it will attempt to resolve the keychain each time, and doesn't keep a per-registry cache. Add a per-registry authentication cache to the per-registry transport cache.

On a "verify-only" copy of 214 images and 7.06GiB, this reduced time from about 20 minutes to about 3 minutes. Will go back and grab "before" timing in a moment.

Succeeded

real	2m53.102s
user	0m2.926s
sys	0m2.721s

Note: I've never touched this code before, so you may want to give this PR extra scrutiny

@evankanderson
Copy link
Contributor Author

The same run using the 0.35.0 imgpkg version:

Succeeded

real	20m19.801s
user	3m12.668s
sys	5m33.005s

@evankanderson evankanderson temporarily deployed to TanzuNet Registry Dev e2e February 13, 2023 18:11 — with GitHub Actions Inactive
@evankanderson evankanderson temporarily deployed to GCR e2e February 13, 2023 18:11 — with GitHub Actions Inactive
@evankanderson evankanderson temporarily deployed to GCR e2e February 13, 2023 18:44 — with GitHub Actions Inactive
@evankanderson evankanderson temporarily deployed to TanzuNet Registry Dev e2e February 13, 2023 18:44 — with GitHub Actions Inactive
Copy link
Member

@joaopapereira joaopapereira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@joaopapereira joaopapereira merged commit 5281971 into carvel-dev:develop Feb 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

Frequent calls to docker-credential-desktop and osascript when doing a copy
2 participants