Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AutoBuild] Allow limiting concurrency of ghr uploads #1334

Merged
merged 1 commit into from
Jun 29, 2024

Conversation

giordano
Copy link
Member

@giordano giordano commented Jun 29, 2024

When uploading a large number of artifacts, like with Enzyme, we've observed errors in ghr like

Failed to upload one of assets: one of the goroutines failed: failed to upload asset: /tmp/jl_tLeFr2/Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version+15.tar.gz: failed to upload release asset: /tmp/jl_tLeFr2/Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version+15.tar.gz: POST https://uploads.github.com/repos/JuliaBinaryWrappers/Enzyme_jll.jl/releases/163097283/assets?name=Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version%2B15.tar.gz: 403 You have exceeded a secondary rate limit. Please wait a few minutes before you try again.

Passing the -p option to reduce parallelism is an attempt to avoid this issue.

CC: @wsmoses.

When uploading a large number of artifacts, like with Enzyme, we've observed
errors in `ghr` like

Failed to upload one of assets: one of the goroutines failed: failed to upload asset: /tmp/jl_tLeFr2/Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version+15.tar.gz: failed to upload release asset: /tmp/jl_tLeFr2/Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version+15.tar.gz: POST https://uploads.github.com/repos/JuliaBinaryWrappers/Enzyme_jll.jl/releases/163097283/assets?name=Enzyme-logs.v0.0.128.i686-linux-gnu-cxx11-llvm_version%2B15.tar.gz: 403 You have exceeded a secondary rate limit. Please wait a few minutes before you try again.

Passing the `-p` option to reduce parallelism is an attempt to avoid this issue.
@giordano giordano merged commit d9ba50f into JuliaPackaging:master Jun 29, 2024
8 of 9 checks passed
@giordano giordano deleted the mg/ghr-limit-parallelism branch June 29, 2024 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants