Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add package download retry in anaconda-iso to avoid The requested URL returned error: 503 #835

Open
henrywang opened this issue Feb 15, 2025 · 2 comments · May be fixed by #840
Open

Add package download retry in anaconda-iso to avoid The requested URL returned error: 503 #835

henrywang opened this issue Feb 15, 2025 · 2 comments · May be fixed by #840

Comments

@henrywang
Copy link
Member

Recently, I found a lot of anaconda-iso failures, like source/org.osbuild.curl (org.osbuild.curl): WARNING: failed to download http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/aarch64/os/Packages/mesa-libEGL-24.2.8-1.el9.aarch64.rpm: The requested URL returned error: 503. Can we add something like retry to avoid this kind of error? Thanks.
For example:
https://artifacts.osci.redhat.com/testing-farm/5829666b-7144-4c15-bdc2-cfaae71dd0f1/
https://artifacts.osci.redhat.com/testing-farm/58eeb608-fa95-40e5-952b-41154ebb9e6c
https://artifacts.osci.redhat.com/testing-farm/1daee862-99fa-4e0f-8948-ac71aa6463b8/
https://artifacts.osci.redhat.com/testing-farm/c75f6d84-5089-46c1-ad3d-b56107493fd7/
https://artifacts.osci.redhat.com/testing-farm/d73175e8-a849-4f11-adcc-dddc0b21d46d/
https://artifacts.osci.redhat.com/testing-farm/b6af1d03-6a42-4b0d-b764-dc215c47fec7/
mvo5 added a commit to mvo5/bootc-image-builder that referenced this issue Feb 17, 2025
@mvo5
main: switch to librepo by default
c0d2bd0 
When building the anaconda-iso from centos or fedora there is
a high chance to hit a bad mirror. The libcurl method is not
able to fallback to different mirrors so the user experience
is bad. Switch to librepo by default therefore.

Closes: osbuild#835
@mvo5 mvo5 linked a pull request Feb 17, 2025 that will close this issue
Draft
@mvo5
Copy link
Collaborator

mvo5 commented Feb 17, 2025

Thanks for the problem report. We noted this as well and we believe that switching from "plain" libcurl to librepo as the download backend will fix the problem. Bib has supoort for this since a couple of weeks and we use it in our own CI since and it seems to be working quite well.

However (and the reason why we have not switched to librepo by default) - we do not have good coverage for subscribed content in our own integration tests. If we have coverage for building isos from subscribed content in the downstream tests that would be great and then I can undraft #840

@ondrejbudai
Copy link
Member

@henrywang actually, I think we can use your help here. Can you test that --use-librepo works fine with RHEL-based anaconda-iso (when subscriptions are involved). If you could somehow verify it in your team's testing pipelines, we can then switch --use-librepo to be on by default, and this would fix the CentOS Issues. Thanks! ❤

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

main: switch to librepo by default mvo5/bootc-image-builder
3 participants
@ondrejbudai @henrywang @mvo5