Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automated solution to address 403 error downloading tLD.zip from akamaized #50

Open
jpiesing opened this issue Jun 2, 2023 · 11 comments
Open

Automated solution to address 403 error downloading tLD.zip from akamaized #50

jpiesing opened this issue Jun 2, 2023 · 11 comments
Assignees
@nlsdvl
Labels
Deferred Deferred to future work

Comments

@jpiesing
Copy link
Contributor

jpiesing commented Jun 2, 2023

While doing a clean re-install, the import.sh script reports errors as follows;

Could not load http url: https://dash.akamaized.net/WAVE/vectors/cfhd_sets/12.5_25_50/tLD/2023-04-28/tLD.zip
Could not load http url: https://dash.akamaized.net/WAVE/vectors/cfhd_sets/15_30_60/tLD/2023-04-28/tLD.zip

Either the URL for the segment zip file in database.json is wrong or access to that file is blocked because downloading at URL fails as follows.

wget https://dash.akamaized.net/WAVE/vectors/cfhd_sets/12.5_25_50/tLD/2023-04-28/tLD.zip
--2023-06-02 16:20:51-- https://dash.akamaized.net/WAVE/vectors/cfhd_sets/12.5_25_50/tLD/2023-04-28/tLD.zip
Resolving dash.akamaized.net (dash.akamaized.net)... 81.243.1.66, 81.243.1.88
Connecting to dash.akamaized.net (dash.akamaized.net)|81.243.1.66|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-06-02 16:20:53 ERROR 403: Forbidden.
@nicholas-fr
Copy link

For larger files I believe https://dash-large-files.akamaized.net/ must be used.

The following work:
https://dash-large-files.akamaized.net/WAVE/vectors/cfhd_sets/12.5_25_50/tLD/2023-04-28/tLD.zip
https://dash-large-files.akamaized.net/WAVE/vectors/cfhd_sets/15_30_60/tLD/2023-04-28/tLD.zip

@jpiesing jpiesing mentioned this issue Jun 2, 2023
Closed
@jpiesing
Copy link
Contributor Author

jpiesing commented Jun 2, 2023

For larger files I believe https://dash-large-files.akamaized.net/ must be used.

The following work: https://dash-large-files.akamaized.net/WAVE/vectors/cfhd_sets/12.5_25_50/tLD/2023-04-28/tLD.zip https://dash-large-files.akamaized.net/WAVE/vectors/cfhd_sets/15_30_60/tLD/2023-04-28/tLD.zip

In that case it's a bug in database.json - the wrong URL is included.

@nicholas-fr
Copy link

OK, to determine which URL should be used: https://dash-large-files.akamaized.net/ is for files over 1.8GB.

@rbouqueau
Copy link
Collaborator

Can't we just use https://dash-large-files.akamaized.net to serve all files? Do you know what difference it would make?

@rbouqueau
Copy link
Collaborator

Can't we just use https://dash-large-files.akamaized.net/ to serve all files? Do you know what difference it would make?

@gitwjr
Copy link

gitwjr commented Aug 1, 2023

Not resolved as of Aug 8, 2023.

@jpiesing jpiesing mentioned this issue Oct 18, 2023
Closed
@jpiesing
Copy link
Contributor Author

Can't we just use https://dash-large-files.akamaized.net/ to serve all files? Do you know what difference it would make?

I have no idea as I wasn't involved when this was setup.

@wilaw Do you know the answer to Romain's question?

@jpiesing jpiesing reopened this Oct 25, 2023
@jpiesing
Copy link
Contributor Author

Manually editing database.json isn't safe as a long term solution so re-opening.

@gitwjr gitwjr added the Blocker Fix before launch label Oct 30, 2023
@gitwjr
Copy link

gitwjr commented Oct 30, 2023

If this issue remains, it is a blocker.

@gitwjr gitwjr changed the title 403 when downloading tLD.zip from akamaized Automated solution to address 403 error downloading tLD.zip from akamaized Dec 5, 2023
@gitwjr gitwjr added Deferred Deferred to future work and removed Blocker Fix before launch labels Dec 5, 2023
@gitwjr
Copy link

gitwjr commented Dec 5, 2023

Renamed issue. Remove blocker.

@gitwjr gitwjr closed this as completed Dec 5, 2023
@gitwjr gitwjr reopened this Dec 5, 2023
@nlsdvl nlsdvl assigned nlsdvl and unassigned rbouqueau Dec 10, 2024
@nlsdvl nlsdvl mentioned this issue Dec 10, 2024
Closed
@nlsdvl
Copy link
Collaborator

nlsdvl commented Dec 10, 2024

See the pull request for an updated database file using 'https://dash-large-files.akamaized.net/'.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nlsdvl nlsdvl

Labels
Deferred Deferred to future work
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

update db to use dash-large-files.akamaized.net cta-wave/Test-Content
5 participants
@rbouqueau @nlsdvl @jpiesing @nicholas-fr @gitwjr