Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to force redownload #986

Closed
kattjevfel opened this issue Sep 9, 2020 · 7 comments
Closed

Option to force redownload #986

kattjevfel opened this issue Sep 9, 2020 · 7 comments

Comments

@kattjevfel
Copy link
Contributor

Looked for an existing issue but couldn't find any.
When downloading a file that already exists in either archive or on disk, the only option currently is either to delete the file or if using archive, grab some db software or temporarily move the db file.

I'd like to request a feature to "force" re-downloading the file anyway, something like --force or so.

@mikf
Copy link
Owner

mikf commented Sep 10, 2020

You can tell it to not skip downloads of existing files: extractor.skip
(-o skip=false on command line)

@mikf mikf closed this as completed in abda352 Sep 11, 2020
@glottisfaun0000
Copy link

You can tell it to not skip downloads of existing files: extractor.skip (-o skip=false on command line)

I came across a problem with this - it forces the download of the imgur "The image you are re questing does not exist or is no longer available." png for expunged images which would originally have been skipped with "imgur: HttpError: '404 Not Found"

@Hrxn
Copy link
Contributor

Hrxn commented Aug 27, 2024

Okay, but why would you want to re-download stuff from Imgur with skip=false that's not even there anymore?

I mean, I see this as a purely theoretical issue, so far.

@mikf
Copy link
Owner

mikf commented Aug 27, 2024

@glottisfaun0000
Could a provide an example of such an imgur post that downloads a "The image you are re questing does not exist or is no longer available." png?

https://i.imgur.com/removed.png do not get downloaded anymore since v1.26.9 (5842e49), but maybe something changed on imgur's end.

@glottisfaun0000
Copy link

Okay, but why would you want to re-download stuff from Imgur with skip=false that's not even there anymore?

I mean, I see this as a purely theoretical issue, so far.

I encountered this downloading a subreddit (or reddit search), which saved to archive, then the files got messed up so I had to redo the download with -o skip=false

@glottisfaun0000 Could a provide an example of such an imgur post that downloads a "The image you are re questing does not exist or is no longer available." png?

https://i.imgur.com/removed.png do not get downloaded anymore since v1.26.9 (5842e49), but maybe something changed on imgur's end.

Here, NSFW subreddit warning-

gallery-dl -v
gallery-dl: Version 1.27.3
gallery-dl --directory ./ -o skip=false https://old.reddit.com/r/kpopfap/comments/14y80zx/nmixx_sullyoon/
imgur: HttpError: '404 Not Found' for 'https://api.imgur.com/post/v1/media/UV9WpZM?include=media%2Ctags%2Caccount'
./14y80zx NMIXX - Sullyoon.png

Saves removed.png as 14y80zx NMIXX - Sullyoon.png

Definitely a rare issue to encounter, but imgur does change takedown policy over time so could happen more often. It was trivial to cleanup with fdupes. It was just one situation where a --skip-archive option would have been useful, or maybe just the option to leave --download-archive blank. Of course one can also just specify a new temp archive too.

@Hrxn
Copy link
Contributor

Hrxn commented Aug 28, 2024

--archive="" is basically the same thing as a theoretical --skip-archive

@glottisfaun0000
Copy link

--archive="" is basically the same thing as a theoretical --skip-archive

That's good to know, I had only tried it with no argument. Works great 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants