Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deviantart behaviour #721

Closed
Butterfly-Dragon opened this issue Apr 30, 2020 · 4 comments
Closed

deviantart behaviour #721

Butterfly-Dragon opened this issue Apr 30, 2020 · 4 comments

Comments

@Butterfly-Dragon
Copy link

i get the following on all deviantart galleries

[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/chocolatekeys/gallery/all'
[deviantart][debug] Using DeviantartGalleryExtractor for 'https://www.deviantart.com/chocolatekeys/gallery/all'
[deviantart][debug] Using default API credentials (client-id 5388)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/chocolatekeys HTTP/1.1" 200 356
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=ChocolateKeys&offset=0&limit=24&mature_content=true HTTP/1.1" 200 None
[deviantart][debug] Using download archive 'D:/Downloads/Downloader//!Downloader/archive.sqlite3'
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/BEC3C4CF-2F43-CD48-A5EB-C4D02B14594A?mature_content=true HTTP/1.1" 200 505
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/69ECDFA4-3D94-4D70-9182-D193A25B58CD?mature_content=true HTTP/1.1" 200 505
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/436003E0-9E3B-B933-DA1F-87D093A16ED5?mature_content=true HTTP/1.1" 200 504

along with comments that it needs to retry downloading with increasingly long times

sometimes i have to stop everything because it tries to download every 4096 seconds... which is... absurd.

i tried to limit it in the extractor options but it does not seem to follow it:

        "deviantart":
        {
            "filename": "{username} - {title}.{extension}",
            "extra": false,
            "flat": true,
            "folders": false,
            "journals": "none",
            "mature": true,
            "metadata": false,
            "original": true,
            "quality": 100,
	        "wait-min": 0,
	        "wait-max": 8
        },
@mikf
Copy link
Owner

mikf commented Apr 30, 2020

wait-max isn't available here, but I've now limited the maximum wait time to 512 seconds / 8 minutes.

You should get your own dA API credentials to avoid those wait times in the first place:
https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst#extractordeviantartclient-id--client-secret

@Butterfly-Dragon
Copy link
Author

i left DA for various personal reasons, i did not wish to try and re-go there

@biznizz
Copy link

biznizz commented May 2, 2020

It is the best way to rip DA galleries/submissions, but I can understand.

You can make a dummy account, then publish the app there, and put the credentials into your config file. Other than possible maintenance (exporting cookies every so often), you won't have to interact with any user/staff than you need to.

@Butterfly-Dragon
Copy link
Author

yeah, i will probably do that at some point... did the same for tumblr and pixiv anyway.

@mikf mikf closed this as completed May 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants