Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DeviantArt] "NotFoundError: Requested deviation could not be found" #2981

Closed
BoostHellSix66 opened this issue Sep 28, 2022 · 9 comments
Closed

[DeviantArt] "NotFoundError: Requested deviation could not be found" #2981

BoostHellSix66 opened this issue Sep 28, 2022 · 9 comments
Labels
site:change

Comments

@BoostHellSix66
Copy link

BoostHellSix66 commented Sep 28, 2022 •
edited
Loading

Preface this with that I'm new to github so I may not be aware of certain etiquette.

To begin, I'm not sure if it's just me or something with DeviantArt recently. I was downloading images with the images individual link, and not through a mass download of one user, and it functioned normally this morning. However later in the day I go to download again and I'm now getting:
[deviantart][error] NotFoundError: Requested deviation could not be found

Yet, I can still mass download a users profile. So it seemingly has something to do with individual image URL's.

I checked my client-id and client-secret to see if it may be that. I removed and reregistered the app in deviantart. Cleared any existing cache and reran OAuth. Nothing.

Here's the output from using the verbose flag:

[gallery-dl][debug] Version 1.23.1 - Executable
[gallery-dl][debug] Python 3.7.9 - Windows-10-10.0.19041
[gallery-dl][debug] requests 2.28.1 - urllib3 1.26.12
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using custom API credentials (client-id *****)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/werol HTTP/1.1" 200 1516
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /_napi/da-browse/shared_api/deviation/extended_fetch?deviationid=50528766&username=werol&type=art&include_session=false HTTP/1.1" 200 134
[deviantart][error] NotFoundError: Requested deviation could not be found

Not sure if this has something to do with DeviantArts API going screwy lately or something I screwed up. Any help is greatly appreciated.
@Telkhine
Copy link

I can confirm that I'm also seeing this behavior:

gallery-dl -v https://www.deviantart.com/werol/art/Heaven-help-50528766
[gallery-dl][debug] Version 1.23.0
[gallery-dl][debug] Python 3.10.7 - Linux-5.19.11-arch1-1-x86_64-with-glibc2.36
[gallery-dl][debug] requests 2.28.1 - urllib3 1.26.11
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using custom API credentials (client-id *****)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/werol HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 1s delay.
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/werol HTTP/1.1" 200 1516
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /_napi/da-browse/shared_api/deviation/extended_fetch?deviationid=50528766&username=werol&type=art&include_session=false HTTP/1.1" 200 134
[deviantart][error] NotFoundError: Requested deviation could not be found

Happened when I upgraded to 1.23.1 as well.

mikf added a commit that referenced this issue Sep 29, 2022
@mikf
[deviantart] fix extraction (#2981, #2983)
6c76b5f 
send a 'csrf_token' with every Eclipse API request
@mikf
Copy link
Owner

mikf commented Sep 29, 2022

Fixed in commit 6c76b5f.

DeviantArt now requires a CSRF token for every request to their Eclipse API, which affects individual images, scraps, and followed users.

@Tekforce12
Copy link

hi. how do i send the CSRF token? i'm new to this.

@Telkhine
Copy link

hi. how do i send the CSRF token? i'm new to this.

The commit mikf mentioned fixed the issue for me. I didn't have to add any additional configuration.

@BoostHellSix66
Copy link
Author

hi. how do i send the CSRF token? i'm new to this.

Go here and download the relevant version for your system, if you use the executable version.

@mikf mikf mentioned this issue Oct 4, 2022
Closed
@BoostHellSix66
Copy link
Author

Same Issue popped up again. Here's an output example from using --verbose. Could be the CSRF tokens again?

gallery-dl --verbose https://www.deviantart.com/kymg/art/RoopRoom-103284434
[gallery-dl][debug] Version 1.23.2 - Executable
[gallery-dl][debug] Python 3.7.9 - Windows-10-10.0.19041
[gallery-dl][debug] requests 2.28.1 - urllib3 1.26.12
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/kymg/art/RoopRoom-103284434'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/kymg/art/RoopRoom-103284434'
[deviantart][debug] Using custom API credentials (client-id *****)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/kymg HTTP/1.1" 200 355
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /KYMG/art/103284434 HTTP/1.1" 200 None
[deviantart][error] NotFoundError: Requested deviation could not be found

@BoostHellSix66 BoostHellSix66 reopened this Oct 5, 2022
@Telkhine
Copy link

Telkhine commented Oct 5, 2022

Same issue on my end, with the latest build:

[gallery-dl][debug] Version 1.23.3-dev
[gallery-dl][debug] Python 3.10.7 - Linux-5.19.11-arch1-1-x86_64-with-glibc2.36
[gallery-dl][debug] requests 2.28.1 - urllib3 1.26.12
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/werol/art/Heaven-help-50528766'
[deviantart][debug] Using custom API credentials (client-id *****)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/werol HTTP/1.1" 200 1517
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /werol/art/50528766 HTTP/1.1" 200 None
[deviantart][error] NotFoundError: Requested deviation could not be found

mikf added a commit that referenced this issue Oct 5, 2022
@mikf
[deviantart] fix 'deviation' extraction (#2981)
a12ce2b
@mikf
Copy link
Owner

mikf commented Oct 5, 2022

Could be the CSRF tokens again?

This time they removed the da:appurl entry from their site,
which gallery-dl was relying on to get a deviation's UUID.

Fixed in a12ce2b, by the way.

@BoostHellSix66
Copy link
Author

It worked! Thanks.

gallery-dl --verbose https://www.deviantart.com/kymg/art/RoopRoom-103284434
[gallery-dl][debug] Version 1.23.3-dev - Executable
[gallery-dl][debug] Python 3.10.7 - Windows-10-10.0.19044-SP0
[gallery-dl][debug] requests 2.28.1 - urllib3 1.26.12
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/kymg/art/RoopRoom-103284434'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/kymg/art/RoopRoom-103284434'
[deviantart][debug] Using custom API credentials (client-id *****)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/kymg HTTP/1.1" 200 355
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /KYMG/art/103284434 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/6396FD6D-59A8-CBE6-4352-176DF86921F7 HTTP/1.1" 200 1354
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/6396FD6D-59A8-CBE6-4352-176DF86921F7?mature_content=true HTTP/1.1" 200 591
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): wixmp-ed30a86b8c4ca887773594c2.wixmp.com:443
[urllib3.connectionpool][debug] https://wixmp-ed30a86b8c4ca887773594c2.wixmp.com:443 "GET /f/1201ca62-2080-486f-8340-b29fdb44a805/d1phqs2-a54324e7-93c3-4c33-968a-6923b760c368.jpg?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ1cm46YXBwOjdlMGQxODg5ODIyNjQzNzNhNWYwZDQxNWVhMGQyNmUwIiwiaXNzIjoidXJuOmFwcDo3ZTBkMTg4OTgyMjY0MzczYTVmMGQ0MTVlYTBkMjZlMCIsImV4cCI6MTY2NDk5OTQzMiwiaWF0IjoxNjY0OTk4ODIyLCJqdGkiOiI2MzNkZGRiMGYxMzJiIiwib2JqIjpbW3sicGF0aCI6IlwvZlwvMTIwMWNhNjItMjA4MC00ODZmLTgzNDAtYjI5ZmRiNDRhODA1XC9kMXBocXMyLWE1NDMyNGU3LTkzYzMtNGMzMy05NjhhLTY5MjNiNzYwYzM2OC5qcGcifV1dLCJhdWQiOlsidXJuOnNlcnZpY2U6ZmlsZS5kb3dubG9hZCJdfQ.Pr-pWPvPQgSThJiCfhujV0bwMofVWmrMu3lvP5EQqW4 HTTP/1.1" 200 335920
* .\gallery-dl\deviantart\KYMG\deviantart_103284434_RoopRoom.jpg

@mikf mikf mentioned this issue Oct 6, 2022
Closed
@mikf mikf mentioned this issue Nov 18, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
site:change
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@Telkhine @mikf @BoostHellSix66 @Tekforce12