Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeviantArt: Suddenly API responded with 400 Bad Request #1267

Closed
Venom-KL opened this issue Jan 23, 2021 · 0 comments
Closed

DeviantArt: Suddenly API responded with 400 Bad Request #1267

Venom-KL opened this issue Jan 23, 2021 · 0 comments
Labels

Comments

@Venom-KL
Copy link

Since several `days, I run into this new issue without having changed anything. The refresh token are also up to date after running the oath: DeviantArt command.

    "extractor":
    {
        "base-directory": "./gallery-dl/",
        "postprocessors": null,
        "archive": null,
        "cookies": null,
        "cookies-update": false,
        "proxy": null,
        "skip": true,
        "sleep": 0,
        "path-restrict": "auto",
        "path-remove": "\\u0000-\\u001f\\u007f",
        "user-agent": "Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0", 

        "deviantart":
        {
            "postprocessors": [{
                "name": "metadata",
                "directory": "metadata"
                               }],
            "directory": ["DeviantArt", "{author[username]}"],
            "extra": true,
            "folders": false,
            "flat": true,
            "journals": "html",
            "mature": false,
            "metadata": true,
            "original": true,
            "quality": 100,
            "wait-min": 0,
            "filename": "{date:%Y%m%d}_{filename} - {title}.{extension}",
            "client-id": "<hidden>",
            "client-secret": "<hidden>",
            "refresh-token": "<hidden>"
        }, } }

For example, running this command gallery-dl.exe "https://www.deviantart.com/search/deviations?order=popular-all-time&q=Ferrari%20F310" with the verbose flag in the terinal, yields me the following log message:

H:\>gallery-dl.exe "https://www.deviantart.com/search/deviations?order=popular-all-time&q=Ferrari%20F310" --verbose
[gallery-dl][debug] Version 1.16.3
[gallery-dl][debug] Python 3.7.9 - Windows-10-10.0.18362
[gallery-dl][debug] requests 2.25.1 - urllib3 1.25.11
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/search/deviations?order=popular-all-time&q=Ferrari%20F310'
[deviantart][debug] Using DeviantartPopularExtractor for 'https://www.deviantart.com/search/deviations?order=popular-all-time&q=Ferrari%20F310'
[deviantart][debug] Using custom API credentials (client-id 12315)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/browse/popular?q=Ferrari+F310&offset=0&limit=120&timerange=alltime&mature_content=true HTTP/1.1" 200 None
[deviantart][debug] Switching to private access token
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/browse/popular?q=Ferrari+F310&offset=0&limit=120&timerange=alltime&mature_content=true HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=F197A434-805A-3A62-AD8F-BCF8E8AB38FC&deviationids%5B1%5D=AA8E0AAE-376C-DE30-627A-84EE8D1631BF&deviationids%5B2%5D=F9C75F01-F36B-C95B-6A14-FDA09CEA2FE3&deviationids%5B3%5D=C36F9227-BE2A-F23D-B8E0-7D970FDDB7FB&deviationids%5B4%5D=1414E521-A2D6-A028-2293-AAA736246408&deviationids%5B5%5D=D48232BE-60C5-64AD-6117-AD9221B5A9D5&deviationids%5B6%5D=E6C98F57-98F0-138F-61D4-4647F2DECB89&deviationids%5B7%5D=459261FE-F76F-4247-AD86-69CB62E962FF&deviationids%5B8%5D=0E5D4011-FCC2-F329-56E2-341FB6EA7EB5&deviationids%5B9%5D=1039DAB0-5CD3-803A-AA14-7FAF2D331560&deviationids%5B10%5D=641288BC-6B49-5BD1-F50B-153A79583D0E&deviationids%5B11%5D=D2079AF8-15B4-16C9-7012-73E87D8FC7CE&deviationids%5B12%5D=AA952A32-93D6-A372-C28F-17E07B57954E&deviationids%5B13%5D=B728CE3D-8ABA-0AFB-CD2E-B34EAF7ACAFD&deviationids%5B14%5D=226037CA-BC74-24C1-7E02-A43B7A436DBD&deviationids%5B15%5D=FDA8ADD6-C4FA-87BC-8A30-AFE81AFF218E&deviationids%5B16%5D=7D42165F-0720-4F86-E033-3B8A682C790A&deviationids%5B17%5D=67D9AE8A-DD16-9D8F-B8F3-968697F94D6B&deviationids%5B18%5D=F5728F5E-0719-DDD9-B3FB-BD6EF8235C0F&deviationids%5B19%5D=B5E6BD3B-DF85-C0E4-1F28-4882125D30CC&deviationids%5B20%5D=8FF17C72-EDA4-FDF8-228A-64CD1C42F058&deviationids%5B21%5D=345017CC-41E6-DEB6-8154-75C2CE334211&deviationids%5B22%5D=DB551BA7-C2CC-3DF3-72BA-674319A623C8&deviationids%5B23%5D=CCC9B905-15DA-520A-E064-9E7277381917&deviationids%5B24%5D=B2E41BCA-75BA-7795-DFA8-2E55891D0843&deviationids%5B25%5D=7ED20D26-EDEE-64F5-4520-B5A1276D4532&deviationids%5B26%5D=39727CE2-1DCC-F6E8-055C-E9CF2A2D61EE&deviationids%5B27%5D=0C672AB1-0782-3E3B-41F5-D499B4CFE6F9&deviationids%5B28%5D=4492FE1E-1417-257A-922F-ED1AA0BEBD9E&deviationids%5B29%5D=3903E426-9294-390C-D4AC-CE7B095E2FC0&deviationids%5B30%5D=E91078E3-283F-0CA2-978A-C7BF66E3D441&deviationids%5B31%5D=F6AA188B-22AF-AA77-C223-CBB2F6FD6DD5&deviationids%5B32%5D=81768E4B-C8D8-363A-4162-3A97C9AC40D7&deviationids%5B33%5D=3151A0E0-95BE-F03D-475E-369CB65138AC&deviationids%5B34%5D=D3A6AF1F-9770-6D3E-F9CA-86D663A5C3A2&deviationids%5B35%5D=7E1637D5-BB71-84B5-4EE3-00BEF4051E43&deviationids%5B36%5D=9419E84A-EA75-18CD-F12E-C49438EDF2C9&deviationids%5B37%5D=E010DDBC-40D5-64EB-7DE7-DAD7CCEFEC57&deviationids%5B38%5D=088C658F-6F81-7753-3E98-4B0176C1CB68&deviationids%5B39%5D=0019D31D-91CA-D473-6A4A-617CBB3D75BF&deviationids%5B40%5D=B5FE7172-42D5-FB75-0E34-5A69CDC93CA8&deviationids%5B41%5D=2F8049BD-13AE-593F-65F5-CF8055F07FBC&deviationids%5B42%5D=307503AD-B952-9669-200D-7B8E5396C05D&deviationids%5B43%5D=C4F1B5A5-AA0B-8C06-3FDB-B9575A673BAC&deviationids%5B44%5D=F721E6CD-6F66-4C3A-1C26-A09394243D36&deviationids%5B45%5D=BC957DCB-D01A-F1F1-7B8D-F50C77D202F1&deviationids%5B46%5D=4A3FEB04-BF1A-CB53-BCD2-C21E07EEE6B0&deviationids%5B47%5D=660C2FDF-CF99-3E91-F44C-8707424118C3&deviationids%5B48%5D=2D22E7DE-E232-FB85-3B0D-B7157666DE73&deviationids%5B49%5D=F283DFD2-7E17-E4F4-23A5-0B34893D6393&deviationids%5B50%5D=23A740D6-46E0-740A-BB51-49AD82DA6A52&deviationids%5B51%5D=A638FB0B-3AFE-FD09-47E5-ACF8BBEE30F8&deviationids%5B52%5D=38D28316-F4D8-6BB2-8074-54F75BC9BB8A&deviationids%5B53%5D=6EB6AB85-CE4F-BF7B-239A-A3B4ACA698D7&deviationids%5B54%5D=E4303019-4888-77AA-2B43-7CC87F0E2C2B&deviationids%5B55%5D=099BFD73-1C5F-F41E-9388-DF0CE78FC0E1&deviationids%5B56%5D=671D0C94-C79C-1C21-7DC2-7D5C3D229ADE&deviationids%5B57%5D=0FEC72C1-4127-8226-DF9E-F36EB962FBC4&deviationids%5B58%5D=349612E5-D65B-5C6F-0D15-CA095A47E7FA&deviationids%5B59%5D=BDB0435B-0682-6F5E-0CF0-C8F2792CB1A7&deviationids%5B60%5D=D6FA8461-9D1C-5300-0FE0-A97005E40805&deviationids%5B61%5D=CAF4E06D-3414-B349-846A-18097076FA27&deviationids%5B62%5D=77606306-FBD9-B05A-22F6-28F4B5327C39&deviationids%5B63%5D=1B18E527-D9C7-B7F2-0998-0C9099252D90&deviationids%5B64%5D=B5B8481F-2B58-C2BF-D3E5-9F3173589E31&deviationids%5B65%5D=64AB9432-820E-87C3-022E-89D66C262B04&deviationids%5B66%5D=2058406B-D95E-5418-C19D-C5CCA31D123F&deviationids%5B67%5D=9EE90590-5862-422B-CF4F-968982FC862F&deviationids%5B68%5D=4AE672BB-54E6-7659-5B37-B51CA7CC8C55&mature_content=false HTTP/1.1" 400 110
[deviantart][debug] {"error":"invalid_request","error_description":"Cannot query that many deviations.","error_code":0,"status":"error"}
[deviantart][error] API responded with 400 Bad Request
[deviantart][error] An unexpected error occurred: KeyError - 'metadata'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[deviantart][debug]
Traceback (most recent call last):
  File "gallery_dl\job.py", line 68, in run
    self.status |= 128
  File "gallery_dl\extractor\deviantart.py", line 82, in items
    url, data = deviation
  File "gallery_dl\extractor\deviantart.py", line 1095, in _pagination
    endpoint = "da-browse/shared_api/deviation/extended_fetch"
  File "gallery_dl\extractor\deviantart.py", line 1112, in _metadata
    return self._pagination(endpoint, params)
  File "gallery_dl\extractor\deviantart.py", line 980, in deviation_metadata
    _refresh_token_cache.update(refresh_token, data["refresh_token"])
KeyError: 'metadata'

I would appreciate the help. It probably is a small error, but one I'm unable to find out.

@mikf mikf added the bug label Jan 23, 2021
@mikf mikf closed this as completed in c6cc86d Jan 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants