Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weird Request: Getting the watching/bookmark of an artist #515

Closed
4 tasks done
DonaldTsang opened this issue Dec 13, 2019 · 8 comments
Closed
4 tasks done

Weird Request: Getting the watching/bookmark of an artist #515

DonaldTsang opened this issue Dec 13, 2019 · 8 comments

Comments

@DonaldTsang
Copy link

DonaldTsang commented Dec 13, 2019

I would like to get a list of other artists that an artists like.

  • deviantArt
    https://www.deviantart.com/<username>/about#watching and hit the "load more" button repeatedly to get all the artists list.
    Challenge: Download user favorites (and create recommendations) kent-lee/deviantart-scraper#2 (comment)
    The list will be in the href of div#watchig div div div span a and the button is at div#watchig div button
  • Pixiv
    https://www.pixiv.net/bookmark.php?id=<some_id>&type=user&p=<page_num>
    Challenge: Download user favorites (and create recommendations) kent-lee/pixiv-scraper#1 (comment)
    The links will be in the href of the <a> element following ul[type="following"] li[type="following"] a and the name will be at ul[type="following"] li[type="following"] div div a div
  • FurAffinity
    http://www.furaffinity.net/watchlist/by/<usernaeme>/<page_num>
    Everything is in the href at tr td a and name is in tr td a span
  • InkBunny
    https://inkbunny.net/usersviewall.php?mode=watching&user_id=<come_id>&page=<page_num>&namesonly=yes
    Everything is in tr td span.widget_userNameSmall a.widget_userNameSmall (either href or name)
@mikf
Copy link
Owner

mikf commented Jan 5, 2020

Not sure if GitHub sends notifications to relevant users if a commit references a specific issue, but in case it doesn't: The new version supports listing followed users for Pixiv and DeviantArt with the URL patterns listed by you. Use -g or parse the output of -j to get the URLs of followed users:

$ gallery-dl -g "https://www.pixiv.net/bookmark.php?id=173530&type=user"
https://www.pixiv.net/member.php?id=1853563
https://www.pixiv.net/member.php?id=3172
…
https://www.pixiv.net/member.php?id=36199
https://www.pixiv.net/member.php?id=45833

@DonaldTsang
Copy link
Author

DonaldTsang commented Jan 6, 2020

Added Inkbunny name list as a feature request, also thanks for the updates on Pixiv and dA.

@catlover1019
Copy link

Any news on implementing this for inkbunny?

@mikf
Copy link
Owner

mikf commented Oct 13, 2021

@catlover1019 inkbunny got done as well (e9dc6ff), although this uses the website directly instead of the API, which is used for everything else on that site.

Do you (or anybody else) know if there are private/protected follower lists on inkbunny that would need a login? At least for your own account's watched users there's an API method that could be used.

@catlover1019
Copy link

awesome :3

And I think besides some userpages being themselves restricted to logged-in users, all follwers and following are public.

@mikf mikf closed this as completed Oct 26, 2021
@DonaldTsang
Copy link
Author

@mikf for clarification, are there any way of dumping this data into a text file or a json file?

@Hrxn
Copy link
Contributor

Hrxn commented Nov 11, 2021

The Metadata? You can use the Metadata postprocessor.

@mikf
Copy link
Owner

mikf commented Nov 11, 2021

You can also use -g for plain text or -j for JSON in combination with > to write that to a file:

$ gallery-dl -g "URL" > links.txt
$ gallery-dl -j "URL" > data.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants