[Site Support Request] SubscribeStar

[biznizz]

https://subscribestar.adult/

A NSFW Patron site where people who have been removed/taken off Patreon due to revisions of their terms & conditions can post content for tiered subscribers.

[mikf]

This is just the adult version of the regular https://www.subscribestar.com/ and any code for one should theoretically work for the other as well, right?

Also, do you know of any accounts that have at least some of there works available for free, for testing purposes etc.

[biznizz]

Yeah, it looks like they're connected. I used my .adult credentials on .com and logged in. I had to log onto .com and .adult separately tho. Weird.

As for a test, I found this on the front page for .com, some stuff locked and some stuff free. https://www.subscribestar.com/dreamkeepers

Here's one for .adult, just in case: https://subscribestar.adult/kanashiipanda
(Hard to find an adult subscribestar with some free stuff that isn't locked, lol).

[mikf]

I've added some extractors for users and individual posts: 821524e. Could you test them and let me know if everything works, something is missing, etc.?

Login with username & password should theoretically be possible since the login page doesn't have a CAPTCHA (for now), but that's not implemented at the moment. You'll have to export your cookies for the time being.

I've had some trouble getting date information to work. For some reason the dates in post listings on e.g. https://www.subscribestar.com/dreamkeepers don't have a year in them, even if they are from one or two years ago. For the time being you can enable the metadata option if you need a date metadata field, but that'll do an extra HTTP request for each post.

[biznizz]

Ooh...

So, creating a new entry in the config with these credentials

"subscribestar":
		{
		    "cookies": "C:\\Users\\USER\\cookies.txt",
			"cookies-update": true
		},

And exporting all subscribestar.com and subscribestar.adult cookies into a valid cookies.txt file, I was able to download all images that are unlocked at the tier of the Star that I'm subscribed to.

Excellent work!

EDIT: Can confirm that extractor works for both user and a locked individual post on a subscribed Star page.

I'm not sure about all the metadata stuff though, but all the downloaded images are in chronological order from first post to latest.

[shinji257]

I did a little digging and you just need the auth_token for subscribestar. This token is the same on both the normal and adult versions of the website.

[biznizz]

Welp, it looks like Patreon is starting to go full Tumblr with NSFW bans and other bullsh*ttery, so getting the extractor to SubscribeStar was damn good timing.

[Hrxn]

Wait, what? What the hell is going on?

[shinji257]

Not really on topic for the report here but I'll mention that there have been a rash of bans because patreon thinks the characters look too young (even though they don't) and for content not even posted on the service but maybe elsewhere. They send demands for the artist to remove content from third party sites or risk ban.

It isn't content that is nsfw that is the issue. It's anything on and off the platform that patreon thinks is violating their rules somehow.

[biznizz]

@shinji257 With at least one artist, they're assuming claim to the artist's entire portfolio as their own because the judged the artist's Patreon as a "project", and, yes, demanded they remove all of their NSFW art from other sites, even ones that predated the creation of the artist's Patreon. It's absolutely crazy.

Also, can confirm that the "only" cookie that's needed for extracting from Subscribestar is the auth_token, but it creates others thanks to cookies-update.

[biznizz]

So the login commit that's going to be added; will it be similar to, say, the way it's set up for Pixiv?

So that the structure for the extractor setting in the conf would look like

"subscribestar":
		{
		    "username": "USER",
		    "password": PASS
		},

Would that be more convenient that just using cookies? Or would you use both user/pass AND cookies?

[mikf]

Yep, it's similar to Pixiv or all other sites where login with username and password is supported. You can still directly use cookies like you have been, but the auth_token cookie seems to expire after ~1 month and you'd have to refresh it manually like with Patreon.

The config structure would be exactly like the one you posted, but it's your choice if you want to use that or keep using cookies like before.

[biznizz]

If the User/Pass is an option, I think I'd prefer it over the cookies since the auth-token has such a short expiry date.

When it's fully set up, I'll make the changes to the conf.

[biznizz]

Have tested the user/pass structure for Subscribestar; had to use my email as "username", but it worked.

[mikf]

had to use my email as "username"

That's for consistencies' sake (and because there is an internal function that handles "username" and "password" fetching).

All sites where login with "something"+password is supported use "username" and "password" as names for their config settings, even if those names don't always exactly match, but they are always the same two values you have to enter when logging in in a browser.

I think everything for SubscribeStar is done now, so I'm closing this issue.

[biznizz]

Cool, thanks!

I only brought up the email username thing since it might be something to mention since it might have caused confusion.

Thank you for all your hard work.

[biznizz]

I've noticed that gallery-dl doesn't grab any attachments that are made to posts.

Would it be possible to have the extractor grab attachments like the one for Patreon does?

[mikf]

Sure, but I'd need an example post to see how this is done on SubscribeStar. Either send me the HTML of a post page and user page per mail or PM on Gitter, or just the link if you have a free one (there aren't any attachments on https://www.subscribestar.com/subscribestar, right?)

[biznizz]

Have never used Gitter before, but I think I've started a private message with you. I sent you two txt files with the HTMLs of a user and direct post with an attachment.

[mikf]

Thanks for the examples! I hope 0d84d3a works in general (it did for your example post).

[biznizz]

Upgraded to latest dev build and tested it, the rar file from my examples also did download through user and post, so it looks like it worked!

Will let you know if there are any further issues!

[biznizz]

Have tried with a different Star. Attachment extraction works on both user and post. Only observation is that the attachments for the new test subject were all RAR files like the initial test. Not sure if other files like direct psd or clip attachments would work, but there should not be any reason for it not to.

As mentioned before, will report if this feature has any further issues.

[developerjohn99]

This isn't working for me.

It always says "No results" for me, as you can see here:

I am using my correct credentials and I have verified the URL is correct.

[biznizz]

This isn't working for me.

It always says "No results" for me, as you can see here:

I am using my correct credentials and I have verified the URL is correct.

I assume that you have a subscription to at least one of the tiers, exported your cookies to your cookies.txt, and then ran the command?

Because, just like you, I didn't get any results... because I have not subscribed to this person and they have everything behind the paywall.

[developerjohn99]

Yeah, I was subscribed but whoops, I didn't know you needed cookies and username and password provided.

All is working well now, thanks!

[Ark-kun]

Weirdly some of the posts have blurred images.

I've noticed that in the cases where it happens, the different URLs in metadata JSON are the same: gallery_preview_url == preview_url == url == https://aaaaaaaaaaaaaaaa.cloudfront.net/previews_v2/bbbbbbb

For working images, the URLs are usually like this:

    "gallery_preview_url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd-740x0.jpeg?EEE",
    "preview_url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd-1200x0.jpeg?EEE",
    "url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd.jpeg?EEE",

[biznizz]

Weirdly some of the posts have blurred images.

I've noticed that in the cases where it happens, the different URLs in metadata JSON are the same: gallery_preview_url == preview_url == url == https://aaaaaaaaaaaaaaaa.cloudfront.net/previews_v2/bbbbbbb

For working images, the URLs are usually like this:

    "gallery_preview_url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd-740x0.jpeg?EEE",
    "preview_url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd-1200x0.jpeg?EEE",
    "url": "https://aaa.cloudfront.net/uploads_v2/users/bbb/posts/ccc/ddd.jpeg?EEE",

Did you make sure to have both login in credentials (username & password) as well as exported browser cookies in a cookies.txt?

When I realized I accidentally moved my txt, I started getting blurred posts, but when I put it back to where config was pointing to, the blurred images were not downloaded, only the clear pics.

[CRONIX228]

how to use it

[infinitejesp]

Hello All, sorry to go digging, but I have followed what I think is the right path for adding login info AND cookie info, but no results.