[Request] "ci-en" Request to add a site #2885

ytoaa · 2022-09-02T02:17:11Z

https://ci-en.net/
It's a kind of sponsorship site that has images as well as images.

Aergernis · 2022-12-01T20:28:55Z

Would like to see support for this Site to

Eradicate2968 · 2023-03-04T11:26:51Z

I too would like to see this. After changes made on Pixiv last winter some authors have left to Ci-En

nomakewan · 2023-06-03T18:25:41Z

Want to update this issue to say I'd love to see support for ci-en.net and ci-en.dlsite.com added to gallery-dl as well.

angramainyuu · 2023-08-17T11:53:19Z

+1 , I don't think there's any downloaders for ci-en out there and it's a pain in the butt to download posts.

biggestsonicfan · 2024-01-10T17:36:49Z

Just FYI, in the <head> element of every article page is a <script type="application/ld+json"> which contains the entire article's contents in json format. Most of the relevant, downloadable, elements will be file-player-* classes located within the articleBody key.

Example article.

jamkinson · 2024-03-20T20:42:54Z

ci-en_dw.zip
My python is not so good, but I really needed to save the posts of one of the authors, perhaps my code will make it easier to understand the extraction of content from cien.

biggestsonicfan · 2024-03-21T03:13:39Z

ci-en_dw.zip My python is not so good, but I really needed to save the posts of one of the authors, perhaps my code will make it easier to understand the extraction of content from cien.

I don't have a jsessionid in my cookies, hmm... oh well, I changed the cookies to be able to import a cookies.txt file and I appear to have backed up paid content successfully! Thank you!

jamkinson · 2024-03-21T15:31:24Z

ci-en_dw.zip My python is not so good, but I really needed to save the posts of one of the authors, perhaps my code will make it easier to understand the extraction of content from cien.

I don't have a jsessionid in my cookies, hmm... oh well, I changed the cookies to be able to import a cookies.txt file and I appear to have backed up paid content successfully! Thank you!

biggestsonicfan · 2024-03-22T19:23:59Z

There's no jsessionid in Firefox, only Chrome.

jamkinson · 2024-03-23T08:24:21Z

Firefox also has "jsessionid", but it has a different hostname 'login.dlsite.com' vs 'ci-en.net'.

There's no jsessionid in Firefox, only Chrome.

biggestsonicfan · 2024-03-23T23:31:20Z

Ah, okay, I do see it now. The value was omitted from my "cookies.txt" file which I used with your script and I managed to successfully down paywalled content. Are you sure it's required?

I will experiment with manipulating my cookies.txt to find the minimum required variables.

biggestsonicfan · 2024-04-13T21:00:28Z

I can confirm on my end that running the download script with just ci_en_session manages to download exclusive works.

biggestsonicfan · 2024-04-14T21:45:33Z

I won't be able to verify support for much longer for paid posts. Visa and Mastercard are temporarily (most likely indefinitely) suspended from use as a payment method on the site.

Eradicate2968 · 2024-04-16T19:50:32Z

As someone new to python, how would I run this script?
I have installed python 3, managed to add my ci_en_session, and change the download directory.

But when i click on the script it just shows cmd for a second then nothing happens.

jamkinson · 2024-04-16T20:33:34Z

I can confirm on my end that running the download script with just ci_en_session manages to download exclusive works.

I think you're right, during testing in postman I couldn't get a list of authors I'm subscribed to without this cookie, but now all ok.

jamkinson · 2024-04-16T20:36:19Z

As someone new to python, how would I run this script? I have installed python 3, managed to add my ci_en_session, and change the download directory.

But when i click on the script it just shows cmd for a second then nothing happens.

just copy code into any IDE(ex pycharm) and run it

Eradicate2968 · 2024-04-17T19:56:01Z

I won't be able to verify support for much longer for paid posts. Visa and Mastercard are temporarily (most likely indefinitely) suspended from use as a payment method on the site.

with https://dl-pay.com/finish you can buy points for DLsite or Ci-en and then buy NSFW works.
MC/VISA/PayPal...

I just did it and it worked just fine.

Eradicate2968 · 2024-04-17T19:57:40Z

I've gotten it working, thanks.

It gets stuck and stops when encountering a zip download.

`Traceback (most recent call last):
  File "D:\Downloads\ci-en_dw\ci-en_dw.py", line 213, in <module>
    download_files(get_post_items(manual_creator_id, posts['post_id']), manual_creator_id, posts['post_id'])
  File "D:\Downloads\ci-en_dw\ci-en_dw.py", line 72, in download_files
    print(item['link'], filepath)
          ~~~~^^^^^^^^
KeyError: 'link'`

jamkinson · 2024-04-17T21:09:35Z

ci_en_session

I didn't problems downloading archives.
If you want, you can try to debug the code manually or using GPT chat.
or tell me your ci_en_session so that I can debug the code and fix the error
You can contact me via messenger (Session) my id: 054db7c0429dba41aa914895603be91abcc37cc9534fa9128da188a37846f87738

!!!Please note if you send me ci_en_session, I will have access to the posts of the authors you are subscribed to, do this only if you trust me.

Eradicate2968 · 2024-04-17T21:40:57Z

ci_en_session

I didn't problems downloading archives. If you want, you can try to debug the code manually or using GPT chat. or tell me your ci_en_session so that I can debug the code and fix the error You can contact me via messenger (Session) my id: 054db7c0429dba41aa914895603be91abcc37cc9534fa9128da188a37846f87738

!!!Please note if you send me ci_en_session, I will have access to the posts of the authors you are subscribed to, do this only if you trust me.

I forgot about GPT's coding abilities.
its recommended this and it works like a charm

def download_files(post_data, creator_id, post_id):
    base_folder = os.path.join(donwbload_folder, creator_id, post_id)
    pictures_folder = os.path.join(base_folder, 'pictures')
    videos_folder = os.path.join(base_folder, 'videos')
    other_files_folder = os.path.join(base_folder, 'other_files')
    description_folder = os.path.join(base_folder, 'description')

    os.makedirs(description_folder, exist_ok=True)
    with open(os.path.join(description_folder, 'description.json'), 'w', encoding='utf-8') as f:
        json.dump(post_data, f, ensure_ascii=False)

    for item in post_data['image_url']:
        filename, ext = os.path.splitext(os.path.basename(urllib.parse.urlparse(item['link']).path))
        filename_decoded = urllib.parse.unquote(filename)
        filename_with_num = f"{item['num']}_{filename_decoded}{ext}"
        filepath = os.path.join(pictures_folder, filename_with_num)
        os.makedirs(pictures_folder, exist_ok=True)
        print(item['link'], filepath)
        download_file(item['link'], filepath)

    for item in post_data['video_url']:
        filename, ext = os.path.splitext(os.path.basename(urllib.parse.urlparse(item['link']).path))
        filename_decoded = urllib.parse.unquote(filename)
        filename_with_num = f"{item['num']}_{filename_decoded}{ext}"
        filepath = os.path.join(videos_folder, filename_with_num)
        os.makedirs(videos_folder, exist_ok=True)
        print(item['link'], filepath)
        download_file(item['link'], filepath)

    if 'download_links' in post_data:
        for item in post_data['download_links']:
            if 'download_link' in item:
                filename, ext = os.path.splitext(os.path.basename(urllib.parse.urlparse(item['download_link']).path))
                filename_decoded = urllib.parse.unquote(filename)
                filename_with_num = f"{item['num']}_{filename_decoded}{ext}"
                filepath = os.path.join(other_files_folder, filename_with_num)
                os.makedirs(other_files_folder, exist_ok=True)
                print(item['download_link'], filepath)
                download_file(item['download_link'], filepath)

501stRookie · 2024-06-01T21:00:52Z

ci-en_dw.zip My python is not so good, but I really needed to save the posts of one of the authors, perhaps my code will make it easier to understand the extraction of content from cien.

I've tried using this, but it seems to just create a description.json and not download any of the images. I tested it using a free post and it downloaded the images fine, but when I attempted to download from a creator I subscribed too it did not work.

jamkinson · 2024-06-04T19:20:27Z

ci-en_dw.zip My python is not so good, but I really needed to save the posts of one of the authors, perhaps my code will make it easier to understand the extraction of content from cien.

I've tried using this, but it seems to just create a description.json and not download any of the images. I tested it using a free post and it downloaded the images fine, but when I attempted to download from a creator I subscribed too it did not work.

Unfortunately, without researching the problematic post, I cannot identify the reason.
Нou can contact me using the contacts above so that I can try to debug the code or you can use gpt chat for debugging.

SAI13103 · 2024-07-09T08:53:55Z

Unfortunately, without researching the problematic post, I cannot identify the reason. Нou can contact me using the contacts above so that I can try to debug the code or you can use gpt chat for debugging.

https://ci-en.dlsite.com/creator/22374/article/1119644
It seems that the manga in the post cannot be downloaded.

Hrxn · 2024-07-09T23:59:15Z

What did you expect? It's still not supported.

DisasterInbound · 2024-07-24T15:16:50Z

I'm here to also request cien support. It would be really helpful to download many posts with so many pictures like the link above. I'm unsure what would be needed to add support but if dev needs information from an account with ci en subscriptions I'll gladly help

mikf · 2024-07-28T17:45:55Z

So I've finally managed to get myself to sit down and write some code: aa6d006

I took some inspiration from jamkinson's code (#2885 (comment)), so my implementation should at least be able to download what it can. Support for galleries like #2885 (comment) and (Youtube) embeds is still missing.

Let me know what else needs to be done or what doesn't work like it should.

nomakewan · 2024-07-28T18:05:59Z

Just tested it real quick on a free article and it worked perfectly! Thank you so much!

EDIT: Well that was fast. Dunno if it was because I wasn't passing a cookie correctly or what, but when I switched to trying to download an account I was following, it suddenly threw a bunch of 403 errors. When I then tried to refresh the website in my browser, sure enough, I now get a 403 when I go to that author's page rather than being able to access it.

EDIT 2: Deleting my browser cookie and logging back in solved the 403. But it would indeed appear that they have some bot detection going on that gallery-dl is tripping.

mikf added the site:support label Sep 14, 2022

mikf mentioned this issue Feb 24, 2024

[REQ] add support for https://ci-en.dlsite.com/ #5240

Closed

biggestsonicfan mentioned this issue Mar 3, 2024

[Multiple Extractors] Implement proper Schema.org support for extractors #5272

Open

mikf added a commit that referenced this issue Jul 28, 2024

[cien] initial support (#2885, #4103, #5240)

aa6d006

mikf mentioned this issue Jul 28, 2024

plz Support ci-en #4103

Closed

mikf added a commit that referenced this issue Aug 1, 2024

[cien] extract 'gallery' images (#2885)

d65fc24

mikf added a commit that referenced this issue Aug 3, 2024

[cien] add 'files' option (#2885)

f87783f

mikf closed this as completed Aug 3, 2024

mikf mentioned this issue Aug 3, 2024

[ci-en] 403 when attempting to download a followed user's gallery #5933

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Request] "ci-en" Request to add a site #2885

[Request] "ci-en" Request to add a site #2885

ytoaa commented Sep 2, 2022

Aergernis commented Dec 1, 2022

Eradicate2968 commented Mar 4, 2023

nomakewan commented Jun 3, 2023

angramainyuu commented Aug 17, 2023

biggestsonicfan commented Jan 10, 2024

jamkinson commented Mar 20, 2024 •

edited

Loading

biggestsonicfan commented Mar 21, 2024 •

edited

Loading

jamkinson commented Mar 21, 2024

biggestsonicfan commented Mar 22, 2024

jamkinson commented Mar 23, 2024

biggestsonicfan commented Mar 23, 2024

biggestsonicfan commented Apr 13, 2024

biggestsonicfan commented Apr 14, 2024

Eradicate2968 commented Apr 16, 2024

jamkinson commented Apr 16, 2024

jamkinson commented Apr 16, 2024

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

jamkinson commented Apr 17, 2024

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

501stRookie commented Jun 1, 2024 •

edited

Loading

jamkinson commented Jun 4, 2024

SAI13103 commented Jul 9, 2024

Hrxn commented Jul 9, 2024

DisasterInbound commented Jul 24, 2024

mikf commented Jul 28, 2024 •

edited

Loading

nomakewan commented Jul 28, 2024 •

edited

Loading

[Request] "ci-en" Request to add a site #2885

[Request] "ci-en" Request to add a site #2885

Comments

ytoaa commented Sep 2, 2022

Aergernis commented Dec 1, 2022

Eradicate2968 commented Mar 4, 2023

nomakewan commented Jun 3, 2023

angramainyuu commented Aug 17, 2023

biggestsonicfan commented Jan 10, 2024

jamkinson commented Mar 20, 2024 • edited Loading

biggestsonicfan commented Mar 21, 2024 • edited Loading

jamkinson commented Mar 21, 2024

biggestsonicfan commented Mar 22, 2024

jamkinson commented Mar 23, 2024

biggestsonicfan commented Mar 23, 2024

biggestsonicfan commented Apr 13, 2024

biggestsonicfan commented Apr 14, 2024

Eradicate2968 commented Apr 16, 2024

jamkinson commented Apr 16, 2024

jamkinson commented Apr 16, 2024

Eradicate2968 commented Apr 17, 2024 • edited Loading

Eradicate2968 commented Apr 17, 2024 • edited Loading

jamkinson commented Apr 17, 2024

Eradicate2968 commented Apr 17, 2024 • edited Loading

501stRookie commented Jun 1, 2024 • edited Loading

jamkinson commented Jun 4, 2024

SAI13103 commented Jul 9, 2024

Hrxn commented Jul 9, 2024

DisasterInbound commented Jul 24, 2024

mikf commented Jul 28, 2024 • edited Loading

nomakewan commented Jul 28, 2024 • edited Loading

jamkinson commented Mar 20, 2024 •

edited

Loading

biggestsonicfan commented Mar 21, 2024 •

edited

Loading

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

Eradicate2968 commented Apr 17, 2024 •

edited

Loading

501stRookie commented Jun 1, 2024 •

edited

Loading

mikf commented Jul 28, 2024 •

edited

Loading

nomakewan commented Jul 28, 2024 •

edited

Loading