crawler-cli

A CLI web crawler/epub converter for Wildbow's works.

Prerequisites

Before running this CLI, you'll need to have installed on your computer the following:

• NodeJS
• Yarn or npm

Setup

Before running the project, you will need to install its dependencies. For that, run:

npm install

Or, in case you're using yarn:

yarn install

Running the application

With a the dependencies installed, just run:

npm run start

Or:

yarn start

A menu should show up with the books available to download and convert. Choose your option and just wait until its finished. The .epub files can be found at crawler-cli/epub/ directory.

The demo is edited to speed up the example, but it usually takes a little more time to finish the epub creation

Source material

For more information about Wildbow's works, or just access to the books in their original form, see:

• Worm
• Ward
• Pact
• Twig
• Pale

License

The project license can be found here.