Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

manual download limits #195

Open
ghost opened this issue Jan 27, 2018 · 6 comments
Open

manual download limits #195

ghost opened this issue Jan 27, 2018 · 6 comments

Comments

@ghost
Copy link

ghost commented Jan 27, 2018

when scraping a big library replacementdocs blocks you for downloading too much for a period of time.

can a rescrape unscraped manuals option be added to allow someone to complete the manuals without redownloading manuals or having to go 1 by 1?

@ghost ghost closed this as completed Jan 27, 2018
@ghost ghost reopened this Jan 27, 2018
@Asnivor Asnivor self-assigned this Jan 27, 2018
@Asnivor
Copy link
Owner

Asnivor commented Jan 27, 2018

Sounds like a sensible idea. I'll look into it.

@ghost
Copy link
Author

ghost commented Jan 29, 2018

I found 2 walk arounds to this so I dont know if its worth your time trying to make a fix.

my initial solution is is a game is missing a manual and you put it in the manual folder manually the launcher will find it. this is awesome cause ou can add walk through and cheat documents too!

other walk around (automatic) you can set the launcher to scrape just manuals, find where it left off, select a range and scrape. next time it stops i record where. then the next day scrap from that range forward.

Having found these two ways to deal with this make me think that its not really needing enhancement maybe just a tip to future users.

BTW:I love this front end. LOVE

@Asnivor
Copy link
Owner

Asnivor commented Jan 29, 2018

Thanks :)

Yeah, I designed the the manuals folder mechanism so you could dump whatever you liked in there and it should appear in the UI (although this probably isn't documented anywhere - like most things currently).

I might be able to code something that skips a manual download if the file already exists locally, but iirc, replacement docs has a PHP download system that doesn't reveal the manual filename until the http request has been sent, so this probably wont help reduce the download quota usage.

I'll have to take a look at the local manual scraping database that ships with MedLaunch and see if there is any way around this.

@ghost
Copy link
Author

ghost commented Feb 5, 2018

would it be possible to add offline scrape and ftp scrape?

I have a big collection of manuals. offline scrape would make things so easy.

I also ask about ftp scrape because I can setup a server with manuals that I can keep online at a commercial building 24 hrs 7 days with the manuals.
Im willing to set this ftp up. let me know.

@Asnivor
Copy link
Owner

Asnivor commented Feb 5, 2018

Offline scrape - possibly with a little bit of work. Would have to partial match based on filename and would be further complicated if the filenames did not include the game system they are for.

FTP scrape - that could be quite cool. Although you would need to provide me with a file list (potentially separated into systems) that I could add into the medlaunch scraping database. I might be overhauling the database anyway over the next month or so though, so there is no great rush on this (as I probably wont be able to implement anything for a while).

@ghost
Copy link
Author

ghost commented Feb 5, 2018

ok well i have a decent collection of already named and organized by directory of manuals.

I will set up a ftp specifically for medlaunch ( i have where I can put this for nothing and keep it online)

As soon as I set it up I will let you know and if you choose to use it great!

Once this is set up I will come to you with the ftp information and a text file showing the dir structure and file names.

It will be my contribution if its something you and other users are interested in.

Would be kind of cool if I get to help somehow Im getting alot of use from this front end. I like it alot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant