Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crawling wrong urls and generating unnesecary folders #95

Open
RohanVashisht1234 opened this issue Dec 24, 2024 · 0 comments
Open

Crawling wrong urls and generating unnesecary folders #95

RohanVashisht1234 opened this issue Dec 24, 2024 · 0 comments

Comments

@RohanVashisht1234
Copy link

RohanVashisht1234 commented Dec 24, 2024

Suppose we are embedding multiple markdown files with links using -- $!{readmeContent}.
These readme files which have been taken from github generally contain links in the form of /something instead of https://github.com/something so, the crawler thinks that /something is a route of my website and generates a folder like /something/index.html which is the main issue. There should be a way to control this, like an option in vite.config.js to for example add only the urls that I want to generate or disable the crawler altogether for specific routes.

@RohanVashisht1234 RohanVashisht1234 changed the title Crawling wrong urls and generating Crawling wrong urls and generating unnesecary folders Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant