Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Location of sitemap listed in robots.txt file is incorrect #4171

Open
matthewgallo opened this issue Jul 12, 2024 · 0 comments
Open

Location of sitemap listed in robots.txt file is incorrect #4171

matthewgallo opened this issue Jul 12, 2024 · 0 comments

Comments

@matthewgallo
Copy link
Member

Detailed description

Describe in detail the issue you're having.

While working on some web scraping for the WatsonX challenge, our team noticed that the location of the sitemap listed from the robots.txt file is incorrect. It is currently listed as: https://www.carbondesignsystem.com/sitemap.xml but the location of the hosted sitemap is actually https://carbondesignsystem.com/sitemap/sitemap-0.xml.

What did you expect to happen? What happened instead? What would you like to see changed?

Expected to be able to reach sitemap from location listed in robots.txt.

What browser are you working in?

Chrome

Steps to reproduce the issue

  1. Navigate to https://carbondesignsystem.com/robots.txt
  2. See incorrect url for the hosted sitemap
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

No branches or pull requests

1 participant