Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"The Rust Programming Language Has Moved" page instead of useful content appears in Google #42632

Closed
kornelski opened this issue Jun 13, 2017 · 10 comments
Labels
T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.

Comments

@kornelski
Copy link
Contributor

kornelski commented Jun 13, 2017

When I google Rust-related topics I often land on the dead links from the old book, e.g.:

https://www.google.co.uk/search?q=rust+enum

for me the first result is:

https://doc.rust-lang.org/book/enums.html

It even has a relevant (out of date?) description:

Enums. An enum in Rust is a type that represents data that is one of several possible variants. Each variant in the enum can optionally have data associated with ...

but the page itself looks like a 404. It does not contain the content I searched for. There is a link to the book page in the block of text, but landing on that page gives such an off-putting "dead-end" impression that I didn't notice it until half way of writing this bug.

Can you remove these "redirect" pages with robots.txt? (or HTTP redirect straight to /first-edition)

Having such pages on the official domain makes a very negative impression — it looks like a combination of a broken link and abandoned out of date documentation.

@steveklabnik
Copy link
Member

I see this:

moved

nothing about enums there?

@kornelski
Copy link
Contributor Author

That's the same thing I see. And nothing about enums is exaclty the problem. This page is shown as the first result for "rust enum" search query, so it should be all about enums.

@steveklabnik
Copy link
Member

I have no idea what our capacity for redirects are; this is how we've done it for years. @rust-lang/infra ?

@alexcrichton
Copy link
Member

We've mostly done this historically with robots.txt but in general we need a lot of SEO love, it's not just this. I unfortunately know of no silver bullet here.

@shepmaster
Copy link
Member

with robots.txt

I didn't think that robots.txt had anything to do with redirects.

Is it possible to get a list of the URLs from the first edition of the book (e.g. /stable/book/first-edition/syntax-and-semantics.html) and set up redirects from the old location (/stable/book/syntax-and-semantics.html -> /stable/book/first-edition/syntax-and-semantics.html)?

we need a lot of SEO love

This goes beyond SEO. Every single link to the book from the entire internet is broken, except for the rare case where people explicitly included the version in the URL. A rough query shows that 400+ of the 6800 Rust questions now have broken links to the documentation.

@steveklabnik
Copy link
Member

Is it possible to get a list of the URLs from the first edition of the book (e.g. /stable/book/first-edition/syntax-and-semantics.html) and set up redirects from the old location (/stable/book/syntax-and-semantics.html -> /stable/book/first-edition/syntax-and-semantics.html)?

To be clear, each of these pages has redirects, just not automatic ones; you have to click the link.

@tomprince
Copy link
Member

I don't have any experience doing anything suggested in it, but https://support.google.com/webmasters/answer/139066 might have some ideas on how to get google to prefer newer URLs.

@shepmaster
Copy link
Member

you have to click the link.

Being transparent, I did not understand that from the text

you probably want to visit first-edition/

To me, that looks like it's going to to take me to https://doc.rust-lang.org/book/first-edition/ (especially because of the trailing slash), not https://doc.rust-lang.org/book/first-edition/enums.html. I didn't think to hover over the link to figure out where it was going to take me beyond that.

I still think I'd prefer for the links to redirect /stable/book/syntax-and-semantics.html -> /stable/book/first-edition/syntax-and-semantics.html and then have a header on each of the pages of the old book that encourages people to see the new one:

if you're trying to learn Rust, checking out the second edition might be a better choice

As a single point of confirmation, Webpack 2 is doing something like this:

image

@steveklabnik steveklabnik added the T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. label Jun 14, 2017
@bstrie
Copy link
Contributor

bstrie commented Jun 14, 2017

I was just bitten by this today, came to file this same issue. I searched for "rust unsafe keyword", the first result was https://doc.rust-lang.org/book/unsafe.html , and from the landing page there it was 100% unclear to me that clicking "first-edition/" would take me to the relevant page in the original book. We really need to do something here, I can't imagine how many people are being frustrated by this.

@kornelski
Copy link
Contributor Author

I suggest changing it to something short, with very prominent links:


There is a new edition of the book

This is an old link. You can continue to the exact older page. If you're trying to learn Rust, checking out the second edition might be a better choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.
Projects
None yet
Development

No branches or pull requests

6 participants