Google’s John Mueller went on a bit of a rant on Reddit on the topic of having your internal search result pages crawlable and indexable. As you know, in general, Google does not want to index search results but John said, this is especially true for search result pages that have no results found.
In short, John said, “if you can’t select which search results pages should be indexable, you should block all of them from being indexable – use robots.txt disallow or noindex robots meta tag.”
The rant is kind of fun to read, so here it is:
Unfortunately, lots of CMSs, hosting platforms, ecommerce platforms, etc still don’t robot or noindex search results pages by default. We’ve given that guidance for probably over a decade. Especially if a search results page returns no results, there’s no reason for it to be indexable. And even for other search results pages, it’s a good practice to either block them all, or to only allow a hand-selected set to be indexed (eg, known product-type queries, where the results are more like category pages). If you can’t limit the indexable search results pages, I would strongly recommend noindexing or robotting *all* of the search pages. It’s still a regular occurrance that we see sites spam the search results with open search results pages — it doesn’t take much work to prevent, and cleaning it up afterwards is such a hassle.
In 2007, Google told webmasters to block internal search results from being indexed. The original guideline reads “Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don’t add much value for users coming from search engines.” Now it reads “Use the robots.txt file on your web server to manage your crawling budget by preventing crawling of infinite spaces such as search result pages.”
Then ten years later, Google’s John Mueller explained why Google doesn’t want your search result pages in its index. He said, “they make infinite spaces (crawling), they’re often low-quality pages, often lead to empty search results/soft-404s.” Later he explained it is a watering down issue and these types of pages can result in soft 404 responses in Search Console.
Forum discussion at Reddit.
We all want to be satisfied, even though we know some people who will never be that way, and others who see satisfaction as a foreign emotion that they can’t hope to ever feel.
Newspaper Ads Canyon Crest CA
Click To See Full Page Ads
Click To See Half Page Ads
Click To See Quarter Page Ads
Click To See Business Card Size Ads
If you have questions before you order, give me a call @ 951-235-3518 or email @ canyoncrestnewspaper@gmail.com
Like us on Facebook Here
What should Google rank in Search when all the content sucks?
Many people have an incredibly low bar for what they consider to be “great” content that...
Google Search Wants To Reward The Best Content No Matter The Size Of The Site
For the past 20 years, probably even longer, the debate about Google giving preferential...
0 Comments