Google announced the guidelines on Search Central in its `Crawling December` series. Most of the information is in the original post, with some important updates.
Here’s Google’s announcement on LinkedIn:
Google recommends
Gary Illyes said in his `Crawling December’ post that site owners should prevent faceted navigation from being crawled to avoid search engines from indexing it if they don’t need it.
They should also follow Google’s guidelines and best practices to guatemala mobile numbers list sustain efficient URL spaces and avoid overloading their site’s crawl budget.
Gary wrote:
“If you don’t need the faceted navigation URLs potentially indexed, prevent crawling these URLs.”
“If you need the faceted navigation URLs potentially indexed, ensure that the URLs follow our best practices outlined in the following section. Keep in mind that crawling faceted URLs tend to cost sites large amounts of computing resources due to the sheer amount of URLs and operations needed to render those pages.”
Google wrote on LinkedIn:
“Regardless of what kind of site you have — events, blog, or a shop, there’s a reasonable chance that your site is exposing URLs that are just a variation of something already discovered under a different URL. These duplicate URLs waste your crawl budget and your server resources; in fact, the most common source of complaints we get about crawling can be traced back to these useless URL spaces, more often than not caused by faceted navigation.”