Indexing of the site in search engines

[mehadihasan123456]

A very useful feature of WordPress is the ability to enable or disable indexing of a site by search engines in literally one click. To do this, go to "Settings" - "Reading" and check/uncheck the box "Ask search engines not to index the site".

Setting up site indexing

Disabling indexing is very important at the stage of internal optimization (working with content and structure, other manipulations with the site). That is, during the period when search algorithms are better off not indexing pages, but waiting until the resource is completely ready. The main thing is not to forget to turn on indexing again when you launch a full-fledgedwebsite promotion.

robot.txt settings
This file is located in the root of the site. It helps search algorithms bosnia and herzegovina email list find content for indexing. First of all, the following pages and content types must be closed from indexing in this file:

archives;
comments;
RSS feeds;
tags;
service sections.
To do this, use the Disallow directive. Example: Disallow: */comments/. But images in robot.txt are usually open for indexing. If you specify the Alt attribute and specify a relevant name when loading, the images can attract additional traffic from image search. Therefore, it is better to remove the ban on their indexing. Also, in this file, you need to specify the path to the sitemap (sitemap.xml), which we will discuss later.