To do this, go to the "Settings" section, then to the "Reading" subsection. There db telegram will be a "Visibility for search engines" field here - it should be empty. You can also use special tools, which we will talk about below. why google doesn't index the site Checking the Robots.txt file To figure out why Google isn't indexing your site, use Google Search Console, a free tool for webmasters. To start using the service, you'll need a Google account. The algorithm is pretty simple: go to the "Indexing" section, then "Pages." Here you'll see which robots.txt files were found on your site. Robots Meta Tags Another common reason why a site is not indexed in Google is the Robots meta tag.
It tells search robots that the page should not be indexed. In its code, the meta tag may look like this: <meta name=“robots” content=“noindex”> Checking the Robots Meta Tag You can do this using Google Search Console. In the Indexing section, you will find the Pages subsection and then the Why are these pages not indexed table. the site is not indexed in google You can also use special programs to search for Robots meta tags, such as Screaming Frog SEO Spider or Netpeak Spider. .htaccess file It allows you to manage various server settings and functions at the level of individual directories or the entire website. And if this file contains prohibiting rules, the site will not be indexed.
