How to find crawl errors

B2C Data Innovating with Forum and Technology
Post Reply
sakibkhan22197
Posts: 31
Joined: Tue Dec 24, 2024 3:32 am

How to find crawl errors

Post by sakibkhan22197 »

Other reasons: Files are missing on the server or the connection to your database has been broken
This is what you see in Google Search Console (GSC) when you find pages with this.

"Soft 404" pages section in Google Search Console
403 Forbidden Errors
The 403 Forbidden error means that the server denied a crawler's request. It means that the server understood the request, but the crawler cannot access the URL.

This is what a 403 Forbidden error looks like on an Nginx server.

Server permissions issues are the main causes of error 403.

Server permissions define the rights that users and bulgaria phone number database administrators have to a folder or file.

We can divide permissions into three categories: read, write, and execute.

For example, you won't be able to access a URL if you don't have read permission.

A faulty .htaccess file is another common cause of 403 errors.

An .htaccess file is a configuration file used on Apache servers. It is useful for configuring settings and implementing redirects.

But any errors in your .htaccess file can lead to problems like a 403 error.

Redirect loops
A redirect loop occurs when page A redirects to page B. And page B redirects to page A.

Results?

An endless loop of redirects that prevents visitors and crawlers from accessing your content. This can hinder your rankings.

An image showing a redirect loop, from page A to page B

Site Audit
Semrush Site Audit allows you to easily discover issues affecting your site's crawlability. And offers suggestions on how to address them.

Open the tool, enter your domain name and click " Start Audit ".

Site Audit Tool Search Bar
Next, follow the Site Audit setup guide to configure your settings. And click " Start Site Audit ."
Post Reply