Post by account_disabled on Dec 2, 2023 1:33:02 GMT -5
Since seeing the Crawled Not Indexed status report, we've received a few questions from site owners asking what it means. One of the benefits of working in an agency is having access to a lot of data, and because we've seen this message across multiple accounts, we've started to understand trends from what's being reported. Google’s definition Let’s start with the official definition. According to official Google documentation, this status means that the page has been crawled by Google, but not indexed.
It may or may not be indexed in the future; there is no need to resubmit this URL Phone Number List for crawling. So, basically what we know is that we were able to access the page, spent some time crawling the page, and decided not to index it. The key to understanding this state is to think about why Google would make a conscious decision against indexing. . We know it's not having a problem finding the page, but for some reason it doesn't think users would benefit from finding the page. This can be very frustrating because you may not know. Below I’ll detail some of the most common reasons our team has discovered as to why this mysterious status might be affecting your site.
False positives are low priority Our first step is to always do some spot checks for indexing that are flagged in the currently unindexed portion of the crawl. It is not uncommon to find items that are reported as excluded but end up in the index. For example, the following is tagged in our website report. However, when using the site search operator, we can see that this is actually included in the index.
It may or may not be indexed in the future; there is no need to resubmit this URL Phone Number List for crawling. So, basically what we know is that we were able to access the page, spent some time crawling the page, and decided not to index it. The key to understanding this state is to think about why Google would make a conscious decision against indexing. . We know it's not having a problem finding the page, but for some reason it doesn't think users would benefit from finding the page. This can be very frustrating because you may not know. Below I’ll detail some of the most common reasons our team has discovered as to why this mysterious status might be affecting your site.
False positives are low priority Our first step is to always do some spot checks for indexing that are flagged in the currently unindexed portion of the crawl. It is not uncommon to find items that are reported as excluded but end up in the index. For example, the following is tagged in our website report. However, when using the site search operator, we can see that this is actually included in the index.