In this post, Getting Google to Index your site I’m focusing on a new feature that’s in Rank Math called Index Status because several of my posts are not getting indexed.
In my of my last post called How to be an SEO Expert one of the items mentioned is to be familiar with search engines.
The name of this post was initially called 20 Blogs at a Glance for PinArtwork. What you need to need to know is that this post has been updated from it’s original title and renamed so that we can learn more about indexing your site. Note: I decided to update the post since it was obviously an item I wouldn’t have considered to get indexed if I were Google because some of the links were broken and the information wasn’t readily useful. That’s a key indicator that I think Google is looking for useful information.
In a post by Rank Math called Google URL Inspection API Integration in Rank Math. It’s mentioned that every day day there are millions upon millions of content getting uploaded to the web on a daily basis and Google is going about it’s regular routine of crawling and indexing websites.
Rank Math SEO plug-in has introduced the new feature of Index Status. But did you know that often times before this came about (unless you’re checking your Google Search Console on a regular basis) that often times its hard to know if your content has actually been indexed or not.
What you need to realize first and foremost about whether or not your post is crawled and indexed depends on a couple of values that Google has in their algorithm to determine the importance and value that you provide in the content of your post.
Now with Index Status it’s possible to look at your posts and see if they’ve indexed or not (all from within the confines of your WordPress dashboard).
I’ve been keeping a close eye on the figures in the Index Status tab and they’re (posts that are currently not indexed and marked as discovered or crawled) going up and not going down. So it’s important for you to distinguish the difference between crawled and indexed.
We don’t need to be concerned with the first field located above called submitted and indexed and represents 362 posts.
If your posts aren’t getting crawled, discovered, or indexed it means that your posts aren’t going to show up in Google SERP results. Moving forward we need to keep an eye on the posts that fall into the last three categories (on the left side).
Moving forward we need to keep an eye on these posts so that we’re utilizing SEO to our advantage to get our posts seen.
A video from Rank Math SEO (How to Get Google to Index your Site – Get your Site to Index faster) does a good job to explain how to get your site to index faster and is well worth the time if you have a few minutes to watch. I wasn’t able to put the URL into the image, so here’s the link if you’d like to visit that video and copy it into your browser >> https://youtu.be/_YYecHEIwMs (w/o the period).
The video shows you how to set up Rank Math SEO plug-in to ensure that you have it optimized and so that it will properly index your site.
Unfortunately, the data is not real live data. “Once the data is fetched, you can check Index Status under Rank Math > Analytics > Index Status tab. Under this tab, you will get the real data/status (from the date your info was fetched/downloaded) of your pages as well as their presence on Google.”
There’s a field called Fail where I have one error. To the best of my knowledge, I thought that I had corrected the error and I was hoping it wouldn’t be visible anymore so it warrants some closer attention. Here’s the definition of a Fail error: “This status says that your website has not been indexed due to an error. You can refer to the specific error type description on each page … to identify what’s happening on the page and how you could fix it. In addition, you need to take care of these problems first.”
Here’s the definitions straight from Rank Math on two types of errors that were shown above:
Crawled – currently not indexed: Although you’ve submitted the page and Google has crawled the page in response, it has decided not to index the page for now. You’ll need to keep a note to work on these pages to ensure the page gets indexed.
If you go to the link above crawled – currently not indexed you’ll see a post called How to Fix “Crawled – Currently Not Indexed” Error in Google Search Console.
Here’s what I didn’t know – Google doesn’t index 100% of the pages that are submitted. Plus there are a variety of reasons that a page gets excluded from being indexed.
If you go to the Google Search Console the indicator of Crawled – currently not indexed is not an error. It’s a notification from Google to you that your page has been “excluded” from getting indexed.
Before your keyword can get ranked in the post that it’s in, it’s required to get indexed so that your able to bring traffic to your website. So it’s imperative that you have an understanding why your post fell into this type of criteria.
To make matters worse, there’s a big disparity that Google is taking an awfully long time to index pages and sometimes the page can be marked in GSC as indexed but the information hasn’t been passed on (see the article how to fix “crawled – currently not indexed” for exact details on this phenomenon).
This post (above) from Rank Math does a good job in the area called How to Improve the Overall Site Quality explaining that there are some quality checks that need to get passing marks in order for a page to be marked as indexed. However, Google doesn’t directly disclose the exact things that they are looking for when they are indexing, so it’s a little bit of a guessing game.
Discovered – currently not indexed: This indicates Google has discovered the page, and even wants to crawl the page. But this was expected to cause an overload on the site, hence Google has rescheduled the crawl. As a result, Google may delay this crawl for several days after it has been discovered and crawl status would remain empty until then.
Number of items in cart: 0
- Your cart is empty.
- Total: $0.00