You are here:

Google's Supplemental Index Does Exist

4.33 out of 5 based on 13 ratings. 3 user reviews.

One method of measuring the SEO health of your web site is determining if your most important web pages like i.e the most lucrative products or services have been moved to Google’s supplemental index or not.

Many people believe that since Google stopped labelling the supplemental results pages, that the supplemental index has gone. That is not true!

Google clearly stated in their article "Supplemental goes mainstream" at their Webmaster Central Blog:

"The distinction between the main and the supplemental index is therefore continuing to narrow. Given all the progress that we’ve been able to make so far, and thinking ahead to future improvements, we’ve decided to stop labeling these URLs as Supplemental Results. Of course, you will continue to benefit from Google’s supplemental index being deeper and fresher."

The pages that show up first for any searches are the ones in the main index. The only time you will see pages from the supplemental index, is if there are not many, or any results for that term in the main index.

Also Google tends to move old cached pages to their supplemental index, which can also be pages that you do not even have on your server anymore.

Bot Herding for PageRank Flow

To be in Google’s main index, your pages need to have a certain undefined amount of juice (Pagerank), independent of other factors being involved. Google uses PageRank values to set crawling priorities and to determine if a document should go into their main or supplemental index.

Matt Cutts, head of the Google Webspam Team’s quote, speaks for itself:

"PageRank is the primary factor determining whether a url is in the main web index vs. the supplemental results."

Once you get to know the common causes of supplemental pages you can determine which pages may be in the supplemental index. Then you can improve your web site internal linking by adding links to these pages from more prominent, fully indexed pages of your site eg. your homepage.

Thanks to Andy Beal, you can hear Matt Cutts say basically the same thing again:

"If you got 60,000 pages, and you only got ’this much’ PageRank, and you divide it [...he mumbles], some of them are going to be in the supplemental index. Given 'this many people' who link to you, we’re willing to include 'this many' pages in the main index."

An SEO or a Link Builder would probably advise you that the best way to get your pages out of the supplemental results is to create high quality, unique content and promote it to get inbound links. That is correct. But, is that really the best route to take? Why not first try to see how far you can get with the PageRank that your web site already has?

There are several internal link-based tactics at your disposal to combat supplemental results. One popular and effective strategy is commonly known as Bot Herding.

Bot Herding is nothing more than a methodology to improve your web site navigation system by controlling the flow of PageRank to boost the prominence of your most important web pages. This can be achieved by linking to them from pages within your domain, and more.

Common causes of supplemental pages

The most common cause of Supplemental results is lack of Page Rank. Still there are some more causes which must be taken into account:

Do you have pages in the supplemental index? Get them out of there, save time and money, and boost your rankings!

About this SEO article

This tutorial was written by , Forensic SEO & Social Semantic Web Consultant at SEO Workers and was published September 12, 2007.

Copyright reserved. Not to be reproduced.

Comments & Ratings

Boost your rankings with Bot Herding Affordable SEO Melbourne 4 stars 2010-10-20 21:34:20 I have only been in the industry for about 18 months and a friend just sent me this link to your site and I'm glad he did. I have never heard of Bot herding before. I might try the method and see what happens with some of my clients sites as well as my own off course.
thanks again.

Andrew R.

Boost your rankings with Bot Herding Miami Web Design 4 stars 2010-07-17 20:25:17 This is a good post. I have engaged in a self SEO campaign and all the help I can use will be great. I always thought that archiving a good position in Google or yahoo was something out of the extraordinary but since I started last June 2010 I have gone from a 10 page position in Google to a 3rd page and in not so competitive keywords I have manage first page in Yahoo as well as in Google.

Boost your rankings with Bot Herding Peter Watson 5 stars 2010-04-24 03:27:25 This article was very informative and speaking from experience I can varify that bot herding using the techniques mentioned in this article works! I seen instant result and noticed a huge increase in the serps resulting in higher traffic and ultimately conversions.

Attention Comment Spammers!

  • Google says that spamming other sites can lower your site rankings;
  • Signature links under comments are not accepted;
  • Highly relevant links in the body such as the web site or blog URL are allowed, but only upon our approval;
  • You can expect that your comment may be deleted if you are attempting to get a backlink link rather than adding real value to the conversation;
  • SEO or Link Builders, if we catch you commenting but linking to a client's site, your online reputation, your firm's and that of your client are being put at severe risk;
  • Link to a page or a blog that can be identified as being about you, so our readers can gain additional perspective on your point of view and where necessary sufficient disclosure.
Comment & Rate