Seventy-two days ago Googlebot first showed up and crawled over 250 pages of a brand new domain in an experiment that has had an odd cartoonish character to it, where unexplained things happen with sometimes dark foreboding, a kind of Fantasia online.
If you're unfamiliar with the Disney animation classic, Fantasia, Mickey Mouse plays a sorcerers' apprentice who wreaks havoc one evening as he dons the bosses magic wand and merrily destroys the castle. Comparing Google to Mickey Mouse is probably not often taken to mean low quality or amateurish in the pejorative use of the name. If I were to compare Google to Mickey Mouse, it would be as Jimmy Carter did, saying, "Mickey Mouse is the symbol of goodwill, surpassing all languages and cultures. When one sees Mickey Mouse, they see happiness."
Source: Wikipedia
I'd suggest that most webmasters see Google the same way Carter sees Mickey Mouse. We're very happy to see Googlebot (Mickey) wandering through our pages and he definitely brings happiness - if and when he ever indexes our pages. But for the past 72 days Google has seemed more like the dark character "Chernabog" from the same movie, a nocturnal demon who holds power over various restless souls whom he summons from their graves. That is how those buried deep in that evil sandbox imposed by Google on new sites must imagine the search engine - we'll be summoned from our graves one day. Google crawls after each article in this series, but has yet to index any of the several hundred pages it has spidered.
This consignment to a "Neverland" of invisibility by Google has only seemed to plague sites with content in tightly competitive markets. The category that this new site fits might be considered competitive since it's all about internet business. There are no shortage of sites addressing internet marketing & ecommerce. Peter Pan probably couldn't fly if not sprinkled by a little of Tinkerbell's Google Pixie Dust. The same is true of Sandboxed web sites.
The long sandboxing in this case may be proof of the long time rumor circulated among webmasters that new sites are indexed very quickly for obscure or unpopular terms, while those seeking entry into tough markets take longer to get indexed. The question every webmaster asks in this scenario is, "How long Mickey?" After the first two articles in this case study series were published, one webmaster after another wrote to say their site was fully indexed in 30 days if targeting terms such as "Grow Bananas in Pots."
But those in hotly contested areas, targeting competitive market segments have found themselves in limbo for as long as six months before release from the Google Sandbox. Guidelines would be nice. Doing that daily search at Google using query operator "site" to find how many, if any, pages are indexed at the search engine gets tiresome after ten weeks of looking. Those who suggest that it only takes a few links to get indexed by Google can do a link search at both MSN (369 links) and Yahoo (7950 links). A result of the intense interest focused on this story by webmaster ezines & online publications.
The second installment in this case study series ranks at #23 for the Google search "Google Sandbox" from the webmaster site: WWW Coder
This might play out to fulfill other suggestions that those sites that are well optimized with extensive inbound links spending even longer periods in the sandbox due to "over-optimizing" type of penalties. The site now fits both descriptions as it's a text- only site (only images are the logo and background) built to rank well that has hundreds of inbound links. Would that suggest that it is wiser to launch with no optimization, little content, lots of images, extensive javascript, obscure market segment and keep quiet about the site online until indexed and released from that awful black sandbox? THEN optimize, remove images and scripts and slowly ease in to the competitive arena after de-sandboxing?
How long Mickey?
A few words about the other three players in the search engine game... AskJeeves has also not yet released this site from their own version of the sandbox. Playing Sleeping Beauty here Teoma?
Yahoo is now showing 8,210 pages indexed, though they had done the inexplicable and CHANGED THE URL of over 8,040 of those pages sending visitors to error pages until we programmed a special 301 redirect just for Yahoo to change all of them back to those they crawled on the site. This is just plain Dopey behavior and earned Yahoo the Dopey Dwarf role in this Disney Sleeping Beauty toon.
Yahoo also earned the Dopey moniker by being very slow once the pages were crawled to post new pages. We're seeing old versions of the site, versions of pages that haven't existed for over 8 weeks now since Slurp first crawled back in May. Some new pages are indexed, but they make up a tiny portion of those listed.
We've found that Yahoo shows several hundred broken links to an email masking directory we've excluded them from in our robots.txt file - weeks after we banned the Slurp crawler from that directory. Dopey, you're so cute, but real sloooooow.
MSN now indexes 6,162 pages and is crawling the site like mad after each of these sandbox case study articles is published. Their index increases by about 1000 pages per week on a rather regular schedule. We've christened MSN "Goofy" for the bizarre search numbers shown with a "site:Publish101.com" query operator.
MSN shows, across the top of the page on the day after each new update, first a very low number of results, then a higher number of results after clicking in five pages, then a lower number of results after the sixth page. THEN after going to page 25 of search results, it stops showing more results pages. So no matter how many pages are indexed, Goofy shows you only 250 of them. In a search done right before completing this article, MSN shows 220 pages indexed on that "site:Publish101.com" query - as do pages 2 through 4. But if you click page 5, it suddenly shows 6,941 results. Page six (links at top & bottom of results pages) then shows 6,721 results. No more after page 25. Goofy, just plain Goofy.
Dopey Yahoo does this as well, first showing 8,210 pages, then dropping back to 8,040, then 8,020, then 7,980 down to 7,770 at result page #100 where you'll see a link at the bottom of that page saying, "In order to show you the most relevant results, we have omitted some entries very similar to the ones already displayed. If you like, you can repeat the search with the omitted results included." But if you click that link, then click page 10, results drop to 5,700 pages, until result page number 100, which shows 3,140 pages indexed and STILL you can't look beyond 100 results pages - 1,000 results.
Very Dopey, very Goofy and very Mickey Mouse!
Copyright © July 26, 2005
Mike Banks Valentine is a search engine optimization specialist who operates WebSite101
Previous Google Sandbox Case Studies are at the following URL's
Sandbox Case Study #1 Sandbox Case Study #2
... and why I 'm dying to get finally in... Read More
Three Ways To Index Your Site With Google Sitemaps [Difficult,... Read More
Search engine optimization is on every webmaster's mind these days.... Read More
Ever wonder how or why your competitor gets better search... Read More
It is official, the search engine wars are in full... Read More
First of all you need to get a blog. If... Read More
"Nothing last forever but the Earth and sky." - from... Read More
Let's face facts - Search engines are starting to rule... Read More
Have you ever stopped to think how much time is... Read More
One of the most overlooked strategies to improve search engine... Read More
It is no secret that search engines are the number... Read More
If you're anything like me, you have a favourite search... Read More
Internet surfers use search engines more than any other tool... Read More
What's all the talk about links we hear about? Reciprocal... Read More
Like many folks, I have been using KEI for some... Read More
I was all set to write an article predicting the... Read More
Many marketers know that search engine marketing is among one... Read More
On the internet, competition is stronger than ever. There was... Read More
Internet users have never had it better what with Yahoo!,... Read More
Branding versus search engine optimization is a marketing dilemma that... Read More
More and more webmasters are building websites with publicly available... Read More
I wish to give a few little tips, about optimizing.... Read More
Keyword Research will reveal answers to 3 critical questions:1. Is... Read More
Where is the need to worry? Who needs a PR... Read More
Search engine optimization this and search engine optimization that. You... Read More
OK, you published your site, now you just sit by... Read More
With all the recent publicity given to Google as the... Read More
You can easily get confused by all the search engine... Read More
Been hearing the words Search Engine Optimization lately? I know... Read More
The Internet may have started as the fervent brainchild of... Read More
I want to touch base with selecting the title of... Read More
IntroductionWhy does a FLASH intro need SEO? Flash, the great... Read More
A good link building strategy has become an essential part... Read More
Search engine optimization is one of most popular online marketing... Read More
The most important thing you can do for your business... Read More
Search engine copywriting has become an extremely important part of... Read More
If you would like to know when your site was... Read More
Getting your site noticed by the search engines and rewarded... Read More
When shopping online for Link Management Software that can... Read More
Last Week I did a Search engine Experiment. I wanted... Read More
Which SEO hat do you wear? Is it white or... Read More
We got down to the basics with web site page... Read More
To get your website listed well in the major search... Read More
Indulge me for a moment.Forget that Google is a search... Read More
This article is actually the summary to a book soon... Read More
The first task most netizens do when they log on... Read More
Below are what I call the "10 Commandments" for Keywords.To... Read More
Onpage optimization is the process by which various elements on... Read More
Before anyone can start optimizing a web site, you must... Read More
The makers of the world renowned search engine, Google, have... Read More
The name of the game is search engine optimization and... Read More
It's in our genes, we're driven to seek. We 'hunt'... Read More
I was all set to write an article predicting the... Read More
In order to design a website that performs well with... Read More
If you are like me, you created web site metatags... Read More
Search Engine Optimization popularly known as SEO.SEO is the process... Read More
Would you like a checklist of the important steps to... Read More
I recently invested quite some time into generating search engine... Read More
Yes, it really happens. Now you might find it hard... Read More
With tons of competition and copycats online, you need a... Read More
Long before the days of researching phrases with the helpful... Read More
Increasing your web traffic and rank in search engines is... Read More
Okay I admit it. I was kidding. I can't guarantee... Read More
Source code optimization.{title}...{/title}This tag is to be a winner. This... Read More
We all know that the search engines can't "see" or... Read More
Ever wondered how one search engine is dominating the entire... Read More
Search Engine Optimization (SEO) |