Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.

It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.

This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.

What caused this infestation of bots?

Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."

So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.

Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".

There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.

Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.

In less than 36 hours, 'Googlebot' found my feed!

In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.

They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!

When will they go home and stop prying into my little secrets?

I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!

I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.

So I have obliged him!

I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.

Isn't this a laugh?

It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.

My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.

So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.

About The Author

Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com

Subscribe to his ezine just send a blank email to:- ebook-sales@aweber.com

---

Adding Content To Your Site Every Day

If you have been a webmaster for more than a... Read More

Link Popularity: Improve Your Search Engine Rankings

What is link popularity?Link Popularity is simply the total number... Read More

Without Conversion Rates You Don’t Know If You’re Mickey Mouse Or Mickey Mantle

I couldn’t agree more with the headline of this article... Read More

Is Something Missing From Your Keywords Research? (Part 1)

As you may already know, keywords are an essential part... Read More

Why Top Search Engine Placements Never Move?

#1 question when it comes to web advertising is how... Read More

The Power of Topic Specific Search

What are Topical Search Engines?Simply put, topical search engines are... Read More

What is Google Talk ?

The advent of Internet has affected lives of almost the... Read More

8 ways to build a really bad web site for Search Engines

Some web sites receive hundreds or thousands of unique visitors... Read More

Getting One Way SEO Links - The Easy and FREE Way

What we are hunting for?Unique Domains,One Way Links,Text Link copy... Read More

Is Google Having a Tough Time with Their Website Limit?

If you are one to pay attention to what happens... Read More

See No Google, Hear No Google, Speak No Google

That's right - I dreamt of a World Wide Web... Read More

Which Search Engine Optimization Services to choose, Google OR Yahoo?

Search Engine Optimization is emerging as the most powerful form... Read More

Beyond Hits!

Your Website visitor reports are a goldmine of information. If... Read More

Page Rank - A Quick Overview for Beginners

Page Rank (PR) is a specific value for a website... Read More

THREE Secrets to High Search Engine Rankings the Easy Way!

Let me guess, you've read article after article on how... Read More

Not Ranking High Enough on Search Engines? Here?s Some Help!

Search engines are frugal things. (Froogle, too, haha! Sorry, lame... Read More

The Truth About Search Engines: Playing A Game You Cant Win

If you go strictly by the numbers, Yahoo, MSN and... Read More

The Great Search Engine Experiment Revisited Who is the Coolest Guy in the Universe

A recent Search Engine Experiment Demonstrates how by combining Key... Read More

Why Optimize Your Site For Search Engines?

Sometimes a search engine optimization company will miss that glaring... Read More

Is Reciprocal Linking Dead?

I just read an article at SitePro News that really... Read More

Diary of a Google Gazumpee

Back in November, when the Google Dance began, Barry Lloyd... Read More

Yahoo Listing Still Worth It?

In October 2002, the Yahoo! portal changed the way it... Read More

Smartpages - Legitimate SEO Or Spam?

Smartpages are highly optimized pages which draw stampeded of search... Read More

Playing in Googlebots Sandbox with Slurp, Teoma, & MSNbot - Spiders Display Differing Personalities

There has been endless webmaster speculation and worry about the... Read More

Secrets on Website Promotion: How You Can Get a #1 Ranking for Your Website Name Within 30 Days

Launching a new website with enough acceleration to rise above... Read More

The Google Phenomenon: Greatest Hits Collection

As my readers know, I've been one of Google's harshest... Read More

Do Search Engines Like Your Web Site?

Between 75% and 98.8% of visitors to Web sites come... Read More

How to Protect Your Search Engine Placement by Keeping Up-to-date on Industry Changes

There's no denying it: Search engines are a dominating force... Read More

Google ? A Bit of History

The first question most people have is, "What the heck... Read More

Top 2 Ways To Get Higher Rankings in Major Search Engines

Top 10 search engine rankings. Everybody wants it but a... Read More

How Google Indexes Content From Your Web Directory

In a fluke, I was able to notice something about... Read More

Picking Keywords for SEO ? A Different View

The first step to developing any search engine optimization effort... Read More

How To Use Google As A Niche Website Builder

The popularity of weblogs or blogs has gotten a lot... Read More