Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.

It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.

This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.

What caused this infestation of bots?

Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."

So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.

Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".

There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.

Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.

In less than 36 hours, 'Googlebot' found my feed!

In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.

They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!

When will they go home and stop prying into my little secrets?

I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!

I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.

So I have obliged him!

I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.

Isn't this a laugh?

It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.

My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.

So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.

About The Author

Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com

Subscribe to his ezine just send a blank email to:- ebook-sales@aweber.com

---

The Other Side of the Search Gods Abracadabra!

Thousands of servers ...billions of web pages.... the possibility of... Read More

How To Get Number 1 Spot In Google, Every Time, Guaranteed

Woaah! Wait a minute. Before I exclusively reveal these insider... Read More

An Introduction to Google Sitemaps

... and why I 'm dying to get finally in... Read More

Search Engines 101 - Search Engines Explained

What Are Search Engines?A search engine is a database system... Read More

Are You Hung-Up on Page Rank and Back Links?

It's unfortunate that many website owners are so hung-up on... Read More

THREE Secrets to High Search Engine Rankings the Easy Way!

Let me guess, you've read article after article on how... Read More

Search Engine Optimization For Blogs

Blogging software is really a simple Content Management System (CMS)... Read More

Without Conversion Rates You Don’t Know If You’re Mickey Mouse Or Mickey Mantle

I couldn’t agree more with the headline of this article... Read More

Search Engine Optimization for Everyone

There are many facets to SEO and the search engines... Read More

Optimizing For Visitors Not Search Engines

Most people feel that optimizing is to target the search... Read More

Picking Keywords for SEO ? A Different View

The first step to developing any search engine optimization effort... Read More

Every Search Engine Robot Needs Validation

Your website is ready. Your content is in place, you... Read More

Finding Profitable Keyword Phrases

So you have a site concept developed that you are... Read More

Optimize Your Website or Get Lost In The Crowd!

It used to be that designing an attractive website to... Read More

Search Engine Optimization - Enhancing Web Site Visibility

I've had several prospects and clients say to me "I... Read More

Search Engine Algorithm Quandaries

Before you make drastic changes to your website after a... Read More

The Search Doesnt End at Your Homepage

In a recent report for a new client, I wrote:... Read More

Link Building: To Link, or Not to Link, That is the Question

Lately, there have been a lot of heated discussions regarding... Read More

Non-Reciprocal Link Building For Higher Search Engine Positioning

Non-Reciprocal Link Building For Higher Search Engine Positioning By Dave... Read More

Link Popularity: Why Its The Best Investment You Can Do For Your Business

More and more search engines rank your web pages based... Read More

Five Simple Steps to Getting Links to Your Site

Today if you want your site to survive in the... Read More

Search Engine Optimization - Free Tips and Help - Part One - The Title Tag

Search Engine Optimization is a widely misunderstood industry. Many webmasters,... Read More

Increase Web Site Sales with a SEO Proposal - Part 1

You can easily get confused by all the search engine... Read More

How To Write Effective And Unique Articles That Are Optimized for the Search Engines

It is a well known fact that writing, distributing and... Read More

SEO India: Tips & Techniques

SEO is all about "Individualism"According to me SEO is not... Read More

SEO #6: How TO GET Banned by Google!

Yesterday you should have read the fifth course out of... Read More

Do Search Engines Scare You?

What do the words "Search Engine" make you think of?... Read More

Has Google Lost the Plot?

With the help of MSN, recently I've been reminiscing about... Read More

Good Things Come to Those Who Wait (and Other Analogies and Cliché?s for SEO)

We've all heard that familiar expression, "Good things come to... Read More

Introduction to Google Page Rank (PR)

For anyone looking to enhance their Google Page Rank (PR)... Read More

Easy Steps to Get Onto Google Top Search Pages

To get on Google's top pages can be accomplished by... Read More

SEO Deadly Sins - Mistakes That Hurt Web Page Ranking

The following are a list of mistakes can ensure that... Read More

The Mystery of the Magical Keyword Density Formula

Keyword density. When it comes to SEO copywriting, this has... Read More