I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.
It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.
This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.
What caused this infestation of bots?
Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."
So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.
Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".
There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.
Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.
In less than 36 hours, 'Googlebot' found my feed!
In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.
They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!
When will they go home and stop prying into my little secrets?
I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!
I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.
So I have obliged him!
I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.
Isn't this a laugh?
It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.
My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.
So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.
About The Author
Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com
Subscribe to his ezine just send a blank email to:- ebook-sales@aweber.com
The top three search pages- the only place you'll be... Read More
Little do you know but you too could be making... Read More
Everyone should realize that the search engines (sponsored ads aside)are... Read More
Having a Google Sitemap just got better! Not only does... Read More
Among the many things you need to worry about for... Read More
By now you have likely heard that keywords and keyword... Read More
Three Ways To Index Your Site With Google Sitemaps [Difficult,... Read More
You may have heard how important it is to have... Read More
November 2003 might go down in history as the month... Read More
Making the following changes to your title tag can help... Read More
By about 2pm everyday, each of my team members has... Read More
Search Engine Optimization (SEO) must be considered a process and... Read More
If your site isn't found in the search engines, it... Read More
When it comes to search engine optimization there is a... Read More
There are a lot of things in Search Engine Optimization... Read More
The major search engines are always on the lookout to... Read More
Thanks to a unique algorithm that produces most relevant results... Read More
1. Search Engine - Is a database of web sites... Read More
So you want to get listed on Google? And you... Read More
Search Engine Optimization, optimizing your website for it to be... Read More
Regardless of which type of business you currently have, you... Read More
The name of the game is search engine optimization and... Read More
The higher the PR of your site the higher will... Read More
We've all heard that familiar expression, "Good things come to... Read More
Your title tag is the most important 3 to 12... Read More
Generating high traffic to your web site can be costly,... Read More
PageRank - an exclusive technology developed by Google which can... Read More
No doubt, having a high search engine ranking is very... Read More
Long before the days of researching phrases with the helpful... Read More
Most webmasters have no idea on how to make a... Read More
Sometimes questions will arise around the subject of gateway information... Read More
1) Title Tag - The title tag is the most... Read More
Its a matter of here today, gone tomorrow at the... Read More
In my previous article, I raised the issue that proper... Read More
One of the important factors in ranking high in search... Read More
This is another one of the controversial questions in many... Read More
Link popularity is very important these days for all websites... Read More
As a search engine optimization specialist, I often run across... Read More
It is literally amazing how many people start their online... Read More
Before using keywords for your site, it is always better... Read More
There is a lot of competition to get good spots... Read More
IntroductionThe Google Sandbox is a term applied to the phenomenon... Read More
With the advent of Google Local, a service that helps... Read More
Google's PageRank has been around for years, and in the... Read More
Lately, there have been a lot of heated discussions regarding... Read More
Some very early users of the Internet - not the... Read More
Nothing could be simpler than the title you give to... Read More
The WhyBut what is the reality of reaching a number... Read More
Search Engine Optimization nowadays has a lot to do with... Read More
Search engine optimization is one of most popular online marketing... Read More
Keyword Research will reveal answers to 3 critical questions:1. Is... Read More
Would you like a checklist of the important steps to... Read More
If you go strictly by the numbers, Yahoo, MSN and... Read More
When people think of search engine optimization, they immediately think... Read More
It all happened 3 months back, I have a blog... Read More
According to the recent release of the Google Patent Application,... Read More
Source code optimization.{title}...{/title}This tag is to be a winner. This... Read More
Let's say you are writing a web site to sell... Read More
Whether you want to start a business and sell on... Read More
At the beginning of the web era, users would go... Read More
We've all heard that familiar expression, "Good things come to... Read More
In very simple words, the link popularity of your site... Read More
Many internet marketers blow mountains of start-up cash on their... Read More
The complexities of Google's PR (Page Ranking) System have grown... Read More
Ever felt intimidated at the convoluted, jargon-ridden information about Internet... Read More
You've spent many hours trying to increase your online traffic... Read More
Search Engine Optimization (SEO) |