Site Maps: Let Search Engines Find Your Pages

With 40 million websites in existence, and more than 3 billion web pages indexed by Google at the time of this writing (July 2003), it's no wonder that more and more people are relying on search engines to find their way through the unruly world that the web has become.

Nowadays, it is crucial to get your pages indexed by the most important search engines. To maximize traffic to your site, you must make sure that all your internal pages are indexed, not just your main page (homepage).

Fortunately, you don't need to submit each of your pages manually. The most efficient way is to create a Site Map (a list of links to all the pages in your site) and link to it directly from your homepage.

How Will A Site Map Help Me?

Search engines find pages by "crawling" the web. They go through the code of all the pages in their database (also called index), following links to other pages and adding them to the database (in fact, more pages are added this way than by manual submission).

However, search engines have trouble following links from pages buried too deep within the directory structure of a site. A Site Map solves this problem by giving the engines access to the links to all your pages once they follow the Site Map link in your homepage. For more effectiveness, place your Site Map in your root directory (where your index page is).

Site Maps: Not Just for Search Engines

While some web users will find their way through your site by following navigation links or by using the search box, others will turn to your Site Map. If you design your Site Map carefully, it will not only be useful to the search engines, but to your human visitors as well.

Here are some pointers:

• The Site Map should act pretty much like the table of contents of a book.

• The Site Map must clearly show all the sections of your site, and the information contained in each of those sections.

• Every item in your Site Map must be hyperlinked to its URL.

• If it's not too long or cumbersome, use each page's TITLE as the link text, since this tends to increase the relevance of your site. Otherwise, use the word or the short phrase that best describes the content of the page.

• Make sure that you place the link to your Site Map at a visible location in your homepage (users shouldn't need a map to find your Site Map!).

• Don't get creative: simply call the link "Site Map".

• Make your Site Map a simple text link. If you use javascript the search engines will ignore it.

How can I check if my pages have been indexed?

Once you have created and uploaded your Site Map and placed a link to it in your homepage, submit both your homepage and your Site Map page to the search engines. You will then have to wait until the search engines do a web crawl. In the case of Google, the largest search engine, this happens approximately once a month.

To check if a page on your site has been picked-up and indexed by Google's, go to www.google.com and use the "allinurl" command in the search box:

allinurl:yourdomain.com/yourpage.html

Where "yourdomain.com/yourpage.html" is the URL of the page you want to check.

To get a list of all the pages in your domain that have been indexed by Google, you'll have to use the "site" command, followed by your domain name plus a word (or group of words) that you know appear in all your pages (for example, a copyright statement or some footer text):

site:yourdomain.com commonword

If after typing this command you get a list of all your pages (or at least a significant number of pages that weren't in the index before), this will be a strong indication that your Site Map has been successful.

-----

You can freely reprint this article. Just include the following resource box at the end:

About The Author

Mario Sanchez publishes The Internet Digest ( http://www.theinternetdigest.net ), an online collection of web design and Internet marketing articles and resources. You can freely reprint his weekly articles in your website, ezine, newsletter or ebook.

---

Link Horse Trading For The PR Challenged

After 105 days Google finally updated PR. And it's about... Read More

Finding The True PR Of A Page?

I had an email "conversation" this last week which I... Read More

A Naive Mistake Cost Me My Google Rankings

Little do you know but you too could be making... Read More

How Do I Improve My Web Site Conversion Rate? Part 2

Question 1Does it help to track visitor behavior on websites... Read More

What Is Search Engine Optimization And Why Do I Need It?

Purchasing web design service is confusing with all of the... Read More

Google Is Taking Descriptions From Alexa!

In a recent study looking at the "descriptions" of website... Read More

The Need of Popularity

In very simple words, the link popularity of your site... Read More

Why SEO Will Make or Break You, Part 1

Today's article is about the wonders of SEO. SEO is... Read More

THREE Secrets to High Search Engine Rankings the Easy Way!

Let me guess, you've read article after article on how... Read More

Google is Quickly Changing...

Google is quickly changing...With the big buzz of Novembers fall... Read More

Keywords, Choose Them Wisely

By now you have likely heard that keywords and keyword... Read More

Monitor and Increase Your Search Engine Visibility with the DIY SEO Tools

In this three part article, you'll find many tools that... Read More

Beating the New Google AdWord Rules with Blogs and RSS

When Google Adwords first came on scene, it was not... Read More

Are You Getting Nuked By Google Lately?

Since the last Google update, there have been many instances... Read More

SEO Expert Guide - Page Optimization (part 5/10)

In parts 1 - 4 you learnt how to develop... Read More

Google PageRank Explained

PageRank - an exclusive technology developed by Google which can... Read More

Search Engine Marketing (SEM) - Houses on Sand

Do you depend on free search engine traffic for your... Read More

An Ethical Alternative to Doorway Pages

Definition: A doorway page is content created specifically for the... Read More

The Real Search Engine Optimization Guide

Nowadays, there is so much talk about SEO (search engine... Read More

Smartpages - Legitimate SEO Or Spam?

Smartpages are highly optimized pages which draw stampeded of search... Read More

3.5 Tips To Help You Avoid Becoming The Next Search Engine Outlaw

Want to avoid being blacklisted by the search engines and... Read More

The Golden 5: Steps to Google Success

The Dream: You wake up one morning and notice your... Read More

Importance of Keywords in Anchor Text or Title Text

Keywords are indisputably, the single most important element of an... Read More

Why Search Engine Optimization is Not Enough

OK. So you've created a nice website with lots of... Read More

Link Popularity: Improve Your Search Engine Rankings

What is link popularity?Link Popularity is simply the total number... Read More

Search Warrant

So, you've just paid £300 - £10,000 for a new... Read More

How Google Indexes Content From Your Web Directory

In a fluke, I was able to notice something about... Read More

The Mystery of the Magical Keyword Density Formula

Keyword density. When it comes to SEO copywriting, this has... Read More

SEO Quickstart - 3 Things You can Do to Improve Search Engine Rankings Right Now

Increasing your search engine rankings should certainly be one of... Read More

New Site and Sandbox: How to Get Rid of It

You have put lot of sweat in making your site.... Read More

The Matrix Help For Keyphrase Analysis

Keyword analysis is a major part of search engine marketing.... Read More

The Hottest Tip On Getting A Web Site Listed Quickly by Yahoo, Inktomi, MSN, FAST and AltaVista

Every webmaster knows that the free search engines are a... Read More

Maximize Your Search Engine Traffic - 13 Ways to Pull in More Visitors From the Search Engines

Maximizing traffic from the search engines to your web site... Read More