Site Maps: Let Search Engines Find Your Pages

With 40 million websites in existence, and more than 3 billion web pages indexed by Google at the time of this writing (July 2003), it's no wonder that more and more people are relying on search engines to find their way through the unruly world that the web has become.

Nowadays, it is crucial to get your pages indexed by the most important search engines. To maximize traffic to your site, you must make sure that all your internal pages are indexed, not just your main page (homepage).

Fortunately, you don't need to submit each of your pages manually. The most efficient way is to create a Site Map (a list of links to all the pages in your site) and link to it directly from your homepage.

How Will A Site Map Help Me?

Search engines find pages by "crawling" the web. They go through the code of all the pages in their database (also called index), following links to other pages and adding them to the database (in fact, more pages are added this way than by manual submission).

However, search engines have trouble following links from pages buried too deep within the directory structure of a site. A Site Map solves this problem by giving the engines access to the links to all your pages once they follow the Site Map link in your homepage. For more effectiveness, place your Site Map in your root directory (where your index page is).

Site Maps: Not Just for Search Engines

While some web users will find their way through your site by following navigation links or by using the search box, others will turn to your Site Map. If you design your Site Map carefully, it will not only be useful to the search engines, but to your human visitors as well.

Here are some pointers:

• The Site Map should act pretty much like the table of contents of a book.

• The Site Map must clearly show all the sections of your site, and the information contained in each of those sections.

• Every item in your Site Map must be hyperlinked to its URL.

• If it's not too long or cumbersome, use each page's TITLE as the link text, since this tends to increase the relevance of your site. Otherwise, use the word or the short phrase that best describes the content of the page.

• Make sure that you place the link to your Site Map at a visible location in your homepage (users shouldn't need a map to find your Site Map!).

• Don't get creative: simply call the link "Site Map".

• Make your Site Map a simple text link. If you use javascript the search engines will ignore it.

How can I check if my pages have been indexed?

Once you have created and uploaded your Site Map and placed a link to it in your homepage, submit both your homepage and your Site Map page to the search engines. You will then have to wait until the search engines do a web crawl. In the case of Google, the largest search engine, this happens approximately once a month.

To check if a page on your site has been picked-up and indexed by Google's, go to www.google.com and use the "allinurl" command in the search box:

allinurl:yourdomain.com/yourpage.html

Where "yourdomain.com/yourpage.html" is the URL of the page you want to check.

To get a list of all the pages in your domain that have been indexed by Google, you'll have to use the "site" command, followed by your domain name plus a word (or group of words) that you know appear in all your pages (for example, a copyright statement or some footer text):

site:yourdomain.com commonword

If after typing this command you get a list of all your pages (or at least a significant number of pages that weren't in the index before), this will be a strong indication that your Site Map has been successful.

-----

You can freely reprint this article. Just include the following resource box at the end:

About The Author

Mario Sanchez publishes The Internet Digest ( http://www.theinternetdigest.net ), an online collection of web design and Internet marketing articles and resources. You can freely reprint his weekly articles in your website, ezine, newsletter or ebook.

---

What Is Search Engine Marketing?

It's in our genes, we're driven to seek. We 'hunt'... Read More

The Changing Face of Search Engine Optimization

With the ever evolving internet market for just about anything... Read More

Buzzwords vs Effective SEO Keywords

Ever see a website that seems to speak a foreign... Read More

Search Engine Metrics: Organic Search vs. Paid Placement

Let me preface this report by citing advertisers in 2004... Read More

Do-It-Yourself Search Engine Optimization

Search engine optimization, or SEO, is big business. If you... Read More

7 Search Engine Optimization Strategies

Search engine optimization refers to the technique of making your... Read More

How to REALLY Profit from SEO

I want to give you a few more things to... Read More

Have You Heard Of Website Optimization

Have you heard of website optimization ? If you are... Read More

Meta Tags - An Important Part of Every Web Page

Meta tags are an absolute must from a search engine... Read More

Internet Directory Submission Tips

Internet Directories and their ImportanceThere are two very pertinent reason... Read More

Submit Your Website to Search Engines

Some search engine submissions are free and some pay for... Read More

Utilizing Popular Directories as Free Link Sources

If you're a webmaster, you've probably spent almost as much... Read More

PPC Advertising ? The First Step In A SEO Marketing Campaign

Often, sites view seo and PPC marketing as exclusive marketing... Read More

Click Click Boom: a Linking Strategy that will Blow Away Your Competition

Web marketers, do you hear what I hear?"Click-click BOOM"That's the... Read More

Google Patent Application - User Data As Part of Ranking Process

In this third article, we continue to dig into the... Read More

SEOs Relationship With Website Architecture

SEO's Relationship With Website ArchitectureSearch engine optimization for today's search... Read More

Can Google Really Deliver Country Specific Searching?

This is a serious matter, can Google really deliver top... Read More

Gaining Additional PageRank

Google is the major search engine webmasters have to deal... Read More

Types of Links

Internal Linking ? An introductionThe web as they call it... Read More

Importance of Keywords in Links to Your Website

Search Engine Optimization (SEO) is a very complex process. It... Read More

Which Search Engine Optimization Services to choose, Google OR Yahoo?

Search Engine Optimization is emerging as the most powerful form... Read More

Search Engine Optimization - Free Tips and Help - Part One - The Title Tag

Search Engine Optimization is a widely misunderstood industry. Many webmasters,... Read More

Importance of Keywords in Anchor Text or Title Text

Keywords are indisputably, the single most important element of an... Read More

3.5 Tips To Help You Avoid Becoming The Next Search Engine Outlaw

Tip 1 - Hide And SeekDo not use hidden text... Read More

Is Something Missing From Your Keywords Research? (Part 2)

In my previous article, I raised the issue that proper... Read More

SEO Help: Dont Try to Fool the Search Engines

Writing articles is all the rage these days on the... Read More

3.5 Tips To Help You Avoid Becoming The Next Search Engine Outlaw

Want to avoid being blacklisted by the search engines and... Read More

Choosing a good domain name isnt always so simple.

So you need a domain name for your brand new... Read More

Future of SEO - Making Money Online from Your Home and Building Homes from Making Money Online

Everyone seems to want the benefits from working at home:... Read More

The Reality of Search Engine Submissions

Over the last few months, search engine submissions have changed... Read More

How to Create Killer Keywords to Get FREE Traffic to Your Website

When exploring good keyword choices there are several steps one... Read More

The Long And Short Of It Is That These Two Sales Techniques Are The Same

With the Internet beginning to stand up and be counted... Read More

Googles Next Big Move

November 2003 might go down in history as the month... Read More