Design A Spider Friendly Site

To be successful in the search engines it's important to design your web site with the spiders in mind. Using the latest in web page design is not generally the best way to go. Spiders don't view web pages like humans do, they must read the HTML in the page to see what it's about. Below you will find tips on how to best design your web site with search engines in mind.

Do not use frames at all. Some search engines cannot spider web pages with frames at all. For the other search engines that can, they can have problems spidering it and sometimes they too can't index the web page. Do not only use image's to link out. You should always use text links to link out to important content on your web site. Spiders can follow image links, but like text links more though.

Use external JavaScript files instead of using Java Script code in the HTML document, using Java Script in the HTML document will make the page size much larger. Using an external Java Script file to do the job will reduce page size and make it easier for both spiders and browsers to download the page. Using Cascading Style Sheets can reduce page size and making the download time much faster in most cases. It will allow the spider to index your web page faster and can help your ranking.

Avoid using web page creators such as FrontPage, Dreamweaver or a WYSIWYG editor. Software such as that will often times add scripting code that is not needed, making the page larger than it needed to be and making it harder to crawl. It will also add code that can't be read by the search engines, causing the spider not to index the page or not index the whole web page. It is better to use standard HTML. Adding code that they can't read or have a hard time to read can lead to major problems with your ranking.

Try not to use Flash when possible. Flash cannot be read by the search engines to date and will cause download time to slow a bit. If you do decide to use Flash anyway, make sure you add text to the web page, so the search engines have something to read and find out what your web page is about. It will also allow your visitors to have something to read while the Flash file loads. Also don't use Flash as a way of navigation, as I said before spiders cannot read Flash.

It's important to add a site map to your web site. Not only will this make it easier for internet surfers to get around your web site, but it will also allow spiders to find your site's content easier and index your web page sooner. The site map should contain text links and not image links.

I highly suggest that you look at your web page with a Lynx browser because this is similar to how search engines will view your web page. There are other tools on the internet that will allow you to view your web page without a Lynx browser, but see a web page just like it, so you may want to check those out as well.

Matt Colyer is the owner of Superior Webmaster. He also is a php, CGI, and ASP developer.

In The News:


pen paper and inkwell


cat break through


Link Reputation - How to Improve Search Engine Rankings

One of the most overlooked strategies to improve search engine... Read More

Spamglish; A Search Engine Comedy With A Language All Its Own

When the movie Spanglish hit the screens in 2004, it... Read More

7 Essential SEO techniques

1) Title Tag ? When we're talking about SEO Technique,... Read More

The Reality of Search Engine Submissions

Over the last few months, search engine submissions have changed... Read More

How Important is PageRank, Really?

Webmasters can spend most of their waking hours doing everything... Read More

The Search Doesnt End at Your Homepage

In a recent report for a new client, I wrote:... Read More

Opinion ? Search Engine Success

This article is actually the summary to a book soon... Read More

Affordable Small Business SEO: 5 Common SEO Errors and How to Fix Them

Don't put the cart before the horse.You can't do SEO... Read More

10 Quick Ways To Kick-Start Your Profit Pulling Keywords

First, you must realize that targeting the right keywords or... Read More

How To Get Your Web Site Banned ? or Search Engine Promotion, How Not to do it!

Search engines constantly strive to advance their technology and algorithms... Read More

The 7 Points of Do-It-Yourself SEO

Ever felt intimidated at the convoluted, jargon-ridden information about Internet... Read More

The Myth of Guaranteed #1 Ranking in Search Engine Marketing

You've seen the ads: Guaranteed #1 Ranking! There are no... Read More

Increase Web Site Sales with a SEO Proposal - Part 1

You can easily get confused by all the search engine... Read More

Search Engine Updates vs. SEO

Webmasters always anxiously wait for a search engine update. Those... Read More

Link Building in Light of Vision-based Page Segmentation

The days of basing a successful link building strategy on... Read More

Breaking the Myth About Page Rank (PR)

The most difficult challenge most web designers face is getting... Read More

Is Something Missing From Your Keywords Research? (Part 2)

In my previous article, I raised the issue that proper... Read More

Googles Next Big Move

November 2003 might go down in history as the month... Read More

SEM - Research Measures Success

SEM - Research Measures SuccessSearch engine marketing success comes from... Read More

Adding City Names At The End Of Your Keywords Can Bring You More Profits

In recent times, I have been closely studying keywords that... Read More

How Do I Improve My Web Site Conversion Rate? Part 3

Question 1How do keywords effect your conversion rate in terms... Read More

How To Choose Keywords Before they Skyrocket in Popularity

Long before the days of researching phrases with the helpful... Read More

Everything You Wanted To Know About Google -- But Were Afraid To Search For!

(A Reflective look at the little search engine that soared!)All... Read More

3 Deadly Search Engine Marketing Sins

My inbox this week provided glaring examples of three all... Read More

Fixed Point of Reference

According to author Frank Peretti, "A fixed point of reference... Read More

The Search Engine Secret That Is No Secret At All

It's common knowledge - we all know that it is... Read More

Duplicate the Exact Steps Used to Get a Number 1 Yahoo Ranking in Less than 30 Days

If you have ever been into a McDonalds you will... Read More

Google Patent Application - User Data As Part of Ranking Process

In this third article, we continue to dig into the... Read More

Youve Got The Power, Why Arent You Promoting It?

Like all things, theft is theft, misery loves company, negative... Read More

Search Engine Optimization :: The Basics and Why Websites Need It

We all know that the most targeted traffic we can... Read More

Search Engine Rankings for Beginners

Search engine optimization is best left in the mystical land... Read More

How To Weather Google Algorithm Changes

If you spend much time reading the various webmaster forums,... Read More

How to REALLY Profit from SEO

I want to give you a few more things to... Read More