Design A Spider Friendly Site

To be successful in the search engines it's important to design your web site with the spiders in mind. Using the latest in web page design is not generally the best way to go. Spiders don't view web pages like humans do, they must read the HTML in the page to see what it's about. Below you will find tips on how to best design your web site with search engines in mind.

Do not use frames at all. Some search engines cannot spider web pages with frames at all. For the other search engines that can, they can have problems spidering it and sometimes they too can't index the web page. Do not only use image's to link out. You should always use text links to link out to important content on your web site. Spiders can follow image links, but like text links more though.

Use external JavaScript files instead of using Java Script code in the HTML document, using Java Script in the HTML document will make the page size much larger. Using an external Java Script file to do the job will reduce page size and make it easier for both spiders and browsers to download the page. Using Cascading Style Sheets can reduce page size and making the download time much faster in most cases. It will allow the spider to index your web page faster and can help your ranking.

Avoid using web page creators such as FrontPage, Dreamweaver or a WYSIWYG editor. Software such as that will often times add scripting code that is not needed, making the page larger than it needed to be and making it harder to crawl. It will also add code that can't be read by the search engines, causing the spider not to index the page or not index the whole web page. It is better to use standard HTML. Adding code that they can't read or have a hard time to read can lead to major problems with your ranking.

Try not to use Flash when possible. Flash cannot be read by the search engines to date and will cause download time to slow a bit. If you do decide to use Flash anyway, make sure you add text to the web page, so the search engines have something to read and find out what your web page is about. It will also allow your visitors to have something to read while the Flash file loads. Also don't use Flash as a way of navigation, as I said before spiders cannot read Flash.

It's important to add a site map to your web site. Not only will this make it easier for internet surfers to get around your web site, but it will also allow spiders to find your site's content easier and index your web page sooner. The site map should contain text links and not image links.

I highly suggest that you look at your web page with a Lynx browser because this is similar to how search engines will view your web page. There are other tools on the internet that will allow you to view your web page without a Lynx browser, but see a web page just like it, so you may want to check those out as well.

Matt Colyer is the owner of Superior Webmaster. He also is a php, CGI, and ASP developer.

In The News:


pen paper and inkwell


cat break through


Speed Indexing - 3 Steps to Getting Your Website Listed in Google Quickly

Getting your website listed in Google quickly simply requires that... Read More

How To Weather Google Algorithm Changes

If you spend much time reading the various webmaster forums,... Read More

Future of SEO - Making Money Online from Your Home and Building Homes from Making Money Online

Everyone seems to want the benefits from working at home:... Read More

How To Measure Search Engine Marketing ROI

According to the Search Engine Marketing Professional Organization (SEMPO), advertisers... Read More

Search Engine Tips & Techniques

As you are building your site or getting your site... Read More

Sitemaps 101 - Back to SEO School

Sitemaps are without doubt one of the most often ignored... Read More

Put the Full Power of Google to Work with 11 Google Power Search Tips

Google has many ways to help you find want you... Read More

Internet Directory Submission Tips

Internet Directories and their ImportanceThere are two very pertinent reason... Read More

Search Engine FAQ

Why shouldn't I use a submission service that submits my... Read More

Black Hat SEO and the Sneaky Redirect

Are shades of grey SEO really Black Hat SEO?Black hat... Read More

Google Is Taking Descriptions From Alexa!

In a recent study looking at the "descriptions" of website... Read More

Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a... Read More

SEO for CEOs ? Search Engine Optimization Unmasked for CEOs

If you're like most other CEOs, the term "search engine... Read More

Optimizing Your Website

Search Engine Optimization, optimizing your website for it to be... Read More

Why SEO (as we know it) is Doomed to Failure and How You Can Avoid the Trap

Search Engine Optimization (SEO) has become one of the biggest... Read More

Finding Targeted Keyword Phrases Your Competitors Miss

Finding Targeted Keyword Phrases Your Competitors MissFinding keyword phrases your... Read More

How To Use Google As A Niche Website Builder

The popularity of weblogs or blogs has gotten a lot... Read More

How to Pick an SEO Firm

If you're looking for an SEO firm, we recommend that... Read More

How to Boost Your Traffic and Profits with Content!

Are you aware of how vitally important and valuable CONTENT... Read More

All About Google

If you read The Search Engine Showdown, you... Read More

Taking Advantage of Googles Sandbox Effect

Most new sites submitted to Google (at least within the... Read More

Link Popularity --- Its Role and Importance In Getting Top Search Engine Rankings

Introduction"Link Popularity" ? these words may have caught your attention... Read More

Search Engine Optimisation ? Why And How To Do It

In the following article I will give you some basic... Read More

SEOing A Flash Intro

IntroductionWhy does a FLASH intro need SEO? Flash, the great... Read More

Keyword Demand Isnt Enough

I get half of the world traffic for the term... Read More

7 Steps to Highly Relevant, Search Engine Friendly, and People Useful Web Site Content

The task is to build a Content Rich Search Friendly... Read More

3.5 Tips To Help You Avoid Becoming The Next Search Engine Outlaw

Want to avoid being blacklisted by the search engines and... Read More

Meta Tag Tactics - Give Your Website Traffic a Boost with the Meta Tag Basics

Getting your site noticed by the search engines and rewarded... Read More

10 Minutes to Your Google Sitemap

Google's calling your name...Hi, Google here. We want to index... Read More

Why is Search Engine Optimisation Expensive?

Many of our customers (http://www.internet-marketing-australia.com) find search engine... Read More

Dont Make the Top 30 SEO Mistake

SEO consultants will tell you that you need to be... Read More

Googles Trap, DMOZs Nap, And Yahoo!s Crap

On November 16th, 2003, Google commenced an update (the Florida... Read More

An Easy Way Not to Get Banned by Google

Strategic search engine optimization involves far more than keyword research,... Read More