Design A Spider Friendly Site

To be successful in the search engines it's important to design your web site with the spiders in mind. Using the latest in web page design is not generally the best way to go. Spiders don't view web pages like humans do, they must read the HTML in the page to see what it's about. Below you will find tips on how to best design your web site with search engines in mind.

Do not use frames at all. Some search engines cannot spider web pages with frames at all. For the other search engines that can, they can have problems spidering it and sometimes they too can't index the web page. Do not only use image's to link out. You should always use text links to link out to important content on your web site. Spiders can follow image links, but like text links more though.

Use external JavaScript files instead of using Java Script code in the HTML document, using Java Script in the HTML document will make the page size much larger. Using an external Java Script file to do the job will reduce page size and make it easier for both spiders and browsers to download the page. Using Cascading Style Sheets can reduce page size and making the download time much faster in most cases. It will allow the spider to index your web page faster and can help your ranking.

Avoid using web page creators such as FrontPage, Dreamweaver or a WYSIWYG editor. Software such as that will often times add scripting code that is not needed, making the page larger than it needed to be and making it harder to crawl. It will also add code that can't be read by the search engines, causing the spider not to index the page or not index the whole web page. It is better to use standard HTML. Adding code that they can't read or have a hard time to read can lead to major problems with your ranking.

Try not to use Flash when possible. Flash cannot be read by the search engines to date and will cause download time to slow a bit. If you do decide to use Flash anyway, make sure you add text to the web page, so the search engines have something to read and find out what your web page is about. It will also allow your visitors to have something to read while the Flash file loads. Also don't use Flash as a way of navigation, as I said before spiders cannot read Flash.

It's important to add a site map to your web site. Not only will this make it easier for internet surfers to get around your web site, but it will also allow spiders to find your site's content easier and index your web page sooner. The site map should contain text links and not image links.

I highly suggest that you look at your web page with a Lynx browser because this is similar to how search engines will view your web page. There are other tools on the internet that will allow you to view your web page without a Lynx browser, but see a web page just like it, so you may want to check those out as well.

Matt Colyer is the owner of Superior Webmaster. He also is a php, CGI, and ASP developer.

In The News:


pen paper and inkwell


cat break through


How Important is PageRank, Really?

Webmasters can spend most of their waking hours doing everything... Read More

How to Increase Alexa Ranking of Your Website

Alexa toolbar also useful to Browse expired websites database. Many... Read More

Would You Let A Dog Or A Butler Market Your Website?

The latest news to hit the Internet's 'water cooler' is... Read More

How You Can Easily Compile A Gigantic Keyword List

It doesn't matter what kind of marketing you are involved... Read More

Adding City Names At The End Of Your Keywords Can Bring You More Profits

In recent times, I have been closely studying keywords that... Read More

Increase Your Link Popularity for Free

Among the many things you need to worry about for... Read More

How to Boost Your Traffic and Profits with Content!

Are you aware of how vitally important and valuable CONTENT... Read More

Search Engine Optimization (SEO) Strategy - Navigating the Dark Waters of Website Promotion

Creating a well-designed website is the first step in your... Read More

Even More Tips For Getting A Top 10 Search Engine Ranking!

I have spent some time discussing the 5 different options... Read More

The Easiest Way to Your Google Sitemap

Google Sitemaps is a new tool for website owners and... Read More

Search Engine Essentials

What are Search Engines?There are numerous different search engines, and... Read More

Table Structures For Top Search Engine Positioning

So you have a beautiful website that you paid a... Read More

SEO #2: On-page Optimization

Yesterday you should have read the first course out of... Read More

The Matrix Help For Keyphrase Analysis

Keyword analysis is a major part of search engine marketing.... Read More

Developing A List Of Keywords For Marketing

Keywords aren't just some words that allow search engines, like... Read More

Complete Web-Site Optimization For Search Engines (Part 1)

SEO or search engine optimization strategy now becomes widely popular... Read More

Improve Search Engine Rankings - The Real Deal!

Ok, here's the deal, follow these steps and shoot me... Read More

SEO Expert Guide - Proposition Development (part 2/10)

It is literally amazing how many people start their online... Read More

Search Engine Optimization --- An Overview

Search engine optimization is one of most popular online marketing... Read More

New MSN Search Engine: How Good is it?

If you have an online business or you just use... Read More

How Do I Submit My Site To Search Engines?

You've built up a good site, put in a lot... Read More

How to Avoid the Google Duplicate Content Filter?

More and more webmasters are building websites with publicly available... Read More

Choosing your Meta-Keywords

Introduction This article assumes you already know what... Read More

Duplicate Content Penalty - How to Lose Google Ranking Fast!

Duplicate content penalty. Ever heard of it? This penalty is... Read More

Search Engine Optimization :: The Basics and Why Websites Need It

We all know that the most targeted traffic we can... Read More

The (Not So) Shocking Truth About Getting A High Search Engine Ranking

I have seen my site hit #3 at Google, and... Read More

Complete Web-Site Optimization For Search Engines (Part 2)

Source code optimization.{title}...{/title}This tag is to be a winner. This... Read More

Keyword Popularity Check

Before using keywords for your site, it is always better... Read More

SEO Facts

The internet is the largest market place on earth. It... Read More

The Ultimate Free Google Ranking Tool

The first months my website was online, I was constantly... Read More

Submit Your WebSite: Add Your URL to Web Directories & Search Engines

Why get into Search engines and directories?Increase backlinks of your... Read More

What Is Waiting for Us? Tomorrows SEO Industry

Today, SEO is swiftly approaching saturation point. More and more... Read More

Optimize Your Website or Get Lost In The Crowd!

It used to be that designing an attractive website to... Read More