As a search engine optimization specialist I often optimize existing web pages for small business clients, upload them to the site and see pages re-indexed by Google within a week. This only happens with existing business sites that have been online for a few years. Google seems to be updating their index as often as every other week at this point and older established sites that are already indexed seem to be re- crawled on that twice a month schedule on a fairly routine basis.
Two clients that hired me for recent work saw their rankings shoot to the top for a newly targeted search phrase in a weekend when I did optimization on a Thursday and they were ranked instantly by Saturday. Now keep in mind that this doesn't happen for everyone, only those that have been online for some period and already have significant content that simply needs tweaking and proper title and metatag information added. They usually have relatively good existing PageRank and do well for other RELEVANT search phrases already. I offer that warning only to avoid instilling false hopes in anyone hoping to achieve the same instant ranking boost overnight.
Those clients that do succeed in this way are often thrilled with the results accomplished in such short order. I'd love to be able to offer that type of ranking boosts to everyone, but some are more equal than others when it comes to easy, inexpensive SEO tune-ups that rev up your rankings overnight. Your mileage may vary.
WHY DO NEW SITES SUFFER?
What is going on with newer sites that don't get crawled for months? I've got a client, a newer attorney directory that offers tons of great information in the form of articles on specific areas of law, links to incredibly valuable and relevant legal sites and over 600,000 attorneys listed by practice area and state. Yet the site has not been re-crawled by Google for over 3 months! Now this would not be such a big issue for many sites, but this site is relatively new and we've optimized all the titles, tags & page text, created a complete site map and placed links to all these resources on the front page.
I know that the site is not being crawled because Google's cached copy of the front page shows it before we did the work four months ago, without the new links and without title tags. We've submitted the site by hand, (manually) once a month for three months via the Google Add URL page. http://www.google.com/addurl.html When the hand submission failed to get it re-indexed for four months, we submitted the sitemap page, which has not been crawled at all. Google shows only ONE page on this site, when in fact it has thousands of pages, a sitemap and dozens static pages!
Part of the problem is that this site must be dynamic, since a database of over 632,000 attorneys must be accessed, retrieved and served for any of those law firms searched for to be returned to the site visitor. Google warns owners of dynamic sites that Googlebot may not crawl dynamically generated pages with "?"" question marks in the URL. This is to avoid crashing the server with too many concurrent page requests from Google's spider. http://www.google.com/webmasters/2.html#A1
The solution to this dynamic URL problem has been discussed widely in search engine forums and solutions have been bandied about including software provided by SEO's, URL re-write techniques for dynamic pages on APACHE servers http://www.alistapart.com/articles/urls/ and PHP pages http://www.stargeek.com/php-seo.php to generate search engine friendly URL's. Others recommend simply adding static HTML sitemap pages as alternatives for the search engine spiders. In this instance the client's developer simply said "I can't do that (PHP solution) on this server". So we resorted to putting up the static HTML sitemap pages with hard-coded
URLS to the main 54 pages of the site at http://lawfirm411.com/Law-Firm-411-sitemap.html This should get at least those fifty pages crawled by Googlebot, but Googles' spider appears not to be crawling this site at all. How do we know this? See for yourself by using the following query in the search box at Google: allinurl:www.lawfirm411.com where the result page shows ONE page in the results. If you try that query on your own site (replace your own domain name for lawfirm411.com), you'll see the results lists ALL your pages.
The site home page was crawled by Google four months ago, when they took their "Cached Snapshot" of the page. You can see this by visiting the Google cached page here: http://66.102.7.104/search?sourceid=navclient&;ie=UTF-8&q=cache:www.lawfirm411.com where the date of this snapshot is "Apr 20, 2004 07:42:19 GMT" and they haven't been back since. The page in that snapshot has none of the newly added links, an outdated title tag, and old content.
This problem is not unique to this site. One client we worked with two years ago had a dynamically generated, framed site! Those two site structures have always given search engines trouble. Their site was not crawled at all and only the front page showed up. Our solution was to create a second domain (owned by the client), which had static HTML pages that precisely mirrored the content of the client's framed, dynamically generated site. Guess what happened after Googlebot crawled the static site? Google indexed the framed site in full and then banned the static site from the index! Not an approach we advocate, but the one that worked for this client.
We're still searching for ways to get Googlebot back to LawFirm411.com before creating that new static site, but decided to share this odd experience with the SEO community before going to any extremes. Google provides over 70% of most search engine referred traffic to ALL of our clients and we realized we can't site idly by and see a major client languish because Googlebot didn't like what it found at the client site on the first visit four months ago. This issue dogs newer sites in other places as well. The Open Directory Project has also become notoriously slow in adding new sites to the directory and in this case, has not picked up this site even after 6 regular monthly submissions. The web playing field may have begun tilting toward older, established sites and away from new ones.
------------------------------------------------------------
Mike Banks Valentine is the SEO for http://www.lawfirm411.com
Contact him at http://www.seoptimism.com/SEO_Contact.htm
Improve Your Small Business Online at our Ecommerce Tutorial
http://website101.com/Free-Tutorials/index.ht ml
------------------------------------------------------------
Over the past few years, there have been many debates... Read More
OK, you published your site, now you just sit by... Read More
Source code optimization.{title}...{/title}This tag is to be a winner. This... Read More
It's unfortunate that many website owners are so hung-up on... Read More
If you are confused about terms like "search engine optimization"... Read More
There are methods to increase your search engine rankings which... Read More
Let's talk about what keyword density is and how to... Read More
You've got a cool new website with all the works:... Read More
Non-Reciprocal Link Building For Higher Search Engine Positioning By Dave... Read More
We all know that the most targeted traffic we can... Read More
When you want your brand new site to be indexed... Read More
I admit it, our SEO services are pretty bad.Speaking of... Read More
Uniquely built web sites can create unique issues when being... Read More
Search engines determine their rankings based on two things: ... Read More
The most difficult challenge most web designers face is getting... Read More
In this three part article, you'll find many tools that... Read More
There is perhaps no more level playing field in business... Read More
The sun seems to be setting on the world of... Read More
Google's premier of desktop search proves that the desktop is... Read More
Once the keywords have been decided for the site one... Read More
The advent of Internet has affected lives of almost the... Read More
With the help of MSN, recently I've been reminiscing about... Read More
If you don't know already, one of the key success... Read More
Most new sites submitted to Google (at least within the... Read More
Anyone who's been on the net any time at all... Read More
Search engine optimization is one of most popular online marketing... Read More
Google's PageRank has been around for years, and in the... Read More
First let's start with definitions:SEO: Search Engine Optimization, SFO: Search... Read More
Use a keyword density of about 1 to 2%. Use... Read More
"Owning your business category online is more than just a... Read More
For beginners, link exchange campaigns can be a minefield of... Read More
Everyone seems to want the benefits from working at home:... Read More
Keyword density. When it comes to SEO copywriting, this has... Read More
If you've been feeling like Tom Cruise climbing up the... Read More
It is no secret that Google and Yahoo are on... Read More
Blogging software is really a simple Content Management System (CMS)... Read More
The recent patent application filed by Google details numerous items... Read More
Do you ever wonder how people search for things on... Read More
Sometimes our jobs as marketers means we need to look... Read More
Internet users have never had it better what with Yahoo!,... Read More
I couldn’t agree more with the headline of this article... Read More
It's unfortunate that many website owners are so hung-up on... Read More
Search engine optimization is the process of increasing the amount... Read More
I want to touch base with selecting the title of... Read More
There are certain tricks and techniques in SEO industry, which... Read More
We all want to get our websites high up in... Read More
The name of the game is search engine optimization and... Read More
Internal Linking ? An introductionThe web as they call it... Read More
The popularity of weblogs or blogs has gotten a lot... Read More
I often talk to people who have lost faith in... Read More
1) Title Tag - The title tag is the most... Read More
You've seen the ads: Guaranteed #1 Ranking! There are no... Read More
As we all know Google uses their PageRank technology to... Read More
Here are some observations that I have made recently:1. On... Read More
Many internet marketers blow mountains of start-up cash on their... Read More
The days of basing a successful link building strategy on... Read More
If you're like most other CEOs, the term "search engine... Read More
So you want to get listed on Google? And you... Read More
If you want to develop a successful search engine optimization... Read More
What's the difference?For those who aren't quite clear what the... Read More
Many of our customers (http://www.internet-marketing-australia.com) find search engine... Read More
The makers of the world renowned search engine, Google, have... Read More
When the movie Spanglish hit the screens in 2004, it... Read More
I don't mind admitting that every time some new fangled... Read More
The term, Search Engine Optimization (SEO), refers to a set... Read More
Webmasters across the Internet were totally floored by what happened... Read More
Search Engine Optimization (SEO) |