There are today search engine and internet marketing services, in fact a new industry has materialised to exploit the fear of low search rankings.
This is not a new trend, back when simply resubmitting your website to the engines resulted in keeping your site at the top of the index, there was an accompanying boom in resubmitting "companies", as we know, these were just men in back bedrooms with a host of CGI and Perl submitting scripts and a timetable.
Search Engine optimisation or "SEO", is the latest incarnation of this bedroom profiteering, the important difference is that now the webmaster's are not just passively involved but are being forced to adopt totally artificial and unsocial practices that ultimately serve only to help damage the Internet!
SEO is supposedly the methodology and processes related to designing search engine "friendly" web content, the basic premise is something like "If I follow all the engines formatting and connectivity criteria, then my website will rank higher then a comparable website that does not".
All other things being equal, this seems quite positive given that the quality of a search engines database (index) directly effects its output; then webmaster's optimising their content so that search engines can correctly categorise the internet should logically improve the speed and quality of "the crawl".
SEO then, logically, should be good for the search providers, being able to maintain an efficient index, this should use less raw processing power, require less equipment and thus less energy; this must also be good for the users, being able to quickly and intuitively find what they want from a reliable source. Sounds reasonable right?
Well that's the happy version. The fact is that initially this may be true, you may gain a short term advantage, but once we have all optimised our content for analysis and (in so doing) ignored our users; We will then be back to where we started, and the search providers will just think up some even more ridiculous "laws" by which to "judge" us by, and like sheep we will all do that as well, thus the causal paradox is perpetuated and the users feel abused!
Even this is a vast oversimplification, the true nature of SEO is a lot more complicated; The heart of the problem and the real issue here is related to the search providers task, which is to strip mine the information junk yard otherwise known as the Internet, it may be full of interesting stuff but also plenty of garbage and they need to devise intelligent techniques to mine the interesting stuff!
The current "solution" is literally for the search engines to use their hegemonic standing to bully the webmaster's into organising their work in ways that have the primary effect of allowing quick "analysis" so they can categorise the website, but this has the secondary effect of requiring content to be designed "for" analysis, which typically translates to highly distributed connectivity, ie the website being effectively divided into "micro sites", which makes the maintenance of links and content more troublesome!
This is not necessarily a bad thing, most of these imposed linking and design methodologies are often positive and beneficial for a lot of subjects. My problem is that this is unilaterally enforced and it is this type of issue that is generating all the money for the SEO boys.
However this will soon be of no consequence. To understand the problem with this type of SEO operation, it is necessary to think about how we can approximate and simulate the human process of mining information and knowledge.
Let us assume we have set our Crawlers to work, automatically indexing pages (at random, looking at previous indexing and guided by user requests); we then format the resulting text: ASCII is usually used and validation follows this, search engines tend to ignore some tags and make use of good ones that help identify the content. At this point we would have reduced the Internet to a corpora, ie the collection of all HTML documents about no particular subject.
We then would set about item normalisation, ie identification of tokens (words), characterisation of tokens (tagging meaning to words), and finally running stemming algorithms to remove suffixes (and/or prefixes) to derive the final database of terms; this can be efficiently and compactly represented in lower term dimensional spaces, (Goggle are still essentially using inverted file structures).
Imagine each document of a corpus as a point ie a term in an N dimensional space, here the literal word matching type search is lost, but we acquire more of a semantic flavour, where closely related information can be grouped in to clusters of documents bearing similarities, however N dimensional vector spaces are of no help to the users.
After applying our algorithms to the corpora, we get a term by document matrix, where terms and documents are represented by vectors, a query can also be represented by a vector. So we have a query and our corpora (represented as vectors, both having the same dimensions), we can now start matching the query against all the available documents using the cosine angle between these two vectors.
But we now have a new artificial "problem"; we know the general answer to the question "which website's best match my search terms", this information now exists in our mathematical object, at a high level of abstraction, ie the cosine angles for all terms against the query vector, this is expressed as a vector corresponding to the sought column and therefore the document we are after, all we need do is present this to the user, right, well....
The issue is that a search engine needs to generate a linear index, ie convert the vectors corresponding to the minimum cosine angles into a human readable format, and until such time as someone thinks of a better way to do it, all engines output lists, like your shopping list, it has a start, a middle and an end, therein lies the problem, how to order the list!
The hypothesis seems simple, ordering information that might look chaotic at first, using the fact that closely associated documents tend to be relevant to similar requests. However, the internet (being a scale free network) is so vast that it is not possible to present a chosen feature space that represents the x closest documents to the convergence point in a given cluster from the common Euclidean distance. This is what should then be presented to the user in a more intelligible (semantic) display.
The engines could just present the returns as produced by the matching algorithms after decomposition, because the grouping generated using probabilistic/fuzzy patterns directly from the cluster might belong to more than one class, but the strength (degree of membership) value measured on a scale; using probability on a [0,1] interval, is quite adequate.
The reason decomposition in singular values works for ordering is related to the fact that the occurrence of two terms (say tomato and potato) is very high is reflected in the term-by-document matrix by showing that only x of the n terms are used very frequently.
The idea is that since the term say pepper is used/mentioned very little, then its axis/dimension does not affect much the search space, making it flat and relevant only in the other two dimensions
However the engine's demonic creators can't do this because they are still essentially using an inverted file structure, but they still want absolute correctness in their indexes and returned results which means trouble, because this assumes your index is perfect, incapable of being manipulated and that you can somehow order the returns in a meaningful way!
So the returned results can't generally represent the documents that match semantically, we now need to account for some subjective quantities, that can not be derived directly from the corpora, they attempt to deal with this by a cocktail of criteria that rank the returns in such a way as its more likely that the "better" results are closer to the top of the list.
There are many ways of doing this, the current trend is to use inference about the quality of web sites were possible because such quantities are beyond the direct control of the content creators and the webmaster's.
PageRank provides a more sophisticated way of citation counting but this is embodied in the consept of link analysis, using a relative value of importance for a page measured based on the average number of citations per referance item.
PageRank is currently one of the main ways to determine who gets into the top of the listings, but soon this will all become irrelevant when the engines stop using inverted file structures, because they can just use the grouping generated using probabilistic/fuzzy patterns resulting from the convergence point in a given cluster from the common Euclidean distance.
When the changeover from inverted file structures occurs, there will be two direct consequences:
1) The corpora will be capable of vastly more representative and more detailed data then is Currently possible.
2) The corpora will no longer be indexed as is currently done, they will embody semantic meaning and value, where some subjective quantities can be derived directly from the corpora without the need for cocktails or totally artificial rules.
The effect is that corpora will be more accurate and incapable of manipulation, thus variations of SEO that involve indirect manipulation of the index will become pointless overnight.
It is worth noting that the search providers are becoming increasingly pessimistic about website promotion in all forms, they currently penalise many things that can effect the results such as duplicated content (which can be perfectly legitimate), and satellite sites, ie one webmaster interlinking seemingly separate but highly relevant website's.
They may well start penalising webmaster's that promote their website's through articles they submit for third party distribution, as they do for people that post their sites information to bulletin boards!
Being banned from the top search engines can effectively destroy your business, if not directly through loss of visibility then indirectly in that people tend to judge you on weather your are organised enough to be listed !
The criteria are continually changing, as the amoral SOE boys attempt to pervert the resultes, these "laws" are not always clear and there are no appeals, where we are all subject to the providers up ending a drum then dispensing swift and hard "judgements", that can doom us at any time!
The part that erks the most is that as the indexes converge, (goggle's index is used directly by 2 of the 3 top engines and 5 others indirectly use it for their rankings) a bann by anyone of these engines is enforced by them all.
© I am the website administrator of the Wandle industrial museum (http://www.wandle.org). Established in 1983 by local people determined to ensure that the history of the valley was no longer neglected but enhanced awareness its heritage for the use and benefits of the community.
Most Search Engine Optimization (SEO) experts agree that links back... Read More
I get half of the world traffic for the term... Read More
Search Engine Optimization (SEO) is a very complex process. It... Read More
Keywords have turned into big business on the internet. If... Read More
Most Internet marketing methods are risky and many will not... Read More
I had an email "conversation" this last week which I... Read More
A good link building strategy has become an essential part... Read More
In recent times, I have been closely studying keywords that... Read More
There has been a good deal written about the Google... Read More
Every business owner I've met has been encouraged at some... Read More
Don't be fooled into believing that all backlinks are created... Read More
I've always been a big time press release aficionado.And up... Read More
Thousands of servers ...billions of web pages.... the possibility of... Read More
PageRank - an exclusive technology developed by Google which can... Read More
If you're serious about SEO, you need to know how... Read More
My inbox this week provided glaring examples of three all... Read More
Previously...In our article on Understanding Google's Algorithm,... Read More
How can you be found on the web?The web is... Read More
If you're anything like me, you have a favourite search... Read More
In today scenario when we talk about Search Engine Optimization,... Read More
Search engine optimization is a very critical task in the... Read More
The latest news to hit the Internet's 'water cooler' is... Read More
Google does not accept payment for inclusion in their main... Read More
There has been endless webmaster speculation and worry about the... Read More
The following are a list of mistakes can ensure that... Read More
About 80% of website traffic comes through search engines. And... Read More
Ask any business person who's website is at the top... Read More
This is part 1 of a 7 part series that... Read More
1. Additional Exposure For Your Site.At the end of 2003,... Read More
Sometimes a search engine optimization company will miss that glaring... Read More
The task is to build a Content Rich Search Friendly... Read More
I recently was asked by an author to remove a... Read More
A few months ago I was looking through the search... Read More
A few months ago I was looking through the search... Read More
Yet the simple truth is that without traffic a website... Read More
The attraction of Pay Per Click (PPC) online advertising is... Read More
Search Engines are hard to tame, that's for sure. But... Read More
With search engine algorithms changing seemingly daily, the quest to... Read More
Use a keyword density of about 1 to 2%. Use... Read More
Keywords are terms or words related to particular topic. Keyword... Read More
You've built up a good site, put in a lot... Read More
Over the last couple of weeks, I've received more e-mails... Read More
Google now checks the year your domain name was first... Read More
Search engines are one of the best tools to bring... Read More
Getting your website listed in the search engines is relatively... Read More
As you may already know, keywords are an essential part... Read More
Almost all SEO's agree that using too much javascript can... Read More
Smartpages are highly optimized pages which draw stampeded of search... Read More
MSN finally unleashed its new search technology to the world... Read More
Do you depend on free search engine traffic for your... Read More
As with any good web developer, the ability to time... Read More
Search engine optimization refers to the technique of making your... Read More
No doubt, having a high search engine ranking is very... Read More
Getting a high ranking on Google is a big achievement.... Read More
So you need a domain name for your brand new... Read More
A good link building strategy has become an essential part... Read More
Google Sitemaps is a new tool for website owners and... Read More
Sometimes, the search engines act really strange. And this story... Read More
If you read The Search Engine Showdown,... Read More
Unfortunately, we don't live in a perfect world. You may... Read More
A good portion of my business involves spending hours and... Read More
The latest news to hit the Internet's 'water cooler' is... Read More
We all want to get our websites high up in... Read More
Not many web master take the time to use a... Read More
Search Engine Optimization popularly known as SEO.SEO is the process... Read More
Part 2 Tips 4 tagsMeta tags are the descriptive tags... Read More
Search Engine Optimization (SEO) |