Friday, February 03, 2006

Duplicate Microcontent Filter

I don't know how many of you readers paid attention to the Google algorithm of erasing duplicates. You can see a message at the end of the search results list which says:

In order to show you the most relevant results, we have omitted some entries very similar to the 163 already displayed. If you like, you can repeat the search with the omitted results included.


When you click on this link you get all the results.

This algorithm is good for omitting macro-content-similar-entries but there is no such algorithm for omitting microcontent-similar-entries.

When you get the top 10 results, for example, and put them on one document odds are that some of the information will overlap: the second document will have something similar to the first one and the third will have something else and when you read the last – all the information is already familiar to you.

It is like a pupil who will brings his teacher an extensive term paper with endless duplicates. How should such a teacher react?
How can search engine users tolerate this phenomenon?

On the other hand imagine how would the internet search look in case the results would have been filtered micro contents that bring them unique information arranged by chapters?

Here is a collection of duplicates from a search on Google top 10 of about 4,620,000 for Tinnitus:

http://en. wikipedia. org/wiki/Tinnitus
Tinnitus is a phenomenon of the nervous system connected to the ear, characterised by perception of a ringing or beating sound (often perceived as sinusoidal) with no external source. This sound may be a quiet background noise, or loud enough to drown out all outside sounds. It is sometimes referred to as "the club disease" as many people get temporary Tinnitus at loud clubs or concerts.

http://www. mayoclinic. com/health/Tinnitus/DS00365
Ringing. Buzzing. Roaring. Whooshing. Chirping. Beating. Humming. You may enjoy these sounds in nature, but not when they come from inside your head. Head noise, or ringing in the ears (Tinnitus), is common. Millions of Americans have Tinnitus to a distressing degree.

http://www. ata. org/about_Tinnitus/
TINNITUS ti-NIGHT-us or TIN-i-tus: the perception of sound in the ears or head where no external source is present. Both pronunciations are correct; the American Tinnitus Association uses ti-NIGHT-us. The word comes from Latin and means "to tinkle or to ring like a bell. "

http://www. entnet. org/healthinfo/hearing/Tinnitus. cfm
Tinnitus is the name for these head noises, and they are very common. Nearly 36 million Americans suffer from this discomfort. Tinnitus may come and go, or you may be aware of a continuous sound.

http://www. nidcd. nih. gov/health/hearing/noiseinear. asp
Do you hear a ringing , roaring, clicking, or hissing sound in your ears? Do you hear this sound often or all the time? Does the sound bother you a lot? If you answer yes to these questions, you may have Tinnitus (tin-NY-tus).

http://www. Tinnitus. org. uk/information/info%20sheets/front%20page/what_is_Tinnitus. htm
Tinnitus is the name given to the condition of noises 'in the ears' and/or 'in the head' with no external source. Tinnitus noises are described variously as ringing , whistling, buzzing and humming.
The noise/s may be heard in one ear, both ears or in the middle of the head or it may be difficult to pinpoint its exact location. The noise may be low, medium or high-pitched. There may be a single noise or two or more components. The noise may be continuous or it may come and go.

http://www. Tinnitus. org/home/frame/THC1. htm
Tinnitus - not a disease, just the ability to hear sounds generated by the auditory (hearing) system, evidence of compensatory mechanisms that are part of its normal function. The problem is the distress created - not the type of sound.

http://www. hearusa. com/hearing/index. asp?m=1&sb=004&p=003
Approximately 24 million people have Tinnitus. Most people experience occasional ringing or sounds in the ear at least one time or another. Tinnitus varies greatly among individuals ranging from a mild occasional sound to an ever present chronic condition. Some people report their Tinnitus is so bothersome that it interferes with their quality of life.

This is a collection of duplicates from the top ten – imagine how many duplicates are on the whole list of 4,620,000 results.

And here's another collection from QTsearch about the keywords "Tinnitus millions"

Tinnitus - MayoClinic.com: http://www. mayoclinic.com/health/Tinnitus/DS00365
Head noise, or ringing in the ears (Tinnitus), is common. Millions of Americans have Tinnitus to a distressing degree. Tinnitus comes from the Latin word tinnire, meaning "to ring."It's a symptom that can be caused by a number of medical conditions.

Tinnitus Research: Update [NIDCD Health Information] : http://www. nidcd. nih. gov/health/hearing/Tinnitus. asp
"This work represents a breakthrough and moves us a step closer to understanding the phenomenon of Tinnitus. We feel certain that this study will lead to further research that will ultimately translate into treatment options for the millions of people who suffer with this difficult condition," said James F.

Audiological Consultants of Atlanta - Tinnitus: http://www. Audioconsult.com/Tinnitus.html
Tinnitus is common problem affecting millions of people. For more information, we recommend you contact the American Tinnitus Association. But see your audiologist, too-- there is help for Tinnitus!

Action for Tinnitus Research: http://www.Tinnitus-research. org
It's estimated that Tinnitus affects over 4. 7 million people in the UK and countless millions around the world. Research has shown that for over ½ million people here in the UK it has a severe effect on their quality of life and for many it affects their ability to lead a normal life. We hope you find the pages of this site useful and informative.

Tinnitus: http://www.stayinginshape.com/4drhs/libv/i53.shtml
(Read about "The Ear and Hearing") That ringing , clicking, roaring or hissing sound that you hear isn't your imagination. Like millions of other Americans, you may suffer from Tinnitus. The estimates of the number of people who suffer from some form of Tinnitus ranges from about 12 million according to the American Tinnitus Association (ATA) to 36 million according to the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS). Millions of those have it so bad it makes it difficult to do many of things most people take for granted, things like, working, hearing normal conversations, even sleeping.

Ear InfoSite - Tinnitus : http://www. earinfosite. org/Tinnitus. htm
Millions of people experience Tinnitus, more commonly referred to as ringing in the ears, or "head noise". Approximately 2 million Americans are disabled by the condition.

No comments: