Google and the Deep Web

An article in the New York Times has commented on how Google has recently indexed its one trillionth web address but still has issues that it can’t yet grasp. Namely the Deep Web.

The NY Times reports that the major search engines still have trouble providing satisfying answers to exact questions that may be posed by searchers. When posting a question such as “the best fare from New York to London next Thursday?” traditional search engines find it hard to offer a suitable answer.  

Help is at hand though as new technologies are being developed that will extend the search engines range into deep corners of the internet.

New software is being tested that matches searches with databases to provide relevant information to a specific search. The results can be found at www.kosmix.com where the investors include the chief executive of Amazon.

With millions of databases out there it is very difficult for any search engine to work their way through all the information located on databases.

The article also reports on a system being developed by the University of Utah where they are working on a project called DeepPeep [www.deeppeep.org] which aims to index every database on the web.

There could be an opportunity here for a new company to be the market leader in supplying this information as Google is reluctant to upset its formula that works so well at the moment.

For more click on http://www.nytimes.com/pages/technology/index.html