02/24/09 08:09 Filed in: search
“The crawlable Web is the tip of the iceberg,” says Anand Rajaraman, co-founder of Kosmix (www.kosmix.com), a Deep Web search start-up whose investors include Jeffrey P. Bezos, chief executive of Amazon.com. Kosmix has developed software that matches searches with the databases most likely to yield relevant information, then returns an overview of the topic drawn from multiple sources.
The New York Times does a survey of new companies and research efforts that will lead to the ability to search deep databases on the Web. Considering that each database structure is unique, and the search interfaces are also unique, this is a horrific problem. Some groups are coming close to solutions.