Sander Bockting

Collection Selection for Distributed Web Search

Using Highly Discriminative Keys, Query-driven Indexing and ColRank

• Broschiertes Buch

Produktbeschreibung

Popular web search engines rely on crawling to build an index of the World Wide Web. This continuous process to keep the index fresh generates an enormous amount of traffic. By far the largest part of the web remains unindexed, as crawlers are unaware of the existence of web pages and they have difficulties crawling dynamically generated content. Now, assume that local web sites can be indexed by peers. Peers cooperate with a broker by sending a part of their index. Receiving indices from many peers, the broker gains a global overview of the peers' content. When a user poses a query to a broker, the broker selects a few peers to which it forwards the query. Selected peers should be promising to create a good result set with many relevant documents. The result sets are merged at the broker and sent to the user. A research prototype, Sophos, was developed for this scenario, combining highly discriminative keys, query-driven indexing and a PageRank-like algorithm to select promisingpeers. Sophos is compared to a language modeling baseline system.

Produktdetails

• Verlag: VDM Verlag Dr. Müller
• Seitenzahl: 132
• Englisch
• Gewicht: 190g
• ISBN-13: 9783639184341
• ISBN-10: 3639184343
• Artikelnr.: 26953454

Autorenporträt

Sander Bockting obtained a master degree in Computer Science from the University of Twente. During his master, he focused on Information Systems Engineering in general, and Information Retrieval in particular. This book presents the results of his Master's project.