Browse wiki

Jump to: navigation, search
Adaptive indexing for content-based search in P2P systems
Abstract One of the major challenges in Peer-to-PeeOne of the major challenges in Peer-to-Peer (P2P) file sharing systems is to support content-based search. Although there have been some proposals to address this challenge, they share the same weakness of using either servers or super-peers to keep global knowledge, which is required to identify importance of terms to avoid popular terms in query processing. As a result, they are not scalable and are prone to the bottleneck problem, which is caused by the high visiting load at the global knowledge maintainers. To that end, in this paper, we propose a novel adaptive indexing approach for content-based search in P2P systems, which can identify importance of terms without keeping global knowledge. Our method is based on an adaptive indexing structure that combines a Chord ring and a balanced tree. The tree is used to aggregate and classify terms adaptively, while the Chord ring is used to index terms of nodes in the tree. Specifically, at each node of the tree, the system classifies terms as either important or unimportant. Important terms, which can distinguish the node from its neighbor nodes, are indexed in the Chord ring. On the other hand, unimportant terms, which are either popular or rare terms, are aggregated to higher level nodes. Such classification enables the system to process queries on the fly without the need for global knowledge. Besides, compared to the methods that index terms separately, term aggregation reduces the indexing cost significantly. Taking advantage of the tree structure, we also develop an efficient search algorithm to tackle the bottleneck problem near the root. Finally, our extensive experiments on both benchmark and Wikipedia datasets validated the effectiveness and efficiency of the proposed method.ess and efficiency of the proposed method.
Added by wikilit team Added on initial load  +
Collected data time dimension Cross-sectional  +
Comments Wikipedia pages Documents We evaluated alWikipedia pages Documents We evaluated all systems on three datasets. The first one is the benchmark dataset containing four different types of documents: MED, CISI, CACM, and TIMES used by Smart [2], with 1033, 1460, 3204, 425 documents and 30, 35, 64 and 83 queries, respectively. The two remaining datasets are the 2005 TREC publish spam corpus consisting of 84,053 files obtained from http://plg.uwaterloo.ca/gvcormac/treccorpus/ and the Wikipedia dataset containing 1,000,000 pages downloaded from Wikipedia (http://wikipedia.org), a free multilingual online encyclopedia. Queries of these two datasets are generated randomly from the categories of TREC and Wikipedia.from the categories of TREC and Wikipedia.
Conclusion As a result, our system avoids several sevAs a result, our system avoids several severe problems caused by maintaining such global knowledge. Nevertheless, it still achieves comparable retrieval efficiency as those systems keeping global knowledge. Although the structure of our system is partially based on a tree structure, our search algorithm guarantees no bottleneck at the root or nodes near the root. In addition, we also introduced several techniques to further improve the system performance. Finally, our extensive experiments demonstrated the effectiveness and efficiency of the proposed approach.s and efficiency of the proposed approach.
Data source Archival records  + , Experiment responses  + , Wikipedia pages  +
Doi 10.1016/j.datak.2008.06.013 +
Google scholar url http://scholar.google.com/scholar?ie=UTF-8&q=%22Adaptive%2Bindexing%2Bfor%2Bcontent-based%2Bsearch%2Bin%2BP2P%2Bsystems%22  +
Has author Aoying Zhou + , Rong Zhang + , Weining Qian + , Quang Hieu Vu + , Tianming Hu +
Has domain Computer science +
Has topic Other information retrieval topics +
Issue 3  +
Pages 381-398  +
Peer reviewed Yes  +
Publication type Journal article  +
Published in Data and Knowledge Engineering +
Research design Experiment  +
Research questions To that end, in this paper, we propose a novel adaptive indexing approach for content-based search in P2P systems, which can identify importance of terms without keeping global knowledge.
Revid 10,648  +
Theories Undetermined
Theory type Design and action  +
Title Adaptive indexing for content-based search in P2P systems
Unit of analysis Article  +
Url http://dx.doi.org/10.1016/j.datak.2008.06.013  +
Volume 67  +
Wikipedia coverage Sample data  +
Wikipedia data extraction Dump  +
Wikipedia language Not specified  +
Wikipedia page type Article  +
Year 2008  +
Creation dateThis property is a special property in this wiki. 15 March 2012 20:02:44  +
Categories Other information retrieval topics  + , Computer science  + , Publications  +
Modification dateThis property is a special property in this wiki. 30 January 2014 20:20:01  +
show properties that link here 

 

Enter the name of the page to start browsing from.