Browse wiki

Jump to: navigation, search
Computational trust in web content quality: a comparative evaluation on the Wikipedia project
Abstract The problem of identifying useful and trusThe problem of identifying useful and trustworthy information on the World Wide Web is becoming increasingly acute as new tools such as wikis and blogs simplify and democratize publication. It is not hard to predict that in the future the direct reliance on this material will expand and the problem of evaluating the trustworthiness of this kind of content become crucial. The Wikipedia project represents the most successful and discussed example of such online resources. In this paper we present a method to predict Wikipedia articles trustworthiness based on computational trust techniques and a deep domain-specific analysis. Our assumption is that a deeper understanding of what in general defines high-standard and expertise in domains related to Wikipedia h i.e. content quality in a collaborative environment h mapped onto Wikipedia elements would lead to a complete set of mechanisms to sustain trust in Wikipedia context. We present a series of experiment. The first is a study-case over a specific category of articles; the second is an evaluation over 8 000 articles representing 65\% of the overall Wikipedia editing activity. We report encouraging results on the automated evaluation of Wikipedia content using our domain-specific expertise method. Finally, in order to appraise the value added by using domain-specific expertise, we compare our results with the ones obtained with a pre-processed cluster analysis, where complex expertise is mostly replaced by training and automatic classification of common features.tomatic classification of common features.
Added by wikilit team Added on initial load  +
Collected data time dimension Cross-sectional  +
Comments An automatic method to compute the trastworthiness of wikipedia was developed and a set of new trust sources and trust evidence were identified.
Conclusion In this paper we have proposed a transpareIn this paper we have proposed a transparent, noninvasive and automatic method to evaluate the trustworthiness of Wikipedia articles. The method was able to estimate the trustworthiness of articles relying only on their present state, a characteristic needed in order to cope with the changing nature of Wikipedia. After having analyzed what brings credibility and expertise in the domains composing Wikipedia, i.e. content quality and collaborative working, we identified a set of new trust sources, trust evidence, to support our trust computation. The experimental evidence that we collected from almost 8 000 pages covering the majority of the encyclopaedia activity leads to promising results. This suggests a role for such a method in the identification of trustworthy material on the Web. The detailed study case, conducted by comparing a set of articles belonging to the category of “national country” shows how the accuracy of the computation can benefit from a deeper analysis of the article content. In our final experiment we compared our results with the results obtained using a pre-processed cluster analysis to isolate featured and standard articles. The comparison has shown the value added by explicitly using domainspecific expertise in a trust computation: a better isolation of articles of great or low quality and the possibility to offer understandable justifications for the outcomes obtained. justifications for the outcomes obtained.
Data source Wikipedia pages  +
Google scholar url http://scholar.google.com/scholar?ie=UTF-8&q=%22Computational%2Btrust%2Bin%2Bweb%2Bcontent%2Bquality%3A%2Ba%2Bcomparative%2Bevaluation%2Bon%2Bthe%2BWikipedia%2Bproject%22  +
Has author Pierpaolo Dondio + , Stephen Barrett +
Has domain Information systems +
Has topic Featured articles + , Computational estimation of trustworthiness +
Issue 2  +
Month June  +
Pages 151-60  +
Peer reviewed Yes  +
Publication type Journal article  +
Published in Informatica +
Research design Mathematical modeling  +
Research questions In this paper we present a method to prediIn this paper we present a method to predict Wikipedia articles trustworthiness based on computational trust techniques and a deep domain-specific analysis. Our assumption is that a deeper understanding of what in general defines high-standard and expertise in domains related to Wikipedia – i.e. content quality in a collaborative environment – mapped onto Wikipedia elements would lead to a complete set of mechanisms to sustain trust in Wikipedia context. We present a series of experiment. The first is a study-case over a specific category of articles; the second is an evaluation over 8 000 articles representing 65% of the overall Wikipedia editing activity.of the overall Wikipedia editing activity.
Revid 10,708  +
Theories We begin by modelling the application undeWe begin by modelling the application under analysis (i.e. Wikipedia). The output of the modelling Phase should be a complete model showing the entities involved, their relationships, the properties and methods for interacting: here we will find out trust dynamics. It is also necessary to produce a valid theory of domaincompatible trust, which is a set of assertions about what behaviours should be considered trustworthy in that domain. This phase, referred as theories analyser, is concerned with the preparation of a theoretical trust model reasonable for that domain. To reach this goal a knowledge-based analysis is done to incorporate general theories of Trust, whose applicability in that domain must be studied, joined with peculiar domain-theories that are considered a good description of high-quality and trustworthy output in that domain. The output is a domain compatible trust theory that acts like a sieve we apply to the application model in order to extract elements useful to support trust computations. This mapping between application model and domain-specific trust theory is referred as trust identifier. These elements, opportunely combined, will be the evidence used for the next phase, our trust computation. The more an entity (a Wikipedia page) shows properties linked to these proven domain-specific theories, the more is trustworthy. In this sense, our method is an evidence-based methodology where evidences are gathered using domain related theories.re gathered using domain related theories.
Theory type Design and action  +
Title Computational trust in web content quality: a comparative evaluation on the Wikipedia project
Unit of analysis Article  +
Url http://www.freepatentsonline.com/article/Informatica/168662927.html  +
Volume 31  +
Wikipedia coverage Main topic  +
Wikipedia data extraction Live Wikipedia  +
Wikipedia language Not specified  +
Wikipedia page type Article  +
Year 2007  +
Creation dateThis property is a special property in this wiki. 15 March 2012 20:25:37  +
Categories Featured articles  + , Computational estimation of trustworthiness  + , Information systems  + , Publications  +
Modification dateThis property is a special property in this wiki. 30 January 2014 20:21:55  +
hide properties that link here 
  No properties link to this page.
 

 

Enter the name of the page to start browsing from.