Assigning trust to Wikipedia content

From WikiLit
Jump to: navigation, search
Publication (help)
Assigning trust to Wikipedia content
Authors: B. Thomas Adler, Krishnendu Chatterjee, Marco Faella, Luca de Alfaro, Ian Pye, Vishwanath Raman [edit item]
Citation: International Symposium on Wikis  : 26:1-26:12. 2008. New York, USA. Association for Computing Machinery.
Publication type: Conference paper
Peer-reviewed: Yes
Database(s):
DOI: 10.1145/1822258.1822293.
Google Scholar cites: Citations
Link(s): Paper link
Added by Wikilit team: Added on initial load
Search
Article: Google Scholar BASE PubMed
Other scholarly wikis: AcaWiki Brede Wiki WikiPapers
Web search: Bing Google Yahoo!Google PDF
Other:
Services
Format: BibTeX
Assigning trust to Wikipedia content is a publication by B. Thomas Adler, Krishnendu Chatterjee, Marco Faella, Luca de Alfaro, Ian Pye, Vishwanath Raman.


[edit] Abstract

The Wikipedia is a collaborative encyclopedia: anyone can contribute to its articles simply by clicking on an "edit" button. The open nature of the Wikipedia has been key to its success, but has also created a challenge: how can readers develop an informed opinion on its reliability? We propose a system that computes quantitative values of trust for the text in Wikipedia articles; these trust values provide an indication of text reliability.

The system uses as input the revision history of each article, as well as information about the reputation of the contributing authors, as provided by a reputation system. The trust of a word in an article is computed on the basis of the reputation of the original author of the word, as well as the reputation of all authors who edited text near the word. The algorithm computes word trust values that vary smoothly across the text; the trust values can be visualized using varying text-background colors. The algorithm ensures that all changes to an article's text are reflected in the trust values, preventing surreptitious content changes.

We have implemented the proposed system, and we have used it to compute and display the trust of the text of thousands of articles of the English Wikipedia. To validate our trust-computation algorithms, we show that text labeled as low-trust has a significantly higher probability of being edited in the future than text labeled as high-trust.

[edit] Research questions

"We introduce a trust system for Wikipedia that computes, and displays, a value of trust for each word of each article version of Wikipedia. The trust value of a word is computed according to the degree in which the word, and the immediately surrounding text, has been revised by previous authors and editors. The computation takes into account both the amount of revision, and the reputation of the people performing the revision, as computed by a separate reputation system [1]."

Research details

Topics: Reputation systems [edit item]
Domains: Computer science [edit item]
Theory type: Design and action [edit item]
Wikipedia coverage: Main topic [edit item]
Theories: "Undetermined" [edit item]
Research design: Mathematical modeling [edit item]
Data source: Wikipedia pages [edit item]
Collected data time dimension: Longitudinal [edit item]
Unit of analysis: Edit [edit item]
Wikipedia data extraction: Dump [edit item]
Wikipedia page type: Article [edit item]
Wikipedia language: English [edit item]

[edit] Conclusion

"The results on precision and recall, word longevity prediction, and trust distribution overall indicate that the trust we compute has indeed a predictive value with respect to future text stability. As mentioned in the introduction, this is an indication that the trust system provides valuable information; the visitors to our on-line demo seemed, in anedoctical fashion, to corroborate this finding."

[edit] Comments


Further notes[edit]

Facts about "Assigning trust to Wikipedia content"RDF feed
AbstractThe Wikipedia is a collaborative encyclopeThe Wikipedia is a collaborative encyclopedia: anyone can contribute to its articles simply by clicking on an "edit" button. The open nature of the Wikipedia has been key to its success, but has also created a challenge: how can readers develop an informed opinion on its reliability? We propose a system that computes quantitative values of trust for the text in Wikipedia articles; these trust values provide an indication of text reliability.

The system uses as input the revision history of each article, as well as information about the reputation of the contributing authors, as provided by a reputation system. The trust of a word in an article is computed on the basis of the reputation of the original author of the word, as well as the reputation of all authors who edited text near the word. The algorithm computes word trust values that vary smoothly across the text; the trust values can be visualized using varying text-background colors. The algorithm ensures that all changes to an article's text are reflected in the trust values, preventing surreptitious content changes.

We have implemented the proposed system, and we have used it to compute and display the trust of the text of thousands of articles of the English Wikipedia. To validate our trust-computation algorithms, we show that text labeled as low-trust has a significantly higher probability of being edited in the future than text labeled as high-trust.
he future than text labeled as high-trust.
Added by wikilit teamAdded on initial load +
Collected data time dimensionLongitudinal +
ConclusionThe results on precision and recall, word The results on precision and recall, word longevity prediction, and trust distribution overall indicate that the trust we compute has indeed a predictive value with respect to future text stability. As mentioned in the introduction, this is an indication that the trust system provides valuable information; the visitors to our on-line demo seemed, in anedoctical fashion, to corroborate this finding.tical fashion, to corroborate this finding.
Conference locationNew York, USA +
Data sourceWikipedia pages +
Doi10.1145/1822258.1822293 +
Google scholar urlhttp://scholar.google.com/scholar?ie=UTF-8&q=%22Assigning%2Btrust%2Bto%2BWikipedia%2Bcontent%22 +
Has authorB. Thomas Adler +, Krishnendu Chatterjee +, Marco Faella +, Luca de Alfaro +, Ian Pye + and Vishwanath Raman +
Has domainComputer science +
Has topicReputation systems +
Pages26:1-26:12 +
Peer reviewedYes +
Publication typeConference paper +
Published inInternational Symposium on Wikis +
PublisherAssociation for Computing Machinery +
Research designMathematical modeling +
Research questionsWe introduce a trust system for Wikipedia We introduce a trust system for Wikipedia that computes, and displays, a value of trust for each word of each article version of Wikipedia. The trust value of a word is computed according to the degree in which the word, and the immediately surrounding text, has been revised by previous authors and editors. The computation takes into account both the amount of revision, and the reputation of the people performing the revision, as computed by a separate reputation system [1].puted by a separate reputation system [1].
Revid10,670 +
TheoriesUndetermined
Theory typeDesign and action +
TitleAssigning trust to Wikipedia content
Unit of analysisEdit +
Urlhttp://portal.acm.org/citation.cfm?doid=1822258.1822293 +
Wikipedia coverageMain topic +
Wikipedia data extractionDump +
Wikipedia languageEnglish +
Wikipedia page typeArticle +
Year2008 +