Browse wiki

Jump to: navigation, search
Requirements-oriented methodology for evaluating ontologies
Abstract Many applications benefit from the use of Many applications benefit from the use of a suitable ontology but it can be difficult to determine which ontology is best suited to a particular application. Although ontology evaluation techniques are improving as more measures and methodologies are proposed, the literature contains few specific examples of cohesive evaluation activity that links ontologies, applications and their requirements, and measures and methodologies. In this paper, we present ROMEO, a requirements-oriented methodology for evaluating ontologies, and apply it to the task of evaluating the suitability of some general ontologies (variants of sub-domains of the Wikipedia category structure) for supporting browsing in Wikipedia. The ROMEO methodology identifies requirements that an ontology must satisfy, and maps these requirements to evaluation measures. We validate part of this mapping with a task-based evaluation method involving users, and report on our findings from this user study.port on our findings from this user study.
Added by wikilit team Added on initial load  +
Collected data time dimension Cross-sectional  +
Conclusion Following the ROMEO methodology, we identiFollowing the ROMEO methodology, we identified requirements that an ontology must satisfy in order to support browsing in Wikipedia, and mapped these requirements to evaluation measures. We validated part of this mapping by conducting a task-based user study that compared variants of two sub-domains of the Wikipedia category structure; variants were obtained by untangling the original (tangled) sub-domains. We also experimented with a technique for generating a variant ontology by clustering categories, but the resulting ontologies were not comparable with the original Wikipedia sub-domains. The user study confirmed that tangledness might be desirable in ontologies and category structures that support browsing in general knowledge application areas like Wikipedia; this is especially significant for tasks that require the user to locate specific information.e the user to locate specific information.
Data source Experiment responses  + , Wikipedia pages  +
Doi 10.1016/j.is.2009.04.002 +
Google scholar url http://scholar.google.com/scholar?ie=UTF-8&q=%22Requirements-oriented%2Bmethodology%2Bfor%2Bevaluating%2Bontologies%22  +
Has author Jonathan Yu + , James A. Thom + , Audrey Tam +
Has domain Linguistics +
Has topic Ontology building +
Issue 8  +
Pages 686-711  +
Peer reviewed Yes  +
Publication type Journal article  +
Published in Information Systems +
Research design Experiment  + , Statistical analysis  +
Research questions the literature contains few specific exampthe literature contains few specific examples of cohesive evaluation activity that links ontologies, applications and their requirements, and measures and methodologies. In this paper, we present ROMEO, a requirements-oriented methodology for evaluating ontologies, and apply it to the task of evaluating the suitability of some general ontologies (variants of sub-domains of the Wikipedia category structure) for supporting browsing in Wikipedia.ure) for supporting browsing in Wikipedia.
Revid 10,928  +
Theories Undetermined
Theory type Design and action  +
Title Requirements-oriented methodology for evaluating ontologies
Unit of analysis Category  +
Url http://dx.doi.org/10.1016/j.is.2009.04.002  +
Volume 34  +
Wikipedia coverage Sample data  +
Wikipedia data extraction Live Wikipedia  +
Wikipedia language English  +
Wikipedia page type Policy  + , Information categorization and navigation  +
Year 2009  +
Creation dateThis property is a special property in this wiki. 15 March 2012 20:30:04  +
Categories Ontology building  + , Linguistics  + , Publications with missing comments  + , Publications  +
Modification dateThis property is a special property in this wiki. 30 January 2014 20:30:54  +
hide properties that link here 
  No properties link to this page.
 

 

Enter the name of the page to start browsing from.