Evaluation of the Ontological Knowledge Model

Darya Plinere, Arkady Borisov


An ontology is an explicit formal conceptualization of some domain of interest. Ontology application is widely used in multi-agent systems. Ontology provides the channel through which software agents interact; therefore, if the ontology definitions have not been sufficiently evaluated, communication between software agents may not succeed. Ontology evaluation guarantees to end users the correctness and completeness of ontology definitions and software. The goal is to detect wrong, incomplete or missed definitions in the ontology. The study is based on multi-agent system application for raw materials management task. The common ontology is used for agent cooperation; the quality of ontology is measured with ontology evaluation techniques.


Application-based ontology evaluation; data-driven ontology evaluation; golden standard; ontology evaluation

Full Text:



D.Vrandečić, “Ontology Evaluation,” PhD thesis, Karlsruher Institut für Technologie, 2010.

D. Plinere, A. Borisov, “A Negotiation-Based Multi-Agent System for Supply Chain Management,” IT and Management Science. vol. 49, pp.128–132, 2011.

J.Brank, M.Grobelnik, D. Mladenic, “A survey of ontology evaluation techniques,” Conference on Data Mining and Data Warehouses (SiKDD 2005), 2005.

J. Brank, D. Mladenic, M. Grobelnik, “Automatic Evaluation of Ontologies,” In: Kao, A., Poteet, S. (eds.), Text Mining and Natural Language Processing, Springer, 2006.

A. Meadche, S. Staab, “Measuring Similarity between Ontologies,” European Conference Knowledge Acquisition and Management (EKAW), pp. 251–263, Oct. 1–4, 2002, Madrid, Spain.

K. Dellschaft, S. Staab “On How to Perform a Gold Standard Based Evaluation of Ontology Learning,” In International Semantic Web Conference, pp. 228–241, 2006.

R. Porzel and R. Malaka, “A Task-Based Approach for Ontology Evaluation,” ECAI Workshop Ontology Learning and Population (OLP), Aug. 2004, Valencia, Spain.

C. Brewster, H. Alani, S. Dasmahapatra, and Y. Wilks, “Data Driven Ontology Evaluation,” International Conference on Language Resources and Evaluation (LREC 2004), May 24–30, 2004, Lisbon, Portugal.

A. Lozano-Tello, A. Gómez-Pérez, “Ontometric: A method to choose the appropriate ontology,” Journal of Database Management, vol. 15, issue 2, pp. 1–18, 2004. http://dx.doi.org/10.4018/jdm.2004040101

A. Gómez-Pérez, “Some ideas and examples to evaluate ontologies,” Knowledge Systems Laboratory, Stanford University, 1994.

A. Gómez-Pérez, “Towards a framework to verify knowledge sharing technology,” Expert Systems with Applications, no. 4, pp. 519–529, 1996. http://dx.doi.org/10.1016/S0957-4174(96)00067-X

V. I. Levenshtein, “Binary codes capable of correcting deletions, insertions, and reversals,” Soviet Physics Doklady vol. 10, no. 8, 1966, pp. 707–710.


  • There are currently no refbacks.

Copyright (c) 2014 Darya Plinere, Arkady Borisov

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.