The purpose of this paper is to formulate apposite criteria for ontology evaluation and test them through assessments of existing ontologies.
Abstract
Purpose
The purpose of this paper is to formulate apposite criteria for ontology evaluation and test them through assessments of existing ontologies.
Design/methodology/approach
A literature review provided the basis from which to extract the categories relevant to an evaluation of internal ontology components. According to the ontology evaluation categories, a panel of experts provided the evaluation criteria for each category via Delphi survey. Reliability was gauged by applying the criteria to assessments of existing smartphone ontologies.
Findings
Existing research tends to approach ontology evaluation through comparison with well-engineered ontologies, implementation in target applications and appropriateness/interconnection appraisals in relation to raw data, but such methodologies fall short of shedding light on the internal workings of ontologies, such as structure, semantic representation and interoperability. This study adopts its evaluation categories from previous research while also collecting concrete evaluation criteria from an expert panel and verifying the reliability of the resulting 53 criteria.
Originality/value
This is the first published study to extract ontology evaluation criteria in terms of syntax, semantics and pragmatics. The results can be used as an evaluation index following ontology construction.
Details
Keywords
Wayne de Fremery, Seonghun Kim, Seulki Do, Sangeun Han and Sam G. Oh
This paper describes a model for integrating publicly available private information concerning textual heritage on the websites of South Korean antiquarian booksellers into the…
Abstract
Purpose
This paper describes a model for integrating publicly available private information concerning textual heritage on the websites of South Korean antiquarian booksellers into the information management systems of the National Library of South Korea (NLK).
Design/methodology/approach
A method for formalizing the coproduction of heritage knowledge is presented, using the NLK and textual heritage as a case study.
Findings
An investigation of the systems and services of the NLK, interviews with South Korean antiquarian booksellers and the researchers' ability to design a system (including an application profile) that will facilitate the integration of data curated by antiquarian booksellers into the systems of the NLK suggest that it is possible to formalize the coproduction of heritage knowledge.
Research limitations/implications
Although this case study is limited to describing the information management procedures of a small number of online South Korean antiquarian booksellers and a single national library, its findings have broad implications. Through discussion of a specific case, the paper identifies a large class of resources that, if acquired, circulated and conserved by public libraries, is likely to enhance the public good provided by public libraries. It also provides an example of how public libraries can better meet their obligations as service and memory institutions by building systems that enable the coproduction of heritage resources by documenting and conserving records related to heritage transactions.
Practical implications
The paper demonstrates that it is possible to create a formal system for coproducing heritage information.
Social implications
The ability of public libraries to coproduce heritage information is likely to increase the public good provided by public libraries and to make heritage resources more accessible.
Originality/value
This paper presents a novel model enabling the curation of publicly available private information about antiquarian texts by a national library to aid cultural understanding and the preservation of documents describing historical texts.