Semantic Annotation and Retrieval of Images in Digital Libraries

Semantic Annotation and Retrieval of Images in Digital Libraries

Taha Osman (Nottingham Trent University, UK), Dhavalkumar Thakker (Nottingham Trent University, UK) and Gerald Schaefer (Aston University, UK)
DOI: 10.4018/978-1-59904-879-6.ch026
OnDemand PDF Download:


While many digital image libraries allow access to large repositories of images, unfortunately, often the provided free-text search returns unsatisfactory retrieval results. The reason for this is that search techniques typically rely solely on statistical analysis of keyword recurrences in image annotations. In this chapter we show that through the employment of a semantic framework for image annotation, vastly improved retrieval can be accomplished. We present a semantically-enabled annotation and retrieval engine which relies on methodically structured ontologies for image annotation, and demonstrate how it provides more accurate retrieval results as well as a richer set of alternatives matchmaking the original query.
Chapter Preview


The fundamental premise of the Semantic Web is to extend the Web’s current human-oriented interface to a format that is comprehensible to software programmes. For instance, in a Semantic Web scenario, intelligent agents would be able to set up an appointment between a patient and the doctor, looking at both timetables, and finding the best way to the clinic without the patient having to interfere in the process. The user would only have to specify the requirements of a task while semantic agents will complete the task on their own (Berners-Lee & Fishetti, 2000).

The concept of ontologies is fundamental to the Semantic Web. An ontology represents an area of knowledge that is used by people, databases, and applications that need to share domain information. Ontologies include computer-usable definitions of basic concepts in the domain and the relationships between them. The Web ontology language (OWL) (Parsia & Sirin, 2004) has become the de-facto standard for expressing ontologies. It adds extensive vocabulary to describe properties and classes and expresses relationships between classes (e.g., disjointness), cardinality (e.g., ‘exactly one’), equality, richer typing of properties, and characteristics of properties (e.g., symmetry). OWL is designed for use by applications that need to process the content of information rather than just presenting information to humans.

Applied to image retrieval, the semantic annotation of images creates a conceptual understanding of the domains that the images represent, enabling software agents (i.e., search engines) to make more intelligent decisions about the relevance of the image to a particular user query. The use of Semantic Web concepts in image retrieval is likely to improve the computer’s understanding of the image objects and their interactions. To attain such improved results, the data need a better structure, so as to make sense between different semantic concepts. Here, the Semantic Web is likely to bring such a structure that integrates concepts and interentity relations from different domains.

Key Terms in this Chapter

Semantic Web: An extension of the Web incorporating semantic information to allow machines to understand the information contained on the Web.

Web Ontology Language (OWL): A computer-readable language in which Semantic Web ontologies can be expressed.

Ontology: A representation of the meanings of terms in a vocabulary.

Semantics: The study of how meaning is generated in language.

Semantic Image Retrieval: Image retrieval that takes into account the meaning of the actions and objects contained in images.

Complete Chapter List

Search this Book: