From Classification to Retrieval: Exploiting Pattern Classifiers in Semantic Image Indexing and Retrieval

From Classification to Retrieval: Exploiting Pattern Classifiers in Semantic Image Indexing and Retrieval

Joo-Hwee Lim (Institute for Infocomm Research, Singapore) and Jesse S. Jin (The University of New Castle, Australia)
Copyright: © 2005 |Pages: 22
DOI: 10.4018/978-1-59140-569-6.ch002
OnDemand PDF Download:


Users query images by using semantics. Though low-level features can be easily extracted from images, they are inconsistent with human visual perception. Hence, low-level features cannot provide sufficient information for retrieval. High-level semantic information is useful and effective in retrieval. However, semantic information is heavily dependent upon semantic image regions and beyond, which are difficult to obtain themselves. Bridging this semantic gap between computed visual features and user query expectation poses a key research challenge in managing multimedia semantics. As a spin-off from pattern recognition and computer vision research more than a decade ago, content-based image retrieval research focuses on a different problem from pattern classification though they are closely related. When the patterns concerned are images, pattern classification could become an image classification problem or an object recognition problem. While the former deals with the entire image as a pattern, the latter attempts to extract useful local semantics, in the form of objects, in the image to enhance image understanding. In this chapter, we review the role of pattern classifiers in state-of-the-art content-based image retrieval systems and discuss their limitations. We present three new indexing schemes that exploit pattern classifiers for semantic image indexing, and illustrate the usefulness of these schemes on the retrieval of 2,400 unconstrained consumer images.

Complete Chapter List

Search this Book:
Table of Contents
Uma Srinivasan, Surya Nepal
Chapter 1
Anne H.H. Ngu, Jialie Shen, John Shepherd
The optimized distance-based access methods currently available for multimedia databases are based on two major assumptions: a suitable distance... Sample PDF
Toward Semantically Meaningful Feature Spaces for Efficient Indexing in Large Image Databases
Chapter 2
Joo-Hwee Lim, Jesse S. Jin
Users query images by using semantics. Though low-level features can be easily extracted from images, they are inconsistent with human visual... Sample PDF
From Classification to Retrieval: Exploiting Pattern Classifiers in Semantic Image Indexing and Retrieval
Chapter 3
Qi Tian, Ying Wu, Jie Yu, Thomas S. Huang
For learning-based tasks such as image classification and object recognition, the feature dimension is usually very high. The learning is afflicted... Sample PDF
Self-Supervised Learning Based on Discriminative Nonlinear Features and Its Applications for Pattern Classification
Chapter 4
Ankush Mittal, Cheong Loong Fah, Ashraf Kassim, Krishnan V. Pagalthivarthi
Most of the video retrieval systems work with a single shot without considering the temporal context in which the shot appears. However, the meaning... Sample PDF
Context-Based Interpretation and Indexing of Video Data
Chapter 5
Changsheng Xu, Xi Shao, Namunu C. Maddage, Jesse S. Jin, Qi Tian
This chapter aims to provide a comprehensive survey of the technical achievements in the area of content-based music summarization and... Sample PDF
Content-Based Music Summarization and Classification
Chapter 6
Uma Srinivasan, Surya Nepal
In order to manage large collections of video content, we need appropriate video content models that can facilitate interaction with the content.... Sample PDF
A Multidimensional Approach for Describing Video Semantics
Chapter 7
Silvia Pfeifer, Conrad Parker, André Pang
The Continuous Media Web project has developed a technology to extend the Web to time-continuously sampled data enabling seamless searching and... Sample PDF
Continuous Media Web: Hyperlinking, Search and Retrieval of Time-Continuous Data on the Web
Chapter 8
Uma Srinivasan, Ajay Divakaran
This chapter presents the ISO/IEC MPEG-7 Multimedia Content description Interface Standard from the point of view of managing semantics in the... Sample PDF
Management of Multimedia Semantics Using MPEG-7
Chapter 9
Qi Tian, Baback Moghaddam, Neal Lesh, Chia Shen, Thomas S. Huang
Recent advances in technology have made it possible to easily amass large collections of digital media. These media offer new opportunities and... Sample PDF
Visualization, Estimation and User Modeling for Interactive Browsing of Personal Photo Libraries
Chapter 10
Brett Adams, Svetha Venkatesh
This chapter takes a look at the task of creating multimedia authoring tools for the amateur media creator, and the problems unique to the... Sample PDF
Multimedia Authoring: Human-Computer Partnership for Harvesting Metadata from the Right Sources
Chapter 11
Ansgar Scherp, Susanne Boll
In the Internet age and with the advent of digital multimedia information, we succumb to the possibilities that the enchanting multimedia... Sample PDF
MM4U: A Framework for Creating Personalized Multimedia Content
Chapter 12
Samar Zutshi, Campbell Wilson, Shonali Krishnamurthy, Bala Srinivasan
Relevance feedback is a mature technique that has been used to take user subjectivity into account in multimedia retrieval. It can be seen as an... Sample PDF
The Role of Relevance Feedback in Managing Multimedia Semantics: A Survey
Chapter 13
Utz Westermann, Sonja Zillner, Karin Schellner, Wolfgang Klaus
Current semantic approaches to multimedia content modeling treat the content’s media, the semantic description of the content, and the functionality... Sample PDF
EMMO: Tradable Units of Knowledge-Enriched Multimedia Content
Chapter 14
Isabel F. Cruz, Olga Sayenko
Semantics can play an important role in multimedia content retrieval and presentation. Although a complete semantic description of a multimedia... Sample PDF
Semantically Driven Multimedia Querying and Presentation
Chapter 15
Viranga Ratnaike, Bala Srinivasan, Surya Nepal
The semantic gap is recognized as one of the major problems in managing multimedia semantics. It is the gap between sensory data and semantic... Sample PDF
Emergent Semantics: An Overview
Chapter 16
Edward Altman, Lonce Wyse
The computation of emergent semantics for blending media into creative compositions is based on the idea that meaning is endowed upon the media in... Sample PDF
Emergent Semantics from Media Blending
About the Authors