Perceptual Semantics

Perceptual Semantics

Andrea Cavallaro (Queen Mary University of London, UK) and Stefan Winkler (National Singapore University and Genista Corporation, Singapore)
Copyright: © 2006 |Pages: 20
DOI: 10.4018/978-1-59140-860-4.ch001
OnDemand PDF Download:


The design of image and video compression or transmission systems is driven by the need for reducing the bandwidth and storage requirements of the content while maintaining its visual quality. Therefore, the objective is to define codecs that maximize perceived quality as well as automated metrics that reliably measure perceived quality. One of the common shortcomings of traditional video coders and quality metrics is the fact that they treat the entire scene uniformly, assuming that people look at every pixel of the image or video. In reality, we focus only on particular areas of the scene. In this chapter, we prioritize the visual data accordingly in order to improve the compression performance of video coders and the prediction performance of perceptual quality metrics. The proposed encoder and quality metric incorporate visual attention and use a semantic segmentation stage, which takes into account certain aspects of the cognitive behavior of people when watching a video. This semantic model corresponds to a specific human abstraction, which need not necessarily be characterized by perceptual uniformity. In particular, we concentrate on segmenting moving objects and faces, and we evaluate the perceptual impact on video coding and on quality evaluation.

Complete Chapter List

Search this Book:
Table of Contents
Klara Nahrstedt
Gheorghita Ghinea , Sherry Y. Chen
Gheorghita Ghinea , Sherry Y. Chen
Chapter 1
Perceptual Semantics  (pages 1-20)
Andrea Cavallaro, Stefan Winkler
The design of image and video compression or transmission systems is driven by the need for reducing the bandwidth and storage requirements of the... Sample PDF
Perceptual Semantics
Chapter 2
Edward Y. Chang
This chapter summarizes the work on Mathematics of Perception performed by my research team between 2000 and 2005. To support personalization, a... Sample PDF
The Mathematics of Perception: Statistical Models and Algorithms for Image Annotation and Retrieval
Chapter 3
Michael May
The aim of this chapter is to sketch a semantic taxonomy of representational forms (or “sign types” in the terminology of semiotics) relevant for... Sample PDF
Feature-Based Multimedia Semantics: Representational Forms for Instructional Multimedia Design
Chapter 4
Stephen R. Gulliver
This chapter introduces a selection of studies relating to each of the multimedia senses — olfactory (smell), tactile/haptic (touch), visual... Sample PDF
Incorporating and Understanding the User-Perspective
Chapter 5
Lesley Axelrod, Kate Hone
In a culture which places increasing emphasis on happiness and wellbeing, multimedia technologies include emotional design to improve commercial... Sample PDF
Multimodel Expressions: E-Motional and Non-Verbal Behaviour
Chapter 6
Linda D. Bussell
This chapter examines the use of haptic feedback in a multimedia simulation as a means of conveying information about physical science concepts. The... Sample PDF
Learning Science Concepts with Haptic Feedback
Chapter 7
Kostas Giannakis
This chapter investigates the use of visual texture for the visualization of multi-dimensional auditory information. Twenty subjects with a strong... Sample PDF
Perceptual-Based Visualization of Auditory Information Using Visual Texture
Chapter 8
Martha E. Crosby, Curtis S. Ikehara
This chapter describes our research focused on deriving changing cognitive state information from the patterns of data acquired from the user, with... Sample PDF
Using Real-Time Physiological Monitoring for Assessing Cognitive States
Chapter 9
Gheorghita Ghinea, Sherry Y. Chen
In this chapter, we describe the results of empirical studies which examined the effect of cognitive style on the perceived quality of distributed... Sample PDF
Perceptual Multimedia: A Cognitive Style Perspective
Chapter 10
Slava Kalyuga
This chapter provides an overview of theoretical frameworks and empirical evidence for the design of adaptive multimedia that is tailored to... Sample PDF
Expert-Novice Differences and Adaptive Multimedia
Chapter 11
Adam Tilinger, Cecilia Sik-Lanyi
This chapter presents the differences between left- and right-handed persons in the aspect of computer-presented information and virtual realities.... Sample PDF
Issues of Hand Preference in Computer Presented Information and Virtual Realities
Chapter 12
Nicola Cranley, Liam Murphy
There is an increasing demand for streaming video applications over both the fixed Internet and wireless IP networks. The fluctuating bandwidth and... Sample PDF
Incorporating User Perception in Adaptive Video Streaming Systems
Chapter 13
Greger Wikstrand
While increasing bandwidth might be an acceptable way to maximize user utility, it is not always sufficient. This chapter presents a three-layer... Sample PDF
A Three-Layer Framework for ?QoS-Aware Service Design
Chapter 14
Panagiotis Germanakos, Constantinos Mourlas
A traditional multimedia system presents the same static content and suggests the same next page to all users, even though they might have widely... Sample PDF
Adaptation and Personalization of Web-Based Multimedia Content
About the Authors