Visual Speech Perception, Optical Phonetics, and Synthetic Speech

Visual Speech Perception, Optical Phonetics, and Synthetic Speech

Lynne E. Bernstein, Jintao Jiang
Copyright: © 2009 |Pages: 23
ISBN13: 9781605661865|ISBN10: 1605661864|ISBN13 Softcover: 9781616925338|EISBN13: 9781605661872
DOI: 10.4018/978-1-60566-186-5.ch015
Cite Chapter Cite Chapter

MLA

Bernstein, Lynne E., and Jintao Jiang. "Visual Speech Perception, Optical Phonetics, and Synthetic Speech." Visual Speech Recognition: Lip Segmentation and Mapping, edited by Alan Wee-Chung Liew and Shilin Wang, IGI Global, 2009, pp. 439-461. https://doi.org/10.4018/978-1-60566-186-5.ch015

APA

Bernstein, L. E. & Jiang, J. (2009). Visual Speech Perception, Optical Phonetics, and Synthetic Speech. In A. Liew & S. Wang (Eds.), Visual Speech Recognition: Lip Segmentation and Mapping (pp. 439-461). IGI Global. https://doi.org/10.4018/978-1-60566-186-5.ch015

Chicago

Bernstein, Lynne E., and Jintao Jiang. "Visual Speech Perception, Optical Phonetics, and Synthetic Speech." In Visual Speech Recognition: Lip Segmentation and Mapping, edited by Alan Wee-Chung Liew and Shilin Wang, 439-461. Hershey, PA: IGI Global, 2009. https://doi.org/10.4018/978-1-60566-186-5.ch015

Export Reference

Mendeley
Favorite

Abstract

The information in optical speech signals is phonetically impoverished compared to the information in acoustic speech signals that are presented under good listening conditions. But high lipreading scores among prelingually deaf adults inform us that optical speech signals are in fact rich in phonetic information. Hearing lipreaders are not as accurate as deaf lipreaders, but they too demonstrate perception of detailed optical phonetic information. This chapter briefly sketches the historical context of and impediments to knowledge about optical phonetics and visual speech perception (lipreading). The authors review findings on deaf and hearing lipreaders. Then we review recent results on relationships between optical speech signals and visual speech perception. We extend the discussion of these relationships to the development of visual speech synthesis. We advocate for a close relationship between visual speech perception research and development of synthetic visible speech.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.