Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older People

Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older People

Ornella Mich (FBK, Trento, Italy), Gianluca Schiavo (FBK, Trento, Italy), Michela Ferron (FBK, Trento, Italy) and Nadia Mana (FBK, Trento, Italy)
Copyright: © 2020 |Pages: 20
DOI: 10.4018/IJMHCI.2020010102

Abstract

Multimodal human–computer interaction has been sought to provide not only more compelling interactive experiences, but also more accessible interfaces to mobile devices. With the advance in mobile technology and in affordable sensors, multimodal research that leverages and combines multiple interaction modalities (such as speech, touch, vision, and gesture) has become more and more prominent. This article provides a framework for the key aspects in mid-air gesture and speech-based interaction for older adults. It explores the literature on multimodal interaction and older adults as technology users and summarises the main findings for this type of users. Building on these findings, a number of crucial factors to take into consideration when designing multimodal mobile technology for older adults are described. The aim of this work is to promote the usefulness and potential of multimodal technologies based on mid-air gestures and voice input for making older adults' interaction with mobile devices more accessible and inclusive.
Article Preview
Top

Older Adults As Technology Users

According to UN estimates, between 2015 and 2050 the proportion of the world's population over 60 years will nearly double from 12% to 22% (World Health Organization, 2018). People tend to not only live longer, but also to remain more active during old age (Crews & Zavotka, 2006; Fisk, Rogers, Charness, Czaja, & Sharit, 2009). For this reason, older adults represent a major target for ICT-related research (Fisk et al., 2009).

Complete Article List

Search this Journal:
Reset
Open Access Articles
Volume 12: 4 Issues (2020): 1 Released, 3 Forthcoming
Volume 11: 4 Issues (2019)
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing