An Empirical Evaluation of a Vocal User Interface for Programming by Voice

An Empirical Evaluation of a Vocal User Interface for Programming by Voice

Amber Wagner, Jeff Gray
DOI: 10.4018/IJITSA.2015070104
(Individual Articles)
No Current Special Offers


Although Graphical User Interfaces (GUIs) often improve usability, individuals with physical disabilities may be unable to use a mouse and keyboard to navigate through a GUI-based application. In such situations, a Vocal User Interface (VUI) may be a viable alternative. Existing vocal tools (e.g., Vocal Joystick) can be integrated into software applications; however, integrating an assistive technology into a legacy application may require tedious and manual adaptation. Furthermore, the challenges are deeper for an application whose GUI changes dynamically (e.g., based on the context of the program) and evolves with each new application release. This paper provides a discussion of challenges observed while mapping a GUI to a VUI. The context of the authors' examples and evaluation are taken from Myna, which is the VUI that is mapped to the Scratch programming environment. Initial user studies on the effectiveness of Myna are also presented in the paper.
Article Preview

GUIs typically require usage of the keyboard and mouse for input, which can be difficult for users with motor impairments. A suggested solution is to provide vocal input, which has proven to be successful in some cases (Begel, 2005; Dai et al., 2004; Désilets et al., 2006; Harada et al., 2009; Shaik et al., 2003). While many tools (e.g., Vocal Joystick) are advantageous and users find them beneficial (Harada et al., 2009), they may not be as helpful when manipulating objects within a GUI, such as in an IPE like Scratch (2015). Such programs require navigation in addition to manipulation of objects on the screen. Beyond providing a means for navigation, we believe that new accessibility tools should be created using ability-based design as described by Wobbrock et al. (2011), which is explained further in the rest of this section.

Complete Article List

Search this Journal:
Volume 17: 1 Issue (2024)
Volume 16: 3 Issues (2023)
Volume 15: 3 Issues (2022)
Volume 14: 2 Issues (2021)
Volume 13: 2 Issues (2020)
Volume 12: 2 Issues (2019)
Volume 11: 2 Issues (2018)
Volume 10: 2 Issues (2017)
Volume 9: 2 Issues (2016)
Volume 8: 2 Issues (2015)
Volume 7: 2 Issues (2014)
Volume 6: 2 Issues (2013)
Volume 5: 2 Issues (2012)
Volume 4: 2 Issues (2011)
Volume 3: 2 Issues (2010)
Volume 2: 2 Issues (2009)
Volume 1: 2 Issues (2008)
View Complete Journal Contents Listing