Multi-modal interaction enables technical systems and their users to communicate with each other via different channels such as natural language, gesture, or graphic presentation, in addition to conventional buttons, switches, remote control panels, etc.
Published in Chapter:
Context-Sensitive Spatial Interaction and Ambient Control
Bernd Krieg-Brückner (Universität Bremen, Germany), Hui Shi (Universität Bremen, Germany), Bernd Gersdorf (Universität Bremen, Germany), Mathias Döhle (Universität Bremen, Germany), and Thomas Röfer (Universität Bremen, Germany)
Copyright: © 2011
|Pages: 21
DOI: 10.4018/978-1-61692-857-5.ch024
Abstract
In this chapter, we first briefly introduce the setting: mobility assistants (the wheelchair Rolland and iWalker) and smart environment control in the Bremen Ambient Assisted Living Lab. In several example scenarios, we then outline our contributions to the state of the art, focussing on spatial knowledge representation, reasoning and spatial interaction (multi-modal, but with special emphasis on natural language dialogue) between three partners: the user, a mobility assistant, and the smart environment.