Inferring Intent and Action from Gaze in Naturalistic Behavior: A Review

Inferring Intent and Action from Gaze in Naturalistic Behavior: A Review

Kristian Lukander (Finnish Institute of Occupational Health, Helsinki, Finland), Miika Toivanen (Finnish Institute of Occupational Health, Helsinki, Finland & Department of Teacher Education, University of Helsinki, Helsinki, Finland) and Kai Puolamäki (Finnish Institute of Occupational Health, Helsinki, Finland)
Copyright: © 2017 |Pages: 17
DOI: 10.4018/IJMHCI.2017100104
OnDemand PDF Download:
No Current Special Offers


We constantly move our gaze to gather acute visual information from our environment. Conversely, as originally shown by Yarbus in his seminal work, the elicited gaze patterns hold information over our changing attentional focus while performing a task. Recently, the proliferation of machine learning algorithms has allowed the research community to test the idea of inferring, or even predicting action and intent from gaze behaviour. The on-going miniaturization of gaze tracking technologies toward pervasive wearable solutions allows studying inference also in everyday activities outside research laboratories. This paper scopes the emerging field and reviews studies focusing on the inference of intent and action in naturalistic behaviour. While the task-specific nature of gaze behavior, and the variability in naturalistic setups present challenges, gaze-based inference holds a clear promise for machine-based understanding of human intent and future interactive solutions.
Article Preview



Work toward this paper started from organizing the workshop2 on “Inferring user action with mobile gaze tracking” as part of the Mobile HCI 2016 conference in Florence, Italy (Toivanen et al., 2016). The objective of the workshop was to map out the developing field of task and intent recognition in natural gaze interaction. The round-up talk after the workshop forms the basis of this contribution.

Complete Article List

Search this Journal:
Open Access Articles
Volume 13: 4 Issues (2021): Forthcoming, Available for Pre-Order
Volume 12: 4 Issues (2020): 2 Released, 2 Forthcoming
Volume 11: 4 Issues (2019)
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing