User Evaluation of Mobile Devices: In-Situ versus Laboratory Experiments

User Evaluation of Mobile Devices: In-Situ versus Laboratory Experiments

Francis Jambon
Copyright: © 2009 |Pages: 16
DOI: 10.4018/jmhci.2009040104
OnDemand:
(Individual Articles)
Available
$37.50
Current Special Offers
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

Nowadays, mobile devices features are often linked up to the context of usage. As a consequence, researchers must consider not only the user and the device, but also the surrounding environment when designing effective user study evaluations. Two opposite experimental setups are possible: in-situ and in the laboratory. There is no consensus on their respective benefits, for instance with regard to the number of usability issues detected. In this paper, we isolate independent variables that could contribute to evaluation biases by proposing a taxonomy that splits the in-situ experimental setups into two new setups. We describe the concept of the “Uncertainty Principle” to emphasize the dilemma between precise observation and bias minimization and introduce the “Trojan Horse” technique to partially overcome the consequences of the uncertainty principle. As a conclusion, a methodology using both laboratory and in-situ experiments in a complementary way is proposed.

Complete Article List

Search this Journal:
Reset
Volume 16: 1 Issue (2024): Forthcoming, Available for Pre-Order
Volume 15: 1 Issue (2023)
Volume 14: 4 Issues (2022): 1 Released, 3 Forthcoming
Volume 13: 1 Issue (2021)
Volume 12: 3 Issues (2020)
Volume 11: 4 Issues (2019)
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing