Using Stressors in Usability Tests: Empirical Results and Practical Recommendations

Using Stressors in Usability Tests: Empirical Results and Practical Recommendations

Monique Janneck (Department of Electrical Engineering and Computer Science, Luebeck University of Applied Sciences, Luebeck, Germany) and Makbule Balin (eparo GmbH, Hamburg, Germany)
DOI: 10.4018/ijskd.2013070102


In this study the authors investigated whether the experience of stressors would influence the performance of users in usability tests as well as their subjective rating of the usability of an interactive system. To that end, an experimental study was conducted comparing a usability test that was performed in the lab under quiet, relaxed conditions with a test situation where several stressors (time pressure, noise, social pressure) were applied. Results show that participants in stress conditions performed worse regarding the completion and correctness of the tasks. The stress and negative feelings the participants experienced also influenced their view of the tested software. Participants in stress conditions rated the usability of the software and their user experience more negative. Implications for the practice of usability testing are discussed.
Article Preview

1. Introduction

Usability tests are an important method to determine the usefulness of interactive systems and products in realistic settings and with real users: In usability tests, participants solve tasks that they would typically work on with a certain system. By observing the interaction, problems and difficulties can be determined and corrected in the software. Furthermore user acceptance and satisfaction can be measured.

Usability tests are often conducted in usability labs, which are equipped with specialized hardware and software for audio and video recording, mouse tracking, screen recording or eye-tracking analysis. Usability tests usually cover ‘normal’ use cases and conditions: It is observed what works well and what problems arise in a regular use situation. Supported by the analysis techniques named above, experimenters are able to gain manifold insights into user behavior and possible improvements of the software.

However, in the laboratory important context factors might not be as present as in the real situation or even suppressed altogether (cf. Greifenender, 2011), such as noise, presence of other people, interruptions, bad or bright lighting, special hardware etc. Imagine, for example, an electronic train ticket vending machine. People typically use such systems in a public situation, possibly in a hurry because the train is leaving shortly, pressured by others waiting in the queue. It is easy to imagine that testing a vending machine under such conditions will yield other results that in a quiet and relaxed usability lab. In many areas simulations are used to specifically test how users and systems perform under difficult conditions or in risky situations, e.g. when training pilots or staff of safety-critical facilities and equipment.

In this paper we investigate the use of stressors in regular usability tests (i.e., not especially regarding safety-critical systems) to find out how they possibly influence users’ performance and also their evaluation of the product or system they tested. To that end, we conducted an experiment to compare usability tests under regular laboratory conditions with a situation where several stressors were induced, such as time pressure, noise, and social pressure. The results of our study provide preliminary insights into the effects of stressors during usability testing.

Complete Article List

Search this Journal:
Open Access Articles: Forthcoming
Volume 12: 4 Issues (2020): 1 Released, 3 Forthcoming
Volume 11: 4 Issues (2019): 3 Released, 1 Forthcoming
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing