Multilayered Approach to Evaluate Mobile User Interfaces
Maria de Fátima Queiroz Vieira Turnell (Universidade Federal de Campina Grande (UFCG), Brazil), José Eustáquio Rangel de Queiroz (Universidade Federal de Campina Grande (UFCG), Brazil) and Danilo de Sousa Ferreira (Universidade Federal de Campina Grande (UFCG), Brazil)
Copyright: © 2008
This chapter presents a method for the evaluation of user interfaces for mobile applications. The method is based upon an approach that combines user opinion, standard conformity assessment, and user performance measurement. It focuses on the evaluation settings and techniques employed in the evaluation process, while offering a comparison between the laboratory evaluation and field evaluation approaches. The method’s presentation and the evaluation comparison will be supported by a discussion of the results obtained from the method’s application to a case study involving a Personal Digital Assistant (PDA). This chapter argues that the experience gained from evaluating conventional user interfaces can be applied to the world of mobile technology.
Key Terms in this Chapter
Conformity Assessment: A collective term used for a number of techniques used to determine if a product, system, or process (including design) meets a defined specification.
Virtual Network Computing (VNC): A desktop sharing system that uses the RFB (Remote Frame Buffer) protocol to remotely control another computer. It transmits the keyboard presses and mouse clicks from one computer to another over a network, relaying the screen updates back in the other direction.
Likert Scale: An attitude scale in which respondents indicate their degree of agreement/ disagreement with a given proposition concerning some object, aspect, person, or situation.
Multi-Layered Evaluation Approach: A product or prototype usability evaluation method that combines techniques for data gathering and analysis based on multiple perspectives (the user’s, the specialist’s, and the usability community). The results are overlaid in order to find discrepancies and offer more robust results.
User Satisfaction Measurement: The process of obtaining qualitative and quantitative information which indicates the extent to which user expectations concerning some object, process, product, or situation are being met. Such information can be obtained in a variety of ways, both formally and informally.
Efficacy of an Evaluation Method or Technique: Translated into the number of problems found, gravity of those problems versus the time, and cost of performing the experiments.
Device Mobility during a Usability Evaluation: The ability to interact with the user and continue to perform its functions while being transported.
User Performance Measurement: The process of gathering actual data from users as they work with a system and its documentation. Usually, the user is given a set of tasks to complete and the evaluator measures the relevant parameters such as the percentage of tasks or subtasks successfully completed, time required to perform each task or subtask, frequency and type of errors, duration of pauses, indications of user frustration, and the ways in which the user seeks assistance.
User Mobility during the Usability Evaluation: The ability to move while performing a task with a product.
Complete Chapter List
Anxo Cereijo Roibás, Stephen Johnson
Hanna Stelmaszewska, Bob Fields, Ann Blandford
Hyowon Lee, Cathal Gurrin, Gareth J.F. Jones, Alan F. Smeaton
Amy K. Karlson, Benjamin B. Bederson, Jose L. Contreras-Vidal
Martina Ziefle, Susanne Bay
Susanne Bay, Martina Ziefle
Chris Barber, James Knight
Anind K. Dey, Jonna Häkkilä
Bent Schmidt-Nielsen, Bret Harsham, Bhiksha Raj, Clifton Forlines
Nikolaos Tselios, Ioanna Papadimitriou, Dimitrios Raptis, Nikoletta Yiannoutsou, Vassilis Komis, Nikolaos Avouris
Siu Cheung Kong
Hyungsung Park, Young Kyun Baek, David Gibson
Nikola Mitrovic, Eduardo Mena, Jose Alberto Royo
Michael J. O’Grady, Gregory M.P. O’Hare
Yang Li, Scott Klemmer, James A. Landay
Emmanuel Dubois, Wafaa Abou Moussa, Cédric Bach, Nelly de Bonnefoy
Ioannis D. Zaharakis, Achilles D. Kameas
Rafael Ballagas, Michael Rohs, Jennifer G. Sheridan, Jan Borchers
Mark David Dunlop, Michelle Montgomery Masters
Min Lin, Andrew Sears, Steven Herbst, Yanfang Liu
Louise E. Moser, P.M. Melliar-Smith
Dong Yu, Li Deng
Parisa Eslambolchilar, Andrew Crossan, Roderick Murray-Smith, Sara Dalzel-Job, Frank Pollick
Panu Korpipää, Jukka Linjama, Juha Kela, Tapani Rantakokko
Enrico Costanza, Samuel A. Inverso, Rebecca Allen, Pattie Maes
Tolga Capin, Antonio Haro
Andrea Sanna, Fabrizio Lamberti
Rock Leung, Joanna Lumsden
Mark Matthews, Gavin Doherty, David Coyle, John Sharry
Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, Massimiliano Margarone
Shigueo Nomura, Takayuki Shiose, Hiroshi Kawakami, Osamu Katai, Keiji Yamanaka
Florence Gaunet, Xavier Briffault
Julio Abascal, Borja Bonail, Daniel Cagigas, Nestor Garay, Luis Gardeazabal
Regina Bernhaupt, Kristijan Mihalic, Marianna Obrist
Jan Willem Streefkerk, Myra P. van Esch-Bussemakers, Mark A. Neerincx, Rosemarijn Looije
Enrico Bertini, Tiziana Catarci, Alan Dix, Silvia Gabrielli, Stephen Kimani, Giuseppe Santucci
Thomas Alexander, Christopher Schlick, Alexander Sievert, Dieter Leyk
Maria de Fátima Queiroz Vieira Turnell, José Eustáquio Rangel de Queiroz, Danilo de Sousa Ferreira
Jaakko T. Lehikoinen
Dong-Han Ham, Jeongyun Heo, Peter Fossick, William Wong, Sanghyun Park, Chiwon Song, Mike Bradley
Kaikkonen, Kaikkonen, Anne, Anne, Aki Kekäläinen, Mikael Cankar, Titti Kallio
Murray Crease, Robert Longworth
Andrew Crossan, Roderick Murray-Smith, Stephen Brewster, Bojan Musizza
Murray Crease, Joanna Lumsden
Rune T. Høegh, Jesper Kjeldskov, Mikael B. Skov, Jan Stage
Adrian Stoica, Georgios Fiotakis, Dimitrios Raptis, Ioanna Papadimitriou, Vassilis Komis, Nikolaos Avouris
Kater Oakley, Gitte Lindgaard, Peter Kroeger, John Miller, Earl Bryenton, Paul Hébert
Shwetak N. Patel, Khai N. Truong, Gillian R. Hayes, Giovanni Iachello, Julie A. Kientz, Gregory D. Abowd
Saturnino Luz, Masood Masoodian
Jason T. Black, Lois Wright Hawkes
Tiong T. Goh, Kinshuk, Nian-Shing Chen