A Field Laboratory for Evaluating in Situ
Rune T. Høegh (Aalborg University, Denmark), Jesper Kjeldskov (Aalborg University, Denmark), Mikael B. Skov (Aalborg University, Denmark) and Jan Stage (Aalborg University, Denmark)
Copyright: © 2008
Evaluating mobile technologies “in the real world” is hard. It is challenging to capture key situations of use, hard to apply established techniques such as observation and “thinking aloud,” and it is complicated to collect data of an acceptable quality. In response to these challenges, a “field laboratory” has been developed for evaluating mobile technologies in situ. Facilitating high-quality data collection as well as unobstructed user interaction, the field laboratory allows a small wireless camera to be attached to a mobile device, capturing a close-up image of the screen and buttons. This chapter describes the iterative development of the field laboratory over 4 years of evaluating several mobile systems in field settings. It leads to a description of the current setup and how it is used, and explains the rationales for key decisions on technology and form factors made throughout its development.
Key Terms in this Chapter
Camera-Clamp: A tiny camera that can be clipped on to a mobile device such as a PDA or a mobile phone. Camera-clamps can be either cabled or wireless. The latter require a battery supply and a video receiver.
Quad Display Unit: A video unit that merges four different video signals into one composite signal. All four video images are rescaled and thus lose a bit of quality in the process.
Close-Up View: A video recording of the screen and buttons on a mobile device such as a PDA or mobile phone, during an evaluation of use or usability; usually captured with a mobile devices camera attached to the device.
Lapel Microphone: A small microphone that can be clipped on to a person’s collar or revere. The microphone is usually connected to a small transmitter that can be carried in a pocket or clipped on to the belt.
Picture-in-Picture Unit: A video unit that inserts a video image over a part of another one. The inserted video image is rescaled and thus loses a bit of quality in the process.
Third Person View: A video recording of the user(s) of a mobile device and their immediate surroundings during an evaluation of use or usability from the perspective of a third person observing from a distance.
AV Hard Disk Recorder: A video unit that records an external video and audio source directly onto a hard disk in a digital format that can be played back on a computer. The video recording is typically compressed when it is recorded resulting in manageable file sizes.
Field Laboratory: A configuration of laboratory equipment, such as video and audio recording devices, put together so that it can be taken into to field for data collection about the use and usability of mobile technologies in situ.
Complete Chapter List
Anxo Cereijo Roibás, Stephen Johnson
Hanna Stelmaszewska, Bob Fields, Ann Blandford
Hyowon Lee, Cathal Gurrin, Gareth J.F. Jones, Alan F. Smeaton
Amy K. Karlson, Benjamin B. Bederson, Jose L. Contreras-Vidal
Martina Ziefle, Susanne Bay
Susanne Bay, Martina Ziefle
Chris Barber, James Knight
Anind K. Dey, Jonna Häkkilä
Bent Schmidt-Nielsen, Bret Harsham, Bhiksha Raj, Clifton Forlines
Nikolaos Tselios, Ioanna Papadimitriou, Dimitrios Raptis, Nikoletta Yiannoutsou, Vassilis Komis, Nikolaos Avouris
Siu Cheung Kong
Hyungsung Park, Young Kyun Baek, David Gibson
Nikola Mitrovic, Eduardo Mena, Jose Alberto Royo
Michael J. O’Grady, Gregory M.P. O’Hare
Yang Li, Scott Klemmer, James A. Landay
Emmanuel Dubois, Wafaa Abou Moussa, Cédric Bach, Nelly de Bonnefoy
Ioannis D. Zaharakis, Achilles D. Kameas
Rafael Ballagas, Michael Rohs, Jennifer G. Sheridan, Jan Borchers
Mark David Dunlop, Michelle Montgomery Masters
Min Lin, Andrew Sears, Steven Herbst, Yanfang Liu
Louise E. Moser, P.M. Melliar-Smith
Dong Yu, Li Deng
Parisa Eslambolchilar, Andrew Crossan, Roderick Murray-Smith, Sara Dalzel-Job, Frank Pollick
Panu Korpipää, Jukka Linjama, Juha Kela, Tapani Rantakokko
Enrico Costanza, Samuel A. Inverso, Rebecca Allen, Pattie Maes
Tolga Capin, Antonio Haro
Andrea Sanna, Fabrizio Lamberti
Rock Leung, Joanna Lumsden
Mark Matthews, Gavin Doherty, David Coyle, John Sharry
Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, Massimiliano Margarone
Shigueo Nomura, Takayuki Shiose, Hiroshi Kawakami, Osamu Katai, Keiji Yamanaka
Florence Gaunet, Xavier Briffault
Julio Abascal, Borja Bonail, Daniel Cagigas, Nestor Garay, Luis Gardeazabal
Regina Bernhaupt, Kristijan Mihalic, Marianna Obrist
Jan Willem Streefkerk, Myra P. van Esch-Bussemakers, Mark A. Neerincx, Rosemarijn Looije
Enrico Bertini, Tiziana Catarci, Alan Dix, Silvia Gabrielli, Stephen Kimani, Giuseppe Santucci
Thomas Alexander, Christopher Schlick, Alexander Sievert, Dieter Leyk
Maria de Fátima Queiroz Vieira Turnell, José Eustáquio Rangel de Queiroz, Danilo de Sousa Ferreira
Jaakko T. Lehikoinen
Dong-Han Ham, Jeongyun Heo, Peter Fossick, William Wong, Sanghyun Park, Chiwon Song, Mike Bradley
Kaikkonen, Kaikkonen, Anne, Anne, Aki Kekäläinen, Mikael Cankar, Titti Kallio
Murray Crease, Robert Longworth
Andrew Crossan, Roderick Murray-Smith, Stephen Brewster, Bojan Musizza
Murray Crease, Joanna Lumsden
Rune T. Høegh, Jesper Kjeldskov, Mikael B. Skov, Jan Stage
Adrian Stoica, Georgios Fiotakis, Dimitrios Raptis, Ioanna Papadimitriou, Vassilis Komis, Nikolaos Avouris
Kater Oakley, Gitte Lindgaard, Peter Kroeger, John Miller, Earl Bryenton, Paul Hébert
Shwetak N. Patel, Khai N. Truong, Gillian R. Hayes, Giovanni Iachello, Julie A. Kientz, Gregory D. Abowd
Saturnino Luz, Masood Masoodian
Jason T. Black, Lois Wright Hawkes
Tiong T. Goh, Kinshuk, Nian-Shing Chen