User Testing and Iterative Design in the Academic Library: A Case Study

Introduction

In this chapter, we present a case study of the development of digital learning objects designed to teach information and research literacy skills. Specifically, we will describe the development process with an emphasis on how iterative design and different testing techniques are employed to produce learning objects that are both engaging and pedagogically sound. We approach this topic from two perspectives: learning design and user-centered design (UCD). As learning designers we are concerned with making high quality, pedagogically sound learning objects that reflect clear, measurable learning objectives. We follow Mestre et al.’s (2011) definition of a learning object as a “reusable instructional resource…developed to support learning” (p. 237). The UCD lens provides tools to help keep the focus on the end user, in this case the learner, not just in terms of content, but also in terms of how the design and function of the learning objects respond to how users naturally engage with the materials (Barnum, 2011; Rubin, Chisnell, & Spool, 2008).

Critically, following UCD principles means that while the design of our learning objects is informed by learning theory, we do not rely on theory alone, nor our own intuitions, to tell us what users want and need. Rather, we draw conclusions based on direct evidence of user behavior and attitudes. Our specific objective for this chapter is to explain how we combine these two perspectives by illustrating the testing process at different stages during the development of digital learning objects. We will demonstrate how this approach improves not only the design and function, but also the content of learning objects. We will conclude by discussing the implications of iterative design for pedagogy, the insights we gained through the process, and recommendations for designers and practitioners.