Qualitative and Quantitative Methods as Complementary Assessment Tools

Introduction

This chapter addresses epistemological and methodological approaches to assessment, with the intent to show how moving beyond paradigm wars and using multiple methods makes for good assessment. Higher education institutions are complex entities and thus require equally complex and comprehensive forms of assessing student learning and development. In this chapter, the authors explore the ways qualitative and quantitative methods are complementary, as opposed to competing concepts. Using both methodologies in collaboration provides a much richer form of assessment. Our approach to assessing assessment considers epistemological perspectives and presents practical mixed method examples.

The chapter is comprised of three main sections. The first section is a review of the literature on qualitative, quantitative, and mixed method designs, which includes an overview of the history and contemporary landscape of the qualitative-quantitative debate. The second section of this chapter highlights successful examples of mixed-method assessment at a mid-sized university. The examples provide not only specific instances, but also general frameworks which can be used on any campus. Finally, the chapter concludes with future trends and recommendations for practitioners. Specific strategies for maximizing the benefits of both assessment methods in any higher education setting are offered.

Given its location within the assessing assessment section of this text, the objectives of this chapter include:

• 1.

  Encouraging readers to consider multiple epistemological perspectives as they select assessment methods.

• 2.

  Encouraging readers to critically evaluate the potential effectiveness of quantitative and qualitative assessment techniques for their projects and carefully select rigorous techniques which can stand up to scrutiny.

• 3.

  Presenting a variety of specific mixed-method assessment examples within a series of frameworks which can be adapted for use in any higher education environment.

• 4.

  Offering practical suggestions for readers to consider prior to implementing their assessment projects, which are often high stakes activities.

The authors fully acknowledge the challenges of addressing the vast epistemological perspectives and language usage issues related to qualitative and quantitative methods. While a brief overview of these issues is included here, the intent of this chapter is not to provide an in-depth philosophical analysis. Instead, we strive to provide useful insight and recommendations for practitioners who are faced with assessment decisions on a daily basis.

Background

Over the past twenty-five years, assessment has become a standard practice in higher education. Ideas of research and scholarship have historically been associated with the professorate, but they are rarely used for program planning and assessment purposes. Both research and assessment are a reality in higher education and have many overlapping procedures and functions (Erwin, 1991). Both require the systematic, rigorous collection and analysis of data to answer a question or solve a problem. Pike (2002) reminds us that there are “five elements of research that are essential for effective assessment: asking good questions, identifying appropriate methods, using appropriate measures, selecting representative participants, and communicating results effectively” (pp. 131-132). A major difference between assessment and research, however, is that research, especially quantitative research methods, are typically used to generate theory or conclusions applicable to many settings. Conversely, the primary intent of assessment is to understand the impact of and improve local and specific higher education practices. However, it should be recognized that assessment findings can also impact accountability concerns, including funding allocations, program development, and public perception.