Outcomes Assessment in Japanese Language Instruction

Outcomes Assessment in Japanese Language Instruction

P. Tokyo Kang (University of Guam, Guam) and David Gugin (University of Guam, Guam)
DOI: 10.4018/978-1-60566-667-9.ch014
OnDemand PDF Download:


This chapter reports an outcomes assessment study conducted at the University of Guam. The assessment project was conducted during the 2006-07 and 2007-08 academic years and focused on two courses: Elementary Japanese I and Elementary Japanese II. To our knowledge, this assessment project was the first ever conducted in the Japanese Studies program. As such, both the results of that assessment as well as the assessment process itself provide useful avenues of inquiry. This chapter first discusses some of the problems and opportunities created by outcomes assessment in Foreign Language instruction. That discussion is followed by an examination of the actual assessment project, including its rationale, methodology and results. Finally, the chapter concludes with a discussion of the more significant implications of the project, especially in terms of on-going and future assessment in the Japanese Studies program.
Chapter Preview

Context And Challenges

On two recent occasions Japanese language instructors at the University of Guam have been asked to conduct and submit the results of student learning outcomes assessment. The first was for a mandated Japanese Studies program review, while the second was for a 2007 Western Association of Schools and Colleges (WASC) accreditation visit. These two occasions made us wonder why the administration was suddenly starting so forcefully to request that we do such assessment and thus supposedly demonstrate faculty accountability for student learning. We also wondered how the administration intended to use the assessment results – to truly enhance the classroom experience for both students and teachers, or to close classes and programs whose results were somehow unsatisfactory. As Barbara Walvoord (2004) points out, one of the challenges facing any assessment process is that teachers tend to place a “high value on faculty independence and autonomy” (p.7). Therefore, when administrators or external agencies require assessment, faculty members are almost automatically suspicious of any so-called “systematic procedure that supposedly can be applied to what they view as the subtle art of teaching” (Walvoord, 2004, p.7). In other words, faculty, perhaps especially in the Liberal Arts, are not clear as to how quantitative methods can be used to evaluate an essentially qualitative experience.

However, instead of resisting or ignoring or minimizing the administration’s request for assessment data, the Japanese Studies program chose to view it as an opportunity to evaluate student learning and strengthen courses in a way that had not yet been tried. No less importantly, the program also saw it as a chance to eventually increase the number of students majoring in Japanese Studies or minoring in Japanese. Numerous scholars (Bok, 2005; Friedman, 2005; Lederman, 2006) have argued that a major reason why the demand for more accountability in higher education is growing is a concern about the United States’ future economic competitiveness in a global society. In addition, in the aftermath of the terrorist attacks of 9/11 the National Language Conference published a White Paper that stressed America’s “critical need to take action to improve [its] foreign language and cultural capabilities” (2005, p.4). From the particular standpoint of FL instruction (in this case, Japanese), both the economic and national security arguments for more accountability offer great potential for recruiting and retaining quality students. But that potential also challenges FL programs to produce learning environments where those students can thrive. As both John Norris (2006) and Barbara Wright (2006) make clear, one way to provide those learning environments is through assessment initiatives designed and implemented by the teachers themselves.

Of course, the decision to proceed immediately presented the Japanese Studies program with another, more methodological challenge – namely, how to successfully implement an assessment project. We were forced to ask ourselves what might be the most effective strategies for assessing learning outcomes in Japanese language classes, given a limited amount of time and resources. First of all, we chose to keep this initial project fairly simple, following Walvoord’s reminder that “assessment need not be complicated” (2004, p.6). Therefore, we selected more standardized (product-driven) assessment methods, what might be termed “pen and pencil” evaluation, such as multiple-choice, true/false or short answer tests. In so doing, we were well aware of various criticisms of such an approach, as well as alternative (qualitative) approaches that seek to assess, for example, problem solving skills through real-world, task-based language performance (Herman, Aschbacher and Winters, 1992; Bachman and Palmer, 1996; Norris, Brown, Hudson and Yoshioka, 1998; Bachman, 2002). Nevertheless, especially at an elementary level, the primary purpose of FL instruction often involves rote learning, or rather, the necessary memorization of appropriate lexical, morphological and syntactic choices. Learning Japanese, for instance, requires an eventually extensive acquisition of kanji vocabulary, so relying on traditional methods (assessing student command of the target language, as opposed to critical thinking skills) seemed justified.

Key Terms in this Chapter

Assessment Methodology: Can be quantitative, qualitative, or some combination of the two.

Student Learning Objectives: A specific set of learning goals for a given course. A main purpose of any assessment is to determine if, and to what extent, the course is achieving its goals, and thus turning objectives into outcomes.

Foreign Language (FL) Instruction: In an American university setting, the teaching of languages other than English. At the elementary level, such instruction typically focuses on grammar, vocabulary, reception (listening/reading) and production (speaking/writing).

Nazo Nazo: Japanese quizzes or riddles, used here as a game or task for Japanese language instruction, especially listening comprehension skills.

Relative Clause: A subordinate clause used to modify nouns. Relative clauses are introduced by the relative pronouns who, whom, whose, that and which.

Loop: A model of assessment as a circular, recursive and multi-stage process: the identification of student learning outcomes, the selection or development of assessment tools, the gathering and interpretation of evidence, and the use of that evidence to improve classroom instruction (i.e., “closing the loop”).

Katakana: Along with hiragana, one of the two syllabaries in Japanese. Typically, katakana is used to represent foreign words in Japanese.

Syntactic Branching: In generative grammar, refers to the directionality of derivation trees. For example, English relative clause structure is right-branched, while Japanese relative clause structure is left-branched.

Kanji: A Japanese writing system that uses ideograms (characters) originally borrowed from Chinese.

Complete Chapter List

Search this Book:
Editorial Advisory Board
Table of Contents
Christopher S. Schreiner
Christopher S. Schreiner
Chapter 1
Melissa A. Dyehouse, John Y. Baek, Richard A. Lesh
This chapter describes a model for evaluating complex organizations or systems. The design assessment model the authors propose is a response to... Sample PDF
Multi-Tier Design Assessment in the Development of Complex Organizational Systems
Chapter 2
Hedva Lewittes
In this chapter critical thinking is assessed using two critical thinking learning outcomes that were required for the State University of New... Sample PDF
A Critical Thinking Rubric as the Basis of Assessment and Curriculum
Chapter 3
Suzanne Pieper, Erika Edwards, Brandon Haist, Walter Nolan
The purpose of this chapter is to review literature over the past ten years regarding technology tools that are being used in higher education to... Sample PDF
A Survey of Effective Technologies to Assess Student Learning
Chapter 4
John Baer, Sharon S. McKool
The Consensual Assessment Technique is a powerful tool used by creativity researchers in which panels of expert judges are asked to rate the... Sample PDF
Assessing Creativity Using the Consensual Assessment Technique
Chapter 5
Christine Charyton, Zorana Ivcevic, Jonathan A. Plucker, James C. Kaufman
This chapter discusses creativity assessment as a means for evaluating skills required in higher education. Creativity is assessed in the context of... Sample PDF
Creativity Assessment in Higher Education
Chapter 6
Asao B. Inoue
This chapter articulates writing assessment as a technology, theorized with three aspects (power, parts, and purpose), accounting for the ways in... Sample PDF
The Technology of Writing Assessment and Racial Validity
Chapter 7
Sheila S. Thompson, Annemarie Vaccaro
The purpose of this chapter is to address epistemological and methodological approaches to assessing assessment. The authors’ intent is to show how... Sample PDF
Qualitative and Quantitative Methods as Complementary Assessment Tools
Chapter 8
Teresa Flateby
The development of the Cognitive Level and Quality of Writing Assessment online system is described in this chapter. Beginning with needs identified... Sample PDF
Effects of Assessment Results on a Writing and Thinking Rubric
Chapter 9
Barbara D’Angelo, Barry Maid
Outcomes-based assessment provides data for programs to demonstrate student learning as a result of their enrollment in the program and to assess... Sample PDF
Assessing Outcomes in a Technical Communication Capstone
Chapter 10
Sonya Borton, Alanna Frost, Kate Warrington
As Jacqueline Jones Royster articulated at the 2006 Conference on College Composition and Communication, English departments are already assessing... Sample PDF
Assessing the Composition Program on Our Own Terms
Chapter 11
Joan Aitken
This chapter uses a case study to exemplify one approach to assessment of three instructional delivery formats: (a) online, (b) distance, satellite... Sample PDF
A Case Study of Instructional Delivery Formats
Chapter 12
Victor W. Brunsden
The author present a case-study of a classroom technique that allows assessment and some remediation of several shortcomings of college student... Sample PDF
Inverting the Remedial Mathematics Classroom with Alternative Assessment
Chapter 13
David A. Eubanks
This chapter describes Coker College’s subjective performance assessment program to rate student thinking and communication skills. It uses a... Sample PDF
A Case Study of Authentic Assessment
Chapter 14
P. Tokyo Kang, David Gugin
This chapter reports an outcomes assessment study conducted at the University of Guam. The assessment project was conducted during the 2006-07 and... Sample PDF
Outcomes Assessment in Japanese Language Instruction
Chapter 15
Barika Barboza, Frances Singh
This chapter describes an outcomes assessment study completed in a basic composition course at a small urban open admissions community college. The... Sample PDF
Assessing the Effectiveness of a Basic Writing Course
Chapter 16
Lorraine Gilpin, Yasar Bodur, Kathleen Crawford
Peer assessment holds tremendous potential to positively impact the development of preservice teachers. The purpose of this chapter is to describe... Sample PDF
Peer Assessment for Development of Preservice Teachers
Chapter 17
Charlotte Brammer, Rhonda Parker
In 2002, Samford University began working on a long-term learning assessment plan designed to evaluate its undergraduates’ competencies in written... Sample PDF
Workshops and E-Portfolios as Transformational Assessment
Chapter 18
Daniel F. Chambliss
This chapter describes how the trend favoring assessment initiatives of a system-wide scope such as program review and collegiate learning... Sample PDF
A Neglected Necessity in Liberal Arts Assessment: The Student as the Unit of Analysis
Chapter 19
Deirdre Pettipiece, Timothy Ray, Justin Everett
Perhaps due to its applicability as a performance of skill sets in virtually all disciplines, writing as a mechanism for measuring student success... Sample PDF
Redefining Writing Reality Multi-Modal Writing and Assessment
Chapter 20
Sean A. McKitrick
This chapter introduces methods that can be used to engage faculty in the assessment process, working within a shared governance structure in... Sample PDF
Engaging Faculty as a Strategic Choice in Assessment
Chapter 21
Steven M. Culver, Ray VanDyke
There is much in the assessment literature about the necessity of developing a culture of assessment and mandates from accrediting bodies include... Sample PDF
Developing a Receptive and Faculty-Focused Environment for Assessment
Chapter 22
John Wittman
This chapter argues that as primary stakeholders in writing program assessment, students and instructors need to be included proactively in... Sample PDF
New Collaborations for Writing Program Assessment
Chapter 23
Mya Poe
The study of racial-ethnic group differences on educational tests has yielded a substantial body of research internationally in the last decade. In... Sample PDF
Reporting Race and Ethnicity in International Assessment
Chapter 24
Joan Hawthorne, Tatyana Dumova, April Bradley, Daphne Pederson
In this chapter the authors describe a method developed to assess the outcome of a “cultural familiarity” general education goal. Challenges in... Sample PDF
Method Development for Assessing a Diversity Goal
About the Contributors