Article Preview
TopQuestionnaires In Call Research And Evaluation
Questionnaires are common instruments in second language research and are typically used for data collection on learner background, preferences, attitudes, beliefs, etc. (Dornyei, 2010; Nunan, 1992). Their versatility is alleged to increase consistency and reliability of anticipated results when triangulating data with regards to undermining biases for drawing conclusions on factual, behavioural, and attitudinal findings (Brown, 2001). Moreover, open-ended items in questionnaires, for instance, can play a significant role in providing real perspective, perhaps countering the aforementioned superficiality of user answers (Dornyei, 2010). Questionnaires are used for similar purposes in CALL research and evaluation (Hémard & Cushion, 2001; Hubbard, 2006; Jamieson, Chapelle & Preiss, 2005; Levy, 1999;).
For instance, in Huh and Hu’s (2005) chapter on criteria for effective CALL research, the authors suggest focusing on what happens through, with, or around the CALL tool through valid research design. Quoting Surry and Ensminger (2001), the authors warn against techno-centrism in CALL research, adding that researchers must take into account the instructional method as well as learner characteristics, by “using a variety of experimental, quasi-experimental and qualitative research designs” (Surry & Ensminger, 2001, p. 35) in order to correctly address the question of CALL evaluation. They also point out that statistical results do not suffice in providing the in-depth explanation and solid evidence needed to investigate the impact of computer technology use in language learning. Adding that certain methods result in more accurate answers to research questions, Huh and Hu (2005) call for a balanced quantitative and qualitative method in CALL research.
With regards to CALL evaluation, Raby (2005) states that such a task requires contrasting the evaluated activity with a user-centered model of reference. The model involves reflexive thinking on behalf of the learner through questionnaires, which allow structuring different qualitative and quantitative data into a coherent framework. More specifically, she recommends the use of questionnaires for information on how a user redefines his task and how a user feels about the achieved task, which the author believes to affect the mental processes in progress Questionnaires, hence, should ask for information on the user’s perception of goal achievement, difficulties met while at task, competencies demonstrated, motivation and reasons for motivation, and complimentary conditions needed to accomplish the task at hand successfully.