Search the World's Largest Database of Information Science & Technology Terms & Definitions
InfInfoScipedia LogoScipedia
A Free Service of IGI Global Publishing House
Below please find a list of definitions for the term that
you selected from multiple scholarly research resources.

What is Inter-Rater Reliability

Recent Tools for Computer- and Mobile-Assisted Foreign Language Learning
The degree of statistical agreement among raters.
Published in Chapter:
Examining Oral Performance Characteristics of L2 Learners With the CAF Calculator
Kazumi Matsumoto (Ball State University, USA), Maki Hirotani (Rose-Hulman Institute of Technology, USA), and Atsushi Fukada (Purdue University, USA)
DOI: 10.4018/978-1-7998-1097-1.ch006
Previous fluency studies typically used small datasets to analyze L2 learners' oral performance with objective fluency measures, and found positive correlation between objective measures and subjective ratings. Findings from a small dataset are difficult to generalize. However, it takes a great deal of time and effort to build a large dataset with various measures. To help facilitate this process, CAF Calculator, which outputs 50 fluency measures, has been developed. In this chapter, CAF Calculator and a workflow to compute fluency measures are introduced along with a study investigating utterance fluency of L2 learners of Japanese at two proficiency levels performing two tasks. The study found significant differences in speed, breakdown, and composite fluency measures between the two groups in both tasks. It also found that task type affects pause locations. It is hoped that the research tools introduced in this chapter will encourage more research on fluency.
Full Text Chapter Download: US $37.50 Add to Cart
More Results
Certifications for Medical Interpreters: A Comparative Analysis
the degree of agreement among raters (Inter-rater concordance)
Full Text Chapter Download: US $37.50 Add to Cart
Assessing the Composition Program on Our Own Terms
The degree to which different readers assess the same document with the same score.
Full Text Chapter Download: US $37.50 Add to Cart
International School Teachers' Professional Development in Response to the Needs of Third Culture Kids in the Classroom
A statistical term relating to the degree of agreement among raters, providing a score of how much consensus there is in the ratings given by each rater.
Full Text Chapter Download: US $37.50 Add to Cart
Full Text Chapter Download: US $37.50 Add to Cart
Learning to Work and Working to Learn: What We are Learning and How Technology and Assessment Can Help
Reliability is consistency over time, and inter-rater refers to consistent agreement among raters judging a performance.
Full Text Chapter Download: US $37.50 Add to Cart
eContent Pro Discount Banner
InfoSci OnDemandECP Editorial ServicesAGOSR