Rubric to Determine a Quality Online Discussion Posting

Rubric to Determine a Quality Online Discussion Posting

Linda L. Larson (McNeese State University, USA), Paul Boyd-Batstone (California State University, USA) and Carole Cox (California State University, USA)
DOI: 10.4018/978-1-60566-106-3.ch026
OnDemand PDF Download:
$37.50

Abstract

When teachers integrate online discussions into courses, they are faced with the challenge of deciding how to evaluate the postings. This chapter discusses a study that used a discussion board rubric to evaluate online discussions. The study tested the reliability of the instrument (rubric) to assess the quality of the content of Web-based discourse. To obtain the rubric interrater reliability, researchers used the rubric to evaluate the discussion postings of preservice teachers’ enrolled in six different sections of an English language arts methods course. Six hundred sixty two (662) postings from 165 preservice teachers were analyzed using the rubric. The study utilized the scorings from six judges. When measured with Cronbach’s alpha intraclass coefficient, the findings indicated substantial agreement between judges in two of the four rubric criteria: evocative (.8742) and reference-resource (.8209). The other rubric criteria rumination (.7256) and storytelling (.5984) scored at the moderate and fair levels respectfully.
Chapter Preview
Top

Background

Case studies have been found to be a powerful pedagogical tool for teacher education (Moore & Kearsley, 1996; Risko & Kinzer, 1997). Discussions about cases fostered thoughtful engagement (Dawson, Mason, & Molebash, 2000; Silverman & Welty, 1996). Specifically, video case studies provided a realistic, yet controlled, context that considerably enhanced textbook readings by bringing descriptions of actual classroom settings to life (Shulman, 1992). Further, Computer-mediated discussions increased time for reflection in formulating thoughtful dialog (Daiute, 2000).

In a pilot study of OVCS, we (Larson, Boyd-Batstone, & Cox, 2004–2005) reported on the nature of online discourse according to who was the discourse audience and what were the discourse functions utilized by a group of 98 preservice teachers in a university language arts methods course. The rubrics used (Flynn & Polin, 2003) provided useful categories for content analysis. But the researchers found that content analysis was limited in determining the function of the dialog. A persistent question was raised about the nature of a quality dialog online. In other words, how can one determine whether learning was taking place and knowledge was being constructed?

Key Terms in this Chapter

Online Video Case Studies (OVCS): An OVCS refers to a Web-based case study model that is composed of video clips of teachers (written about in an accompanying textbook) actually teaching, teacher interviews, responses of preservice teachers to video-clips posted online, and online interaction between students and with the instructor.

Posting: A posting is a message or response that is uploaded or “posted” hence the word posting, to an electronic discussion board.

Prompt: A prompt is a statement or group of statements about a specific topic, constructed to stimulate reflective thought. In the case of OVCS, the online discussions usually begin with a teacher posted prompt.

Rubric: A rubric is a scoring instrument that lists the criteria for a piece of work or artifact. In the case of OVCS, the rubric for a quality posting will list the content the student must include to receive a certain score or rating. Rubrics help the student understand how discussion board postings are evaluated. Generally, rubrics specify the level of performance expected for several levels of quality.

Discussant: The discussant is one of the several people participating in an online discussion group. Groups may or may not have an appointed group leader.

Critical Reflection: Critical reflection refers to a person’s ability to reflect critically on his/her experiences, integrate the knowledge acquired from these experiences with the previous knowledge, and then be able make an informed decision based on insights he/she gained from the new and previous experiences.

Storytelling: Storytelling is a narrative or story that uses personal examples or narrative details.

Rumination: Rumination is a long thoughtful consideration of an idea or thought.

Discussion Board: The discussion board allows students to post threads (comments or responses) to forums usually created by the instructor. The posted threads (comments, responses) can be viewed and responded to by the instructor and other students enrolled in the course.

Interrater Reliability: Interrater reliability is the degree of agreement among judges when they are rating rubric criteria. The score shows how much the ratings of the judges agree. Scores can range from a 0.00 to a 1.00. A score of 1.00 indicates 100% agreement of the judges. A score of 0.00 indicates 0% agreement of the judges. A 0.00 score could mean that either the rating scale is defective or the raters need to be re-trained in the meaning of the rubric criteria.

Complete Chapter List

Search this Book:
Reset
Dedication
Editorial Advisory Board
Table of Contents
Foreword
Michael Beyerlein
Preface
Janet Salmons, Lynn Wilson
Acknowledgment
Janet Salmons, Lynn Wilson
Chapter 1
Frances Deepwell
In this chapter, we consider two multi-institution, multinational education research projects in Europe that used a variety of technology to... Sample PDF
E-Research Collaboration, Conflict and Compromise
$37.50
Chapter 2
Susanne Croasdaile
In the world of education, many occasions necessitate interorganizational collaboration. Geographical distance and time constraints are challenges... Sample PDF
Inter-Organizational E-Collaboration in Education
$37.50
Chapter 3
Kumiko Aoki
This chapter discusses cultural differences in educational practices of the East and West. In East Asian countries, where Confucian philosophy has... Sample PDF
Cultural Issues in Global Collaborative Education
$37.50
Chapter 4
Ken Stevens
The Internet and an expanding range of technologies have enabled small schools in rural communities in Atlantic Canada to collaborate in addressing... Sample PDF
The Development of Collaborative Structures to Support Virtual Classes in Small Schools
$37.50
Chapter 5
Christine Marrett
Information communication technologies (ICTs) have facilitated institutional collaboration in distance education. Based on the study, Institutional... Sample PDF
Experiences in Collaboration in Distance Education from the Caribbean, Looking Beyond Electronic
$37.50
Chapter 6
Neli Maria Mengalli
This chapter presents the course School Management and Technologies, and what emerged from the discourses of subjects that make it possible to... Sample PDF
Collaboration and Networks: Basis for the Management Based on Knowledge in Education
$37.50
Chapter 7
Niki Lambropoulos, Panagiotis Kampylis, Sofia Papadimitriou, Marianna Vivitsou, Alexander Gkikas
Recent rapid technological advancement has influenced communication and information management. In addition, it has facilitated collaboration, an... Sample PDF
Hybrid Synergy for Virtual Knowledge Working
$37.50
Chapter 8
Chijioke J. Evoh
The purpose of this study is to examine the dynamics of collaborative partnership involving the private sector, government, and community groups in... Sample PDF
Collaborative Partnerships and the Application of ICTs in Secondary Education in South Africa
$37.50
Chapter 9
Sandra J. Chrystal
This chapter reports on two University of Southern California collaborations that partner business communication classes with not-for-profit... Sample PDF
Technology Leverages a Community University Collaboration
$37.50
Chapter 10
Tine Köhler, Michael Berry
Internationally distributed teams (IDTs) face challenges related to the team members’ diversity and geographic dispersion. However, research on IDTs... Sample PDF
Creating Synergy for Inter-Cultural Learning
$37.50
Chapter 11
Iris C. Fischlmayr
In this chapter, factors “really” influencing virtual multicultural team work shall be described and a training design used for students and company... Sample PDF
A Training Design for Behavioral Factors in Virtual Multicultural Teams
$37.50
Chapter 12
Jennifer V. Lock, Petrea Redmond
An international online collaborative learning experience was designed and implemented in preservice teacher education classes at the University of... Sample PDF
Working Collaboratively on the Digital Global Frontier
$37.50
Chapter 13
John D. Murphy
This chapter introduces Collaboration Engineering as an approach to developing more effective collaborative sessions for interdisciplinary teams.... Sample PDF
Engineering for Interdisciplinary Collaboration
$37.50
Chapter 14
Darren Lee Pullen
Communication technology, which is not constrained by geographical boundaries, has increasingly resulted in faster and more efficient ways to... Sample PDF
Back to Basics: Electronic Collaboration in the Education Sector
$37.50
Chapter 15
Elizabeth DePoy
This chapter presents and analyzes the scholarly basis and empirical work that resulted in the development of Techscape, the application of... Sample PDF
Designing University Techscapes
$37.50
Chapter 16
Kathy Lynch, Aleksej Heinze, Eljse Scott
The barriers to global collaboration of yesteryear include country boundaries and time zones. Today, however, in a world where communication is... Sample PDF
Scholarly Collaboration Across Time Zones
$37.50
Chapter 17
Christine Aikens Wolfe, Cheryl North-Coleman, Shari Wallis Williams, Denise Amos, Glorianne Bradshaw, Toby Emert
A group of National Writing Project teachers from around the nation attended a Professional Writing Retreat in Santa Fe in 2004 and continued their... Sample PDF
Stepping into the Role of Professional Writer
$37.50
Chapter 18
Garry G. Burnett
This chapter introduces Media Synchronicity Theory as a means to examine the influence of technology use on the relationship between a... Sample PDF
Collective Identity and Learning in a Virtual Team
$37.50
Chapter 19
Janet Salmons
Social constructivism is an established educational theory based on the principle that learners and teachers co-construct knowledge through social... Sample PDF
E-Social Constructivism and Collaborative E-Learning
$37.50
Chapter 20
Jeffrey Mok
Technological artifacts such as computers and mobile electronic devices have dramatically increased our learning interactions with machines. Coupled... Sample PDF
Social and Distributed Cognition in Collaborative Learning Contexts
$37.50
Chapter 21
Qing Li
Increasingly, educators in a range of venues and institutions (e.g., K-12 schools, post secondary institutions, training facilities) are being... Sample PDF
Modeling the Model for Distributed Learning
$37.50
Chapter 22
Kathryn Dixon
This chapter is the result of an investigation into the capacity of an electronic portfolio (e-folio) to promote reflection and collaboration in a... Sample PDF
Capacity of an Electronic Portfolio to Promote Professionalism, Collaboration and Accountability in Educational Leadership
$37.50
Chapter 23
Robert J. Redmon Jr.
Departmental e-mail reflection groups promise to help resolve two of the most pressing problems facing the teaching profession, finding time for... Sample PDF
E-Mail Reflection Groups as Collaborative Action Research
$37.50
Chapter 24
Janet L. Holland
This chapter reports on a mixed study dealing with the impact of integrating student peer mentor facilitators into online discussions in an effort... Sample PDF
Integrating Student Peer Mentoring Online
$37.50
Chapter 25
Rosemarie Reynolds, Michael T. Brannick
This study examined the effect of computer-based videoconferencing and text-based chat on mentoring relationships, and compared the findings to... Sample PDF
Outcomes of Computer Mentoring
$37.50
Chapter 26
Linda L. Larson, Paul Boyd-Batstone, Carole Cox
When teachers integrate online discussions into courses, they are faced with the challenge of deciding how to evaluate the postings. This chapter... Sample PDF
Rubric to Determine a Quality Online Discussion Posting
$37.50
Chapter 27
Andre L. Araujo
Recent advances in Web-based technologies along with investments in international outsourcing and offshore locations have unquestionably increased... Sample PDF
Instrumental and Social Influences on Adoption of Collaborative Technologies in Global Virtual Teams
$37.50
Chapter 28
Kenneth David Strang
Logically, it makes sense that organizations can be successful if their employees collaborate effectively, in a synergistic manner. Economically... Sample PDF
Collaborative Synergy and Leadership in E-Business
$37.50
Chapter 29
Gilliean Lee
Recent industry and business trends can be described as shorter life cycle, increased speed to market, customizability, and a wide variety (rather... Sample PDF
Overview on Information Systems and Tools for Collaborative Enterprise: Business Impacts and Managerial Issues
$37.50
Chapter 30
Apivut Chakuthip, Yvonne Brunetto, Rod Farr-Wharton, Sheryl Ramsay
This chapter uses the structural and relational dimension of Social Capital Theory as the lens for examining the factors affecting a Small and... Sample PDF
Trust, Social Networks and Electronic Commerce Adoption
$37.50
Chapter 31
Bolanle A. Olaniran
Trust and relational development represents a critical challenge in online collaboration groups. Often the problem is attributed to several factors... Sample PDF
A Proposition for Developing Trust and Relational Synergy in International e-Collaborative Groups
$37.50
Chapter 32
Peter Rittgen
The increasing complexity of products and services encourages more and more companies to form collaborative networks. As these companies are... Sample PDF
Supporting Inter-Business Collaboration via Contract Negotiation and Enactment
$37.50
Chapter 33
Larry R. Irons
This chapter reviews research in distributed work, relating it to the way organizations manage collaboration between home-based customer support... Sample PDF
The Limits of Anytime, Anywhere Customer Support
$37.50
Chapter 34
Tobias Müller-Prothmann
Collaboration is a constitutional element of any organization. To conceptualize the organization as an evolving system of interactions means to put... Sample PDF
KMmaster® for Collaboration and Knowledge Management
$37.50
Chapter 35
Steven Jeddeloh
This essay explores ultimate team performance as experienced by veteran airline pilots working together with a common purpose. The research... Sample PDF
Ultimate Performance in a Highly Functioning Team
$37.50
Chapter 36
Theresa Rich
This case study presents the work done to develop and execute the global vision for a 24/7 matrix organization within a major multinational... Sample PDF
Globalizing a Function within a Company
$37.50
Chapter 37
R. Todd Stephens
This chapter examines the elements of the new Web 2.0 technology base and reviews the lessons learned when implementing these technologies.... Sample PDF
Integrating Web 2.0 Technologies within the Enterprise
$37.50
Chapter 38
Mairi Stewart Kershaw
This chapter details one project, “Linking for a Change” (LFC), connecting schools and public/social sector providers of education for sustainable... Sample PDF
An Evaluation of ‘Linking for a Change'
$37.50
Chapter 39
Lynn Wilson
Environmental sustainability and global climate change issues intensify the need for collaborations between scientists and policymakers. Working in... Sample PDF
Collaboration in the Service of Knowledge Co-Creation for Environmental Outcomes, Science and Public Policy
$37.50
Chapter 40
Diego Liberati
In current economic and scientific scenarios, interactions and organization models tend to be more and more oriented to flexibility of... Sample PDF
Networked Experiments in Global E-Science
$37.50
Chapter 41
Jeroen Wolbers, Peter Groenewegen, Pieter Wagenaar
The implementation of GMS (Integrated Emergency room System) in the Netherlands has had a tumultuous record. A direct consequence of the... Sample PDF
ICT to Facilitate Emergency Response in The Netherlands
$37.50
Chapter 42
Elena Corradini
This chapter discusses a project for the implementation of a digital repository in a specific context, namely a small Italian town. The latest... Sample PDF
Enhancing Collective Memory with a Community Repository
$37.50
Chapter 43
Simon Milne
This chapter examines the development and associated outcomes of two government funded projects designed to support small tourism enterprise (STE)... Sample PDF
ICT and Tourism Enterprise Collaboration in Rural New Zealand
$37.50
Chapter 44
Rubye Braye, Eric Evans
This chapter originated as a reflection of the communication between U.S. facilitators and a Rwandan host as they ecollaborated in planning... Sample PDF
2007 Leadership and Human Resources Training in Rwanda
$37.50
Chapter 45
James L. Smith
This chapter reveals the common theme three rural Minnesota communities used in their collaboration efforts in to install and deliver broadband... Sample PDF
Collaboration through Municipal Motivators
$37.50
Chapter 46
Keith Baker
Information and Communication Technology (ICT) is often seen as a vehicle for organizational reform. However, the established literature on... Sample PDF
Understanding the Dialectic Relationship between Intraand Inter-Organizational Cooperation
$37.50
Chapter 47
Rakesh Biswas, Jayanthy Maniam, Edwin Wen Huo Lee, Shashikiran Umakanth, Premalatha Gopal Das
This is an illustrative process description of a collaborative project utilizing a multidisciplinary approach. The requirement for collaboration... Sample PDF
Electronic Collaboration Toward Social Health Outcomes
$37.50
Chapter 48
Beverly-Jean Daniel, April Boyington Wall
This chapter presents a case study of the process of employing technology in a project involving the development and presentation of a unique... Sample PDF
Technology Enhanced Collaborative Leadership Development
$37.50
Chapter 49
Lisa Faithorn, Baruch S. Blumberg
Complex social, economic, political and environmental challenges as well as new research areas that cut across disciplinary, institutional and... Sample PDF
Lessons Learned from the NASA Astrobiology Institute
$37.50
Chapter 50
Lynn Wilson, Janet Salmons
The concluding chapter offers the editors’ insights into the book chapters’ combined contribution. Using the editors’ Collaborative Integration... Sample PDF
Online Collaborative Integration and Recommendations for Future Research
$37.50
About the Editors
About the Contributors