Student Modeling in an Intelligent Tutoring System

Student Modeling in an Intelligent Tutoring System

Mingyu Feng (SRI International, USA), Neil Heffernan (Worcester Polytechnic Institute, USA) and Kenneth Koedinger (Carnegie Mellon University, USA)
DOI: 10.4018/978-1-61692-008-1.ch011
OnDemand PDF Download:


Student modeling and cognitively diagnostic assessment are important issues that need to be addressed for the development and successful application of intelligent tutoring systems (its). Its needs the construction of complex models to represent the skills that students are using and their knowledge states, and practitioners want cognitively diagnostic information at a finer grained level. This chapter reviews our effort on modeling student’s knowledge in the ASSISTment project. Intelligent tutors have been mainly used to teach students. In the ASSISTment project, we have emphasized using the intelligent tutoring system as an assessment system that provides instructional assistance during the test. Usually it is believed that assessment get harder if students are allowed to learn during the test, as its then like try to hit a moving target. So our results are surprising that by providing tutoring to students while they are assessed we actually prove the assessment of students’ knowledge. Additionally, in this article, we present encouraging results about a fine-grained skill model with that system that is able to predict state test scores. We conclude that using intelligent tutoring systems to do assessment seems like a reasonable way of dealing with the dilemma that every minute spent testing students takes time away from instruction.
Chapter Preview


In the United States there are concerns about poor student performance on new high-stakes standards based tests required by the No Child Left Behind Act (NCLB, 2002) legislation. To address this issue, educational technologies, like intelligent tutoring systems (ITS) have been developed and proven to be useful helping students learn. For instance, the Cognitive Tutors leads to large learning gains (Koedinger et al, 1997). Recently, President Obama made a commitment to increase investment on educational software, saying that, “[W]e will devote more than 3 percent of our GDP to research and development. … Just think what this will allow us to accomplish: solar cells as cheap as paint, …, learning software as effective as a personal tutor….” 1 So, how do we build ITS that are as effective as a personal tutor? To create an effective piece of learning software, we need a good model of student learning. Assessment of an examinee’s ability is the first step of student modeling in an ITS because student state is a prerequisite for creating a pedagogical strategy. The student model provides valuable information for the tutor to help build tutoring strategy (e.g., when to interrupt and what to say when interrupt), problem sequencing (e.g., what’s the next appropriate task to give to a student so his learning gain is maximized), performance prediction (how a student will respond to a step associated with certain rules), etc.

Recently, in an interview with U.S. News & World Report (Ramírez & Clark, 2009), U.S. Secretary of Education Arne Duncan weighed in on the NCLB Act and called for continuous assessment. He said that he is concerned about over-testing, and feels that fewer, better tests would be more effective. He wants to develop better data management systems that will help teachers track individual student’s progress in real-time, so teachers and parents can assess and monitor student strengths and weaknesses. To reflect on the “continuous assessment” idea, we think, one way that ITS research distinguishes itself from other educational software development is that it is concerned with modeling the knowledge of the learner in some computationally useful and inspectable way (McCalla & Greer, 1994). The modeling phase should involve understanding learner behavior in the rich context of the environment in which learning occurs, thus, obtaining a better understanding of each student’s pre-existing, or current knowledge status and how that knowledge is changing over time.

Student models in ITS are constructive, especially cognitive models. Cognitive modeling involves a great deal of detailed protocol collection and task analysis. The models are not easy to construct and are difficult to verify. Yet, cognitive modeling is very important in an ITS as it is the basis of cognitively diagnostic assessment and teacher reporting. Wiliam (2006) describes an assessment as formative only if information about what is being assessed results in change that would otherwise not occur. Here the definition of formative assessment becomes more detailed to the utility for teachers to understand if and how students are learning. By giving teachers cognitively diagnostic data in a timely fashion, teachers can change their teaching in response to the data they collect about student understanding. The US Department of Education (2003) stated, “Research shows that teachers who use student test performance to guide and improve teaching are more effective than teachers who do not use such information” (p. 2). Therefore, if assessments are to move from assessments of learning to assessments for learning (c.f., Stiggins 2005) then we must continue to focus on the box that encompasses diagnostic modeling data and teachers as the end-users.

Complete Chapter List

Search this Book:
List of Reviewers
Table of Contents
Slavomir Stankov, Vlado Glavinic, Marko Rosic
Slavomir Stankov, Vlado Glavinic, Marko Rosic
Chapter 1
Aytürk Keles, Ali Keles
Today’s education is faced by new challenges and yet new innovations. The key area where innovations are introduced lies on instructional... Sample PDF
Intelligent Tutoring Systems: Best Practices
Chapter 2
G.M. Curilem, B. Vizcarra, A.M. Poo, D. Huenteman, L.M. Brasil
This chapter describes a learning design methodology for creating an intelligent tutoring system (ITS) to support non-violent conflict resolution... Sample PDF
Design Methodology of an Intelligent Learning Environment Applied to the Non Violent Conflict Resolution Education
Chapter 3
Xin Bai, John B. Black
A cognitive framework called REflective Agent Learning environment (REAL) is developed in this study. REAL is a reusable framework that allows... Sample PDF
Enhancing Intelligent Tutoring Systems with the Agent Paradigm
Chapter 4
Alke Martens, Andreas Harrer
In this chapter, an approach to support the development of ITS based on patterns and pattern catalogues is described. Patterns are means to... Sample PDF
Intelligent Tutoring System Architecture Rebuilt: A Pattern Approach
Chapter 5
Saša Mladenovic, Haidi Kuvac, Maja Štula
This paper describes a mathematical model of virtual learning environment considering both technology and users. Recognized interested users are... Sample PDF
Virtual Learning Environment
Chapter 6
Mobile Learning  (pages 103-128)
Marija Zelic
Mobile learning, as the “portable and personal” fashion of e-learning, is intended to enhance the efficiency and effectiveness of learning in the... Sample PDF
Mobile Learning
Chapter 7
Abdolhossein Sarrafzadeh, Jamshid Shanbehzadeh, Scott Overmyer
E-learning has attracted a great deal of interest in educational circles from K-12 to universities. A question that is often rightly asked is how... Sample PDF
E-Learning with Affective Tutoring Systems
Chapter 8
Jeroen Geuze, Egon L. van den Broek
A generic theoretical framework on teaching children to negotiate is presented, founded on Piaget’s child development and Thompson and Hastie’s... Sample PDF
E-Learning through Gaming: Unfolding Children’s Negotiation Skills
Chapter 9
Tonci Dadic
Tutoring systems for programming help students understand features of target programming languages, and develop their general problem solving... Sample PDF
Intelligent Tutoring System for Learning Programming
Chapter 10
Branko Žitko
Irrespective how domain knowledge is well formalized, and irrespective of applying appropriate pedagogical techniques in Intelligent tutoring... Sample PDF
Overlay Method in Testing Knowledge by Natural Language Dialogue
Chapter 11
Mingyu Feng, Neil Heffernan, Kenneth Koedinger
Student modeling and cognitively diagnostic assessment are important issues that need to be addressed for the development and successful application... Sample PDF
Student Modeling in an Intelligent Tutoring System
Chapter 12
Divna Krpan, Suzana Tomaš, Roko Vladušic
There is great need for collaboration in education and e-learning systems which imply the necessity for group modeling. Since Bloom’s experiment... Sample PDF
Using Effect Size for Group Modeling in E-Learning Systems
Chapter 13
Funda Dag, Kadir Erkan
In this study, a personalized learning system framework that is KOULearn (Kocaeli University Learning System) has been proposed. It is based on... Sample PDF
A Personalized Learning System Based on Semantic Web Technologies
Chapter 14
Lung-Hsiang Wong, Chee-Kit Looi
One major direction in research on technology-enabled learning systems revolves round the notion of generating optimal learning pathways. Two... Sample PDF
A Survey of Optimized Learning Pathway Planning and Assessment Paper Generation with Swarm Intelligence
Chapter 15
Benedict du Boulay, Julie Coultas, Rosemary Luckin, Fred Garnett
This chapter examines part of the broad question: “How compelling is the evidence for the effectiveness of e-Learning in the post-16 sector? It... Sample PDF
Factors Determining the Overall Effectiveness of E-Learning Systems used in Higher Education
Chapter 16
Ani Grubišic
As the acquisition of knowledge is often an expensive and time-consuming process, it is important to know whether it actually improves the student... Sample PDF
A Meta-Analytic Estimation of a Common Effect Size from a Series of Experiments Related To an E-Learning System Effectiveness Evaluation
Chapter 17
Francisco Villa Ulhôa Botelho, Rosa Maria Vicari
The general objectives of this study are: to analyze significant indicators for assessment of the effectiveness of Distance Learning (DL) courses;... Sample PDF
Assessment of the Effectiveness of Distance Learning Courses and of Interactive Processes in Virtual Learning Environments
About the Contributors