Application of the Cognitive Walkthrough Method to Evaluate the Usability of PhET Simulations Package to Teach Physics

Application of the Cognitive Walkthrough Method to Evaluate the Usability of PhET Simulations Package to Teach Physics

Gustavo de Oliveira Almeida, Cesar Augusto Rangel Bastos
DOI: 10.4018/IJICTE.2018100103
(Individual Articles)
No Current Special Offers


The use of simulators and customized applications for educational use opens new possibilities in the teaching and learning process of the most varied disciplines through computer-mediated interactions. In this context, teachers are developing digital material considering this powerful tool. And the use of educational apps and simulators has increased significantly with the spread of the internet in schools. However, the evaluation of the effectiveness of these applications is complex and incipient. This article presents a proposed interface usability assessment for the use of simulators with elementary school students using a customized version of the PSSUQ, along with an evaluation by the cognitive walkthrough method. The interface chosen was the simple pendulum simulator used as part of the PhET simulations package. The results indicated satisfactory usability of the application, although some limitations and usability difficulties were found.
Article Preview

1. Introduction

The authorial role of teachers is increasingly becoming evident with the increased use and need for creation of digital educational materials. Buzato (2006) states that thinking on new technologies as ways to improve the world is to think of education. In this context, the “teacher-author” is included in a model with great technological complexity, with social, cultural and educational implications. Mesquita (2013) points out that the teaching expertise includes the disciplines, programs and materials, and a set of competences related to the organization and management and of specific didactics related to the context in which the teaching-learning occurs.

The recent technological changes bring challenges for teachers and developers of educational software, calling for a definition the educational objectives to be achieved, the target audience and the incorporation of the fundamentals of the theory of learning (Falkembach, 2015). The use of simulators and customized applications open new possibilities in the teaching and learning process of the most varied disciplines through interactions mediated by computers. Hirsh-Pasek et al. (2015) define educational software as applications designed to promote active, engaged, meaningful and socially interactive learning.

According to Barroso, Felipe and Silva (2006) there are four characteristics essential to the effectiveness of the learning process: (a) active and not passive engagement of students in the learning process; b) use of groups using collaborative work; c) interaction with return or “feedback”; d) presence of connections to real-world situations compatible with students’ daily life.

One crucial issue for teachers that develop and employ digital materials is the usability of interfaces. The usability is the degree that the interface is sufficiently clear to students, and supportive in the learning process, the rather than inhibiting it. A good interface supports a greater engagement, collaboration, feedback and connection to the real world.

Barroso, Felipe and Silva (2006) state that as happens with traditional educational tools and materials, it is difficult to assess the use and efficacy of computer-based tools for education, and this is a problem also in programs computer with educational focus. Hirsh-Pasek et al (2015) point out that students are in the core of a vast, unplanned experiment, encircled by digital technologies that were not available a decade ago. They point out that educational apps are largely unregulated and untested, and by January 2015 stood at 80,000 in Apple’s App Store alone, thus the evaluation of educational apps is an urgent and important task.

Accordingly, the main objective of this work is to evaluate the usability of an interface developed for the physics teaching using a simple pendulum simulator by applying a questionnaire to verify the satisfaction with the use and to perform a usability analysis using the cognitive walkthrough (CW) method to identify opportunities for improvement and anticipate student difficulties while using the interface. This article is divided into six sections, the first is this introduction. The second section presents the theoretical foundation for the study, while the third section briefly introduces the research method. Fourth section describes the procedures, while fifth section presents results and analysis. The sixth and final section presents the conclusions of the study.


2. Theoretical Framework

A computational interface conveys a large amount of information and must be designed in accordance with accessibility guidelines with focus on usability. The designer communicates with the user through the interface, and must clearly communicate his design intentions and the logic that determines his behavior. Usability evaluation refers to the methods to examine aspects related to an interface. A usability-oriented system must have an interface where the task can be performed without drawing attention to the interface, in which users do not have to spend time and energy on learning and dealing with the interface, but only in doing the task they want to perform.

Complete Article List

Search this Journal:
Volume 19: 1 Issue (2023)
Volume 18: 3 Issues (2022)
Volume 17: 4 Issues (2021)
Volume 16: 4 Issues (2020)
Volume 15: 4 Issues (2019)
Volume 14: 4 Issues (2018)
Volume 13: 4 Issues (2017)
Volume 12: 4 Issues (2016)
Volume 11: 4 Issues (2015)
Volume 10: 4 Issues (2014)
Volume 9: 4 Issues (2013)
Volume 8: 4 Issues (2012)
Volume 7: 4 Issues (2011)
Volume 6: 4 Issues (2010)
Volume 5: 4 Issues (2009)
Volume 4: 4 Issues (2008)
Volume 3: 4 Issues (2007)
Volume 2: 4 Issues (2006)
Volume 1: 4 Issues (2005)
View Complete Journal Contents Listing