Evaluating Learning Management Systems: Leveraging Learned Experiences from Interactive Multimedia

Abstract

This paper maintains that the use of multimedia content in Web-based instruction — facilitated by the proliferation and standardization of learning management systems (LMS) — calls for the extension of traditional multimedia design and evaluation guidelines to the Web. The compliance with these guidelines needs to be thoroughly evaluated by any institution using (or planning to use) Web-based learning management systems. In addition to providing criteria and examples for the evaluation of these systems, the paper includes a survey instrument that can be used for university-wide assessments of the design effectiveness of technologies that support learning. As an example, the proposed evaluation instrument is applied to a learning management system developed at a large university in the United States. While the assessment refers to one system, the model, the instructional and design evaluation criteria, and the questionnaire are built for use in any organization conducting a formative and summative evaluation or a selection of learning technologies.