Effort-Accuracy Trade-Off in Using Knowledge Management Systems

Abstract

To solve complicated problems, people often seek input from others. Knowledge management systems (KMSs) provide help in this activity by offering a computer-mediated approach to information sharing. However, if the KMS contains content that is obsolete or incomplete, those using the system may expend greater amounts of effort to detect what content is worthwhile or they risk relying on poor inputs, which may lead to less accurate solutions to their problems. As a result, most KMSs include rating schemes as part of the user interface designed to help those using the system identify high-quality content. Rating schemes depend on current users rating the quality of the existing content, guiding subsequent users in future content searches. If specific ratings are low in validity, then they may not reflect the true content quality (unintentionally or intentionally). This chapter provides a robust summary of the KMS literature and draws on the effort-accuracy trade-off framework to offer the results of a research study. The research study examines how rating validity influences how KMS users employ their limited cognitive resources to search and evaluate KMS content, with the goal of finding and using the highest-quality content. Through an experimental design, the study described herein manipulates rating validity and content quality in a replicated KMS setting and examines how users trade off search and evaluation effort. The results of the study demonstrate that rating validity differentially influences how KMS search and evaluation effort relates to decision accuracy. The chapter concludes with a discussion of the study findings and ideas for future research.