Early, Often, and Repeat: Assessment and Evaluation Methodology for Ensuring Stakeholder Satisfaction with Information Technology Projects

Early, Often, and Repeat: Assessment and Evaluation Methodology for Ensuring Stakeholder Satisfaction with Information Technology Projects

Lauren Fancher (University System of Georgia, USA)
DOI: 10.4018/978-1-60566-400-2.ch019
OnDemand PDF Download:


IT projects across all sectors are relying on more iterative methodologies that can employ early and frequent assessment and evaluation processes in order to ensure that project deliverables are satisfactory. This chapter provides a practical overview of assessment and evaluation processes and how they can be built into any of the various project management and development models. Methods discussed include: audience and needs assessment; approaches for maintaining engagement with stakeholder audiences; requirements and feedback-gathering methods including focus groups, surveys, and other communications; and evaluation and review methods such as usability testing and user acceptance testing. Iterative cycles of assessment, prototyping, evaluation, and implementation will be demonstrated through examples and process model flow diagrams.
Chapter Preview

Failure And Success: Introduction And Background

Ask any project manager: How many ways can a project fail? They will list many paths to failure, from doomed objectives to overdrawn budgets to implementation that is delivered just as core technologies become obsolete. Ask how many ways can a project succeed? Many project managers will say “by delivering the desired functionality on time and within budget.” But the visionary project manager, the tuned-in project manager, the flexible and proactive project manager? They will tell you that success must be achieved in the eye of the stakeholder. Just as the tree falling alone in the forest makes no sound, without stakeholders to perceive success, there is no success. Three propositions regarding stakeholder satisfaction with IT projects synthesize the practices of project management, stakeholder analysis, and evaluation and form the foundation of this chapter.

Proposition One:The perception of success is subjective and requires stakeholders.

The practice of managing projects has produced a number of different popular formulaic approaches, which may differ in emphasis but typically share some common elements related to planning, managing, controlling, communicating about, and learning from projects. Often the emphasis in managing information technology (IT) projects is placed on controlling the schedule, coordination and supply of staff resources, and implementation costs (Schwalbe, 2000). In many environments, the service or system to be delivered impacts multiple audiences that exist in organizational or customer spaces that are isolated from each other as well as from those involved in the project deployment. The definition of “stakeholder” is in itself often overly limited to members of executive management or other higher-ups. As a result, key stakeholders are not identified ahead of time, critical inputs are missed, and misplaced assumptions regarding priorities result in great unhappiness amongst all of the potential stakeholders, in spite of a project that has been delivered on time, within budget, and matching the requirements that have been provided to the project team (Drummond & Hodgson, 2003). While timely and frequent communication with stakeholders is often noted as a key to project success, early identification of and engagement with all stakeholder audiences is even more fundamental (Pinto & Kharbanda, 1996). Stakeholders can be defined in multiple ways and may vary based on the context and project. A primary first step for any project is to identify the stakeholders and determine how best to engage and manage their participation (Umbach, 2006).

Stakeholder analysis is a practice within the fields of business and management that seeks to identify and manage stakeholders within an organization. (Mayer, 2008). Research and theory regarding stakeholders and how to define and manage them has proliferated since the early 1990’s. Motivations for broadening the definition of “stakeholder” within an organization can include both social responsibility and profit. The stakes that are held may be weighted with according difference (Mitchell, Angle, & Wood, 1997). In either case, the goal of attending to stakeholder interests for the purpose of achieving success has been well documented (Van Grembergen, 2002).

Key Terms in this Chapter

Communication Plan: A chart of stakeholders and the communication methods that will be used to gather feedback and to keep them informed about the project status.

Focus Group: A small group discussion that is focused on a particular topic.

Stakeholder: Someone who has an interest or concern in the outcome of a particular endeavor.

ADDIE: An instructional design and development model consisting of iterative steps: Analysis, Design, Development, and Implementation.

Stakeholder Analysis: Understanding everything there is to discover about stakeholders and sorting them into categories.

Stakeholder Matrix: A chart of stakeholders, their interests, organizational affiliations, roles on the project, and input channels.

Agile: A form of project management that emphasizes small teams, close interaction between developers and customers, and rapid development cycles

Evaluation: A process for gathering information about a thing for the purposes of making decisions.

Usability Testing: An evaluation procedure in which actual users conduct tasks according to a protocol and whose performance can indicate design problems.

Benchmark: The best or most fitting example of its kind.

Heuristics: Best practice benchmarks against which something can be evaluated.

Complete Chapter List

Search this Book:
Editorial Advisory Board
Table of Contents
Robert K. Hiltbrand
Terry T. Kidd
Terry T. Kidd
Chapter 1
James W. Price Jr., Pamila Dembla
As exploratory research, the chapter’s aim is to assess if Sun-Tzu’s application of Taoist principles are applicable to the problem domain of... Sample PDF
The Tao To Understanding Enterprise It Project Complexity: Sun-Tzu's Five Factors Revisited
Chapter 2
A. J. Gilbert Silvius
This chapter describes a study into the expected development of the competences of the project manager in the year 2027. The study was performed... Sample PDF
Project Management 2027: The Future of Project Management
Chapter 3
Gregory J. Skulmoski, Francis T. Hartman
The purpose of this research was to investigate the soft competencies by project phase that IT project managers, hybrid and technical team members... Sample PDF
The Progression Towards Project Management Competence
Chapter 4
Ralf Müller
This chapter addresses project managers’ leadership styles, mainly from the perspective of technology projects. It starts by defining and outlining... Sample PDF
Leadership in Technology Project Management
Chapter 5
Melanie S. Karas, Mahesh S. Raisinghani, Kerry S. Webb
A project manager’s role on any project goes far beyond task-related deliverables. Although the project manager must be able to effectively manage... Sample PDF
The Importance of Leadership in Project Management
Chapter 6
Jaby Mohammed
This chapter introduces the concept of technology management by objectives. Technology is one of the fastest moving elements in the 21st Century... Sample PDF
Technology Management by Objectives (TMO)
Chapter 7
Gary Pan
The goal of any product is to be used. In a very real sense, people judge the success or failure of any product by the extent to which it is used by... Sample PDF
Examining Stakeholders' Roles in Influencing IT Project Cancellation Decisions
Chapter 8
Daniel W. Surry
This chapter will discuss more than 20 system development life cycles (SDLC) found in the Information Technology project management arena, whereby... Sample PDF
Bringing the User into the Project Development Process
Chapter 9
Evon M. O. Abu-Taieh, Asim A. El Sheikh, Jeihan M. Abu-Tayeh, Maha T. El-Mahied
This chapter uses the Diffusion of Innovations (DOI) theory and examines a business case, highlighting certain gaps in the theory. First, confusion... Sample PDF
Information Technology Projects System Development Life Cycles: Comparative Study
Chapter 10
Francisco Chia Cua, Tony C. Garrett
This chapter introduces the Firm-Level Value Creation Model as a means of planning Information Systems projects based on their potential for... Sample PDF
Analyzing Diffusion and Value Creation Dimensions of a Business Case of Replacing Enterprise Systems
Chapter 11
Otavio Prospero Sanchez, Alberto Luiz Albertin
In this chapter the authors investigate the management of service innovation projects; can ICT based service innovation be facilitated by... Sample PDF
IT Project Planning based on Business Value Generation
Chapter 12
Bendik Bygstad, Gjermund Lanestedt
This chapter provides a framework for technology project implementation in systems where the human is an integral element of the completed project.... Sample PDF
Managing ICT Based Service Innovation
Chapter 13
Katy E. Ellis
Project management is a carefully planned, organized effort to manage the resources in order to successfully accomplish specific project goals and... Sample PDF
Employee Preparation, Participation, and Performance
Chapter 14
Jaby Mohammed, Ali Alavizadeh
This chapter provides a fundamental yet comprehensive coverage of quality management. Bringing managers and engineers the most up-to-date quality... Sample PDF
Quality Assurance in Project Management
Chapter 15
Sohail Anwar
Project management is a carefully planned, organized effort to manage the resources in order to successfully accomplish specific project goals and... Sample PDF
Quality Management and Control
Chapter 16
Dawn M. Owens, Deepak Khazanchi
Successful implementation of IT (information technology) projects is a critical strategic and competitive necessity for firms in all industrial... Sample PDF
Software Quality Assurance
Chapter 17
Fayez Ahmad Albadri
An overwhelming number of Information Technology (IT) projects experience persistent problems and failures. This chapter reflects on some of the... Sample PDF
IPRM: The Integrated Project Risk Model
Chapter 18
Technical Risk Management  (pages 283-294)
Pete Hylton
In today’s highly competitive industrial environment, many high-tech businesses are using Technical Risk Management (TRM) in their engineering... Sample PDF
Technical Risk Management
Chapter 19
Lauren Fancher
IT projects across all sectors are relying on more iterative methodologies that can employ early and frequent assessment and evaluation processes in... Sample PDF
Early, Often, and Repeat: Assessment and Evaluation Methodology for Ensuring Stakeholder Satisfaction with Information Technology Projects
Chapter 20
Chad J. Cray
Considering the high failure rate of information technology (IT) projects over the last 40 years, project managers should use all the tools at their... Sample PDF
A Needle in a Haystack: Choosing the Right Development Methodology for IT Projects
Chapter 21
Mysore Narayanan
In this chapter, the author describes how one can implement and incorporate creative techniques to design, develop, document and disseminate a... Sample PDF
Project Management Assessment Methods
Chapter 22
Mario Vanhoucke
It is well-known that well managed and controlled projects are more likely to be delivered on time and within budget. The construction of a... Sample PDF
Static and Dynamic Determinants of Earned Value Based Time Forecast Accuracy
Chapter 23
Michele De Lorenzi
This chapter presents a technology exploration process designed to support service innovation for information and communication technologies in a... Sample PDF
Technology Exploration Process: From Technology to New Services
Chapter 24
Henryk R. Marcinkiewicz
Three models structure the planning for technology integration into instruction. Institutional needs are assessed for three dimensions suggested in... Sample PDF
Planning for Integrating Technology
Chapter 25
Michael Crow
Kansas State University has ensured greatly increased academic involvement in the implementation of its new student information system through the... Sample PDF
University Task Force Deepens Academic Involvement in ERP System
Chapter 26
Joni A. Amorim, Carlos Machado, Rosana G.S. Miskulin, Mauro S. Miskulin
The production of quality educational multimedia content involves both its publication and its use, considering aspects ranging from metadata... Sample PDF
Production, Publication, and Use of Educational Multimedia Content in Brazil: Challenges and Opportunities in Real World Technology Projects
Chapter 27
Hasan Tinmaz
Technology planning is an indispensable activity for all higher education institutions nowadays. The major purpose of the technology planning is to... Sample PDF
Instructional Technology Plans for Higher Education Institutions
Chapter 28
Patricia McGee, Veronica Diaz
The rapid proliferation of e-learning tools that offer low or no cost investment and are not housed on institutional servers, has made it very... Sample PDF
Shifting from Classroom to Online Delivery
Chapter 29
Bimal P. Nepal, Leslie Monplaisir
Original equipment manufacturers (OEMs) in automotive industry are faced with the conflicting goals of creating vehicles with higher reliability... Sample PDF
Lean and Global Product Development in Auto Industry
Chapter 30
Debra D. Orosbullard
The business world is running at a faster pace than ever before. Globalization has partnered the world and new ways of doing business to meet... Sample PDF
Future Trends: Global Projects & Virtual Teaming
Chapter 31
Geoffrey Corb, Stephen Hellen
Social networking technologies—such as Wikis, blogs and instant messaging—are increasingly being employed in business settings to support... Sample PDF
Wiki-enabled Technology Management
Chapter 32
Owen G. McGrath
Higher education IT project managers have always relied on user activity data as logged in one form or another. Summarized counts of users and... Sample PDF
Mining User Activity Data In Higher Education Open Systems: Trends, Challenges, and Possibilities
About the Contributors