You are on page 1of 13

British Journal of Management, Vol.

16, * – * (2005)
DOI: 10.1111/j.1467-8551.2005.00438.x

Methods for Managing Different


Perspectives of Project Success
David J. Bryde
School of Management, Faculty of Business and Law, Liverpool John Moores University, John Foster
Building, 98 Mount Pleasant, Liverpool, L3 5UZ, UK
Email: D.J.Bryde@livjm.ac.uk

The results of an exploratory study of UK organizations into methods for meeting


project key performance indicators (KPIs) are presented. The paper explores: influences
on the use of methods to manage project KPIs; the need for and existence of methods;
the factors that facilitate the meeting of the KPIs. It is concluded that the use of
methods varies depending upon the perceived importance of the project, the type of
project, the client-team relationship and whether an organization performance
management system exists. With project management capability often decreasing, in
part due to a failure to meet psychosocial project KPIs, a need for methods linked to the
KPIs was identified. However, the study found relatively low levels of adoption of such
methods. Where psychosocial project KPIs were being met the following facilitating
factors emerged: top-level policies, organization-wide training, integration with existing
management processes, building into project management system. Situations were
found where decision-makers did not consider the psychosocial KPIs of programme and
project managers. This was seen to contribute to a failure by organizations to manage
necessary increases in their project management capability and to be acting as a
possible barrier to long-term, sustainable improvements in performance.

Introduction However, the development of new PMS models


introduced a level of complexity. Measuring
The management literature reports changes in the performance requires understanding of a balance
theoretical constructs of performance measure- of different perspectives from different stake-
ment over the last 20 years. Up until the 1980s, holder groups. But it is recognized in the liter-
the emphasis was on a narrow range of financial- ature on the subject of organizational effective-
based measures, such as profit, return on invest- ness that different stakeholders use different
ment and productivity. In the 1980s, dissatisfaction criteria/key performance indicators (KPIs) to as-
with these ‘traditional’ performance measure- sess effectiveness and that it is rare that organiza-
ment systems (PMSs) led to the development of tions fulfil the KPIs of all groups simultaneously.
‘balanced’ or ‘multi-dimensional’ frameworks Therefore the need for balance is accompanied by
(Bourne et al., 2000) and PMS models, such as complexity in terms of understanding the differ-
the Balanced Scorecard (BSC) model (Kaplan ent perspectives and reconciling the paradoxical
and Norton, 1992). The new PMSs were seen to nature of the multidimensional framework. This
address the limitations of the old ‘traditional’ complexity is reflected in models of organizati-
PMSs. For example, in a manufacturing context, onal effectiveness, such as the Competing Values
newly emerging PMSs helped the achievement of Model (Walton and Dawson, 2001). This model
continuous improvement goals and guarded arranges 17 KPIs in three dimensions that in-
against the dangers of sub-optimization (Gha- corporate the values and preferences of stake-
layini and Noble, 1996). holders in terms of the degree of internal or

r 2005 British Academy of Management


2 D. J. Bryde

external focus, the flexibility and control of related objectives, which has been described as
structure and the emphasis placed on either the the ‘iron triangle’ (Atkinson, 1999). Methods for
means or the end. managing project performance through the meet-
In the context of a balanced, multidimensional ing of the iron triangle KPIs – the term ‘project
framework the need to consider different stake- success criteria’ is often used interchangeably
holder perspectives influences recent theoretical with the term ‘KPI’ (APM, 2000) – were
work and empirical study of the management predicated on this narrow definition; being
processes to enable managers to design and focused on adherence to budgets, schedules and
implement a PMS. For example, Feurer and technical specifications. In addition, the para-
Chaharbaghi (1995) have the identification of meters of project success were, in part, con-
stakeholder goals and learning requirements as strained by the practical difficulties of assessing
the first of a theoretical four-step approach to success using other, more subjective, measures.
developing a PMS. In a case study of the Estates As with other management disciplines that
Management Department of the Mass Transit focus on performance measurement, such as
Railway Corporation, Walters (1999) examines operations management, quality management
the usefulness of a new PMS developed to reflect and strategic management, from the 1980s
the different goals that the organization wished to onwards there have been a number of broad,
fulfil. These goals include sustainable development, interlinked developments in the field of project
continuous improvement, longevity, growth, and management that led to a redefined framework of
employee and customer satisfaction. Kald and what constitutes successful project performance.
Nilsson (2000) construct a multidimensional perfor- There has been recognition that there is a
mance measurement framework, reflecting the need difference between project management success
for balanced control, as per the BSC model, for a and project success (De Wit, 1988) and that
study of the characteristics and uses of PMSs in 236 assessing project performance requires more than
business units in Denmark, Finland and Norway. taking measurements against the iron triangle
De Toni and Tonchia (2001) use a multidimensional KPIs. Project management success focuses on the
construct involving cost and non-cost performance iron triangle and also on the way in which a
measures in their study of operations performance project is managed, that is the ‘quality of the
of 115 Italian firms in the mechanical, electro- process’. This forms one part of project success.
mechanical and electronic industries. Hlavacka et al. The other part of project success relates to the
(2001), in a study of the link between different effects of the project’s final product or service and
strategic types and organization performance in the is referred to as ‘product success’ (Baccarini,
healthcare industry, use a multidimensional PMS 1999). Therefore a project can be viewed as being
predicated upon meeting the expectations of internal successful despite the iron triangle KPIs not
stakeholders, such as employees and external being met. For example, a project might be
stakeholders, such as patients. delivered late and over budget, yet it might lead
The general move away from traditional PMSs to an increase in the capability of the organiza-
that focus on a narrow range of measures towards tion to better manage future projects (Firth,
multidimensional frameworks that require the 1995; Taylor and Graham, 1992).
balancing of various stakeholder perspectives and The distinction between project management
the attendant issues of complexity that accompany success and project success is not just a debate
such a move informs developments in the project about terminology. Determining how success is
management discipline. In particular, develop- to be defined for a project is a necessary
ments relating to the definition and measurement precursor to the establishment of appropriate
of project performance see theoretical-based work methods for managing the project life cycle and
and empirical studies focusing, either implicitly or for the selection of suitable measurement techni-
explicitly, on putting the changing character of ques. Defining success is also a key step in
PMSs that are reported in the management understanding the important ‘success factors’,
literature in the context to project environments. that is, the inputs to the project management
Prior to the 1980s, project ‘success’ was narrowly system that have an influence on the outcome
defined in terms of an individual project meeting (Cooke-Davies, 2002). A narrow definition of
cost, time and quality (of the end product)- project success that focuses exclusively on the
Managing Different Perspectives of Project Success 3

iron triangle may lead to an inadequate range of ment methods. External-focused KPIs are often
success factors being considered by the project expressed as an amalgam (Deutsch, 1991; Larson
team to the detriment of factors that relate to and Gobeli, 1989; Mallak, Patzak and Kursted,
other KPIs in the project success construct. 1991; Might and Fisher, 1985; Nicholas, 1989;
Being ‘multi-dimensional and multi-observa- Pinto and Prescott, 1990; Shenhar, Levy and Dvir,
tional’ (Shenhar, Levy and Dvir, 1997) project 1997; Tukel and Rom, 2001; Tuman, 1993;
success is defined and measured using various Wateridge, 1998). The amalgam is composed of
criteria, by disparate groups of people, through- various elements, depending upon the project role
out the project life cycle. The disparate groups of of a particular stakeholder; for example, Larson
people who make up the project stakeholders and Gobeli define ‘satisfaction’ in terms of
(Mallak, Patzak and Kursted, 1991) will rank the customer perception, and for the organization,
various KPIs that make up project success. For by an increase in market share and by technolo-
example, KPIs linked to meeting technical gical breakthrough; whereas Pinto and Prescott,
‘quality’ or specification-related objectives, in define satisfaction in terms of factors relating to
some situations, take precedence over KPIs the implementation process, factors relating to
linked to meeting time and cost objectives (Might perceptions of the project’s value and factors
and Fisher, 1985; Tukel and Rom, 2001). relating to concern for and attendance to, the
Previous research relating to the post-1980s client’s needs. There is also recognition in some
project success paradigm has two main foci: esta- parts of the literature (Cleland, 1986; Nicholas,
blishing the character of the ranked theoretical 1989; Tuman, 1993) that satisfaction can be
construct and investigating the factors influencing defined by groups internal to the project, such as
the particular ranks assigned to individual KPIs the project manager and project team members
within the construct. and that their desired outcomes, whether they be
In terms of the character of the ranked theoreti- task-oriented or psychosocial-oriented (Pinto and
cal construct, a consistent dichotomy in the liter- Pinto, 1991), are important KPIs.
ature is between the internal-focused and, to some The main focus of research relating to inves-
extent, quantifiable KPIs of adherence to budget tigating the factors influencing the particular
and schedule and the external-focused, in terms of ranks assigned to individual KPIs is in the area
being outside or inside the project team, but less of ‘stakeholder’ (see Figure 1).
quantifiable KPIs, which, in many cases, require Theoretical constructs identify a number of
the employment of perceptual-based measure- different characteristics of project stakeholders,

Level of
management Position in Function
organization

Time
perspective Stage of Project
Stakeholder Life Cycle

1
PM role
Strategy Ranked Project
success KPIs:
Involvement multi-dimensional
in PM system

Type of
Structure Organization Project

Product/service Type of
Sector Degree of delivered contract
customer focus

Figure 1. Influences on ranked project success KPIs


4 D. J. Bryde

which include the following: whether the stake- the perceptual measures of success were ranked
holders are distinguishable by following either an higher in terms of performance than the quanti-
adversarial, supporting or championing strategy tative measures of cost and schedule. This
(Cleland, 1986; Mallak, Patzak and Kursted, finding, which is confirmed in a later study
1991; Tuman, 1993), whether they are internal to (Tukel and Rom, 2001), is significant in provid-
the project organization or external (Cleland, ing confirmation through empirical study of the
1986), whether they have intrinsic power validity of previous theoretical work and anec-
(Deutsch, 1991; Mallak, Patzak and Kursted, dotal evidence, reviewed by Nicholas (1989), that
1991) whether they are involved in sponsoring or suggest KPIs with perceptual-oriented measure-
managing a project (Freeman and Beale, 1992), ment methods take precedence over other KPIs:
whether they view success from a long-term or and the recognition of the pre-eminence given to
short-term time perspective (Pinto and Pinto, perceptual measures over more ‘pragmatic’ mea-
1991), whether they are project managers or end sures is found to promulgate into related project
users (Wateridge, 1995) and where they are management research. See, for example, studies
positioned in the organization in terms of their of project critical success factors by Larson and
job (Larson and Gobeli, 1989) and management Gobeli (1989) and Pinto and Slevin (1987, 1989).
level (Tukel and Rom, 2001). There is also recog- Research into the influences on the ranking of
nition that the factors distinguishing different project success KPIs relating to ‘Organization’
stakeholder types are interrelated. For example, factors is considered in terms of the type of
those stakeholders who are internal to the project structures used (Kerzner, 1989) and in terms of
are likely to follow supportive strategies (Cleland, whether the organization is a service-provider/
1986) and those with a long-term time perspective manufacturer and customer-focused/not custo-
are often those who carry out the role of sponsor mer-focused (Tukel and Rom, 2001). Kerzner
or who occupy positions in the upper levels of the describes a redefinition of KPIs, within the US
management hierarchy (Pinto and Pinto, 1991). Inland Revenue, post-1986, beyond KPIs linked
Empirical research relating to the stakeholder to the achievement of time-base milestones, to
area has investigated the extent to which the include KPIs related to the successful operation
multi-attribute character of the project success of a matrix structure: namely, that line managers
KPIs varies according to different stakeholder do not have to sacrifice their existing, opera-
contexts. Although variations in the precedence tional-related work. Although the single case-
given to KPIs have been reported (Tukel and study research method employed by Kerzner
Rom, 2001; Wateridge, 1998), these variations does not allow external validity of similar
are not shown to be statistically significant. redefinitions in other organizations, there is
There has been less emphasis, but some statistical evidence that manufacturing and non
reported studies, of the influence on the character customer-focused organizations, with a variety of
of project success KPIs of the three other project structures, are as likely to give precedence
variables shown in Figure 1; ‘Type of Project’, to customer satisfaction-related KPIs over inter-
‘Organization’ and ‘Stage of the Project Life nal measures, such as meeting time objectives, as
Cycle’. The influence of the type of project on service-providers or customer-focused organiza-
rankings of KPIs is considered in a study of the tions (Tukel and Rom, 2001).
important KPIs for 103 development projects in The potential influence of the stage of the
30 US firms, 70% of which were sponsored by the project life cycle on the importance attached to
US Department of Defense or NASA (Might and individual KPIs is proposed in a theoretical
Fisher, 1985). Using a six-item project success model of project success (De Wit, 1988). Empiri-
KPI construct, they distinguish between the cal study suggests a limited influence. A study of
following perceptual KPIs: overall satisfaction, the experience of 127 project managers involved
technical performance relative to the initial in industrial projects carried out in Israel over the
specification, technical performance compared preceding ten years (Shenhar, Levy and Dvir,
with other similar projects and performance 1997) found that the importance attached to
relating to identification and resolution of pro- KPIs, expressed as the following four dimen-
blems and cost and schedule, which are measured sions: customer satisfaction, budget and sche-
using quantitative methods. The study found that dule, business success and future potential, did
Managing Different Perspectives of Project Success 5

not significantly change depending upon the stage gauged. There is a need to explore how project
a current project was at. This was confirmed in a success is actually defined and measured in
later study that found that ‘quality’-related KPIs practice and how methods for definition and
took precedence over time and cost-related KPIs measurement are used to produce the desired
throughout all stages of the project life cycle outcomes. This paper will make a contribution to
(Tukel and Rom, 2001). meeting this need through an exploratory study,
The attention of the research carried out to with the aims of the study being:
date, described above, is on identifying, classify-
 to investigate the variables that influence the
ing and ranking, in order of importance, the
use of methods to manage project KPIs;
project success KPIs; with the focus on under-
 to explore the need for and the existence of
standing the multidimensional, multi-observa-
methods to meet psychosocial project KPIs;
tional attributes internal to the ranked project
 to investigate factors which enable the meet-
success KPI element, shown in Figure 1. How-
ing of psychosocial project KPIs.
ever, there has also been some work looking at the
practical implications of the change from the iron The findings of the study are reported and
triangle construct to a construct with a multi- discussed and, given the exploratory nature of the
dimensional and multi-observational character. research, suggestions for further work are pro-
Boehm and Ross (1989) suggest that it is possible vided at the end of the paper.
to reconcile the competing values inherent to the
project success construct and meet the KPIs of all
parties involved in software projects by applying The research context
Theory W software project management. Boehm Data collection
and Ross describe the principles of Theory W,
which focuses on developing ‘win-win’ situations Semi-structured interviews were used to obtain
through attention to people’s interests and data concerning project management practice
expectations. They illustrate the usefulness of and the attitudes and opinions of project
Theory W by showing how its principles could participants, in various organizations. As part
have been applied to an information systems of the study the prior research, described in the
project in a manufacturing organization that had preceding section, was used to establish a project
failed to satisfy the main participants. One success KPI construct comprising 17 attributes
principle is understanding the psychosocial-or- (see Table 1).
iented KPIs of project team members and aligning The focus of this study is on the following
them with other objectives, which is described by elements in the construct: client perception
Boehm and Ross as to ‘match people’s tasks to (external focus); meeting specified project objec-
their win conditions’. This is achieved by search- tives (iron-triangle focus); growth of others, own
ing out win-win conditions. For example a win personal growth, personal non-financial and
condition for software professionals might be financial rewards (all psychosocial focus).
professional growth rather than promotion to a
management position, therefore assigning a role
Sample
on a project that provides such growth would
create a win condition. Central to the successful Purposive, heterogeneous sampling was used to
application of Theory W is that key decision- ensure data were collected from a diverse range of
makers, such as project sponsors and project organizations. The sample has representation
managers, recognize the importance of meeting from traditional project-focused organizations,
psychosocial KPIs such as personal growth. such as a supplier of defence products and
In general terms research has been undertaken services, and from organizations that have less
which explores the influences on how project of a tradition of managing projects, such as a
success is defined and measured. These influences university. Details of the nine organizations in
include the stage of the project life cycle, the type the sample are shown in Table 2.
of project being undertaken, the type of organi- In each organization, one of the people
zation and the stakeholders involved. The focus interviewed was the person with overall respon-
of this work is on how project success ought to be sibility for project management. In some organi-
6 D. J. Bryde

Table 1. Character of project KPI

Project KPI Character of KPI

Client perception An external focus linked to the quality of the product and the quality of the
project management process
Meeting specified project objectives The ‘iron triangle’ of cost, time and quality
Smoothness of handover An external focus linked to the quality of the project management process in
the post-implementation stage
Responsiveness to change An internal focus that encompasses the quality of the project management
process throughout the project
Cost effectiveness of work An internal focus that encompasses the quality of the project management
process throughout the project
Improvement in organizational capability A long-term strategic focus linked to benefit for the organization
Growth of others Psychosocial focus on team member’s development
Own personal growth Psychosocial focus on individual development
Level of disruption to organization An external focus linked to a short-term strategic focus for the organization
Avoidance of non-benefit through early cancellation An internal focus linked to short-term strategic focus for the organization
Enabling of other project work An internal focus linked to long-term strategic focus for the organization
Personal non-financial rewards Psychosocial focus on reward and recognition for the project team
Contribution to continuous improvement Long-term strategic focus linked to benefits to the organization
Adherence to defined procedures Short-term focus linked to the quality of the project management process
Degree of process innovation Long-term strategic focus linked to the quality of the project management
process
Personal financial rewards Psychosocial focus on reward and recognition for the project team

Note: Those KPIs shown in bold are the focus of this exploratory study

Table 2. Organizations interviewed

Organization Nature of business Scope of interviews

A Supplier of defence products and services Head of Project Management, Programme Manager,
Project Manager, Senior Project Engineer and
Engineering Manager
B Re-processor of fuel products Head of Project Management, Head of the Project
Procurement Group (responsible for projects), Head of
Engineering Management Development (responsible for
the development of project management) and Project
Manager
C Manufacturer of telecommunications products Manager of Business Efficiency (responsible for Project
Management), Product Manager, Programme Manager
and Project Manager
D Manufacturer of electronic components Programme Manager, Product Manager, Project Manager
and Senior Project Engineer
E Supplier of financial products and services Project Support Manager, Product Manager, Project
Consultant and Project Manager
F Supplier of Information Technology facilities and Head of Project Management Focus Group (responsible
services for project management), Project Office Manager
(responsible for project management support services),
Programme Manager and Project Manager
G Provider of consultancy and training services Managing Director (responsible for project management),
Project Consultant, Senior Project Manager and Project
Manager
H Local authority Director (responsible for project management), Assistant
Director (responsible for special projects), Programme
Manager and Project Manager
I University Director (responsible for academic projects), Director
(responsible for non-academic projects), Programme
Manager (construction projects), Project Manager
(academic), Project Manager (non-academic)
Managing Different Perspectives of Project Success 7

zations. this person had the title ‘Head of Project


Perceived Type of
Management’, whilst in others it was the job of a importance of
project project
person at director level. This enabled data to be
Use of methods to
collected about how project management ought manage
to happen in an organization, as well as how it project KPI
happened in practice. Interviewing programme
managers, project managers, project engineers Client/
Organization Contractor
and product managers obtained additional data PMS relationship
on project management practice. This data was
supplemented by interviewing people working in Figure 2. Influences on methods to manage project KPIs
a project management support role, such as
project consultants and staff in project offices or
project management development roles. vary within project-focused organizations, depend-
ing on the importance attached to the activity.
Findings Type of project. The influence of the activity
Variables that influence the use of methods to being undertaken was also evident in the organi-
manage project KPIs zations with less of a traditional focus on
managing projects, such as H and I, the local
The interviews with subjects highlighted a num- authority and the university. In these two
ber of possible variables influencing the manage- organizations, small pockets of project manage-
ment of project KPIs, as shown in Figure 2. ment maturity existed. In these pockets of
maturity, iron-triangle and customer/client KPIs
Perceived importance. The staff from organiza- were being managed on a certain type of project.
tions A and B described how methods were For example, a construction programme man-
consistently employed to manage the iron trian- ager in a university’s Estate Management Ser-
gle KPIs and the KPIs linked to customer or vices and an assistant director involved in large-
client satisfaction, in respect of their traditional scale construction projects in a local authority,
project work or core project-related business. described well-developed methods for managing
There were established methods used to manage iron triangle and customer/client KPIs, similar to
the iron-triangle KPIs: actual versus budgets, those used in the project-focused organizations
revised versus baseline plans and quality sche- (see above). Yet in the other parts of the two
dules versus specifications. Perception surveys organizations, where different types of projects
were undertaken both during and at the end of were being undertaken, no such methods were
projects to help manage customer/client satisfac- being used. Unlike the experiences of the two
tion. These two organizations could be classed as organizations A and B discussed above, the use
being traditionally project focused and, in terms of methods in H and I did not seem to be linked
of using methods for managing KPIs, could also to any perceived importance of the work, rather a
be classed as project-management focused. How- reflection of the fact that such methods are
ever, within these two organizations there was routinely used, and expected to be used, for such
evidence that the use of methods was influenced types of project.
by the perceived importance of the project, where
importance was assessed in relation to whether it Client/contractor relationship. The nature of the
was a core-business or supportive activity. For client/contractor relationship seemed to influence
example, the use of the methods described earlier the development of the methods for managing
in this paragraph on ‘supportive’ projects: such as customer/client KPIs in some of the organizations.
the introduction of a new IT system or the under- Typical methods were used by organizations D
taking of an internal human-resource manage- and F and involved working with clients to
ment initiative, was typically described by staff as establish the important KPIs. Common to these
being variable and patchy. This suggests that in situations, and others in which predefined project
terms of utilizing methods for managing KPIs, success KPIs were used, was the characteristics of
the degree of project management focus might the client/contractor relationship, with the two
8 D. J. Bryde

organizations managing projects for a small keeping pace with changes in demand for project
number of customers in long-term partnerships. management resources. In many cases, the de-
This allowed the project teams to gain an mand for skilled project managers was going up
understanding over time of how to develop but the level of resource was going down. This
appropriate and measurable customer stake- decrease in capability was due, in part, to
holder-focused project success KPIs. For those psychosocial project KPIs not being met. A project
projects with no such client/team relationships, consultant in organization E described this:
the establishment of customer stakeholder-
focused project success KPIs typically took place ‘Good people are leaving. Good people are not
rewarded as being good. There is no reward and
through workshops, which often ran over a
recognition.’
number of days. The use of such workshops
tended to be confined to projects in which the There was a recognition that as part of the solution
value of the project to the organization was project managers’ and project team members’
deemed to justify the cost involved in under- psychosocial project KPIs needed to be better
standing and defining the customer and stake- met and that methods need to be developed to
holder-focused project success KPIs (see above). facilitate the process. Potential methods identified
For example, organization E used them on a included the following: establishing internal devel-
project to develop a new product line, which was opment processes, raising the profile for project
crucial to the achievement of the organization’s management, defining ways of matching the right
business strategy, but not on all other projects. people to project management roles, establishing
processes for the retention of people, establishing
Organization PMS. Interviews with staff in clear structures/processes/procedures to manage
organization A highlighted the possible role of the project life cycle, which included consideration
an organization PMS, which did in part aim at of psychosocial project KPIs.
aligning definitions of project success between the
organization and the project team, through the
Existence of methods to meet psychosocial project
establishment of harmonized and aligned project
KPIs
objectives. The management process for imple-
menting this PMS took place outside individual In terms of the existence of methods used to meet
projects and typically involved a form of manage- psychosocial project KPIs, the interviews sug-
ment-by-objectives. Specified objectives to be met gested a dichotomy between the perceived im-
were stated in terms of business targets, which portance attached to a KPI and the practicalities
incorporated task-oriented project success KPIs, of data measurement linked to that KPI. For
such as achieving time, cost and quality objec- example, there was a high degree of unanimity
tives and personal targets, which incorporated across all organizations that in relative terms the
psychosocial project success KPIs, such as most important KPI was client perception. Some
personal development and non-financial reward of the organizations had translated this perceived
and recognition. The Head of Project Manage- importance into their project management sys-
ment described this process as ‘the value planning tems, mainly through perception surveys, but the
process’. The Chief Executive Officer of the use of such surveys was patchy and inconsistent,
organization had 6–10 individual objectives even within these organizations. More common
broken down under the headings of The Eur- was a tension between the desire to measure, and
opean Foundation for Quality Management hence manage, client perception and the difficulty
(EFQM) model and these ‘values’ were cascaded of doing it in practice. A programme manager in
down through the organization in the form of organization A best expressed this tension:
individual business and personal objectives.
‘Yes we would like to do it [measure client perception]
and we talk about it a lot, but in terms of getting a
Need for methods to meet psychosocial project specific metric to measure client perception I can’t
KPIs think of one. Though it is crucial to what we do.’

In all of the organizations, a common view was In comparison with methods for measuring and
that project management capability was not managing client perception, there was more
Managing Different Perspectives of Project Success 9

widespread adoption of methods for managing dissemination was part of an effective implemen-
KPIs focused on the iron triangle. This preva- tation of the policies. This resulted in the
lence seemed to be influenced most by the programme and project managers expressing
existence of well-established, quantitative-based satisfaction that their psychosocial KPIs were
data-collection methods for measuring time and considered.
cost-related objectives, rather than a general view
that the iron triangle KPI takes precedence over Organization-wide training in project management
the client perception KPI. Indeed, the interviews skills. In organizations A, B, C, D, F and H
suggested that client perception is ranked as more there was common agreement amongst the staff
important than meeting the iron triangle. at all levels that organization-wide training in
Compared to methods related to client percep- project management had been formally under-
tion and the iron triangle, formal methods to taken and had had a positive effect. These formal
manage the psychosocial project KPIs were not as training programmes had contributed to high
prevalent, either across organizations or within levels of satisfaction that the psychosocial KPIs
organizations. In a similar fashion to the other related to personal growth and development,
KPIs discussed above, this seemed to reflect the both of individuals and others, was being met by
following: first, psychosocial KPIs of the project the organizations. These high levels of satisfac-
team were not perceived to be as important as tion were found not only amongst programme
client perception and the iron triangle; second, they and project managers, but also amongst those
were difficult KPIs to measure and integrate the responsible for project management and those
management of into project management systems. working in a project support role.

Factors to enable the meeting of psychosocial Integration of meeting psychosocial project KPIs
project KPIs with existing management processes. As dis-
cussed earlier (see ‘Organization PMS’, above).
From the interviews a number of factors emerged Organization A had linked the meeting of
that seemed to have an influence on meeting psychosocial project KPIs with an existing
psychosocial project KPIs of personal growth and ‘cascading values’ management process. As was
development and non-financial reward and recog- the case with the establishment of policies, the use
nition. (During the interviews it became clear that of this management process was having a positive
financial reward and recognition was not per- effect in terms of the staff involved in projects
ceived as important to staff involved in projects, believing that their psychosocial KPIs of non-
compared with the other psychosocial KPIs.) financial recognition were being met.

Top-level policies relating to psychosocial project Building the meeting of psychosocial project KPIs
KPIs. In a number of the organizations inter- into the project management system. The staff in
viewed, the establishment of a high-level, written organizations D and F described similar project
policy of recognizing both project management- management processes that involved an interac-
related performance and the development of tion between all the stakeholders, including the
project management skills had an influence on project team members, to identify expectations.
meeting the psychosocial KPIs relating to project For programme managers, project managers and
team members’ personal growth and reward and project engineers these expectations could relate
recognition. In organizations B, D and H the to meeting their psychosocial KPIs. Through this
development of such policies was known not only interaction, which took place at the start of the
to those responsible for project management, project when the project was defined and
such as the Heads of Project Management, but continued throughout the life cycle to include a
also to the programme managers and project review of performance in closure and handover,
managers. The key factor was not the existence of the definitions for project success between the
the policy, but that it had been disseminated to stakeholders were shared.
those working in project teams, that is, the In organization D this process seemed to work
programme and project managers and that the well, with staff expressing satisfaction that their
10 D. J. Bryde

expectations were considered at the start and their importance of the KPI and problems in develop-
perceptions taken into account at the end. ing appropriate measurement methods. Varia-
However, in organization F the process was not tions in the use of methods to manage project
always effective. There was a formal project KPIs also seems to result from the type of project
management procedure that built the measure- being carried out, the client/contractor project
ment of previously defined project KPIs, including relationship and whether an organization PMS
psychosocial, into the closure stage of the project exists. (Though the exploratory nature of the
life cycle. However, despite the procedure being in study means further work is needed to confirm
place, the project manager did not believe that the findings – see below.)
their psychosocial project KPIs, such as the need The use of a narrow range of KPIs that focuses
to take on projects that were challenging and exclusively on the iron triangle, whether by
stretching, were always properly evaluated. This accident or design, is potentially limiting in terms
left the project manager feeling frustrated, demo- of optimizing project performance. The metrics
tivated for the next project and questioning their emphasized in project environments, which are
long-term future in the organization. It also linked to the project success KPIs, serve to
highlighted the fact that there was a dissonance influence actions and decisions (Hauser and
between the goals of the organization, in relation Katz, 1998), help determine how the project is
to carrying out a project and the goals of the to be managed (APM, 2000) and enable win-win
project manager, which were not reconciled. situations (Boehm and Ross, 1989). Therefore
ignoring such measures as ‘project team member
Recognition of the importance of psychosocial satisfaction’ and ‘increase in organizational cap-
KPIs. In organization G, a lack of recognition ability’ might lead to a failure to align project
at top-management level of the importance of management action to key elements of perfor-
psychosocial KPIs was found to be a restraining mance, with actions focusing exclusively on the
force working against the meeting of the KPIs. A short-term and ignoring more long-term goals,
common psychosocial project KPI amongst the such as the achievement of continuous improve-
project consultant, senior project manager and ment in project management and the develop-
project manager was the degree to which the ment of sustainable improvements in project
senior management, in their role of sponsors, performance. This is a particularly pertinent issue
involved them in the initiating of new projects. given the widespread reduction in project man-
Such involvement was regarded as crucial to their agement capability reported in the survey results.
personal development. The inability of the Where methods exist to manage a range of
organization to recognize the project managers’ task-oriented and psychosocial-oriented project
psychosocial project KPIs was a perceived weak- KPIs, the influence of wider developments in the
ness in project performance, with all the staff area of performance measurements is evident.
members believing that the organization was not The use of the ‘cascading values’ model PMS
delivering successful projects. As was the case in topology, as described in the performance man-
the previous section, they were left frustrated and agement literature (see De Toni and Tonchia,
demotivated. 2001), shows how existing management processes
for performance management are applied in
project contexts. Where specific project manage-
Conclusions ment-related business processes are developed for
considering psychosocial project KPIs, difficulties
This study suggests that although there might be are sometimes encountered. These difficulties are
widespread theoretical acceptance of the multi- consistent with prior literature (see for example
dimensional, multi-observational project success Bourne et al., 2000) that testifies to the problems
KPI construct, more emphasis in project manage- of practically implementing multidimensional
ment practice is being placed on iron-triangle and PMSs. They also suggest that it cannot be assum-
customer/client external focused project success ed that internal stakeholders, such as project
KPIs compared to psychosocial-oriented and managers, will always base their definitions of
internal stakeholder focused project success success on being supportive of project goals, nor
KPIs. This seems to reflect both the perceived that the merging of the distinction between
Managing Different Perspectives of Project Success 11

company objectives and definitions of project long-term, project KPIs, such as increasing the
success is achieved with positive consequences. capability of the organization to manage future
(This assumption is found in some of the project projects, are important, in addition to the short-
management literature.) term, project-specific project KPIs, such as satis-
In terms of project management practice, a key fying the client and getting the project completed
outcome from the study is the problem of align- on time. However, such project management
ment or integration of different project stakeholder processes are not currently common, with an em-
perspectives, as a necessary step in dealing with the phasis in the methods used to manage the project
complexity and paradoxes inherent in the multi- success KPIs on defining and measuring perfor-
dimensional construct. Developing practical solu- mance against the iron triangle and on measuring
tions is also made more difficult by the inherent client perception. With project success being
tension in project environments between the need defined by the organization in such a narrow
to establish a degree of solidity (at the project level) way, project managers are encouraged to focus
in the context of external environments that are exclusively on short-term measures, as these are
often fluid and fast changing (at the programme seen as being those that provide most rewards
level). Establishing metrics linked to a project and recognition. This may lead to optimization of
success KPI construct is in part a response to the project performance in the short-term and from
need for solidity and as such metrics need to be the narrow, tactical project perspective, but sub-
treated a being flexible and adaptable over time optimization in the long term and from the
and across stakeholder groups. broader, strategic organization perspective (such
The results suggest another barrier to the a phenomenon was described by one person in
alignment or integration of stakeholder perspec- the survey as ‘projectitis’). The existence of such a
tives may be in the difference in emphasis placed phenomenon has potentially damaging conse-
on psychosocial project KPIs, such as personal quences: there would be a focus by the project
growth of team members, between those directly manager on the task-oriented goals of the project
involved in projects on a day-to-day basis and at the expense of the psychosocial-oriented goals
those with an overseeing role above the project of project team members and of the goals of
manager and the team. These differences need to other projects being carried out in the organiza-
be recognized if Theory W project management tion. In terms of organizational performance,
(Boehm and Ross, 1989) is to be practised and problems with such a focus may not materialize
win-win situations created. However, in some in the short-term but may manifest themselves as
cases it might not be possible to meet psychosocial the organization looks to sustain performance
project KPIs, such as providing a career oppor- over longer timescales.
tunity or the opportunity for personal growth.
But even in these situations it is still necessary to
understand the expectations of the internal Suggestions for further work
stakeholder, in terms of their involvement in the
project, through the interaction between the In some areas of project management, work is
organization stakeholders and the internal stake- currently being carried out to develop normative
holders. Crucial to this alignment will be to models based on empirical research. One such
ensure that, whilst not being able to guarantee a initiative is that of Archibald and Voropaev
particular psychosocial-oriented outcome for the (2003), which is looking to achieve consensus and
stakeholder, there is a perception that their context within the international project manage-
psychosocial project KPIs were considered and ment community in both how projects ought to
treated in a fair and just manner. To maximize be categorized and how the stages of the life cycle
the likelihood of such a perception existing, the ought to be classified. The ultimate aim of such
interaction must start early in the project life an initiative is that categorization and classifica-
cycle and continue through subsequent stages. tion can contribute to our understanding of the
There needs to be a recognition in the variables influencing project success and to the
development of project management processes selection of appropriate methods for achieving
of the acceptance by stakeholders representing success. The exploratory work reported in this
the organization, such as project sponsors, that paper makes a contribution in terms of testing
12 D. J. Bryde

the validity of the multidimensional project KPI Baccarini, D. (1999). ‘The Logical Framework Method for
construct but further empirical study of how Defining Project Success’, Project Management Journal,
project success is defined and measured could 30(4), pp. 25–32.
Boehm, B. W. and R. Ross (1989). ‘Theory-W Software Project
make a similar contribution to that of the work Management: Principles and Examples’, IEEE Transactions
being carried out in the area of project categor- on Software Engineering, 15(7), pp. 902–916.
ization and life-cycle classification. Such a study Bourne, M., J. Mills, M. Wilcox, A. Neely and K. Platts (2000).
of project management practice in the area of ‘Designing, implementing and updating performance mea-
project success could lead to the establishment of surement systems’, International Journal of Operations &
Production Management, 20(7), pp. 754–771.
normative models, if appropriate for different Cleland, D. I. (1986). ‘Project Stakeholder Management’,
cultural, business, organization and project con- Project Management Journal, 17(4), pp. 36–44.
texts, which could be used by practitioners. Cooke-Davies, T. (2002). ‘The ‘‘real’’ success factors on
The exploratory study reported in this paper projects’, International Journal of Project Management,
has highlighted forces that could either facilitate 20(3), pp. 185–190.
De Toni, A. and S. Tonchia (2001). ‘Performance measurement
or restrain the meeting of psychosocial project systems: models, characteristics and measures’, International
KPIs. These include the development of imple- Journal of Operations & Production Management, 20(1/2),
mentation of top-level policies, organization-wide pp. 46–70.
training, integration with existing management Deutsch, M. S. (1991). ‘An Exploratory Analysis Relating the
processes and development of the project manage- Software Project Management Process to Project Success’,
IEEE Transactions on Engineering Management, 38(4),
ment system. Further work is needed to explore in pp. 365–375.
more detail which factors are important and how De Wit, A. (1988). ‘Measurement of Project Management
the factors interact with each other. The study has Success’, International Journal of Project Management, 6(3),
also brought to light the difficulty of developing pp. 164–170.
methods that reflect and attempt to reconcile the Dixon, J. R., A. J. Nanni and T. E. Vollman (1990). The New
Performance Challenge: Measuring Operations for World
complexities of the multidimensional and multi- Class Competition. Dow Jones-Irwin, Homewood IL.
observational character of the project success Epstein, M. J. and M. J. Roy (2001). ‘Sustainability in Action:
construct. In this respect the wider performance Identifying and Measuring the Key Performance Drivers’,
measurement literature has provided potentially Long Range Planning, 34, pp. 585–604.
useful theoretical frameworks to inform the Feurer, R. and K. Chaharbaghi (1995). ‘Performance measure-
ment in strategic change’, Benchmarking for Quality Manage-
establishment of models for measuring and mana-
ment & Technology, 2(2), pp. 64–83.
ging project performance: i.e. the use of Dixon et Freeman, M. and P. Beale (1992). ‘Measuring Project Success’,
al’s (1990) performance measurement questionnaire Project Management Journal, 23(1), pp. 8–17.
(PMQ), discussed in Ghalayini and Noble (1996); Firth, G. (1995). ‘Choosing the right structure for a project
procedurally just performance management systems, based organisation’, Seminar - Project Organisation, Project
Management ’95, London, March.
for example see Taylor, Renard and Tracy (1998);
Ghalayini, A. G. and J. S. Noble (1996). ‘The changing basis of
sustainability metrics, for example see Epstein and performance measurement’, International Journal of Opera-
Roy (2001); and the ‘balanced scorecard’ (BSC) tions & Production Management, 16(8), pp. 63–80.
approach, see Stewart (2001). Further work would Hauser, J. and G. Katz (1998). ‘Metrics: You Are What You
be useful to establish the extent to which such Measure!’, European Management Journal, 16(5), pp. 517–
528.
models reflect practice and to understand how they
Hlavacka, S., L. Bacharova, V. Rusnakova and R. Wagner
might contribute to achieving project success. (2001). ‘Performance implications of Porter’s generic strate-
gies in Slovak hospitals’, Journal of Management in
Medicine’, 15(1), pp. 44–66.
References Kald, M. and F. Nilsson (2000). ‘Performance Measurement At
Nordic Companies’, European Management Journal, 18(1),
Archibald, R. D. and V. Voropaev (2003). ‘Commonalities and pp. 113–127.
differences in project management around the world: a survey Kaplan, R. S. and D. P. Norton (1992). ‘The balanced
of project categories and life cycles’. 17th World Congress on scorecard - measures that drive performance’, Harvard
Project Management, Moscow, 4–6 June 2003. Business Review, 70(January–February), pp. 71–79.
APM (2000). Body of Knowledge, (4th edn). Association for Kerzner, H. (1989). ‘Systems Project Management: A Case
Project Management, High Wycombe. Study at The IRS’, Journal of Systems Management, 40(1),
Atkinson, R. (1999). ‘Project management: cost, time and pp. 7–9.
quality, two best guesses and a phenomenon, its time to Larson, E. W. and D. H. Gobeli (1989). ‘Significance of Project
accept other success criteria’, International Journal of Project Management Structure on Development Success’, IEEE
Management, 17(6), pp. 337–343. Transactions on Engineering Management, 36(2), pp. 119–125.
Managing Different Perspectives of Project Success 13

Mallak, L. A., G. R. Patzak and H. A. Kursted, Jnr (1991). Stewart, W. E. (2001). ‘Balanced Scorecard for Projects’,
‘Satisfying Stakeholders for Successful Project Management’, Project Management Journal, 32(1), pp. 38–53.
Computer Industrial Engineering, 21(1–4), pp. 429–433. Taylor, B. and C. Graham (1992). ‘Information For Strategic
Might, R. J. and W. A. Fisher (1985). ‘The role of structural Management’, Management Accounting, January, pp. 52–54.
factors in determining project management success’, IEEE Taylor, M. S., M. K. Renard and K. B. Tracy (1998).
Transactions on Engineering Management, 32(2), pp. 71–77. ‘Manager’s reactions to procedurally just performance
Nicholas, J. M. (1989). ‘Successful Project Management: A management systems’, Academy of Management Journal,
Force-Field Analysis’, Journal of Systems Management, 41(5), pp. 568–579.
40(1), pp. 24–30, 36. Tukel, O. I. and W. O. Rom (2001). ‘An empirical investigation
Pinto, M. B. and J. K. Pinto (1991). ‘Determinants of Cross- of project evaluation criteria’, International Journal of
Functional Cooperation in the Project Implementation Operations and Production Management, 21(3), pp. 400–416.
Process’, Project Management Journal, 20(4), pp. 13–20. Tuman, J. (1993). Models for Achieving Success through Team-
Pinto, J. K. and J. E. Prescott (1990). ‘Planning and Tactical building and Stakeholder Management (ed. P. G. Dinsmore),
Factors in the Project Implementation Process’, Journal of pp. 207–223. AMACOM, USA.
Management Studies, 3, pp. 305–327. Walters, M. (1999). ‘Performance measurement systems – a case
Pinto, J. K. and D. P. Slevin (1987). ‘Critical Factors in study of customer satisfaction’, Facilities, 17(3/4), pp. 97–104.
Successful Project Implementation’, IEEE Transactions on Walton, E. J. and S. Dawson (2001). ‘Managers’ Perceptions of
Engineering Management, 34(1), pp. 22–27. Criteria of Organizational Effectiveness’, Journal of Manage-
Pinto, J. K. and D. P. Slevin (1989). ‘Critical Success Factors in ment Studies, 38(2), pp. 173–199.
R&D Projects’, Research Technology Management, Jan–Feb, Wateridge, J. (1995). ‘IT projects: a basis for success’, Interna-
pp. 31–35. tional Journal of Project Management, 13(3), pp. 169–172.
Shenhar, A. J., O. Levy and D. Dvir (1997). ‘Mapping the Wateridge, J. (1998). ‘How can IS/IT projects be measured for
Dimensions of Project Success’, International Journal of success?’, International Journal of Project Management, 16(1),
Project Management, 28(2), pp. 5–13. pp. 59–63.

David Bryde is currently senior lecturer in operations management at Liverpool John Moores
University. He is an experienced researcher and teacher at executive, masters and undergraduate
level and has published his research in various journals. Prior to joining Liverpool JMU he
worked for Metier Management Systems, suppliers of Artemis project management software.
After leaving Metier the author joined ICI, working as a project manager in a group specialising
in IT related and infrastructure projects.

You might also like