Professional Documents
Culture Documents
167184
doi:10.1111/j.1467-8500.2011.00718.x
Australian Journal of Public Administration C 2011 National Council of the Institute of Public Administration Australia
168
June 2011
16
172
of BSC in varying circumstances and differing firm types. For example, Robinson
et al. (2005) found that construction engineering organisations reported significant
chal- lenges in the implementation of the BSC
in terms of planning, deployment and
assessment and review stages which includes
the
motivation
for
performance
management, leadership and resources,
communication mechanisms, measurement
and data collection techniques and the role of
knowledge
management.
This
was
corroborated by Othman et al. (2006) who
found that there are likely to be problems in
implementation when a top down approach is
used, particularly if there is a lack of buy-in
and understanding at the lower levels, and a
lack of employee motivation as the scorecard
may not address human relations norms (see
also Johanson et al. 2006:846). A number of
studies show that there is not a one size fits
all appli- cation of the BSC. In relation to
public sector organisations, Johanson et al.
(2006:847) as- sert that a prescribed BSC may
culminate in a dysfunctional central planning
system that fails to stimulate learning.
Tennant and Tanoren (2005) found that size
may also be a factor as the use of the BSC
by SMEs is very low compared to its wider
adoption in larger com- panies.
Moreover, as briefly referred to in the introduction to this article, there are significant
challenges in transposing the BSC principles
to public sector organisations, which give rise
to the need for adjustments in both BSC design and implementation (Kaplan 2001; Niven
2002; Wisniewski and Stewart 2004; Adcroft
and Willis 2005; Greatbanks and Tapp 2007).
Kaplan (2001) articulates the difficulty that
nonprofit organisations have in clearly
defining their strategy as there is often a focus
on achiev- ing lists of programs and
initiatives rather than strategic outcomes.
Niven (2002) suggests that the main
challenges include issues relating to
difficulties in measuring outcomes rather than
outputs, the tendency to use poor results as
punitive measures, and the failure to determine the true mission of any organisational
unit. Other challenges include a culture of not
trusting business solutions, a lack of staff
June 2011
17
Figure 1. The Three Perspectives of Public Sector Agencies for Financial/Customer Objectives
Mission
Value/benefit of service
Internal processes
The main problems associated with implementation of the BSC system in public
organi- sations as identified by previous
studies involve difficulties in cascading of
scorecard mea- sures and issues of leadership
(Umashev and Willett 2008); employee
motivational schemes and training in
performance management tech- niques (Kloot
and Martin 2000); and organisa- tional factors
such as top management com- mitment,
information
systems
related
issues
(Cavalluzzo and Ittner 2004). However there
173
174
a number of standardised
LGA and open ended
questions. This indirect but non-threatening
approach was designed to allow for greater
depth of responses and to elicit or tease out
the real opinions of the managers, who may
have otherwise not been comfortable in providing answers concerning some of the more
sensitive
issues.
Consequently
the
respondents were guided by but not
necessarily limited to the structure of the
questions themselves.
The schedule of interview questions commenced with some background questions
con- cerning the role and scope of the
managers division or program and the
period of time for which it had been
monitoring performance. This was followed
by some questions on how and what types of
processes were used by the manager in
putting the system into place; how, by whom
and for whom the performance in- dicators
(PIs) were developed; and how and where
the data are collected and outcomes are
communicated. These questions were devised to elicit responses on how the system
works. Next, an open ended question was
asked to determine the major components of
June 2011
the performance monitoring system. This was
followed by questions on how and why the
system works at the strategic, tactical and operational levels and examples of how this is
accomplished. Respondents were then asked
questions on whether the system worked
overall and the problems and the challenges it
posed.
In relation to the main issues involved in
establishing and implementing the balanced
scorecard, the interview schedule elicited responses in terms of planning (theme 1),
deployment, assessment and review (theme
2), leadership and motivation (theme 3),
commu- nication mechanisms (theme 4),
measurement, data collection techniques, and
the role of knowledge management, including
how many metrics were used and whether
these were man- ageable (theme 5). This was
followed by ques- tions on the nature of
employee reward sys- tem and incentives (if
any) (theme 6). Next were questions designed
to
elicit
responses on whether their
experience was transferable to other internal
public sector divisions and business units
(theme 7). Finally a series of questions were
posed to probe critical issues
Customer
MeasuresA
Satisfied
Community/Effective Program Outcomes/
Customer Service;
vironment or system;
providing decision-makers with no
alter- native but a focus on outcomes for
the community rather than the soft option
of outputs;
linking outputs to outcomes in a
meaningful way;
creating joint accountabilities across
de- partments and divisions; and
addressing
the
growing
sustainability
agenda which is a demand generated by
both the community and elected
represen- tatives of government.
In determining whether this approach has
been successful, a summary of the main
findings relating to each of the seven main
themes is presented in the following section.
Findings
In relation to the introductory questions concerning the major components of the performance monitoring system, most managers of
programs and divisions stated that they were
us- ing a Planning and Performance System
(PPS)
the restrictions placed on monetary rewards within this regulated public sector
system.
However, some managers thought that
the incentive and reward systems may
have sometimes focused more on
sanctions and punishment rather than
more positive as- pects. For example,
some managers ob- served that although
there was merit in the incentive and
reward system, in many cases people
get punished if numbers are bad.
7. In relation to theme seven as to
whether this experience is transferable
to other internal public sector divisions
and business units, managers views
were consistent in showing a high
degree of involvement of other internal
(other programs and divisions) and
external
players
(eg,
communities/government de- partments)
when their particular pro- grams
formulated KPIs for the BSC as
reflected in the following comments:
Yes, we try to influence associated entities through financial partnerships and
economic forecasting, which are evidence
based; We are trying to develop metrics and convince other related agencies.
We also run random workshops on aspects of cognitive edge which has a set
of methodology for stakeholders; All
our work involves internal and external
stake- holders through negotiation; It
is not just about formulating but about
finding out what their (other public sector
units) re- sponsibilities are. KPIs on their
own do not have much impact; Service
Level Agree- ments (SLAs) and other
ongoing commu- nications are made with
other public sector units involving the
community, politicians, and the State
Government.
18
1
182
June 2011
184
June 2011
18
Strategies
Program Outcomes (eg, sustainable water use)
O
Financial
This is a process of tracking the problem in a matrix of BSC components and strategies adopted in
each BSC perspective.
Outputs
O1
O2
O3
O5
For each output, the measures are developed, and by considering the vital few outputs that have
a big influence in the outcome, a much-simplified relationship between outputs and outcome is
identified.
Copyright of Australian Journal of Public Administration is the property of Wiley-Blackwell and its content
may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express
written permission. However, users may print, download, or email articles for individual use.