Professional Documents
Culture Documents
www.emeraldinsight.com/0968-4883.htm
On quality
On quality in education in education
Geoffrey D. Doherty
University of Wolverhampton, Wolverhampton, UK
255
Abstract
Purpose – The purpose of this paper is to discuss some key aspects of quality in education in the Received 10 January 2008
light of over 30 years practical experience of doing quality assurance (QA). Revised March 2008
Design/methodology/approach – Reflection on three concepts, which are still the subject of Accepted March 2008
debate, namely: “quality”; “total quality management (TQM)”; and “autonomy”.
Findings – As this is not a research paper, it presents no findings. There are some research
implications, if only to deter researchers from digging up old ground. More research into the diversity
of and interactions between cultures in academia might prove useful.
Practical implications – There are lessons to be learnt from the past. Doing quality improves
quality. Talking about it or trying to impose it does not. Managers and leaders need to reflect more
carefully than is their wont on the purposes and procedures of QA in education.
Originality/value – This paper makes a contribution to the debate about quality in education in
universities and schools and suggests that a clearer understanding across the education system of the
scope and purpose of QA, the nature of TQM and the limitations of autonomy might lead to better
embedded and more effective continuous improvement.
Keywords Education, Quality assurance, Total quality management, Quality indicators
Paper type Viewpoint
Introduction
The quality debate still rages on in academia. What a good thing this is for the quality
business in general, which nowadays provides quite a decent living for a not
inconsiderable cadre of administrators, academics and experts, and in particular for
journals like this, which has been kept in business for over 15 years. I use the language of
the market place deliberately because this highlights one of the main bones of contention.
The quality assurance (QA) methods currently used in education demonstrably derive
from industrial applications. To many academics, this is an anathema.
I would like to offer a few reflections on this debate, in which I first became
consciously involved about 30 years ago. Before I retired, I made some contributions to
this journal. For instance, I was its first guest editor – for a volume focussed on
assessment, quality and continuous improvement in higher education (HE) (QAE,
1997) and elsewhere. This is almost certainly the last paper I shall ever write and I want
to make it clear that that it is not research based. I am primarily concerned to attempt
some clarifications of contested issues and to make some suggestions as to why so
many academics are pathologically averse to what, in my opinion, they incorrectly
perceive QA to be.
What are my credentials for this exercise? I first became actively involved in quality
matters, on the one hand, as a member of several Council for National Academic
Quality Assurance in Education
Awards (CNAA) committees and working parties – the education committee; the files Vol. 16 No. 3, 2008
pp. 255-265
q Emerald Group Publishing Limited
The paper is a reflection of his long association with the quality movement in education by the 0968-4883
author, a member of the journal’s editorial board. DOI 10.1108/09684880810886268
QAE on institutions committee; and a little known but fascinating think-tank convened by
16,3 Edwin Kerr (the Chief Officer) himself, focussed on further developments in HE. On the
other, I was a curriculum developer (Assistant Director for Academic Affairs,
Crewe þ Alsager College of Higher Education) and Chair of numerous CNAA
validating panels for education and the humanities. Subsequently, I led the University
of Wolverhampton’s successful bid for British Standards (BS) 9001 registration and
256 later became a subject review leader and reports editor for the Quality Assurance
Agency (QAA). I was also a member of the British Institute of Quality Assurance’s
working party producing the UK’s contribution to the development of International
Standards Organisation (ISO) 9000. I did not become involved with QA systems purely
for the money but because, naively perhaps, I thought firstly that quality systems in
general and secondly the QAA in particular, had something positive to offer to
academia and to the educational experiences of students.
As already stated, this is not a research paper: I am neither reporting on research
nor trying to prove anything. I shall break a few “rules” – for instance, I shall not
weigh it down with references, so there may be a few unevidenced assertions and the
occasional anecdote. There will be no statistics, though I may comment on the validity
of some statistical evidence and I shall lay few offerings on the shrine of quality theory.
However, I shall structure the paper round three frequently asked, non-research
questions (NRQ), namely:
NRQ1. What do you mean by quality?
NRQ2. What do you mean by total quality management (TQM)?
NRQ3. What do you mean by autonomy?
Nevertheless, they have been accepted by-and-large with delight by the national
press, such as The Times Higher Education for universities and colleges and The
260 Daily and Sunday Times Newspapers and The Daily and Sunday Telegraph
Newspapers for schools. This is presumably because they are on the one hand an
easy means of giving academics and teachers a bit of stick and on the other an
equally easy means of scoring anti-government points when institutions are failing
to deliver government targets. Governments, on the other hand, like them because
they are a means of exerting pressure on the system to deliver educational (or other,
e.g. National Health Service) policy decisions: they are a means of coercion. A
change of government would not lead to the abandonment of data-based league
tables: merely a change of emphasis. A Tory Government, for instance, might well
use social mobility data to support a change of policy to re-introduce selective
education. However, this begs the question of whether league tables are either a
satisfactory or valid measure of what students and parents perceive to be quality.
For instance, as far as schools are concerned they are palpably not so, for many
schools nowhere near the top of the league tables, particularly the CVA tables,
remain oversubscribed and I have yet to see any evidence that the only reason why
a potential student applies for a university is its league-table position. Although I
have no valid evidence, I suspect that the continued maintenance of what is
perceived as quality education in schools and universities, by students and parents
at least, depends far more on the efforts of some enlightened leaders and
practitioners than on coercion from external agencies, which generally leads to
superficial and unwilling compliance or even worse, teaching to targets.
In fairness, that quality is more than numerically-calculated outcomes was at least
recognised by the QAA in its subject review methodology in that those elements
of review dealing with curriculum content, student numbers and attainment were
regarded as related to standards, while those related to resources, student progression
and student support were regarded as quality of student experience. Even Ofsted uses a
wide range of evidence other than numerical performance indicators in arriving at its
conclusions about a school, though there is plenty of evidence that they give such data
undue weighting.
Quality, then, remains elusive, since what any individual regards as quality will
always be a subjective judgement. QA, however, is something organisations do:
a methodology for judging the degree to which macro and micro organisational aims,
objectives and outcomes have been achieved. Quite frankly, it is a management tool,
which can make an effective contribution to improving performance at the institutional
level or at a subject or departmental level within an institution. In itself, it will not
make management better or worse. The methodology may be used for negative or
positive purposes. Even unreliable instruments like “Comparative” (or “Contextual”)
value-added can be an effective tool within an institution, but attempts to make
comparisons between institutions for the purposes of coercion, league tables or funding,
need to be strongly resisted.
What do you mean by total quality management? On quality
Despite the fact that there is an enormous volume of published books and journal in education
articles on this subject ranging from the gurus of the early 1980s (Crosby, Deming.
Jurran, Ishikawa, Tagguchi, Peters and Watermen et al.) to contemporary six sigma
methodology it is still frequently misrepresented, misunderstood, or both, by many
academics. I think it was Edward Deming, who commented that he preferred the idea of
continuous improvement to TQM, because everyone understands what that means. 261
This may be so, but as a quality system, TQM implies something much more
fundamental than continuous improvement. It is a holistic management system
requiring the development of a system-wide culture. In a TQM culture, everyone,
whatever his/her role, task or position in the organisational hierarchy (and there is a
hierarchy in collegial organisations) is responsible for the management of his/her
contribution to the whole (hence “total”). Tribus (1994) wrote one of the best
introductions I know to TQM in education the early 1990s. In it, he makes clear that
philosophy and vision are as important as skills and resources and that managing a
school, college or university in which the product is learning, is not the same as
managing a factory. Developing TQM in education requires some intellectual effort and
lateral thinking, and not facile misapplication of business vocabulary and techniques.
Being person focussed, TQM aims are easily misrepresented (sentimental approach
to “empowerment of the people”) or degraded (political use as a “management tool for
exploiting the workers”). TQM principles (one of which is that quality cannot be
inspected in) underpin most contemporary quality systems: e.g. ISO 9000 series
(developed from the old British Standards Institute BS 5750 series); the requirements of
the Baldridge Award; the British Quality Foundation Model (BQFM); and The
European Foundation for Quality Management Model (EFQM) for excellence. Of these,
only ISO 9000 series is, as was BS 5750, a documented quality system for which an
institution requires registration to achieve the coveted “kite” mark – the logo, in the
shape of a kite, of the British Standards Institute. To put this in perspective, a business
friend of mine, when the University of Wolverhampton had achieved the kite mark,
said to me, “Well, that’s it then, you no longer have to waste time on government
inspections.” In order to retain the kite mark, annual audit by approved, professional
auditors is required. The others offer annual awards in various categories, of which
education is one. There are regular school winners of BQFM and EFQM awards, which
are based on self-evaluation and peer-group assessment. Nowadays, the EFQM also
offers registration to the model at different levels of “readiness”, in order to encourage
organisations to commit to continuous improvement. In the world of business,
commerce and service industries outside education, these are immensely prestigious
awards. A list of winners is a role call of internationally famous companies.
A Baldridge, BQFM or EFQM winner, is a “world class” organisation. Pretty well
everyone outside education in the UK, or anywhere else, knows this means that not
only has quality been rigorously assured but also that it is outstanding among its
peers. This is what my friend’s above remark implied.
In the UK, of course, education is subject to review or inspection by either the QAA, for
HE or Ofsted for schools. Both have been influenced by TQM. For instance, the QAA in its
current Institutional Audit looks across the institution at such elements as student
experience, progression and support, support staff, financial management, resources,
“ethos” and systems for the QA of both: the institution and its collaborators as well as
QAE academic achievement. Some years ago Lloyds TSB (2003, foreword) sponsored the
16,3 application of the EFQM to schools. They produced an excellent guide to self-assessment
in the foreword to which Charles Clarke, the then Minister of State for Education wrote:
Rigorous self-assessment lies at the heart of well-managed and successful organisations. The
EFQM Excellence Model, on which the Quality in education tool is based, is widely used
throughout both public and private sectors and as a proven track record supporting
262 continuous improvement.
He later comments that it is used within the department and its influence can certainly be
seen in the latest Ofsted methodology. However, the crucial difference between EFQM
and either QAA or Ofsted, is that there are no “inspectors”, only external “peer” review
and that only if an institution is putting itself up for an award or registration. The
“excellence model” cannot be effectively imposed from the top-down: it has to be
achieved and it can only be achieved through the commitment of the whole organisation.
The EFQM emphasises leadership (rather than management), people, processes,
results and the importance of innovation and learning – all key quality characteristics
in educational organisations. A basic tool in either TQM systems in general or EFQM
in particular, is Deming’s continuous improvement cycle. This is modified in
BQFM/EQFM methodology to the RADAR cycle. Both these are versions of what
every teacher is introduced to as lesson evaluation – refer Figures 1-3.
Since the underpinning intentions of all three approaches to continuous
improvement are shared by educators, one might think that academics and
school-teachers would be reasonably well disposed to adopting the approach: they
should be already be using it as part of their everyday teaching (and research). I have
met very few colleagues who reject the concept of evaluation as generally a good thing,
but there seems to be a barrier to extending that perception to their performance within
an institution, or between institutions for that matter. In this respect, things do not
seem to have changed very much since 1993 (Matthews, 1993):
Figure 1.
The deming cycle
Figure 2.
The EQFM RADAR cycle
Figure 3.
The teacher education
cycle
The concepts of quality and excellence are viewed as highly laudable provided they are On quality
applied to others (a variation of the “not in my backyard” philosophy).
in education
A generation on, academics are still obsessed by autonomy.
Corresponding author
Geoffrey D. Doherty can be contacted at: geoffrey.doherty@btinternet.com