You are on page 1of 8

Curriculum Renewal and Examination Reform: a Case Study from

Malaysia

Keith Lewin
This paper is concerned with inter-relationships The general approach to science education pro-
between qualitative improvements in curricula moted by this course can best be indicated
and patterns of public examination. Through con- through some exemplary quotes taken from
sideration of a particular examplethe develop- material recommended to Malaysian teachers:
ment and implementation of the Malaysian it is suggested that the 'didactic' method should
Integrated Science course (MIS)it argues the be minim ised and the 'heuristic' method utilised
case for: wherever possible. [MIS 1973]
1 developing techniques of assessment and in order ro achieve the objectives it is essential
examination which correspond systematically with that discovery methods should be used, involv-
the educational objectives of new curricula; ing pupils in carrying out as much practical
2 close monitoring of the workings of selection work as possible. They must be active partici-
examinations and their effects on the curriculum; pators, not passive receptors. [Mee et al 19711
3 detailed and substantive feedback of examina- The very process of discovering appears to us to
tion performance to teachers and pupils. be as important as the knowledge discovered.
[Scottish Education Dept 1969]
Though the data on which this article is based Pupils [should be provided] with examples of
derive from fieldwork in Malaysia, many of the scientific methods so that with sufficient practice
problems highlighted have their parallels in other they may eventually use them in new situations
countries. I leave it to the reader to decide without the support of imposed worksheets.
whether differences in contexts they are familiar [Scottish Education Dept 1969]
with are sufficiently significant to warrant
modifying my conclusions. Course aims' include nine in the cognitive
domain (intellectual skills) of which two relate to
The Malaysian Integrated Science Course the acquisition of knowledge, two to communica-
Like many other science courses in the Asian tion skills and five to comprehension, application,
region introduced in the late 1960s and early analysis and higher level behaviours. In addition
1 970s, MIS is modelled fairly closely on materials six affective aims (attitudinal) are specified along
and methods designed initially for the schools of with two which are primarily concerned with
a developed country. Scottish Integrated Science psychomotor skills (physical coordination and
provided the model for MIS and, though some manipulation).
adaptation took place, the bulk of the course
material and recommended teaching strategies In intention, the programme's emphasis is clear.
remained unchanged. Indeed, MIS materials refer Science is not to be approached as a repository
teachers to the Scottish Integrated Science publi- of factual infonnation to be memorised but
cations for further advice and guidance. through an exploration of the world of experi-
ence. Active involvement of pupils in identifying,
The MIS programme was first introduced in observing and analysing phenomena is central to
Malaysia in 1969 and by 1975 was being taught the teaching strategy and pupils are expected to
in almost all lower secondary schools (grades develop intellectual skills associated with problem
7-9) as the standard programme The course is solving, hypothesising, experimental design and
based on a series of worksheets for pupils to use interpreting results. Attitudinal outcomes are to
in carrying out classroom activities, which are be given considerable emphasis (eg interest and
supplemented by help from teachers. Pupil text- enjoyment in scientific activities, awareness of
books have been widely available since 1973. social and economic implications of scientific
These follow closely the pattern of the work- activity).
sheets but include additional information and
explanation. 1 These are stated in the Syllabus document. [MIS 19731

34 Bulletin. 1980, vol. 11 no. 2, Institute of Development Studies, Sussex


MIS and Public Examinations intended emphases of the MIS programme. The
The public examination associated with the MIS classification system used is that of Bloom [1971],
course is known as the LCE/SRP.2 It is a selec- referred to in course materials.
tive examination: performance in it decides
whether pupils will be offered a place to proceed
to grades 10 and Il and take the MCE/SPM3 Over half the items used were classified as testing
(approximately equivalent to 'O' level in the achievement at the knowledge level (je they were
English system). For Integrated Science this questions answerable from recall of information
examination takes the form of a 75 item, multiple alone). Though some items are related to experi-
choice, objectively scored paper with five possible ments performed by pupils there is no provision
responses to each question. Though this was for any practical examination. Few questions used
introduced as a new examination relating required the application of knowledge and none
specifically to MIS, its form paralleled previous was directed towards measuring affective out-
practice. Objective, multiple choice papers were comes. Given the intended stress in the pro-
introduced for most subjects after 1967, includ- gramme on higher cognitive and attitudinal out-
ing science. Question content was modified to comes and the deliberate playing down of the
reflect new teaching material in MIS. importance of factual information, the distribu-
tion of item types appears anachronistic.
Original Scottish materials emphasise that
any examinations set should be such that this It is relatively easy to explain why the format
syllabus is taught as it ought to be; tests chosen for the LCE/SRP Integrated Science was
should be constructed to examine practical an objective multiple choice examination. Other
techniques, design of experiments and ability subjects had adapted this pattern of testing in
to solve problem situations either by ex peri- Malaysia and original Scottish materials appeared
mentation or by describing the experiment in to advocate it [Scottish Education Dept 1969]
words. When written answers are required they (though Scottish Integrated Science was not
should not be long essays about remembered designed to lead to a public examination). In
details; instead, questions of the multiple choice addition, the Malaysian Examinations Syndicate's
and one word answer type should be used. need to measure the achievement of large
[Scottish Education Dept 1969] numbers of pupils for selection purposes weighed
heavily in favour of examining methods that
Malaysian materials endorse this and further would allow large scale mechanisation of the pro-
stress that 'testing should be done only to assess cessing of scripts. A practical examination was
whether the stated objectives have been achieved' never considered a possibility because of its costs
[MIS 1973]. and administrative problems.
Table I
Classification of items in the LCE/SRP Integrated Science 1972-75'

classification no % no % no no %
1972 1973 1974 1975

Knowledge 46 61 45 60 38 51 38 51
Comprehension 23 31 23 31 25 33 24 32
Application and Higher 6 8 7 9 12 16 13 17
Affective o o o o o o o o

This overall classification was the result of combining the classificatory judgements of four independent,
experienced educationists familiar with the course.
Analysis of examination papers between 1972 and It is more difficult to explain why the papers
1975 provides some insight into the extent to designed did not more closely reflect the inten-
which behaviours actually tested reflect the tions of course designers and stress non-recall
based achievement. In some respects, eg in
experimental design, problem solving techniques,
2 Lower Certificate of Education/Sijil Rendah Pelajaranthe application of scientific knowledge, there seem
English medium qualification has been phased out since no compelling reasons for the lack of emphasis
this study was undertaken.
3 Malaysian Certificate of Education/Sijil Pelajaran Malaysia. on related questions in the public examination. In

35
other respects, eg in relation to affective out- Some Effects of Public Examinations on MIS
comes, it is more plausible that problems related The precise causes of continued emphasis in
to the construction of appropriate questions can public examination papers on the recall of infor-
provide an explanation. mation, despite explicit changes in the rationale
behind the course to which they relate, are not
Part of the conventional wisdom amongst some easy to unravel. What is perhaps clearer is the
Malaysian examiners with whom the course was consequences of such an emphasis on the MIS
discussed appeared to be that knowledge level curriculum in action. The LCE/SRP is crucial in
items were easier to construct and validate than the allocation of life chances for Malaysian
those measuring higher level cognitive skills. This pupils; it is the first selection point in the educa-
is not a sufficient reason to justify dispropor- tion system which limits progression to the next
tionate emphasis on the former. Items designed to level. Pupils who fail the LCE/SRP are unlikely
operate above the knowledge level may be more subsequently to obtain wage or salary employ-
difficult for examinees, but not necessarily so- ment and will almost certainly find occupational
facility values (ie proportion of candidates pro- niches in the 'traditional' sector of the economy.
ducing correct responses) for the 1975 LCE/SRP
items clearly show this.
Understandably the pupils' anxiety about passing
Table 2
the LCE/SRP is highover 60 per cent of a
sample of approximately 2,000 grade 8 and 9
Analysis of 1975 LCE/SRP pupils expressed worry about failing the LCE/
SRP; about 75 per cent indicated that they would
item mean range of facility try and resit if they did fail; 75 per cent claimed
classification facility values that they practised objective tests in order to
Knowledge 0.503 0.18-0.74 improve their examination performance and
Comprehension 0.487 0.29-0.86 nearly 40 per cent indicated that the main reason
Application and higher 0.429 0.24-0.61 they studied science was to pass the LCE/SRP.4
These observations, coupled with a recognition
that it is easily possible to pass LCE/SRP science
on the basis of the recall of information alone,5
The most difficult question, with only 18 per cent suggest that the pattern of examining is likely to
achieving a correct response, was a knowledge have adverse effects on teaching and learning
item [see also Little 1978]. related to MIS.
Common practice within the Malaysian examina-
tion syndicate is to involve groups of teachers and In the research on which this article is based,
curriculum specialists in the design and develop- teachers of MIS from 54 schools in the West
ment of question papers within guidelines provided Malaysian states of Selangor and Kelantan were
by 'Tables of Specifications'. Guidelines relating asked to comment in a free response question-
to MIS specify that approximately 40 per cent of naire on the form and effects of the LCE/SRP
items (30/75) should be constructed to test know- examination. The number of teachers responding
ledge. This figure seems to have been constantly to this invitation was 105, and the main remarks
exceeded. Conservatism on the part of teacher made are summarised below. Bracketed figures
members of question setting teams may be partly refer to actual numbers of teachers making
responsible (if the majority of them adhere to a substantively similar remarks; where these
view of science education as primarily the numbers were small such remarks have been
acquisition of factual information). Pressure on omitted from this table.
time and limited expertise may also be factors
inhibiting a more balanced development of
papers that more accurately reflect the learning 4 Figures here relate to responses to a pupil questionnaire
emphases of MIS. The fact that examination used with a representative sample of 2,076 pupils drawn
almost entirely from grades 8 and 9 in schools distributed
papers were not routinely available to curriculum throughout the West Malaysian states of Selangor and
workers as late as 1975 suggests that communi- Kelantan. The response rate for the questionnaire was over
86 per cent.
cation between them and examination setters was 5 Historically, pass marks in science fluctuate around 30/75.
not as effective as it might have been. Some With over half the questions answerable from recall alone,
genuine misunderstandings may have contributed it is relatively easy to pass without answering other types
of questions successfully. More evidence of the widespread
to the apparent mismatch between curricula perception that LCE/SRP examinations primarily test recall
intentions and their formal assessment. ability, is provided later in this paper.

36
Table 3 of recognition and recall (three responses);
Free response remarks made by teachers relating increased the bad effects of examination orienta-
to the LCE/SRP examination tion since weaker students especially perceived
performance to be related closely to practice and
memory (seven responses). Several teachers
Summary % of total referred to a common belief amongst pupils that
comments comments
21
objective tests were 'easier' than other types and
Expression! understanding therefore required less work and more luck in
1) Objective questions inhibit expressive (10)
ability
their completion. This, they asserted, had
ii) Pupils can do well with little under- (10) adverse motivational results particularly amongst
standing
the less able. Some (three) teachers went as far
as to suggest that considerable proportions of
students relied heavily on books of objective test
Motivation questions for examination practice and neglected
1) Pupils are only interest in studying the course itself almost entirely.
for the examination
Pupils need only recognise answers A few teachers stated that they had had no train-
and concentrate on memorisation ing in writing multiple choice items and were
Pupils rely on practising objective therefore forced to rely on books of questions as
tests for revision a source for their own internal tests. Most
Pupils guess objective tests and do not teachers who commented on writing tests did this
study for them as a matter of convenience in any case. One
teacher pointed out that time constraints and
Effects on teachers 14 workload compelled him to use objective tests,
i) Teachers concentrate on facts and (10) though he did not think they were the best instru-
discard discovery methods ments available. Those teachers who attempted to
justify their use of objective items did so by citing
Nature of examination questions 30 the format of the LCE/SRP examination and the
Few questions relate to practical work (10) course recommendations.
and it is therefore undervalued
Concentration on factual knowledge (7) Though two teachers expressed the opinion that
restricts teaching and learning practical work was useful indirectly in enhan-
Other forms of questions apart from (5) cing LCE/SRP performance through helping
multiple choice should be used students remember facts and processes, a larger
number (six) said explicitly that they felt
General 6 practicals had little effect on examination results
i) Examination system is satisfactory (4) in the present LCE/SRP. About a quarter of the
teachers interviewed referred unprompted to
examination orientation dominating teaching in
Few teachers responding had positive remarks to their schools saying for example that 'teachers
make concerning the effects of the LCE/SRP on only teach for examinations'; 'the headmaster,
the teaching of MIS. Teachers might reasonably parents and pupils are only interested in examina-
be expected to voice dissatisfaction rather than tion results'; 'good teachers are those who give
satisfaction in response to an open question, good notes for examination revision'. One
since those who are dissatisfied may feel more teacher pithily observed: 'the purpose of the
motivated to write comments. That only four Integrated Science course is to develop the ability
teachers did indicate general satisfaction does to observe and reason, the purpose of the school
suggest that there is widespread and genuine con- is to get as many examination passes as possible'.
cern with the adverse effects of the LCE/SRP.
Another way in which the format adooted for
Information from semi-structured interviews the LCE/SRP seems to have influenced classroom
with 43 teachers in 15 of the 54 schools followed teaching is in relation to methods of internal
a similar pattern to the questionnaire responses. school assessment. Despite the largely unfavour-
Objective tests were the subject of much able percertion of the educational consequences
criticism, the most common assertions being that of restricting assessment to the use of objective
they discouraged the development of powers of multiple choice tests, this is in fact what the bulk
expression and language fluency (six responses); of teachers do according to their questionnaire
discouraged understanding by rewarding powers responses and interview data.

37
Table 4
Test types by frequency of use (%)'
type frequency of use
not used less than 1-all
of tests of tests of tests tests

Structured 18 35 35 9 2
Short answer 30 31 25 10 4
Essay 58 32 5 3 2
Multiple choice 10 7 12 22 49
Practical 66 27 5 1 1

Total number of teachers responding = 242, total number of teachers in sample 291, response rate = 83%

Significantly, very few utilise forms of practical memorisation does appear to contradict the inten-
testing though this is the only kind explicitly tion of the MIS course to provide a 'much
recommended in addition to multiple choice reduced emphasis on the retention of the factual
objective questions in Malaysian course materials. content of the syllabus'.
Moreover, other questionnaire data indicate that
the majority of teachers rely on published books
of multiple choice items (usually derived from Table 5
previous LCE/SRP question papers) in construct- Pupil response to survey questions
ing their tests and that most use questions to test question:
knowledge of scientific facts and principles rather I like objective questions because they are easier
than their application. Teachers' opinions of the to answer than essay questions:
purposes served by internal testing give overall no % %
priority to measuring the achievement of pupils strongly agree 755 36.4
(52 per cent ranked this first) and providing a agree 744 35.8 722
motivation for pupils to study (21 per cent ranked undecided 316 15.2 15.2
this first). Only 17 per cent ranked measuring disagree 153 7.4
how effective their teaching had been as a strongly disagree 86 4.1 115
primary purpose though this seems to be the omissions 22 1.0 1.0
recommendation in course materials [MIS 1973,
Scottish Education Dept 1969]. 2,076 99.9 99.9
Pupils' attitudes to learning do seem strongly question:
influenced by the LCE/SRP examination. In To do well on objective questions all you need is
addition to the levels of concern with success, the a good memory:
numbers of pupils practising objective tests and no % %
the large numbers asserting that they only studied strongly agree 497 23.9
agree 687 33.1 570
science to pass the LCE/SRP noted above, it is
clear that pupils perceive multiple choice objec- undecided 369 17.8 17.8
tive questions as easier than essay questions disagree 376 18.1
strongly disagree 125 6.0 241
that involve expression. They also see such
questions as being primarily dependent on recall omissions 22 1.0 1.0
for their successful completion. Two question-
naire responses from the pupil survey cited above 2,076 99.9 99.9
indicate this.
Moreover, 'having a good memory' and 'practis- A large majority of pupils apparently do feel that
ing examination questions' were ranked third and 'there are too many facts to remember in
fourth in importance by pupils as factors contri- Integrated Science'about 62 per cent of the
buting to performance on science examinations sample agreed with this statement. Morçover it is
('working hard' and 'having good teachers' were disproportionately the less able who feel this. (Of
ranked first and second). Pupils attached more those getting the top three LCE/SRP grades, 40
importance to memory and examination practice per cent agreed with this, and over 70 per cent
than did teachers. Such stress on the value of of those getting the bottom three grades. The
38
question was asked before the examination was The observed pattern of teaching described very
taken.) Thus the perception is strong amongst briefly here is not inconsistent with an interpre-
pupils that science education is concerned very tation which holds that the lack of emphasis on
much with the acquisition of factual information. practical work and related skills is at least partly
attributable to patterns of examining. Insofar as
Data from the observation of 40 normal class these encourage the acquisition of factual know-
periods in 15 of the schools in the sample pro- ledge, they inhibit teachers from devoting more
vides some additional insight into ways in which time to experimentation and the use of 'guided
the LCE/SRP may affect the teaching of the discovery' methods. Interestingly, one teacher did
course. An observation schedule was used to refer directly to examinations in an observed
record the frequency with which various types of lesson, indicating that, at least for her, this pro-
activity took place, with the following results. vided a powerful source of motivation for her
pupils and influenced her teaching, even though
Table 6 the examination was four months away. The
remarks she made included the following:
Classroom interactions by percentage time spent
% Come, you are going to sit for the examina-
tion. (The teacher was trying to get the atten-
Settling the class/Administration 45 tion of the class at the beginning of the lesson.)
General class discussion 322
Group-teacher discussion 83 J am fed up with you people, many of you do
Individual-teacher discussion 09 not work and deserve to fail. Be quiet and
Teacher draws/writes/reads 70 try to pass your LCE. Do not disturb us. (A
Pupils draw/write 29 large group of boys were misbehaving.)
Pupils use text/reference books 21
Pupils use worksheets reading/writing 16 6 Do you think you can guess the answers [in
Teacher explains experimental procedure 56 the LCE]? If only A and B you could, but
Teacher demonstrates experiment 42 with five [alternatives] A BCDEyou cannot.
Class experiments l57 Other explanations of the observed patterns of
teaching described are of course possible (lack of
That is, less than 16 per cent of class time was teacher understanding of new pedagogy, shortage
spent with pupils actually undertaking experimen- of resources etc). It would seem, however, that
tation as the main activity. Most class timeover at least some of the reasons for such patterns
32 per centwas spent with the teacher address- are to be found in the character of the formal
ing the class as a whole. These interactions were examination associated with the course.
further analysed into categories of discussion
types, with the following percentage distribution: A brief summary of some of the evidence emerg-
ing from a detailed study of MIS does suggest
Introduce facts/principles 21 strongly that the impact of a particular pattern
Recall facts/principles 35 of examining on its use in schools has been
Apply facts/principles 6 detrimental to the realisation of the course aims.
Hypothesise 1 Patterns of teaching, internal assessment proce-
Observe 28 dures and students' perceptions of the nature of
Interpret data 7 science education all appear to have been
Infer from data influenced adversely by aspects of the LCE/SRP.
In principle, however, there seem no overriding
Thus considerable time was spent in class dis- reasons why changes in the LCE/SRP should not
cussions introducing new information and con- be capable of producing an examining pattern
cepts, and the greatest ringle number of observa- that reinforces rather than undermines important
tions occurred when teachers were requiring emphases of the curriculum. An analysis of
pupils to recall such information and/or examination performance of 744 LCE/SRP
principles. Further analysis of other observation candidates suggests that differences between high
data indicated that the 'guided discovery' and low achievers are not related closely to
approach recommended in course materials was differential performance on higher cognitive level
used by very few teachers. For example, on no questions. The proportion of marks scored on
occasion were pupils observed contributing to the different types of questions is quite similar
design of experiments and they were rarely asked between groups of pupils at each end of the
to hypothesise, predict, interpret or infer. ability spectrum. The inclusion of much greater

39
proportions of comprehension- and application- focus greater attention on ways in which examin-
based questions in the examination would not ing procedures can be used to reinforce, rather
therefore penalise poorer pupils disproportion- than undermine, the achievement of curriculum
ately. It could have the positive effect of shifting objectives. Changes in the nature and content of
the priorities of both teachers and pupils away assessment procedures and the quality of their
from the acquisition of factual knowledge towards interaction with teaching and learning are
greater concern with the kinds of achievement unlikely to prove as expensive and time consum-
that the MIS course seeks to promote. ing, as, say, redesigning an entire curriculum.

Some Concluding Remarks In conclusion, I will identify three general areas


The main characteristics of the relationship in whIch changes in patterns and procedures of
between the MIS curriculum and the public selec- examining have particularly powerful implica-
tion examination associated with it are not tions for effective curriculum renewal. These are:
specific to this course. Observers in many coun- 1 developing techniques of assessment and
tries have noted similar linkages between the examination which correspond systematically
cuÈriculum in action and patterns of assessment.6 with the educational objectives of new
In this particular case it seems that there is ample curricula. Recall-dominated examining of cur-
evidence that both the form (objective multiple ricula designed to encourage other types of
choice questions) and the content (particularly cognitive and affective outcomes is clearly
the bias towards questions answerable through counterproductive. Investment in effective pro-
recall alone) of examinations, have had adverse cedures and adequately trained staff obviates
effects on teaching and learning. I have chosen difficulties arising from the differing require-
to highlight some of these effects here in order ments of curricula and examinations;
to counteract the tendency to ignore or under- 2 close monitoring of the working of selection
rate the need to develop consonant and support- examinations and their effects on the cur-
ing systems of assessment and examination for riculum in action.
curriculum renewal programmes Where people
go to school chiefly to be selected for more Curriculum workers need to monitor the
schooling, the form and content of the selection influence of selection examinations on curricula
process define the curriculum in action far more in order that appropriate action can be taken
effectively than exhortation, rhetoric or prescrip- to ensure that such influence is benign. The
tive curriculum materials. form taken by programmes in support of a new
curriculum (in-service courses, changes in
This is not to argue that teaching methodology, initial training, resource provision etc) must
or course content is not important for the take cognisance of changes in patterns of
achievement of curricular objectives; obviously assessment if it is accepted that these play a
they are. It is to stress that the motives and central role in delineating the curriculum and
meanings that pupils, parents and many teachers motivating those who experience it. It is worth
bring to the educational process in schools may noting that evidence from several countries,
not coincide with those of the professional including Malaysia, indicates that selection
educators who design and develop new pro- examinations can work to test the adequacy and
grammes. The value of new content and changes understanding of teachers as much as provide
in pedagogy are generally not self evident to such reliable indicators of pupil potential.8 Close
participants when they are associated with monitoring could establish the extent to which
examinations and selection procedures which do this is true and whether action is desirable to
not reflect the emphasis of the new curricula. diminish this effect;
3 detailed and explicit feedback of examination
The 'restricted professional' and the 'instru- performance to teachers and pupils.
mentally motivated' student are not so much Communicating to a teacher that 20 per cent
aberrations to be eliminated from the implemen- of his class failed with grade Es tells him
tation of the curriculum, as central actors whose nothing of the reasons for his and their failure.
characteristics must be accommodated in any Indicating which questions and tasks pupils
proposal for curriculum renewal which seeks to completed successfully and which they did not
have lasting impact. A cost-effective way of provides useful information on which to base
influencing the performance of such actors is to future action. If pupils do behave according to
B See for example, Little 1978, Dore 1976. UNESCO 1969.
what they perceive to be the demands of
7 See especially Ruth wong's paper in UNESCO 1969. 8 See for example Somerset, H.C.A. 1974.

40
examinations, then feedback of this kind pro- Little, A., 1978, 'Types of Achievement and
vides a potentially effective method of reducing Examinations', IDS Research Reports 4, IDS,
misconceptions and using examination 'back- Sussex
wash' to support new curricula.
Mee, A. J., P. Boyd and D. Ritchie, 1971, Science
Taken together, concerted action on these aspects for the 70s, Heinemann Educational Books
of examining does providé an attractive response
to some of the problems of effective and endur-
ing changes in the curriculum in action. Though MIS, 1973, Malaysian Integrated Science:
not a panacea, such a tactical shift towards Syllabus, revised version, Ministry of Educa-
curriculum improvement through examination tion, Kuala Lumpur
reform does provide genuine possibilities for
effective action at relatively low cost and in a Scottish Education Department, 1969, 'Science for
comparatively short time. a General Education', Curriculum Paper 7,
HMSO
References
Bloom, B. S. et al, 1971, Handbook on Formative Somerset, H. C. A., 1974, 'Who goes to secondary
and Summative Evaluation of Student Learn- school?', in D. Court and D. P. Ghai, Educa-
ing, McGraw Hill tion and Social Department, Institute of
Development Studies, Nairobi
Dore, R. P., 1976, The Diploma Disease, Allen
& Unwin UNESCO, 1969, 'Examinations', in World Year
Book of Education, Paris

41

You might also like