Professional Documents
Culture Documents
(iii)
EDAHOD-8/1/20072009
Contents
Study unit
INTRODUCTION The role of assessment Changes in assessment Expected outcomes: what to expect from the course Reading the course material A two-way conversation Application a practical approach Planning your study 1 HISTORICAL BACKGROUND TO ASSESSMENT Introduction 1.1 Historical issues and assessment 1.1.1 The Chinese literati 1.1.2 The feudal system in Europe 1.1.3 Colonialism in Africa RE-EVALUATION OF ASSESSMENT IN THE SOUTH AFRICAN CONTEXT 2.1 The exam crisis in South African schools 2.1.1 How valid or reliable is the Matric exam as an assessment method? 2.1.2 Are tests and exams still useful forms of assessment? 2.2 The influence of context on the educational situation 2.2.1 The key economic forces that drive our new education system 2.3 Changes in the South African context: social and political context 2.3.1 Changes in South Africa's social context 2.3.2 Changes in South Africa's political context 2.4 The influence of educational system, infrastructure and policies on assessment 2.4.1 The National Curriculum Statement 2.4.2 Change as a process 2.5 Outcomes-based education and assessment 2.5.1 The term ``outcomes-based'' 2.6 Reflection on the case study WHY ASSESS? Introduction 3.1 Choosing a purpose for assessment 3.1.1 Assessment in order to grade or sort 3.1.2 Assessment in order to promote or select 3.1.3 Assessment in order to evaluate 3.1.4 Assessment in order to predict
Page
(v) (v) (v) (vi) (vi) (vi) (vii) (viii) 1 1 1 2 2 2 4 4 8 13 15 15 16 16 16 19 19 21 23 25 29 31 31 31 31 31 32 32
(iv)
Study unit
3.1.5 3.1.6 3.1.7 3.1.8 3.2 3.2.1 3.2.2 3.2.3 3.3 3.3.1 3.3.2 4 Assessment in order to control Assessment in order to diagnose Assessment in order to guide and motivate Assessment in order to learn Key concepts in assessment Approaches to assessment Assessment involves comparison Fairness in assessment The teacher and assessment Planning an assessment cycle The focus and purpose of assessment
Page
32 32 33 33 33 33 34 39 42 44 45 46 46 47 48 56 57 57 58 59 69 69 69 71 71 74 74 74 78 78 80 81 93
EFFECTIVE ASSESSMENT 4.1 Assessing with outcomes and integration in mind 4.1.1 Planning to integrate teaching and assessment 4.1.2 Planning the assessment strategy 4.2 The assessment of higher-order thinking skills 4.2.1 Bloom's taxonomy of thinking 4.2.2 Questions and answers 4.2.3 Instructions and action words 4.2.4 Activities 4.3 Fairness 4.3.1 Curriculum fidelity and diversity 4.3.2 Eliminate gender and cultural bias 4.4 Assessment and moderation 4.5 Useful feedback REPORTING AND RECORDING Introduction 5.1 Reporting according to outcomes 5.2 Criterion-referenced reporting for grades 5.3 Criterion-referenced reporting per outcome 5.4 Reflection on effective recording ADDENDUM A BIBLIOGRAPHY
(v)
EDAHOD-8/1
Introduction
CHANGES IN ASSESSMENT
To see whether our past and, in many cases, current methods of assessment (that is, tests and exams) are appropriate to the purpose of assessment, we have to think about the choice of modes (forms), media and frames of reference. The British writer Elizabeth Bray, in Lubisi (1999:20), calls this phenomenon ``fitness for purpose''. According to her, your assessment methods should ``fit the purpose'' of your assessment. This means your method should be right for the purpose or the reason you are assessing. Fitness for purpose is a key concept in assessment. Very early in the planning of an assessment strategy you are faced with certain key questions: . Why are you assessing? . What are you assessing? . How will you assess? Bray says the why and the what will determine how you assess. Remember that, so far, we have only been referring to tests and exams the Matric exams in particular. Think about why we assessed in this way in the past. What did we assess? Was the method (the how) appropriate or not?
(vi)
LEARNING OUTCOMES By the end of this study unit you should be able to . demonstrate an understanding of the characteristics of traditional assessment practices . determine whether these methods of assessment were appropriate to the context we lived in . interpret the value of these methods from a historical perspective . make a value judgement about whether these methods of assessment meet the demands of current educational trends and a rapidly changing world . demonstrate an understanding of the significance of new developments in assessment
A two-way conversation
The study guide is not like an old-fashioned textbook, to be read and learnt by heart. We have written it in the form of a conversation on OBA. Like all good conversations, the study guide works best if you participate. To encourage your participation, we have included many activities and requests to ``think!''. In fact, it is probably true to say that your work is the most important part of the guide. If you do not do the activities, you will be ignoring the major part of the learning experience, which is your own understanding of particular concepts. Another very important aspect of this ``conversation'' with the content of this study guide is to rethink and reflect on what you have read so as
(vii)
EDAHOD-8/1
to understand it. It is important to know that understanding (as opposed to rote learning) develops in layers. Think about how we get to know things in the world. When we are first introduced to an idea, it seems strange and confusing. Only when we think, talk, read and write about things on a regular basis does their full importance become clear to us.
COMMENT Pay special attention to this icon: it points to important information about the particular topic under discussion. Comments and guidelines will accompany this icon.
RETHINK AND REFLECT Reflect on the previous discussion and find your own meaning and understanding.
(viii)
EDAHOD-5/1
STUDY UNIT 1
2 In fact, the dominance of this one form of assessment, namely examinations or tests, is not a recent phenomenon. It has a long history. Let us look at this issue from a historical perspective.
EDAHOD-5/1
required their students to write the so-called O-level and A-level examinations set in Cambridge or Oxford to obtain school-leaving certificates. Obviously, if your exam is set by people in Cambridge, you need to make sure that you are taught what the Cambridge examiners consider to be worthwhile knowledge! It is clear that social interests (colonial interests in this case) are served by some forms of assessment (in this case O-level and A-level exams).
STUDY UNIT 2
EDAHOD-5/1
Essay 1
Topic: Write a narrative essay on ``The day everything went wrong''. I woke early that day. It was fine day no clouds and no wind birds were singing joyfully, promising to be a fine day for me too. But at the end everything went wrong for me. I was going to write my final Geography paper. The previous night I slept very late because I study. I was very prepared for the paper. I showed, dress and eat my breakfast as usual. I was going to write the paper at 9H00. At about 8H00 I took my belongings and went to catch a taxi I realised that I leave the money at home. The driver stopped and I went back home took the money and I went to catch another taxi. I was so confused and I was not taking notice of what was happening, I found out that I was in a wrong taxi. I tried to tell the driver that I was in a wrong taxi he was very angry, he told me that he will first deliver the other passengers then he will find another taxi for me. Truly het delivered the passenger and found me another taxi, it was getting late, I was running out of time. Luckily I found another taxi and I was off to the correct place. When I arrived in the examination rooms all students were seated waiting for the question papers to start writing. I was relieved because I was not that late. The people gave us question papers to my surprise it was no a geography paper but a Physical science paper. When I got home I found out that my little brother was in the hospital, he was involved in a serious car accident. I went to see him and found that he was seriously injured. I was very worried because that day was not meant for me. Even today I don't know what happened in my mind and life that day. I was very confused. I still ask myself that did I know that I was going to write geography or Physical Science. And what if I didn't realise that I had money or not what would have happened. But thank God because everything afterwards became right. My brother was then discharged from the hospital. And I passed my Physical Science with a ``E''.
Essay 2
Topic: For a whole year you suffered at the hands of a school bully. Write an essay on your experiences and how you finally brought an end to the bullying. Bullies are as common a phenomena in school as brilliant children. Our school has many bullies but none of them is as terrifying as TB. TB is very meaning of terror itself. Once she has singled you out as her enemy you dread every morning on which you have to go to school. I was one of the unfortunate ones for the whole of last year
6 because TB singled me out as an object of her hatred. My only crime was that my teachers were fond of me (and to tell the truth I don't know why). But anyway if anything had to be done I was always one to do it. TB did not like this in the least. Afterall what gave me, a newcomer the right to be more popular than them i.e. all those who were not new in the school. So whenever TB saw me she would humiliate, frighten, threaten or bully me in any way she saw it. One day one of the teacher had sent me to fetch her some water in a bowl. On my way to the staff room there appeared TB. She headed straight for me and before I could stop her she had tipped the bowl, thus spilling the water all over my uniform and then she smiled that horrible smile of hers and I was too shocked to speak and too terrified to tell the teacher. I just cried and asked for permission to go home. But TB had not been satisfied. She let a few days pass and then she saw me in the school tuck-shop she shouted ``Hey Favourite, come here right this minute!'' I went meekly to her; like a sheep to the slaughter. She said: ``From today onwards you have to pay a protection fee of R2 a day or you'll curse the day you came to this school. Is that clear''. As she said this, she held me by the ears and pinched them so hard they became red and my eyes filled with tears. I simply nodded my head. She held out her hand and I gave her all the money I had (which was more than R2 by the way). And so began months of paying two rands every day. I would even steal the money if I hadn't been given enough at home, but all this was to stop TB's bullying. One day on my way from school I was walking with some friends. There appeared TB with her group and I froze because I knew how she liked to show off. Anyway she headed for me and started accusing me of having an affair with one of the teachers. Before I could deny it she was already on me with her fists. She pounced on me like a lion. Fists and slaps rained down on me in rapid succession. rying (and failing) to cover my face was all I could do. My books flew into the air, my uniform was dirtied and torn and everybody was having a jolly good time laughing at me. When she got tired she let go of me and said, ``That's what becomes of school-girls who fall in love with teachers.'' I felt so humiliated especially because she was lying. All the time I was crying. I started to collect my books and for one moment I stood still. I decided enough was enough. I ran after her crying like a maniac. I was so angry! I pounched on her before I knew what was happening. I hit her again and again. I bit her. I strangled her. She tried to free herself but I strangled her until she fainted and I released her. I collected my books and went home. That was the last day she bullied me.
EDAHOD-5/1
Below 45%
45%49%
45% -49%
50%59%
60%69%
55%64%
65%74%
75%80%
75%80%
80%100%
(1) Assess the two essays by using the assessment grid. (2) Which of the two essays do you think is the better one? Give reasons for your answer.
8 (3) Do you think the opinions of fellow students/colleagues will differ from yours? (4) What percentage would you give the second essay? (5) Do you think other students will differ from you? Here are our thoughts on these questions: (2) We thought the second essay was definitely of a higher standard than the first. The most obvious reasons would be that the second essay is more grammatically correct, displays a richer vocabulary and meets the criteria for a good story or narrative essay. It is also rather captivating and invites one to read on (although it ends rather violently!). (3) Although students may phrase their opinions differently and probably elaborate a bit, we believe most of their reasons would boil down to the same thing. (4) Your answers possibly ranged between 50 and 60 percent. The first essay, however, is another story (pun intended!). In fact, the external examiner failed this candidate on firstlanguage level. According to him, the standard was too low and there were too many grammatical mistakes. In other words, this learner's performance was measured against the average level of performance of others in the `'normative'' group, that is, all the matrics in the country who wrote English. This is clearly a norm-referenced assessment for purposes of grading, ranking and comparing. Do you agree? (5) It is clear that different people can come up with different marks that would ultimately determine the future success of this learner. This means that there may be a discrepancy of up to 5 percent between our mark and that of the examiner.
2.1.1.1 Validity
When we say in our daily conversation that something is ``valid'', we
EDAHOD-5/1
often mean that it is sound or justifiable. For instance, people say: ``Maggie gave a valid excuse for not learning for her test'', or ``Izak's argument about the problems around examinations is valid''. It simply means that their excuse or argument is sound or justifiable. There is no major difference between the use of the term ``valid'' in daily conversation and the way it is used when talking about assessment in education. What we need to recognise with regard to educational assessment, however, is that ``soundness'' or ``validity'' has various dimensions. This means that an assessment can be more valid in one aspect and less valid in another. Let us look at the first essay again. We want you to look at it from various angles and, to help you, we are going to ask you some questions. These questions serve as criteria against which you can measure the examiner's assessment of the first essay. In this way we hope to stimulate critical thinking, and illustrate the meaning of some difficult concepts regarding validity at the same time. For ease of reference we will make use of a table:
(1) On the face of things, does the mark that the examiner gave look valid? (2) To what extent does the assessment cover the content of the course? Does it cover the content adequately? (This is called content validity. Learners may be assessed on one chapter when they have in fact gone through ten chapters!) (3) How well does this assessment predict a learner's future performance? (This is referred to as predictive validity. It was claimed for the traditional Matric exam that it could actually predict a learner's future academic performance. Do you agree with this claim?) (4) To what extent will the learner's performance on this assessment correlate with his performance on another assessment that evaluates the same thing? (Concurrent validity refers to the correlation between a learner's performances in two or more assessments, when we consider the same variable or when the same thing is being assessed.) (5) What consequences could the assessment have for the learner? (Consequential validity is concerned with equity or fairness in assessment.)
Considering the abovementioned questions with regard to validity, do you think the mark that the examiner gave the learner is valid or not? Give reasons for your answer.
10
This is not an easy question to answer. Here is what we thought, although you may disagree with us: (1) On first impressions (face validity) we would possibly have passed this learner, although the examiner thought differently. On first impressions he believed his assessment was sound. What do you think? (2) Content validity is not a criterion this assessment can be measured against, because writing a narrative essay assesses language skills and a bit of creativity, not specific content which, therefore, cannot be brought into the equation. However, the student must write on a specific topic, and most rubrics will award some marks to the relevance, depth and insight displayed by the student in her handling of the topic. Suppose an essay topic required students in deep inland rural areas to write about their experiences when visiting the seaside! (3) We are not sure whether the assessment has predictive validity. Failing English at Matric level may suggest that the learner will have difficulty studying through the medium of English at a higher level. On the other hand, suppose the learner just had a cold on the day of the exam and so did not perform well. Suppose the learner simply had no interest in the topics that were set, and could have written informatively and accurately on many other topics. A lot of different factors may have influenced the learner's performance at that particular time, on that particular day, undermining the predictive validity of this form of assessment. Even if the exam were a true indicator, it is always possible to improve one's language skills. (4) Concurrent validity is definitely an aspect one should take into account. Imagine if this learner had passed English in the record exams and usually gets approximately 50 percent for his essays in class exercises, yet fails his final Matric exams! If this in fact happened, what do you think could have gone wrong? (5) Consequential validity is a type of validity that has only been identified fairly recently. It is essentially concerned with issues of fairness or equity in assessment and raises the question whether failing English at Matric level should determine whether a student can pursue a course in dancing or the trade of carpentry thereafter. The assessment has little relevance to the actual skills and knowledge needed subsequently and yet has a direct impact on the choices available to the student.
11
EDAHOD-5/1
2.1.1.2 Reliability
In our everyday conversations the word ``reliability'' has something to do with trustworthiness. When people say something is reliable, they usually mean that it can be trusted. In education, the principle of reliability means much the same as in everyday usage. When is an assessment reliable? We think it is safe to say that an assessment is reliable if it can be trusted to help us make generalisations about a learner's knowledge, skills and attitudes in a variety of contexts and with minimal variation between the judgements made by a variety of assessors. Surely there is something wrong if two assessors use the same assessment instrument and criteria and award completely different marks for the same work by the same learner? Can one measure reliability? An interesting question. However, there are a few criteria that one can apply to assess whether an assessment is reliable or not. For example: . Is the learner's performance likely to remain the same if the assessment is done at different times? There are obviously temperamental and other issues that would cause a learner's performance in the same assessment activity to be different at different times. Think about the difference between an essay you had to write for an ordinary homework assignment and one you had to write in a formal exam situation. Of course one is more anxious in a formal exam setting than when doing an ordinary assignment for homework. . To what extent would a different sample of similar assessment tasks deliver the same level of performance? When we assess learners, we often choose specific tasks. From the learners' performance in these tasks, we assume that they would perform the same if we set similar tasks. . To what extent would different assessors award the same value to a learner's performance in an assessment activity? Look and compare how we differed from the examiner who assessed the first essay!
Which of these criteria can you apply to the examiner's assessment of the first essay?
12
(1) We assume that the considerations mentioned in the first criterion would definitely have had an impact on the reliability of the assessment. Any final, high-stake examination plays havoc with the nerves and has a negative effect on most learners. (2) We believe that most learners score a better mark for an essay under relaxed conditions. So, in terms of the second criterion, the reliability of the assessment would also be affected. (3) We often hear of two teachers giving completely different marks for the same essay, and this was demonstrated with regard to the first essay. Our mark differed from the examiner's mark. Therefore, without a doubt, this variability would affect the reliability of the assessment.
Let's summarise what has been noted regarding the Matric exam in the past: . Tests and exams were mainly formal, the most formal assessment mode being the final Matric examination. . Final assessment occurred at the end of a course or schooling and was based on the curriculum that was taught. . The curriculum was mainly knowledge-driven and therefore input-based, which means that the teacher was primarily responsible for imparting the knowledge. . Tests and exams are summative, which means that a final ``summing up'' of the marks is done and the results are often used for grading, ranking and selection purposes. . The examinations not only served the purposes of selection and grading in the apartheid era, but also of monitoring and controlling what was regarded as valuable educational knowledge. Those who met the requirements obtained certificates and thus a passport to all sorts of options in society. . This form of assessment is highly competitive, because learners are selected for further career choices and the job market by means of grading and ranking. . Assessment took the form of an external examination and was therefore set and marked by external agents (examination boards). . All these factors raise the question of the validity and reliability of this form of assessment, especially with regard to those learners who were disadvantaged in the past. . Fundamental to the Matric examination is the concept of
13
EDAHOD-5/1
`'norms''. Performance is measured against a norm for example, the performance of all the higher-grade English candidates in the country. Norm-referenced assessment therefore compares learners' performance with the performance of other higher-grade English learners. . The choice of media was mainly written forms (such as pencil and paper).
14
What type of assessment practice will be appropriate or worthwhile in our current educational approach? Will tests and exams still have a place? What does continuous assessment really mean? These questions will be addressed in the following study unit, where we shall be taking you further on the journey of assessment in education, particularly in terms of an outcomes-based approach. We will be exploring what outcomes-based assessment entails and why it is more valuable and worthwhile in preparing learners for a fast-changing world and the challenges of life.
15
EDAHOD-5/1
2.2.1 The key economic forces that drive our new education system
One of the forces that drive our new education system is called globalisation. Since South Africa's democratic elections in 1994 we have re-entered the world economy. The economy of the country therefore has to grow at a rate comparable to the growth rates of countries in the rest of the world. But has this happened? It is said that South Africa is currently rated 93rd out of 178 countries on the United Nations Human Development Index. This suggests that our country is not producing people capable of competing with their counterparts in other parts of the world in terms of producing highquality goods cost-effectively. Why is this so? Has it got something to do with how we were educated and how, and on what, we were assessed? Did the education system focus on providing the learner with the right skills and attitudes to enter the job market? We need to develop economic capital; money and physical resources as well as ``human'' capital; people with knowledge, skills and attitudes (Ndhlovu et al 1999:54). It is also said that South Africa as a country has one of the highest unemployment rates in the world. It was estimated that for every ten matriculants in 1996, only one was employed. A shocking statistic, isn't it? We need to develop and assess entrepreneurial abilities to enable them to start their own businesses. In this way, provide employment for themselves and others (Ndhlovu et al 1999:54).
Why is this so? How should the education system respond? Does this mean knowledge is not important any more? Think of reasons for your opinion.
16
This probably explains the increased emphasis on life skills, business education and skills such as innovation, risk taking and problem solving in the new curriculum. Do you agree? Education should help learners to find, select, understand and organise information and to use it in solving problems. It is logical, therefore, that the new policies make frequent reference to ideas like ``thinking skills'', ``independent study'', and ``formative, continuous assessment''. It becomes vital for learners to demonstrate that they are able to solve problems, think critically, be creative, analyse information and use technology (Ndhlovu et al 1999:55).
(1 Write down what social, economical and political changes you can identify that took place after 1994. (2) Indicate why you think the changes in the South African context will influence the way we teach and assess. (3) How will you assess learners' skills and attitudes? (4) Will tests and exams be sufficient? Even if we retain tests and exams, should the focus remain on testing memory of content or should we ``examine'' different things?
2.3 CHANGES IN THE SOUTH AFRICAN CONTEXT: SOCIAL AND POLITICAL CONTEXT 2.3.1 Changes in South Africa's social context
The new education system encourages learners to develop attitudes of tolerance and understanding towards people who are different from themselves. The social aim is to shift people's attitudes from the prejudice and stereotyping of the apartheid era. It also reflects a global move towards a world in which the spiritual aspects of our existence are valued, rather than simply our rational thinking abilities. This might explain the new policies' emphasis on holism and on educating the whole person.
17
EDAHOD-5/1
school governance is now in the hands of the school community: the parents, educators and learners. This signals a move away from the highly centralised, tightly controlled bureaucratic system of the past to a more open, flexible, democratic and participatory system. Schools are central to building a new culture of tolerance in South Africa. One way in which this can be achieved, according to Ndhlovu et al, is by building more democratic and participatory structures: Another way will be through teaching learners the skills and attitudes that will enable them to participate critically in our new democracy, by promoting tolerance of differences, eliminating racist and sexist attitudes and other prejudices and (promoting) respect for the shared environment (Ndhlovu et al 1999:56). You do not have to look very far to see the effects, not only of our assessment practices but also of changes in the system. Simply picture yourself back at school and try to remember yourself as the learner. Visualise the teachers; what and how they taught; what and how you learned; the curriculum; why, on what and how you were assessed; and even the classroom organisation and learning environment.
ACTIVITY (Suggested time: 15 min) To help you reflect, you can choose some of the headings and write down some facts under each heading on the board to summarise your experiences at school.
18 A few ideas: The teacher takes responsibility for the learners. Learners motivated by constant feedback and affirmation of their worth. How motivation takes place depends on the personality of the teacher. Syllabus is content based and broken down into subjects; rigid and non-negotiable; curriculum-as-blueprint; content placed in rigid time frame. Can you understand why the past education system, including its particular assessment practices, needed to change? Would the type of learner that this system produced have been able to keep up with such a fast-changing world and meet the economic and other needs of the `'new'', democratic South Africa? This does not mean that we should do away completely with tests and exams as means of assessment in the new curriculum. In fact, they may still be useful methods of assessment. Assessment that is aimed only at passing or failing the learner is of very little value. Assessment is worthwhile only if it enhances the learning process! We have seen that our past assessment practices were aimed at grading, selection and certification and that tests and exams provided the means of measuring whether the learner either made the grade or standard, and could be selected for a particular course of further studies, or not. Certification simply meant that learners passed the required standard. By implication, the assessment was aimed at passing or failing the learner. Today we realise that this form of assessment is of very little value in a fast-changing world. Although we recognise that tests and exams were ``fit for purpose'' in the past, our current education system has a different focus, which influences the way we assess. Many teachers (like yourself, perhaps) may not be fully acquainted with the range of assessment possibilities our current education system offers. Yet they are uneasily aware that many of their learners are not best served by the assessment practices they are using, and that some curricular objectives cannot be assessed adequately by traditional methods. While we are not completely rejecting traditional modes of assessment, new emphases are appearing and we will have to open our minds and the discussion in order to explore new territories. Thus we will be taking the first steps towards a paradigm shift.
19
EDAHOD-5/1
Contexts
n ga
iza
Teaching practice
sc
ho
o
l
2.4.1 The National Curriculum Statement 2.4.1.1 From Curriculum 2005 to the National Curriculum Statement
The Constitution of the Republic of South Africa (Act 188 of 1996) provides the basis for curriculum change and development in South Africa. Education and the curriculum have an important part to play in realising and developing the full potential of each learner as a citizen of a democratic South Africa. When our educational planners initially went to the drawing board to draw up a plan to implement an outcomes-based approach to education, they designed a framework called Curriculum 2005. Curriculum 2005 was designed to change the face of education in South Africa. It was similar to models of outcomes-based education found in other countries, but also it was unique in many ways. We know that the implementation of Curriculum 2005 was complemented by appropriate OBE teaching, learning and assessment strategies. Part of these strategies was the development of the critical outcomes, which flowed from a vision of a truly democratic South Africa. These critical outcomes laid the foundation for developing more specific outcomes (and all other outcomes). Specific outcomes describe the competence that learners should be able to demonstrate in specific contexts and particular areas of learning at certain levels.
20
For the purpose of assessment in the classroom, the specific outcomes were the focus. The specific outcomes were accompanied by assessment criteria and range statements and these, together, assisted the assessor and learner in understanding what needed to be achieved. Furthermore, evidence of achievement was based on performance indicators, which were elements of the assessment criteria. Performance indicators could be seen as the building blocks that gradually constructed the assessment criteria for a particular specific outcome. You must have felt exactly the same way at some stage. Think about your initial experience of OBE. How did you react to all the changes in teaching and assessment? And what about all the new terminology you were confronted with? Did you think the change was worth the effort?
. The word ``outcomes'' in OBA refers to the things we want our learners to know and be able to do by the end of a learning programme. These include knowledge, skills and attitudes. . OBA uses a set of criteria (as opposed to a norm, such as the performance of other learners) as the basis of assessment. This type of assessment is broadly known as criterionreferenced assessment. . OBA yields information that can help you monitor a learner's progress, as well as inform you about your teaching practice. We refer to this type of assessment as formative assessment. . Assessment must be built into a regular pattern of classroom activities as a cycle of plan-do-assess-review. In this way you can monitor your learners' progress as well as adapt your teaching approach on an ongoing basis. This is the whole point of continuous assessment. . That is why assessment can be described as a process, which evolves informally and in a noncompetitive way. . Although OBA is of a more formative nature, it can include summative assessment but only to the extent that it enables you to sum up the extent of the learners' progress. When summative assessment is well-developed and matched to individual learners, it will also inform you about your teaching and your learners' learning. . The Constitution provides the basis for curriculum change and development in South Africa. Therefore Curriculum
21
EDAHOD-5/1
2005 was implemented and complemented by appropriate OBE teaching, learning and assessment strategies. . Part of these strategies was the development of the critical outcomes which flowed from a vision of a truly democratic South Africa. These outcomes laid the foundation for developing more specific outcomes, assessment criteria, range statements and performance indicators. . The Revised National Curriculum Statement has done away with the specific outcomes, assessment criteria, range statements and performance indicators and replaced them with learning outcomes and assessment standards, because these outcomes are fewer, easier to work with and easier to assess. . There are a few basic principles of assessment that we should uphold when planning an assessment. Any assessment should have a clear focus and purpose, as this will determine the best method of assessment; assessment should concentrate on selected learning outcomes and be built into the process of teaching and learning from the start; the activities should be realistic and authentic and match the desired learning outcomes; and it should be learner paced and learner centred.
ACTIVITY (1) Explain what you understand as the main purpose of OBA. (2) Compare the characteristics of OBA to the characteristics of traditional assessment practices and write some notes on your comparison. (3) Explain why summative assessment, if applied appropriately, can still be a worthwhile method of assessment. (4) Write down a valued judgement on whether OBA practices meet the demands of current education trends and a rapidly changing world. Give reasons for your answer.
22 specific outcomes, range statements, performance indicators and so on, and replaced them with more understandable learning outcomes and assessment standards. The difficult and sometimes tongue-twisting names for the eight learning areas have also been simplified, and they are now called . . . . . . . . Languages Mathematics Natural Sciences Social Sciences Arts and Culture Life Orientation Economic and Management Sciences Technology
Each learning area will, in future, have its own learning outcomes. Learning outcomes are usually more general and there are fewer of them. These outcomes should be easier to work with and easier to assess. Each learning outcome will have assessment standards, which will guide the assessment process and indicate which of the content can be used as a basis for developing the outcome. The revised NCS also stipulates the core content that must be covered in each phase. The content is outlined in the document and is divided into various areas of knowledge. Within each area there are subareas. The core content and concepts that have to be covered in each phase are listed within these subareas.
EDAHOD-5/1
Teachers may be so scared of the change or the results of change that they decide not to apply it at all. The easy way out would be to carry on with the familiar traditional practice and structure. c Mutual adaptation as reaction to change Mutual adaptation occurs where the implementation was successful and there is visible and significant change in the participant's attitudes, skills and behaviour. This means that the implementation is characterised by a process of mutual adaptation in which the structures, strategies, methods, settings, and so forth are modified to suit the needs and interests of participants and in which participants change to meet the requirements.
24 We hope that your journey into OBA will unfold like a story, and that which you already know and can do will make more sense to you and ultimately form a meaningful whole. As they say when you embark on a journey: bon voyage! We would like to start the journey by way of an analogy. This means we want to compare the partial likeness between two things. We can deduce a lot about OBA from the analogy, provided we ask the right questions. You may already know the answers to many of these questions. However, it is seeing things in context that makes learning more meaningful. Now read the following analogy carefully: Imagine that you are setting out on a journey to a place you have not been to before. You start by deciding exactly where you want to go and then plan a route to get there. Along the way you keep your route in mind, and every now and then you check for landmarks or ask directions to make sure that you are still on course. When you think you have reached your destination, you check again for landmarks or signs that will confirm where you are. The same thing happens in OBA. You start by deciding on the outcomes you want your learners to reach, and by finding out where your learners are in relation to those outcomes (1) Then you plan a learning programme that will steer them towards the outcomes one step at a time. Each step involves a learning activity that the learners have to do for themselves. However, even with the best-planned journeys we sometimes lose our way and sometimes discover new and unexpected things. The same is true of learning. We must accept that we will not always achieve our planned outcomes, and by the same token we must learn to celebrate the achievement of additional and unforeseen outcomes. While the learners are working on these activities, you constantly check their progress and give them feedback to ensure that they know how they are getting on. When both you and the learners think they have attained the desired standard of performance with regard to the outcome, you do a final check with them to make sure. The whole process of finding out where the learners are, how they're getting along and how far they've got, is called continuous assessment (See Study Unit 4 for more on continuous assessment.)
25
EDAHOD-5/1
Here are our thoughts on this question. Our answers may be a bit longer than yours, as we shall be giving you more information to think about. You will notice that we compare the characteristics of OBA with traditional assessment practices throughout our discussion. In this way we hope to review your knowledge of the previous study unit, and also to help you understand difficult terminology and concepts about assessment. The word ``outcomes'' in ``outcomes-based assessment'' refers to the things we want our learners to know and be able to do by the end of a learning programme. They are, in effect, demonstrations of learning that is, visible activities performed by learners to show what they have learned. An outcome includes knowledge, skills and attitudes. In other words, to assess your learners' progress towards the desired outcome, you must provide opportunities for them to demonstrate that they are competent and have acquired the desired knowledge, skills and attitudes with regard to a specific task. Do you remember that traditional assessment practices focus mainly on recalling input (knowledge)? OBA assesses knowledge, skills and attitudes. That is why we say the assessment model has moved from input-based (knowledge-driven) to outcomes-based, with the focus on knowledge, skills and attitudes. When we are assessing a learner's demonstrations or performances, we assess them against assessment criteria. These will give us an idea of whether the learner is achieving the outcomes, progressing well towards that achievement, or having problems. OBA uses a set of criteria (as opposed to a norm, such as the performance of other learners) as the basis of assessment. This type of assessment is broadly known as criterion-referenced assessment. Do you recall that traditional assessment is norm-referenced, which means that the learners' performance is assessed against the class average?
26 The shift to criterion referencing reflects a desire to move away from an assessment system which is primarily designed to select, towards one which is primarily designed to credit achievement at different levels. ACTIVITY Compare the following two classroom situations. A Image of how Mr September teaches and assesses
Try to visualise him standing in front of the class, teaching Science ... Imagine him writing notes on the board with one hand, the textbook in his other hand. The learners are copying the notes from the board about a navigator's compass, because next week they will be writing a test on this section. You can hear a pin drop in the class. The learners know that they dare not ask Mr September any unnecessary questions, because his motto is: sit down, be quiet and listen! B Image of how Mr Cele teaches and assesses
Now think of Mr Cele's class and the way he teaches and assesses. Keep the Natural Sciences lesson in mind and try to visualise Mr Cele as a facilitator of learning.
27
EDAHOD-5/1
Visualise the learners making their own navigator's compass, using simple science to solve practical problems. Mr Cele's lesson unfolds as follows: Planning the lesson. Mr Cele begins by referring to the learning outcomes for the Natural Sciences learning area in the NCS. He has decided to plan his lesson around five basic steps in the scientific process, since these steps apply to all three learning outcomes. He thinks the learners will learn a lot about science if they actually go through the five steps themselves. These steps are: Identify the problem. Collect information about the problem. Analyse the information and come up with solutions. Try out the solutions Evaluate the solutions to find the best one. Starting the lesson. Mr Cele begins by asking the learners questions about compasses, but they are not sure how these work. He then divides the class into groups of four and asks them to write down everything they know about magnets. Continuing the lesson. Mr Cele gives each group a small red-and-blue bar magnet and some items to test. The learners test to see which items stick to the magnet and then go on to test a variety of other objects, like watches, buttons and so on. Mr Cele facilitates the learning process by means of thought-provoking questions. He does not provide the answers, but allows the learners to experiment and interact with one another in a meaningful way. In this way he manages to build their knowledge layer by layer until they are able to classify things and find relationships and are willing to test their ideas through prediction and by applying them to other materials. Doing diagnostic assessment. Mr Cele then tells the learners to write a report on what they have learnt about magnetism up to that point. He is not sure if all the learners have understood the principles of magnetism. He wants to find out more about the particular difficulties they have in order to adapt his lessons and address their needs. Changing the plan. Mr Cele feels confident that the learners have grasped the basic concepts of magnetism, so he moves on to the topic of navigational compasses, which work with the earth's magnetic field. The particular activity he has planned does not work too well, because the learners do not have compasses of their own to refer to and have to rely on their memory of the compass on the table. After a number of false starts and setbacks, the learners grow restless and unruly. The
28 lesson is beginning to disintegrate, so Mr Cele decides to abandon this activity. Instead, he plans a new activity and draws on what he knows the learners are capable of doing by themselves. During the next phase. Mr Cele brings along a shoebox full of scrap materials and after some discussion about the earth's magnetic field, the learners try to make a simple navigational compass themselves. First the groups discuss at length the problem of how to use a strong permanent magnet to make a magnetic compass needle from a piece of metal. Then they try out their ideas and so they continue until they discover that the end of the metal which last touches the S-pole of the permanent magnet becomes the N-pole of the newly magnetised needle. They are delighted and start experimenting with even more advanced principles of magnetism, while having fun at the same time! Obviously Mr Cele still has to do a summative assessment (see Study Unit 3) to complete the cycle. Remember, this form of assessment is aimed at finding out how much the learners have progressed over a period of time, or through doing a particular section of work. ACTIVITY (1) Write down some notes on how teaching and learning take place in Classroom A (Mr September) and Classroom B (Mr Cele) with regard to the following: . . . . . lesson preparation teacher activities learner activities classroom setting assessment
(2) Explain which one of the classrooms you would associate with OBA? Give reasons for your answer. (3) Write down some ideas of how assessment was built into the process of teaching and learning from the start in Mr Cele's class. (4) What baseline assessments did he perform? (5) How did he benefit from doing a diagnostic assessment? (6) What formative assessment did Mr Cele do during the lesson? (7) Comment on Mr Cele's methods of assessment. Do you think they were appropriate or not for the particular purpose and focus of each assessment? (8) If you were the teacher, how would you do summative assessment in order to assess the learners' performance up to that point?
29
EDAHOD-5/1
30 The more realistic and ``authentic'' an assessment activity is, the more likely it is to produce accurate and reliable information. Authentic activities are those that closely resemble the things people do in ``real life''. This makes the activity more interesting and more challenging to the learners.
31
EDAHOD-5/1
STUDY UNIT 3
Why assess?
INTRODUCTION
Everyone in the educational field agrees that there should be a reason or purpose for assessment. Educators should always be able to say why they assess, who will benefit from the assessment and why a particular form of assessment was chosen.
32
33
EDAHOD-5/1
3.2 KEY CONCEPTS IN ASSESSMENT 3.2.1 Approaches to assessment 3.2.1.1 Summative assessment
Summative assessment is known as the traditional mode of assessment where a judgement is made. This is usually done in the form of a mark indicating the learner's level of competence. Summative assessment is often done at the end of a programme to sum up what the learner has achieved. Central to summative assessment is the idea, ``I will teach you something and then test how well you've learnt it''. It separates teaching and assessment in time as well as in concept. If all assessment is summative, then any teaching or support during an assessment task is considered ``unfair'' because it helps learners to do better than they should. Summative assessment is used chiefly for grading, selection, prediction and control. In theory, if not always in reality, great care is taken to provide accurate information and judgement about a learner's ability especially when the consequences are important, as in the case of promotion to a higher grade or obtaining a certificate.
34 These teachers watch out to see which learners are struggling and which are coping. They know when to adjust their teaching methods to meet the needs of learners: it's just that they don't record these observations formally. For this reason, formative assessment happens informally and at all times. It involves a teacher in looking for clues when listening to group work, or looking over the shoulder of a learner who is writing, or listening carefully while a learner is reading. They use such clues to build a theory about the learner's level of competence. Formative assessment is used chiefly in diagnosing, motivating and learning. In some ways it turns the traditional logic of assessment on its head. Instead of thinking of assessment as always summative and always a test, we have to acknowledge that assessment shapes and forms the learning process as well. It is important to keep in mind that summative and formative assessment support each other in the teaching-learning process.
To some people it might appear that OBA has done away with tests and exams. The reply to this is that there is no reason why tests and exams should not be used to test the achievement of outcomes. There are strong arguments in favour of using them, provided they are not the only means of assessment used. They are a valid means of assessing the set criteria, and they comply with the requirements of OBA. Unfortunately, however, summative tests and exams are often used to test learners' recall of knowledge only. This practice has led to strong criticism of summative assessments, but they can offer an opportunity for learners to demonstrate what they have learnt. To illustrate: A class undertakes a Science project. If the assessment is intended to find out who needs special help in Science, it is called formative assessment. If, however, the assessment is used to decide whether or not a certain outcome has been achieved, it is called summative assessment. As you can see, the results of the same means of assessment can be used in a formative and a summative way. Therefore we say OBA is formative by nature but can include summative assessment. When summative assessment is well developed and matched to individual learners, it will also tell you more about your teaching and your learners' learning.
35
EDAHOD-5/1
We normally compare a learner's performance with one of two types of ``something else'': The norm set by others in the group. The teacher judges how well the learner performed compared with the performance of the group. Standards and criteria. Teachers check whether the learner has achieved an identified level of achievement by ascertaining whether the set criteria have been met.
36 Criterion-referenced school assignments and examinations try to provide measurable criteria, so that a learner's progress can be monitored and particular achievements acknowledged. This means that anyone who meets the criteria set for a field of knowledge and skill can pass the subject. Criterion referencing is also used to bring the learner into the assessment process. Criteria are set with the cooperation of the learners before an assignment or test, so that learners know exactly what will be assessed and what proportion of credit will be allocated to particular efforts. The assessment criteria in criterion referencing are quite explicit, so that every learner should be able to understand how the work is assessed. Similarly, every educator should be able to explain results with reference to the stated criteria. Criterion referencing and norm referencing are not mutually exclusive. In practice, assessment and evaluation processes tend to involve elements of both approaches. As Firth and Macintosh (1984) note: A swimming test demands certain levels of performance and is ostensibly criterion-referenced, yet the criteria can change with improvements in levels of performance. For example, the qualifying times for the Olympic Games are governed by the norm, which implies that if a swimmer were to set a new world record, the criteria for matching that record would have to be adapted. The shift from norm-referenced to criterion-referenced assessment is part of an international trend in education. It is also appropriate to the changes that are happening in our society at the moment. This reflects a desire to move away from an assessment system which is primarily designed to select toward one which is primarily designed to give credit for achievement at different levels.
An example
An educator told her class: ``Write a story with the title `Alone in the forest'. Make it interesting.'' A learner wrote a very interesting story, stretching her vocabulary, using all her creative powers to create a powerful atmosphere. Those who read the story could feel the loneliness, smell the damp and share the fear in the story. The work was returned and the learner was puzzled by her very poor mark. The educator explained that she had marked it out of 20 and subtracted a mark for each spelling, punctuation or grammar mistake. That learner was very unhappy with the result of the assessment and was discouraged from trying to write interesting stories.
37
EDAHOD-5/1
What criteria did the examiner use? What criteria did she give the learners? Was the assessment fair? Imagine if the educator had said: ``Write an interesting story. I will mark your writing as follows: Assessment criteria Creative use of language Expressing feelings clearly Punctuation Spelling Total mark Mark 20 5 5 5 5 20
Had the learner then seen the assessment, she would have understood what her strong and weak points were.
38
Maths test
Grade 9
(1) You have bought the following items: . . . . . . Fruit: Cereal: Canned food: Bread and buns: Tea and coffee: Milk: R43,98 R22,45 R34,68 R11,80 R41,60 R10,60
How much did you pay for all the groceries? (2) You have bought groceries for R187,00 and had to fill up the car as well. You have R250 in your purse. How much petrol can you buy? (3) If you bought 12 workbooks and paid R2,30 each, how much would you have to pay for 20 of the same workbooks? Mr Ludritz is pleased with the test he has compiled, but nearly all the children have done badly. His colleague, Mrs Ngwenya, tells him this proves that his practical, hands-on approach to Maths is not working. Mr Ludritz knows that this is not true, because he has seen the children handling and calculating the play money correctly. He cannot, however, explain the poor results. Let us take a look at what happened here. Mr Ludritz was doing a good job, laying solid foundations for a genuine understanding of the manipulation of figures representing money. But the best way to assess whether his outcomes have been achieved is to get the learners to use money. He could then simply have observed his learners in their games and decided who was using money well and who was not. He did not need a written test! So Mr Ludritz's problem was that the test he set did not test what the children had been learning to do. The test introduced too many things at the same time. He had moved too quickly from the skill of manipulating money to the skill of adding figures that represent money (the calculations in the test). How did Mr Ludritz adapt his assessment technique? He made a list, noting down the different things he wanted his learners to be able to understand and do. He took a class list and put each of his outcomes in columns next to the names, something like this:
39 Outcomes Knows how to add rands Can add rands and cents Can read, interpret word sums correctly Can subtract totals Can multiply and find the correct total Name Fikile Tsepho Karin Siphiwe Morne
EDAHOD-5/1
During the next two lessons, he assesses the children constantly by observing them at work, listening to their communications with each other, asking questions and making notes against his check list. He puts a tick next to the child's name when he is satisfied that one of his selected assessment criteria has been met. He has also left a space on his check list for comments, because he has found that he sometimes wants to add a note (because people often learn things that are not in the educator's plan). Mr Ludritz is doing three key things in his adaptation: . He is making more use of observation as a form of assessment. . He is integrating assessment into his teaching. . He is using a form of criterion-referenced testing. In other words, he did not just allocate a mark in some arbitrary way. Instead, he assessed his learners' performance against a list of criteria which he believed they should meet in order to achieve his outcome.
40 who would do his utmost to enable them to understand and apply concepts. He involves learners in class with practical activities. Mr Botwick realised a bit late that he would not be able to complete all the subject content in the syllabus with his learners and therefore left out sections of the work. The final exam at the end of the year included questions on the whole syllabus. Mr Botwick's learners didn't perform well, because none could answer the questions on the sections they were not familiar with. Although Mr Botwick felt very bad about the situation, he couldn't change anything at that stage.
For Mr Botwick it was difficult to achieve curriculum fidelity, because the design of the assessment task was out of his hands. He is a skilled teacher, concerned about the performance of learners, but still there is no relationship (congruence) between Mr Botwick's teaching and the assessment done. Therefore we can say that he unfortunately did not adhere to the requirement of curriculum fidelity.
41
EDAHOD-5/1
department had produced in decades. If he could have been assessed in a more informal way and given credit for what he could do, he probably would have had a far happier university experience.
42 assessment. Write down two which you consider very important and give reasons for your choice. Diversity and opportunity are especially important in the South African context. Do you agree? Give reasons for your answer. There are three issues mentioned and discussed in the section ``The influence of the test-taking situation''. Make a list of these issues. How does your experience in the classroom relate to what the authors are saying? Gender issues are discussed in ``The influence of the response format of assessment tasks''. What type of assessment tasks do males tend to prefer? Compare these tasks to what females would prefer and indicate how they differ. Describe your assessment situation in relation to what you've read about gender preferences. (See Unit 4.4.3.2 as well.) Summarise the main points the authors make about the use of results.
. .
3.2.3.4 Transparency
Transparency means that all stakeholders, especially the learners, should understand what is going on in the assessment. (See Unit 4.3.2.2, 4.4.2.3.1 as well.). Being transparent is often an issue of communication. It can include allocating marks to questions in a written test instead of just allocating a mark to the whole test. This can be varied by breaking down questions to show exactly what the marks are for. An important way of achieving transparency is through criterionreferencing (see Unit 3, 3.1.1.2 as well). Teachers should always have a set of criteria by which the learner's performance is measured. This could be a marking memorandum, a set of criteria negotiated with the learners or even an assessment grid which is discussed with the learners or otherwise provided as a guide to finishing the project, work sheet or whatever.
43
EDAHOD-5/1
Teacher
Content
It is clear that teaching, learning and assessment are inseparable. This hand-in-hand relationship will lead to an enhanced teaching-learning situation. One has to remember that, in order to achieve such an enhanced situation, the teacher has to plan, plan and plan again. A single task, can for instance, combine the functions of teaching, learning and assessment. The method of assessment will depend on where the task fits into the teaching sequence and what kind of information is wanted. What should be the teacher's guidelines when planning assessment? . Design tasks that are fair to all learners. A good assessment task reveals what learners know and can do. A fair task provides equal opportunities for all learners, regardless of their ability, learning styles, interests and language. . Use a variety of tasks for instance, open and closed questions and tasks, formal and informal, relating to different contexts, requiring different modes of communication and thinking. This gives more learners opportunities to show what they can do, and of course it better addresses the different dimensions of competence. . Keep outcomes in mind at all times. When designing a task, select a small number of outcomes (or even assessment criteria) as so-called ``focus outcomes''. For example: ``In this activity I will be looking especially at your ability to plan an argument, organise ideas and give evidence that will support your argument.'' By implication, the teacher will not be so concerned about actually presenting the argument in this particular task. . Design tasks that are authentic, which means that these tasks ought to be appropriate to the learners' experience and the particular learning areas concerned. . Ensure that learners know what they are to do, which parts of the process are their responsibility, what are the time lines for the process and how they will be assessed. . Always seek balance in your programme with regard to types of
44 assessment, outcomes, content of and emphases in the learning programme. Assess the things that are important, not merely aspects that are easy to assess or subject content that would ``select or grade'' learners. Draw up some grids and schemes that enable you as the teacher to check the variety of tasks and the balance across outcomes within a learning programme. Always keep in mind what is manageable for teacher and learner. It helps if most of the tasks can be ``marked'' efficiently and easily, or if the learners themselves are involved in the assessment of their tasks. Ask the following questions regarding the fairness of a task: (1) Does the task provide the information you intended it to provide? (2) Has the content (or skill) that is being assessed been taught? (3) Does the task enable learners to demonstrate their progress and capabilities? (4) Is the marking memorandum objective, or do you subtract marks for things like handwriting and behaviour? (5) Is the learner familiar with the type of task? (6) Does the task use authentic, real-world activities? (7) Does the task match an important outcome that reflects a range of complex thinking skills? (8) Does the task test larger areas of the curriculum and higherorder thinking skills at the same time? (9) Is the language level appropriate for the learners? (10) Is the task gender-biased? (11) Will important stakeholders (learners, parents, school, employers) see the task as meaningful? (12) Will the task be meaningful, engaging learners so that they will be motivated to show their capabilities?
. . .
After all the comments and questions you can ask yourself, such as the ones above, you can conclude that the teacher is the creator and mediator of assessment which is, all in all, the teaching and learning situation per se!
45
EDAHOD-5/1
The cycle would include, for instance, gathering information (evidence), recording the results, giving feedback to the learners, and so forth. It shows that assessment does not come at the end of the teaching and learning process; it is used, rather, to guide and direct future teaching and learning by analysing what has taken place and establishing a new cycle of teaching and learning. CASE STUDY In order to observe and assess while teaching, Mrs Ngwenya found that she had to change her style of teaching. She started giving learners plenty of time and space to work things out for themselves. She only intervened when they seemed really confused and unable to proceed. She found that her habit of supplying answers when learners could not answer her questions stopped active learning. The learners did not bother trying, because they knew she would supply the answers anyway. They also used to wait for her to tell them what to do next. Now Mrs Ngwenya asks different questions and insists that learners spend some time working them out for themselves. But in order to do this, and to be able to assess the development of the learners' skills and knowledge through observation, she has to ask appropriate and well-planned questions. Practising this cycle of plan-do-assess-and-review is the key to developing as a reflexive practitioner. It also enables you to give constructive feedback on learners' work, so that they know exactly how well they are doing and where they can improve. This is the whole point of continuous assessment.
46
STUDY UNIT 4
Effective assessment
4.1 ASSESSING WITH OUTCOMES AND INTEGRATION IN MIND
We saw in Study unit 2 that the Matric examination serves the purposes of selection, grading, monitoring and controlling, which was regarded as valuable educational knowledge that mattered at a particular time. Those who met the requirements obtained certificates and thereby a passport to all sorts of options and professions in society, which were denied to others who did not make the grade. We unfortunately still cling to a paradigm of the past in which certain subjects were considered more important than others and in which these subjects held the key to ultimate success. To be well equipped for the contexts in which we are living today, another paradigm should become part of our thinking with regard to education, namely the integration of teaching, learning and assessment and the planning of assessment with outcomes in mind.
Read through the following list: Learners should be able to . . . . . . . . . . . . identify and solve problems by critical and creative thinking work effectively in a group/team organise and manage themselves responsibly and effectively collect, analyse and critically evaluate information communicate effectively use science and technology effectively and show responsibility towards the environment demonstrate an understanding that the world is a set of related systems and that problems do not exist in isolation explore a variety of strategies for learning explore education and career opportunities develop entrepreneurial abilities be culturally sensitive participate as responsible citizens
47
EDAHOD-5/1
Yes, they are the seven critical outcomes and five developmental outcomes. Our policy makers also thought that these outcomes were crucial and should underpin the learning process in all its facets. That is why they called them critical outcomes, because they should direct our teaching and education practices and the development of learning programmes and materials in all learning areas. Critical outcomes are broad, generic and cross-curricular. These outcomes lay the foundation for developing all other outcomes. In other words, all learning outcomes should follow from these critical outcomes and they are not restricted to any specific learning context. According to these outcomes, learners must be able to indicate that they can . . . . . . work effectively in a group/team solve problems organise and manage their activities responsibly and effectively collect, organise and evaluate information communicate effectively use science and technology effectively and critically, and act responsibly towards the environment . demonstrate an understanding of the world as a set of related systems Developmental outcomes are also outlined: Learners should . . . . . explore a variety of strategies to learn effectively develop responsible citizenship explore educational and career opportunities be sensitive towards cultural issues develop entrepreneurial abilities
Do you think these are the types of skills that should be developed in a learner? Do you believe that these skills could help a learner to survive in a fast-changing world? And most importantly, could they prepare a learner for an active life? Can you see why these outcomes are so important? We believe all educators should know them by heart! In fact, one should always keep them in mind in all aspects of teaching and learning.
48 This planning requires collaboration, all the teachers bringing their knowledge and skills ``to the table'' and working together to develop a learning programme. Previously most educators planned individually. In grade planning, it is important to plan together for the following reasons: . . . . . . to ensure an integrated approach to teaching, learning and assessment to empower educators (team teaching) to enrich the different learning approaches with a diversity of input to ensure consistency to ensure a high standard of work throughout the grade to share the work load
Do you understand why they say OBE should be a holistic and integrated process? Think about it again. Holistic means that the sum of the parts is greater than the whole!
49
EDAHOD-5/1
Look at the list of action words. Indicate which of them will be suitable for the following levels of thinking:
Knowledge . . etc Comprehen- Application sion Analysis Evaluation Synthesis
Know; arrange; identify; list; name; locate; memorise; recall; relate; reproduce; classify; compare; infer; describe; discuss; distinguish; explain; identify; indicate; define; interpret; review; summarise; apply; choose; discover; demonstrate; dramatise; draw; illustrate; modify; use; practise; prepare; show; sketch; survey; analyse; calculate; classify; categorise; compare; contract; criticise; deduce; differentiate; discriminate; distinguish; examine; experiment; question; arrange; assemble; plan; collect; construct; write; design; create; develop; formulate; insert; set up; integrate; organise; argue; assess; attack; choose/decide; estimate; judge; predict; rate/score; select; support; recommend; justify.
Note that each verb elicits a different skill. The first two categories, knowledge and comprehension, will help you formulate outcomes for the specific content that is required for your learning programme. The other categories give you a selection of verbs that will sharpen certain practical skills as well as higher-order thinking skills. You will also have to think carefully about the values and attitudes you would like to instil, and select a verb that will elicit the specific values and attitudes you want learners to adopt.
We used the verb ``cultivate'', which implies that we would consciously spend time developing cultural awareness throughout this learning programme.
We have summarised the learning outcomes for this lesson as follows: By the end of this learning programme, the learner should . be able to distinguish between the various cultural groups in South Africa (knowledge) . have developed entrepreneurial skills . have cultivated cultural awareness and sensitivity (attitudes)
50
Note that the last outcome is also an important critical outcome that would be dealt with in various ways. Step 3: Do a baseline assessment Baseline assessment is the assessment an educator uses at the beginning of a new set of learning activities to find out what the learners already know and can demonstrate, in order to decide what level of knowledge/instruction/learning to build into the learningexperience plan. You can do baseline assessment in various ways. For example, you can ask questions to determine the depth and scope of your learners' knowledge about the various cultural groups in South Africa. (This will indicate the level of demand that is required, so that you will know what to cover in this programme organiser.) The assessment standards will also give you an indication of the level of demand that is required and what types of activity to plan. Step 4: Brainstorm ideas for possible activities for the topic you have selected At this point we would like to generate as many ideas as possible around our chosen topic, so that we can develop activities that are really authentic and relevant to the present and future lives of our learners. Brainstorming is an excellent technique to employ. There are various steps to this technique which, if properly applied, will give you a wealth of creative ideas to use as activities and you will have a lot of fun at the same time. Preparing a brainstorming session . Provide a time limit, say 20 to 30 minutes. . Identify a recorder/facilitator. . Establish ground rules such as: Do not criticise. Do not edit/change what is said. Go for quantity. Encourage wild, outrageous ideas. Build on the ideas of others. Base the ideas on real-life issues. Determine the brainstorming method: Determine what method you will use for example: shouting out ideas, or everyone takes a turn. . List all ideas. . Do not spend more than 10 to 15 minutes on this section.
51
EDAHOD-5/1
Remember that ideas can be diverse, yet they all relate to the same topic. This is because teachers from various learning areas put their minds together and one idea leads to another. Step 5: Plan activities from the ideas you have generated The next stage of the brainstorming process is very important: it ``customises'' the ideas you have generated, so that appropriate activities can be developed that will take the learners towards the outcome one step at a time. How to adapt ideas and create filters: . . . . . . Substitute/combine ideas Adapt ideas Modify/magnify ideas Put ideas to other uses Eliminate ideas Rearrange ideas
Think about the critical outcomes you would like to incorporate in your learning programme. This may provide you with various ideas when it comes to planning activities. How would teachers from different fields of study interpret the topic? For instance, a Social Sciences teacher decided to give the learners a research project, ``A brief history of the various cultural groups in South Africa, where they originated and where they are located now''. This would cover the history they need to know about the various cultural groups. To integrate this with Geography, she thought map work would be a good idea. One could depict the population distribution of the various cultural groups in this way. The Maths and EMS teachers took the opportunity of covering graphs thoroughly and offered to plan a work sheet that covered this knowledge. The EMS teacher further decided that ``setting up a spaza shop'' would be an excellent way of dealing with trade and barter in this programme organiser.
52 The Arts and Culture teacher had quite a few good ideas too. She thought she could elaborate on the knowledge the learners were acquiring about the various cultural groups and do a collage at the same time, thus incorporating various religions and particular ceremonies and festivals as well as famous leaders and political figures of the different cultural groups. She also decided that the learners could illustrate the various cultures' musical instruments by making a few of them that could be used in a play or drama. The EMS teacher then asked her if the learners could also create something authentic out of pottery or clay, such as beads or clay pots that could be sold in the spaza shop. The Natural Sciences teacher decided to incorporate one of the assessment standards for Grade 8 and turn it into an activity, because it integrated well with the research project the learners had to do for Social Sciences. She decided that the learners should generate a list of basic human needs that are common to all sciences, now and in the past. The Languages teacher thought he could let the learners do a written presentation to go with the collage, and for oral the learners could do research on some of the beliefs and myths of each cultural group and dramatise these in front of the class. The Life Orientation teacher really came up with a bright idea. He thought that the learners could learn how to make a fire without using present-day aids, and dramatise their stories around a ``camp fire''. They could also use their musical instruments in the play. Can you see how easy it becomes when you collaborate with your colleagues? It not only makes the task much lighter and more meaningful, but also allows for learning area integration and a holistic learning experience. Just imagine how exciting this learning experience could be for teachers as well as learners! Now it is your turn again to plan activities from the ideas you have generated. Step 6: Determine the time frame for the duration of the learning programme The time you need to complete the learning programme should also be taken into account during the filtering stage of the brainstorming session. You may have to adapt the time frame, depending on the magnitude of the learning programme. Try to keep to a three to fourweek time span, otherwise the learners may become bored with the same topic.
53
EDAHOD-5/1
Step 7: Formulate assessment criteria for the activities The choice of activity should make it evident what you want to assess and how you want to assess it. It is important to be very specific and to ensure that the criteria are measurable. Remember, we are talking about criterion-referenced assessment. This form of assessment is viewed as making judgements about learners' performance/progress by measuring their work against set criteria that are independent of the work of other learners. Even if grades are given, the learners are graded in terms of whether they have satisfied the criteria set for assessment. Make use of the verbs that we listed in Step 2. They will help you to formulate assessment criteria. Select an appropriate verb to ensure that the learners' knowledge, skills and attitudes are developed.
But how does one measure attitude? Educators often ask this question. Simply ask yourself the following question: did the learner put in some effort; did he/she show perseverance? If you really think about it, you should be able to say: Yes, he or she put in a lot of effort, or a fair amount of effort, or no effort at all. Do you agree? Now look at the assessment criteria we have designed for a research project entitled ``A brief history of the origin of the various cultural groups in South Africa''. Then select one activity and formulate appropriate assessment criteria for it. Our example Activity: Research project Learners should be able to . select applicable information (knowledge) . summarise the essence of where and how each cultural group originated and where they are mainly located today (knowledge) . illustrate the above by using a map of South Africa (skill) . demonstrate a creative and original flair (skill) . show effort in their presentation (attitude) Step 8: Decide what resources you will require for each activity After identifying possible links between outcomes and activities and the resources that you have available, the most appropriate resources should be selected. In this case we would have selected books or articles from the library as resource material. Do you agree? What would you use?
54 The resources you are going to use should . . . . . . . . . encourage learning get the learners interested build a learning experience respect different views on different issues suit the environment of the learners link up with the learners' existing knowledge be appropriate for all learners in the target group encourage positive values and attitudes be free from any bias and stimulate critical and creative thinking ACTIVITY Write down the resources you can use. Step 9: Design an appropriate assessment strategy Your assessment strategy should include a variety of techniques, tools and methods. You already covered the first step of your assessment strategy when you planned your activities. For example, we selected a map for Social Sciences and a bar graph for EMS as suitable activities for the learning programme. They are also regarded as assessment techniques, because they are designed or selected to generate specific evidence for assessment. So the moment you plan your first activity, you have taken the first step in planning your assessment strategy.
Can you see why we say teaching and assessment are linked? When planning a learning programme, you should ask the following question from the outset: What assessment technique would be the most applicable for measuring the required outcomes? Would you, for instance, use a research project or a written assignment? How would you assess a research project or an assignment? Would you use an observation sheet with assessment criteria, or a rubric? These are the tools of assessment. Remember, the assessment criteria have already been designed for the activity. Simply use these criteria again and select an appropriate assessment tool. One should then ask: ``Who will be doing the assessing?'' Will it be a group assessment, self-assessment or peer assessment? These are possible methods of assessment. The following table provides you with a variety of assessment techniques (activities), tools and methods to choose from:
55 Techniques (``what'') project, collage, essay, assignment, survey, report, scenario, construction, descriptions, physical activity Tools (``how'') observation sheet, tests, worksheet, journal, questionnaire, examination, written report
EDAHOD-5/1 Methods (``who'') self/peer/teacher/group assessment also interviews, conferencing, observation, questions and answers, examinations/tests, self-reporting, portfolio this can be group to learner/group, learner to learner, learner to group, class to learner self/peer/teacher/group assessment self/peer/teacher/group assessment
music/songs, poetry, stories, oral, game, roleplay, drama, presentation, panel discussion model, graph, design, sculpture, maps, posters, painting mind map, table, questions, charts
grids/rubric, photograph
ACTIVITY (1) What assessment tool would be the most appropriate to record your findings about your learners' performance? (2) What assessment method would be the most suitable in this case? Write down your answer and give a reason why you say so.
Step 10: Select appropriate critical outcomes and learning outcomes Deciding on the applicable critical outcomes (COs) and learning outcomes (LOs) are the last pieces of the puzzle. We have followed a bottom-up approach: we feel it is easier to select the applicable COs and LOs at this point, as you know what activities you have planned in order to generate evidence for assessment. You also know what assessment strategy you have designed to evaluate the evidence against the outcomes. We also find it easier to refer to the policy document at this point, because you have a broader base of knowledge and more information to select the most appropriate COs and LOs.
56
Now that you have worked through this section, can you . select an appropriate topic for the particular grade and learning area for which you are responsible? . formulate the outcomes you want your learners to achieve for the content/topic you have selected? . do baseline assessment to determine what the learners already know and understand about the topic you have selected? . brainstorm ideas for possible activities that will take the learner towards the outcome one step at a time? . plan activities from the ideas you have conceived? . cater for diversity and different learning styles and intelligence? . determine the approximate time frame for the duration of a learning programme? . formulate assessment criteria for the activities you have planned? . determine what resources you will require for each activity? . design an assessment strategy that generates evidence for assessment and evaluates the applicable evidence against the outcomes? . select appropriate COs and LOs for your learning programme from the policy documents?
You have reached a very important milestone in the planning process. If you consistently and systematically preserve clarity of focus regarding your outcomes, plan backwards all the way, have high expectations and avoid limiting the learners' opportunities of achieving these outcomes, both you and your learners will most certainly achieve them. It may not be at the same time and in the same way for every learner, but it will certainly be worthwhile!
57
EDAHOD-5/1
learning. By informing teachers about the demands of different types of questions, he hoped to encourage them to teach learners higher-order ``thinking skills'' (cognitive skills).
Evaluation
Analysis
Understand how parts relate to a whole. Understand structure and motive. Note fallacies Transfer knowledge learned in one situation to another
Application
Comprehension
Demonstrate a basic understanding of concepts and curriculum. Translate to other words Ability to remember something previously learned
Knowledge
58 recall and ask for information and knowledge. The difficulty lies in asking questions that require thinking, an own opinion, or analysis and evaluation. In the past some teachers have thought that one has to start with knowledge at the beginning of the school year and work up to synthesis towards the end of the year, which ought not to happen at all! What actually needs to happen is that one should ask all the different types of questions and make sure that there is a balance between them. Are knowledge questions not worthwhile then? Of course they are worthwhile! Without knowledge and content there won't be anything to apply that is why it's so important to make sure that learners do understand particular concepts, that they can define, describe and explain before they can compare, recommend and give an own opinion. Say, for instance, that we ask learners to do a comprehension task in English or an experimental task in Science: we would need to cover several cognitive skills at the same time. Regarding the comprehension task, we need to . . . . check whether learners can recall particular information check whether learners understand the information ask questions in which learners can apply the information challenge learners to look for deeper levels of meaning or to synthesise the new knowledge with things they already know
59
EDAHOD-5/1
could be determined by finding the gradient (slope) of its velocity versus time graph at a specific point on the graph? . A car moves along a straight road. We plot the velocity versus time graph for the motion. Which quantity do we get from the slope of the graph at a specified time? (2) It also helps to use active rather than passive voice. For example: write ``We add sugar to the cup of tea'', rather than ``Sugar is added to the cup of tea''. (3) Avoid words of many syllables. For example, write ``Use the remedy'' rather than ``Implement the remedy''. (4) When using words that refer back to something in the previous sentence words like ``he, they, it, that,'' etc it must be clear what those words are referring to. For example, who are ``they'' and ``them'' in the following sentence: ``When teachers explain things, they often forget that they should ask them diagnostic questions first.'' (5) Encourage learners to answer in ways with which they feel most comfortable. For example, let learners use words in languages other than English, if that is how they can best express an idea. Or allow several ways of explaining the same thing, like giving a definition by using a word or a labelled diagram.
60 integrates knowledge, skills and values with perception, judgement and decision making, all to achieve a particular purpose. To assess a driver's competence, we want the driver not only to talk about how to drive, but to do it practically and show us how to drive. Furthermore, we need to observe this particular driver in different situations:
Some of the situations can be reactions, knowledge of traffic signs, or skills, but other situations may be complex and integrative for instance, driving in heavy traffic in the rain. Assessment using complex tasks is commonly called performancebased assessment. Learners might complete a project where they do the reach, analyse ideas, work in teams, invent solutions, and so on. They might produce a physical model, a newspaper article, a play, a debate, a report or whatever. The projects or performances require integration of knowledge and skills in the context of producing something, solving a problem or presenting a case. The teacher can focus on a particular skill or competence by deciding on a variety of small tasks that give the learners opportunities to demonstrate their competence in different situations. For example: learners demonstrate their writing skill, spelling and punctuation in a short paragraph. Later they can integrate this competence with others by compiling a report, ordering ideas, doing a research summary, and so forth. Always remember the importance of context, purpose and decision making in competence without under-valuing knowledge and skills or the need to practise. Learners won't be able to communicate effectively it they only have a small vocabulary. They won't be able to solve a problem if they don't have the knowledge and experience to draw on! a Assessing competence through authentic tasks Authentic tasks mean that the assessment of competence in such cases should be real (genuine) and applicable to the subject and the learners' world. When authentic in relation to the subject (say, Science), it means that learners should work scientifically in investigating a problem, analysing an issue, providing an explanation and so forth. An authentic task in relation to the learners' world means that learners should see the tasks as worth doing, linked to their interests and
61
EDAHOD-5/1
experiences. An authentic task in Maths asks learners to tackle problems they wish to solve in contexts that relate to their interests. For instance: You are planning to spend your ``free year'' after Matric in London. First describe how you are going about finding information about jobs, the season in London when you want to go, whom to contact about accommodation and transport. Think also how much money you will need between home and work. Indicate in your planning report how long you plan to stay and what your reasons are for going to London. Calculate the following: . . . . . . . Air tickets: Johannesburg London How much money you will need till you get your first wages Accommodation per week E-mail and cell phone costs Monthly wages when you receive 5 per hour (R11,20 per hour) Cost of visiting France and Switzerland during your stay, Savings (if any!)
b Example 1: Assessing ``Learning how to learn'' The ability to learn is in itself a competence! Usually learners don't think much about their learning strategies. Teachers can promote learners' metacognition (reviewing yourself how you learn) by helping them to become more conscious of their learning skills reflecting on effectiveness, evaluating strategies and developing particular skills. The teacher can furthermore explain to learners why they have to do certain tasks; they can talk about links and goals. It is quite difficult to separate learning skills from tasks and the things that are being learnt but it's useful. For example: standing outside the reading process and thinking about strategies not only improves skills in reading, it also helps in understanding the content. Tasks that help learners to reflect on and evaluate their competence in learning include the following: i Compare and reflect on learning strategies Learners write, draw and talk about the purpose of the activity, for instance; how it relates to their experience and fits into the bigger picture of the topic. Learners can only identify the strategies they will need in order to get information from the text and decide what is important.
62 ii Compare different ways of working When solving a problem, analysing a text or planning an experiment, the teacher might raise some different approaches and encourage discussion. For instance: some learners, when preparing an essay, like to start reading through the references and underling points that seem important. Thereafter they will reshuffle points and start to think of their essay plan. Other learners prefer to start by thinking about what they want to address and then go to the texts to find answers. Later the class can compare the different strategies they have used to approach and complete the essay. iii Draw mind maps (concept maps) First let the learners brainstorm some aspects, concepts or information in a particular unit of work or set of concepts. Thereafter learners identify individually all major and minor ``concepts'', information or even experiences in a unit of work. Concept maps work best when learners have to explain what they have drawn to the teacher and to the other learners. iv Create analogies, role plays, illustrative stories, cartoons or tables These activities require learners to look at ideas from different perspectives, express them in different ways and reorganise them. v Translate information from one form to another In this case the learners can translate information from text to graphic, table, graph or cartoon, or vice versa. Again, learners have to look at the information from different perspectives and re-interpret it. vi Create a glossary of terms, a summary of ideas or a flow chart of the logic of a unit of work vii Match playing games Teachers can rewrite their plan of work, giving in one column things the class did and, in another column, reasons for doing them. The two lists can be jumbled. The learners have to place ``things done'' in logical order, and align the reasons with the things they relate to. viii Reflect and review Just as you found some aspects in this module to rethink and reflect on, learners have to look back over their work and think, write, draw, talk, etc about what they found interesting and important. These review activities can also be imaginative. Imagine, for instance, that a visitor came to the class today and wanted to know why it had been worthwhile to do this project. What would you say?
EDAHOD-5/1
The class can be asked to reflect on particular activities and develop a set of rules that increases the value of the activity. This activity may result in rules for group work, projects, understanding text, and so on. c Example 3: Assessing skills in group work Working in a group is most valuable when all its members are working towards the same goal and, in doing so, pooling their knowledge, talents and experience to help each other find new meaning or a new concept. The ability to work in a group is one of the critical outcomes of Curriculum 2005 and therefore teachers have to teach and assess it effectively. In a group, individuals can learn from one another and can, of course, work from their own perspective, language and starting point. In linking outcomes to how participation in a group can be assessed, the following criteria will be applicable: Learners should be able to . demonstrate active commitment to the group . contribute themselves and their experience in the context of the group's task or project . when work is divided up, accept responsibility for the job the group requires . help the group to structure the task . show sensitivity and skill in sharing power, leadership and work . respect members of the group . respect all members' tasks and fulfil own tasks . be self-directed in cooperation with the others . be aware of the ``rules'' of group work . learn from and with the group members
Assessment is a way of finding out what a person knows, understands and thinks, and what he or she can do. Continuous assessment is simply a matter of being constantly aware of how your learners are developing, and keeping a record of this development. Evidence of competence (when a learner achieves outcomes) often emerges during normal daily class work or from homework. The educator may observe that a learner has met the criteria for achieving a particular outcome by
64 . . . . watching the learner working in a group listening to the learner explaining a concept reading the learner's evaluation of a model, drawing or graph assessing any other activity used to teach the learners
Mrs Ngwenya had also learned an important practical lesson. One cannot assess every child in every lesson. Therefore it is necessary to design a system where you can observe each learner for a good length of time every two weeks or so. Continuous assessment is about recording your observations of your learners' progress, and using this information to see how they learn and to guide you on how you should teach your next lesson. All assessment, even examinations, should be designed to form a part of active learning and not be treated as a separate activity. It is clear from the above discussions that continuous assessment did not happen in this manner in traditional assessment practices. Tests and examinations were treated as totally separate, final activities and were used to see whether the learner had passed or failed! They had very little formative function and usually took place only at the end of the course. Continuous, formative assessment takes place on and off throughout a course or period of learning in order to monitor the learners' progress and inform teaching and learning. If the pattern in the classroom is simply one of teach-test-and-move-on, there will be little opportunity for either you or your learners to improve on our performance, and you would be repeating the pattern of the traditional approach. Do you agree? a The cycle of continuous assessment Continuous assessment means that you assess your learners at each critical step of their learning.
Baseline assessment is done prior to teaching or at the beginning of a lesson, and provides the teacher with planning information. It helps you to find out what the learners already know and can do. It is best done quickly and informally. For example, the teacher can ask questions like, ``show me how you would ...'', or give a spot quiz. Diagnostic assessment is used to find out more about the exact nature of learners' problems. For example: the teacher, while monitoring the learners' progress in numeracy, may find that a
65
EDAHOD-5/1
particular learner has a problem with place value. This could happen informally during the learning programme, or when the learners are tested. The teacher should remedy the problem immediately.
Did you notice how formative and summative assessments are used in conjunction in this continuous cycle? Ideally, they should be used to offer learners an opportunity of demonstrating what they have learnt and to inform teaching and learning.
So far we have seen that the nature of outcomes-based assessment favours criterion-referenced, formative and continuous assessment.
Analyse the following two ways of assessing a Natural Science lesson: Together, Mrs Preacher and Mr Fortijn worked out a Natural Sciences activity for their learners. This was the activity: Make a model of a cross-section of a flower, using paper, plasticine and wire. Label the parts; be sure to include the stamen, the stigma and so forth ... (and the activity went on to list a number of other things the learners had to include). The learners completed their models and the two educators separately evaluated their learners' models, giving grades ranging from A to E. There was very little difference in the performance of the two classes. In both classes, most learners got a C or D rating, while there were one or two good performers (rated A or B) in each class. The following term, the same classes were asked to make plasticine models showing a cross-section of the heart, labelling certain identified parts. Although this activity dealt with a different topic (the heart as opposed to a flower), it required similar skills. But for some reason the learners in Mrs Preacher's class worked quickly and
66 confidently, with good results (a number of them got A's and B's), while the performance of the learners in the other class had not improved (the majority still had C's and D's). The two educators were puzzled. ``How is it that one class has developed so well while the other has not, although we are teaching them in the same way?'' they wondered. Marking and evaluation Mr Fortijn marked the work and returned it. The learners each received a grade. One or two also had short, written comments on their scripts. Mr Fortijn did not allow learners to look at and discuss one another's work, because he felt that this would ``waste time''. Mrs Preacher, on the other hand, put all the learners' work on display and invited them to look at all the models carefully. She reminded learners of the assessment criteria she was using to award a grade. (She had given these to the learners before they did the activity, and their work was compared to the criteria while they were working. Their progress was checked and improvements were made along the way.) The criteria were as follows: (1) The model must be a cross-section and must be well made. (2) The structure of the flower must be correct. (3) The parts must be labelled correctly. She then started a discussion in which learners were asked to identify models that satisfied the first assessment criterion. To begin the discussion, she asked questions like: ``Are there any other models that fulfil this indicator better? Why do you say so?'' She also asked if anyone could see a way of improving their own models. Mrs Preacher furthermore explained how she had awarded grades. She said that in order to receive an A, someone had to have met all the assessment criteria outlined. After a full period of discussion, she returned the work with grades awarded, and said that any of them who felt puzzled by the grade they had received should speak to her after the lesson.
The only difference between these two educators was in their manner of assessing. But it had a significant impact on their learners' learning. While Mrs Preacher integrated her assessment into her teaching, Mr Ntuli understood assessment only as a way to check what learners had learned. In other words, he only used it summatively (to ``sum up'' what learners had learned). Because Mrs Preacher used assessment as a teaching
67
EDAHOD-5/1
opportunity, her learners began to understand where they had gone wrong and what they could do about it. How did Mrs Preacher demonstrate good OBE assessment practice? . Mrs Preacher and her learners started with the assessment criteria that were going to be used to evaluate the work. This means that the learners started with a clear picture of what was required; it gave direction to their learning. In other words, it was criterionreferenced assessment. . The learners were involved in the assessment process. They helped each other to understand the problems they experienced and discussed what they could do about them. . Assessment was part of everyday class work and/or homework. In other words, it was continuous. The learners tried things out, checked how they worked, and improved on them. Mrs Preacher did not teach first and then stop teaching in order to assess. This indicates that it was formative assessment. . As her learners developed the skills to evaluate their own and later each other's work in a fair and reliable way, they began to take some of the burden of assessment off Mrs Preacher's shoulders. She could begin to delegate the marking of certain activities to groups of learners (although she still guided the marking). . Did you also notice how Mrs Preacher integrated teaching and assessment throughout her lesson? Note how she discussed with the learners the way in which she awarded grades and invited learners to discuss their marks with her if they did not agree? A good way to summarise what we have learned so far might be to compare Mr Fortijn's assessment practice with that of Mrs Preacher. In this way we will be analysing two types of assessment practice in context and simultaneously we will recap what we have learnt.
ACTIVITY Write some notes on the following: (1) Compare Mr Fortijn's mode of assessment with that of Mrs Preacher. (For ease of reference you can also make use of a table, which is always an excellent note-taking strategy.) Address the following in your answer: . the choice of mode . the choice of frame of reference . the choice of media (If you are unsure of what is meant by the above terms, refer
68 back to the table on the Matric exam in Study Unit 2 to refresh your memory.) (2) Are all the learners doing the same project? Why would you say that? (3) Which of the two classes did best? What reasons can you give for these learners' better performance? (4) In what ways did Mrs Preacher use the assessment as a teaching opportunity? (5) How did Mrs Preacher demonstrate good OBE assessment practice?
Mr Fortijn's choice of assessment mode is clearly summative. Although his choice of media is practical work (a model), he still awarded grades by marking the work and returning it without any disussion. Can you see that he has treated the assessment in the same way as one would mark a test? It may therefore be described as a norm-referenced test. The learners were possibly awarded an A, a C or a D depending on whether they performed above or below the class average, which in this case appears to have been a D. This indicates a more competitive and formal assessment. The fact that Mr Fortijn would not allow any further debate about the marks also implies that it was a final product. Mrs Preacher's assessment, on the other hand, is of a formative and criterion-referenced nature. Both she and her learners started with the assessment criteria that were used to evaluate the work. Learners were allowed to compare their work to the criteria, try things out and improve on their work. They were also allowed to discuss their grades with her afterwards. Can you see that this is a process, which is implemented informally and in a non-competitive way? From all these characteristics one can also see that Mr Fortijn's assessment leans towards the traditional approach, the main purpose of which was grading. The main purpose of Mrs Preacher's assessment practice was to inform teaching and learning and monitor the learners' progress. Mrs Preacher also indicated that she was a reflexive practitioner by going back to the drawing board and improving on her assessment in the second activity. From the above discussions, do you agree that Mrs Preacher's assessment demonstrates good outcomes-based practice?
69
EDAHOD-5/1
70 community above another. This applies to cultural differences as well! For instance, a physics problem in a Matriculation examination paper referred to bungee jumping. Since bungee jumping is completely foreign to many of the rural candidates who wrote the examination, they were disadvantage by this context. ACTIVITY (1) How can you change a task to make it gender inclusive? (a) Study the adapted version of Table 1 (The gender orientation of assessment items) which you saw in the article by Parker and Rennie (Addendum A).
CRITERIA Language Portrayal of stereotypes Appeal to b a c k g ro un d experiences Context MALE ORIENTATION Uses ``he'', ``him'', ``his'' Males in active role, females in passive role Relevant to stereotyped male experiences Decontextualised abstract GENDER-INCLUSIVE ORIENTATION Uses the name of a person, uses you Both male and females in active and passive roles Relevant to males and females equally Human, social. Environmental
(b) Read the following assessment question from a Science test: Mary boils eggs on the stove for her brother Mike's breakfast. She asks him to explain to her what is in the bubbles that form in the boiling water. In order to explain, Mike holds a cold saucer half a meter above the boiling water. After a while, Mike tells Mary to look at the saucer. (i) What will Mary see? (ii) What does Mike say is in the bubbles? (iii) Mike explains to Mary how he deduces what is in the bubbles from his observation of the saucer. Give his explanation. (2) Comment on the gender orientation of this assessment task. How does it portray gender stereotypes and background experiences? How does it try to be gender-inclusive? Is that attempt at inclusivity successful? Give reasons for your answer. (3) Rewrite the task so that it has a proper gender-inclusive orientation
71
EDAHOD-5/1
72 them. Formative feedback should recognise what learners have achieved and point to what comes next; it should reward achievement and point to directions of improvement in ways that guide that improvement. To be really useful, formative feedback needs to relate to the outcomes assessed. The comments need to engage with the content and substance of the particular task. For example, ``Write more neatly'', is not a useful comment when a learner cannot understand why her solution to a maths problem was not correct. A learner who gets an essay back with spelling corrections as the only ``comments'' is bound to assume that spelling is the important thing that the teacher looked at. A comment like ``a good effort'', is encouraging and makes the learner feel good, but it still doesn't help her to write a better story next time. Giving useful, formative feedback is a skill that needs to be learnt and practiced. Take note of the following ideas for how to give more constructive feedback: Praise Give positive feedback. Praise learners for specific things they have done well: for instance, ``You've presented the ideas well. Very interesting story!'' or ``This is a very realistic description well done''. Question It is useful to ask leading questions that will help the learner to identify and address major weaknesses in his work. An example could be: ``It's not clear how you've reached the conclusion. What is actually the relation between the community and the team?'' Or ``I disagree with your interpretation of ... . Look at the text again to check whether your explanation really applies.'' Through these questions you actually start a ``conversation'' with the learner and guide her to know how to improve in future. Encourage End the feedback with a comment which (for instance) will tell the learner that you enjoyed reading the work and that you found useful information in it. It's also very useful to give general feedback to the whole class, especially where you find that nearly all the learners are struggling with a particular concept. Rather than talking to each learner individually, it is more worthwhile to speak to the whole class. Sometimes more questions and points of discussion will come from the feedback session. The feedback for Task A will certainly influence the learners' approach
73
EDAHOD-5/1
to the next task. Making only negative comments could be really demotivating, while the positive reinforcement of achievements has a stimulating and attitude-building effect. Make sure the feedback is clear and practical in order to make it easier for the learner to make use of it in a step-by-step way!
74
STUDY UNIT 5
75
EDAHOD-5/1
. Mr Cele also knew that he would shortly have to report on his learners' progress, as it was near the end of the year. He realised that Grade 9 learners' work should be between levels 1 and 4; but most of them were working at level 3 at that stage, although he expected that they would soon be entering level 4. He hoped to achieve this after the planned series of lessons.
76
Formative assessment also informs teaching and learning. Mr Cele had to go back to the drawing board, because he saw that his initial plan did not work.
77
EDAHOD-5/1
Level 1 Examples: Can magnetise the compass needle. Chooses suitable object to magnetise right size and shape.
Level 2 Examples: Ch an ge s t hic k string and uses finer thread. OR: Smooths point of nail so that strip moves easily. OR: Tries to make floater stay in middle of large tub and not touch sides.
Level 3 Examples: Hangs needle up, finds thread is too stiff; then tries balancing the needle on sharp point, finds it unstable; then decides on floating the needle and works on improving that idea.
Level 4 Examples: H angs needle, realises that it has to be heavy compared to stiffness of thread. Balances needle on sharp point and explains how it can be made stable by having more weight below the sharp point. Decides to develop a floating compass needle and solves some problems to get it to work.
Level 5 Examples: Solves problem of ``large floater'' by making a freely moving compass needle, such as the floater in the small tub. Wonders how the water drew the floater towards the side of the bigger margarine tub; suggests floating it in paraffin to look for differences. Tries to find out if compass will still point North if surrounded by a ring of iron. Wonders how compasses work on board iron ships.
Two things about the assessment grid which Mr Cele devised are especially noteworthy: (1) It describes levels of performance of a generic skill; namely solving problems through the application of a scientific method. The examples illustrate each level of performance in terms of this particular activity, but the level descriptors could just as easily be applied to any activity involving problem solving in the NS learning area. So Mr Cele has a practical instrument for assessing a wide range of NS activities on a common scale. Can you see that this will also make it easy for him to make summative judgements of learners' performance on any number of problem-solving activities and that these can be used for recording and reporting purposes? (2) The grid is, in effect, a ``mini progress map''. The value of such ``mini progress maps'' lies in the way they bring a standard grading system to any assessment and in the way they show learners the difference between the level they are on and the next one up. This helps learners to know what they must do in order to make the jump to the next level.
78 Once you have recorded and reported your learners' performance, you start the cycle of plan-do-assess-review all over again!
79
EDAHOD-5/1
In this case the teacher writes the criteria for the two ends of the scale, A and E, and simply places learners in between by circling A to E under each heading.
E Can follow and give oral directions when finding or explaining how to find objects in the environment D C B A Can visualise locations shown in a drawing, using distances, directions, reference points and scales. Can translate between map and physical situation D C B A Can use words like triangle, rectangle and circle to describe and compare objects and features of objects in the environment, relating objects to drawings of them. D C B A Can measure lengths, using suitable units, techniques and directions. D C B A Can use a variety of ways when prompted to check working. D C B A
E Can talk about likenesses and differences between simple shapes of objects in the environment
E Can compare lengths, using whole numbers of units provided (eg foot, hand, stick ...) E Beginning to use some self-correcting behaviours when asked to check working E
80
Teaching, learning and assessment are integrated in an effective educational environment. For this reason, recording will be the end result of assessment and will therefore still be integrated with teaching, learning and assessment. This means that the teacher plans teaching, teaching strategies and learner activities with assessment and recording in mind. The set outcomes will determine the assessment criteria and therefore the way marks, performance or skills will be recorded. Plan effectively what, when and how to teach and assess, and the how of recording will follow!
81
EDAHOD-5/1
ADDENDUM A
82
83
EDAHOD-5/1
84
85
EDAHOD-5/1
86
87
EDAHOD-5/1
88
89
EDAHOD-5/1
90
91
EDAHOD-5/1
92
93
EDAHOD-5/1
Bibliography
Bloom Curriculum 2005, vide Department of Education. Department of Education. 1998. Curriculum 2005: implementing OBE: lifelong learning for the 21st century. Pretoria: Government Printer. Department of Education. 2002. Revised National Curriculum Statement Grades R9 (Schools): Mathematics. Pretoria: Government Printer. Department of Education. 2002. Revised National Curriculum Statement Grades R9 (Schools): Natural Sciences. Pretoria: Government Printer. Department of Education. 2001. Assessment policy in the General Education and Training Band Grades R9. Pretoria: Government Printer. Department of Education. 2001. Expected levels of performance. Pretoria: Government Printer. Firth & Macintosh. 1984. Gauteng Department of Education. 1999. GDE/GICD Task team on learning support material: policy recommendations. Pretoria: Government Printer. Gauteng Department of Education. 2000. Circular 5. Pretoria: Government Printer. Gauteng Department of Education. 2000. Circular 72. Pretoria: Government Printer. Gauteng Department of Education. 2001. Assessing performance, Guidebook 1. Gauteng Institute for Curriculum Development. Pretoria: Government Printer. Gauteng Department of Education. 2001. Recording and reporting, Guidebook 3. Gauteng Institute for Curriculum Development. Pretoria: Government Printer. Gauteng Institute for Curriculum Development. 2001. Illustrative learning programmes. Pretoria: Government Printer. Joffe, LS. 1993. Assessment options: broadening the range, In Inventing knowledge, contests in curriculum construction, edited by N Taylor. Cape Town: Maskew Miller Longman. Lubisi. 1999. Lubisi, Parker & Wedekund. 1998. Naicker, C & Sigamoney, M. 2000. An investigation into the implementation of outcomes-based education in the Western Cape Province. Bellville: University of the Western Cape. Ndhlovu, T, Bertram, C, Mthiyane, N & Avery, N. 1999. Creating people-centred schools: school organisation and change in South Africa. Cape Town: Oxford University Press. Parker, L & Rennie L.J. 1998. Equitable assessment strategies, in
94 International Handbook of Science Education, Part Two, edited by BJ Fraser & KG Tobin. Dordrecht: Kluwer Academic Publishers. Pettigrew, L & Akhurst, J. 1999. Learning and teaching: psychological perspectives. Pietermaritzburg: Natal Witness. Revised National Curriculum Statement, vide Department of Education. Sieborger, R & Macintosh, H. 1998. Transforming assessment: a guide for South African teachers. Johannesburg: Juta. Steinberg, C. 2004. Classroom assessment. ACE learning guide. 2nd edition (reworked). Johannesburg: WITS School of Education. Van der Horst, H & McDonald, R. 2001. Outcomes-based education: theory and practice. Pretoria: University of South Africa. Van Deventer, I. 2000. School management skills, study unit 1. Pretoria: University of Natal/South African College for Teacher Education. Versfeld R & Dyer, D. 1997. Ways of assessing. Chapter 7 in Word for all: a handbook for teachers of multilingual classes. Manzini: Macmillan Boleswa. www.cio.com/archive/031596_qa.html