CHAPTER III

RESEARCH METHODOLOGY
3.1 Research Method

The method that used in this research is experimental quantitative research. In

this research, the word experiment means a way of trying something new, especially
in order to gain experience. The methodology of a quantitative research maintains the
assumption of an empiricist paradigm (Creswell, 2003). The research itself is
independent of the researcher. As a result, data is used to objectively measure reality.
Quantitative research creates meaning through objectivity uncovered in the collected
data.
The writer conducted the experiment to prove the hypotheses whether the
treatment by using substitution drill improves students speaking skill especially in
pronunciation element or not. The experimental activities involve pre-test, treatment,
and post-test. This statement is supported by Prasetyo and Jannah (2005: 97), they
stated that an experimental research is a study that treats or creates a condition to the
subject of research. For this research, teaching treatment conducted by applying
Substitution Drill.
In this study, the author was going to implement one-group pretest-posttest
design as the design for his experiment. Creswell (2003:168) briefly defines it as a
design which includes conducting a pretest measurement then following with a
treatment and later on giving a posttest for a single group. In this case, the writer is
intended to conduct the experiment associated with the main objective of this study,

14

which is to find out if the implementation of Substitution Drill can improve students
speaking performance preferably in pronunciation aspect.
2.2

Population and Sample

Population is the whole sample of the research, as it said by Usman & Akbar

(2006:56). Population is any of individuals that have one or more characteristics in

common that is of interest to the teacher. This means that population is the total
amount of subjects who are going to be observed for the need of the research. The
population in this study is all second grade students at SMP Negeri 16 Banda Aceh
which has three regular classes consisting of 98 students (63 female students and 35
male students) with an average 32 students in each class.
This sample obtained using probability sampling technique, specifically
through random sampling. Random sampling technique means that all members of
the population have an equal and independent chance of being included as a sample
(Kasim: 2010). To keep the effectiveness in treatment process, the author will take
one group as the sample for pre-test and post-test in this research. The process of
choosing the sample conducted as follow. First, the author will write the name of
classes (VIII.1, VIII.2, and VIII.3). Then, each piece of paper rolled up. After that,
the author asked one of the representatives from teachers to take a piece of paper and
read the name of the class chosen.
2.3

Research Instrument
In this writing, the writer needs data that should be obtained from the students

at SMP Negeri 16 Banda Aceh. The instrument that used in this study is test. In this
case, the writer conducted test as an instrument to measure the improvement on
15

students pronunciation. The test itself consist of pre-test, following by treatment,

and then post-test. Pre-test provided in the first meeting. It was in the form of oral
retelling performance with topic about family members (such as my parents, sisters
or relatives). Students are given text which has the theme decided by the writer. The
oral retelling is purposively offered in order to help them conveying their ideas in
target language, to know how far they have learned with their own teacher, and to
measure how good their target language specifically pronunciation practice so far.
The treatment undertake in case of the application of Substitution Drill. The
treatment conducted in three meetings, which is 80 minutes per meeting. After
conducting the treatment, the post-test provided for the students. The post-test
constructed in the form of oral retelling performance related to descriptive text. The
students are asked to retell the text offered by the teacher one by one in front of the
classroom. The post-test used to measure the students ability in speaking as well as
their pronunciation progress after the treatment is conducted.
The foreign language considered in this research is English and the mother
tongue is Acehnese. In this research, the two components such knowledge and ability
are the estimation of the pronunciation quality. The knowledge component shows the
speakers knowledge of the correct phonetic. Therefore, the ability component shows
the speakers ability to pronounce the phonemes of the target language correctly. The
ratio has been used for pronunciation scoring by Cucchiarini et al (2000). This is
modeled by:

16

2.3.1

Validity and Reliability

One of factors to verify the quality of the test or instrument is validity.

Shohamy (1985, p.74) refers validity as the extent to which test measures what it
was intended to measure. Validity is important in doing effective research since it
relates directly to the purpose of test conducting in a research. Besides, if the
instrument of the test is invalid, it means that the research is worthless. To get the
validity of the test performing in this study, the author focused on content validity.
Content validity depends on a careful analysis of the language that is being
tested and the particular of course objectives (Heaton: 1975, p.160). It means that the
test contains the representative of subject matter so there is a relationship between
test items and the objectives of course. Therefore, in this study, the author will
conduct a test which was related with the objectives of study containing in National
Indonesian Curriculum 2013 (KD 3.10/ KD 4.12/ KD 4.13) and the course which
was taught by the English teacher for Junior High School grade one in odd semester.
Another factor to determine if the test is qualified is reliability. Heaton (1975,
p.162) refers reliability to the extent to which the test administered to the same
candidates on different occasions. In addition, Shohamy (1985, p. 70) defines it as
the level whereas the test is consistent in its score and give indication of how
accurate the test score are. From those theories, it can be assumed that reliability

17

deals with the condition where the test will constantly consistent on its measurement
whenever it is tested to students.
Related to the reliability of the test conducting in this study, the author will
give the test as pilot study at the different time before the treatment process begins.
2.4

Technique of Data Collection

Type of data that

collected in this study is quantitative data. Quantitative

data is the data which is obtained by using test as the instrument for its data
collection (Setiyadi, 2006: 153). For this study, the writer will collect the data based
on score that was taken from pretest and posttest of the samples.
In term of experimental design which is one group pre-test and post-test, the
author will conduct one pre-test and one post-test for collecting data. The data will
record as well as measure students speaking performance in terms of students
pronunciation.
The process of data collection is planned as follow:
Day 1: The author gives pre-test for students by conducting oral retelling
performance related to the family members. The author may ask the students to retell
as much as possible. The author will record the students performance by using his
mobile phone recorder. By doing this, the author can review the students
pronunciation.

18

Day 2: The author provides a passage about recount text and teaches the
material using Substitution Drill. By doing this, the author expected that the students
familiar with the sentences that lead to good pronunciation.
Day 3: The author will conduct the post-test related to the previous material.
Each student asked to retell a monolog about with theme about family members and
author will assess them especially in case of students pronunciation. Here, students
voice also recorded by using mobile phone.
2.5

Technique of Data Analysis

To find out the differences between the class of experiment and controlling

class are significant. The writer used the following t-Score formula suggested by
Sudjana (1989: 231).
_

X1 X 2

t
s

1
1

N1 N 2

Where: t = t-score
X1 = Mean of Posttest
X2 = Mean of Pretest
S = Standard Deviation
N1 = Number of students
N2 = Number of students

19