GG2012 3.2 Sandy Bhangal

Best Practices for Best Results:
Using TOEFL iBT Test Scores for Admissions Decisions

Going Global
Sandy Bhangal, ETS Global Diane Schmitt, BALEAP
Copyright 2012 by Educational Testing Service. All rights reserved. ETS, the ETS logo, TOEFL and TOEFL iBT are registered trademarks of Educational Testing Service (ETS). IELTS is a trademark of the University of Cambridge ESOL Examinations. 19030
What is the TOEFL Test?

The TOEFL test measures the ability of nonnative speakers to use and understand English as it is spoken, written and heard in college and university settings Used primarily for admission into universities where English is the language of instruction
Accepted at both undergraduate and postgraduate levels
Also used for immigration, licensing, scholarships and placement
2
The TOEFL Test Format

Section Reading Listening Break Speaking Writing Description
3-4 passages from academic texts; 12-14 questions per passage 4-6 lectures, some with classroom discussion, 6 questions each; 2-3 conversations, 5 questions each 2 tasks to express an opinion; 4 tasks to speak based on reading and listening passages 1 integrated task (write based on what is read and listened to); 1 independent task (support an opinion on a topic)
Testing Time 60-80 min. 60-90 min. 10 min. 20 min. 50 min.
Score Scale 0-30 0-30 0-30 0-30
Total
Note-taking is allowed in all sections.

3
0-120
Scoring Sets the TOEFL Test Apart

Scoring process ensures fairness and integrity of scores
Rigorous rater training Daily calibration for Speaking and Writing raters Multiple raters for Speaking and Writing Three to six raters for Speaking responses Four ratings for Writing responses Scoring is separate from the testing site to maintain score integrity Raters see and hear worldwide responses, not just from one country Anonymous raters do not know the examinee
4
What TOEFL does

The TOEFL program uses the e-rater automated scoring engine in a limited and responsible way for the Writing section
Independent Writing task
one human rater + one automated rating
Integrated Writing task

one human rater + one automated rating
Combines the judgment of humans for content and meaning and the consistency of automated scoring for linguistic features
5
Automated Scoring
Measures the mechanical aspects of writing sufficiently, but content is measured only at a basic level The kinds of test questions designed only for automated scoring are more coachable and promote rote learning, not practice of real communication skills Repeat a sentence out loud Read a sentence out loud At present, no automated scoring engine can evaluate content and meaning at the sophisticated level tested by the TOEFL iBT writing tasks without also having the contributions of a human scorer
6
TOEFL iBT Scores

Four skill scores Reading 0-30 Listening 0-30 Speaking 0-30 Writing 0-30 Total score: 0-120 Score reports sent within 10 calendar days after test TOEFL test scores are valid for two years from the test administration date
Security-enhanced Score Reports
8
Performance Feedback on Examinee Report
TOEFL iBT Reading Scores
10
TOEFL iBT Speaking Scores
11
Speaking Scores
Holistic score Test takers are rated on: Topic development (especially for integrated tasks) Delivery Language use Ratings are 04 from rubrics Converted to a scaled score of 030
Speaking Benchmarks
What is a benchmark? Listen to the four Benchmarks for Speaking Task #2 Independent Speaking
Independent Speaking Task
Benchmark Speaking Responses

Benchmarks independent speaking Annotations provide narrative description of the level Each score represents a range of ability Level 4 Level 3 Level 2 Level 1
Integrated Speaking Task

Task #5 Problem/Solution A Listening/Speaking campus situation topic Consists of one source, a listening passage, a single question
The test taker hears a conversation between two people about a campus topic less than 90 seconds The test taker is asked to briefly summarize the problem and to express a personal opinion about the topic Note-taking allowed Preparation time: 20 seconds Response time: 60 seconds
Speaking Responses
Listen for the following key points
Student #1 stressed out because she has too much homework a paper to write, two exams to study for and math problems to complete
Student #2 recommends two possible solutions Ask her professors for an extension on paper and math work Create a schedule to manage her time and focus her energies Then test taker states which solution he/she prefers and explains why
Sample #1 Sample #2
TOEFL iBT Writing Scores
20
TOEFL Score Requirements

ETS does not determine which students must take the TOEFL test, nor does ETS establish the TOEFL score requirements institutions/agencies should use in making their decisions Each institution sets its own policy on whether a TOEFL score is required as well as the minimum TOEFL score they will accept ETS supports each universitys individual decision on who should be required to submit a TOEFL score
21
General Guidelines for Good Score Use

Base evaluation of an applicants readiness to begin academic work on all available relevant information, not solely on TOEFL scores Look for other supporting evidence of English-proficiency in the application Use score ranges rather than rigid cut scores on the TOEFL test to help make admissions decisions
22
TOEFL UKBA scores

B1 LEVEL Reading Listening Speaking Writing Totals 4 9 16 13 42 B2 LEVEL Reading Listening Speaking Writing Totals 18 17 20 17 72
23
Setting TOEFL Score Requirements

There are many options for setting TOEFL score requirements
Require total score only Require a total score but review applicant section scores for the skills most important to your program Require a total score and a minimum section score for the most important skill(s) Require minimum section scores only (most restrictive)
It is important to consider scores from all English-proficiency tests in the same manner
24
Using TOEFL Section Scores
Reading Listening Writing Student 1 18 22 16 Student 2 20 20 20 Student 3 25 25 16
Speaking 24 20 14
Total 80 80 80
All three students have a total score of 80, but they have different profiles of English skills. Which student is best for your program?
25
Review your score requirements regularly

How much English is enough?
Different departments have different needs What language skills are important for success in this program?
Level of ESL support available Competitive situation

Higher score requirements could reduce applications Lower scores could result in student failure, need for ESL support or slowing down the rest of the class
26
Selecting TOEFL Score Requirement

Conduct a Standard Setting Session using the free TOEFL Standard Setting CD-ROM Select a panel of 10-12 faculty members, including ESL and admissions staff Follow procedures outlined on CD-ROM
Listen to TOEFL test items and responses at various levels and determine minimum acceptable performance Analysis of panelists decisions determines panels selection of minimum acceptable TOEFL requirements for each skill
27
Test and Score Data Summary for TOEFL iBT
Percentile data Score means listed by total population, native language, native country, gender and purpose for taking the test (i.e., Undergraduate, Graduate, or Professional License) Based on data from previous testing year Annual publication available for download from the Research section of the TOEFL website (www.ets.org/toefl) by the beginning of Q2
28
TOEFL iBT Score Comparison Tool

Universities have asked for a way to compare TOEFL iBT and IELTS scores ETS collected more than 1,100 sets of TOEFL iBT and IELTS scores from individuals who had taken both tests An equipercentile approach was applied to each IELTS band score to develop the comparison table
Example: a TOEFL iBT score of 115 represents the 90th percentile of the test takers in the sample, the same as an IELTS score of 8.5
Related research report: Linking TOEFL iBT Scores to IELTS Scores

29
Comparing TOEFL iBT
and IELTS Scores
Research report at http://www.ets.org/toefl/comparescores

30
TOEFL iBT Score Comparison Tool

The comparison table was created as an initial step for universities that wanted to compare TOEFL iBT and IELTS scores ETS recommends the table be used for purposes of general understanding and not for establishing cut scores It is not appropriate to use the comparison table to project an applicants IELTS or TOEFL iBT score Follow up validity studies are recommended to validate the score comparisons
31
TOEFL Information and Contacts

TOEFL website for institutions: www.ets.org/toefl/institutions TOEFL website for students: http://www.toeflgoanywhere.org Sandy Bhangal UK Client Relations sbhangal@etsglobal.org Diane Schmitt testing@baleap.org
ETS Listening. Learning. Leading.
Copyright 2011 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., GRE and POWERPREP are registered trademarks of Educational Testing Service (ETS). BETTER BY DESIGN and SCOREITNOW! are trademarks of ETS. All other trademarks Copyright 2012 by Educational Testing Service. All rights reserved. ETS, theowners. TOEFL and TOEFL iBT are registered trademarks of Educational Testing Service (ETS). IELTS is a trademark of the are property of their respective ETS logo, University of Cambridge ESOL Examinations. 19030
Questions?

GG2012 3.2 Sandy Bhangal

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

GG2012 3.2 Sandy Bhangal

Uploaded by

Copyright:

Available Formats

Best Practices for Best Results:

Using TOEFL iBT Test Scores for Admissions Decisions

Sandy Bhangal, ETS Global Diane Schmitt, BALEAP

What is the TOEFL Test?

Accepted at both undergraduate and postgraduate levels

Also used for immigration, licensing, scholarships and placement

The TOEFL Test Format

Testing Time 60-80 min. 60-90 min. 10 min. 20 min. 50 min.

Score Scale 0-30 0-30 0-30 0-30

Note-taking is allowed in all sections.

Scoring Sets the TOEFL Test Apart

What TOEFL does

Integrated Writing task

TOEFL iBT Scores

Security-enhanced Score Reports

Performance Feedback on Examinee Report

TOEFL iBT Reading Scores

TOEFL iBT Speaking Scores

Independent Speaking Task

Benchmark Speaking Responses

Integrated Speaking Task

Listen for the following key points

TOEFL iBT Writing Scores

TOEFL Score Requirements

General Guidelines for Good Score Use

TOEFL UKBA scores

Setting TOEFL Score Requirements

Using TOEFL Section Scores

Reading Listening Writing Student 1 18 22 16 Student 2 20 20 20 Student 3 25 25 16

Review your score requirements regularly

Level of ESL support available Competitive situation

Selecting TOEFL Score Requirement

Test and Score Data Summary for TOEFL iBT

TOEFL iBT Score Comparison Tool

Related research report: Linking TOEFL iBT Scores to IELTS Scores

Comparing TOEFL iBT

and IELTS Scores

Research report at http://www.ets.org/toefl/comparescores

TOEFL iBT Score Comparison Tool

TOEFL Information and Contacts

ETS Listening. Learning. Leading.

You might also like