Master of Arts in Digital Technologies for Language Teaching: Research Methods for Language Professionals

Analysing the results of a mock experiment

Category
Dataset
preparation

4
Variables are properly
defined. No missing
values exist or they are
marked appropriately.
Textual values are
converted to numerical
in a consistent and
appropriate manner.

3
There are few problems
with the preparation of the
dataset (e.g. not all
variables are properly
defined, missing values
are not marked
appropriately, textual to
numerical conversion of
values is not always
consistent across
variables).

Calculating
The mean and
measures of
Standard Deviation are
central tendency accurately calculated.

A few errors exist in the

calculation of the mean
and Standard Deviation.

Determining
statistical
significance

The p value is
accurately identified
and interpreted.

The p value is identified,

but the interpretation is
not so accurate.

Determining
effect size

Effect size is
accurately calculated
and interpreted.

Effect size is calculated,

but the interpretation is
not so accurate.

Interpretation

Interpretation of the
results is correct and
reasonable within the
context of the research
question.
Results are reported in
a concise and clear
way that is easy to
understand and follow.

Interpretation of the
results is not always
correct and/or reasonable
within the context of the
research question.
Results are reported in a
quite concise and clear
way that is generally easy
to understand and follow,
yet there are few issues
that impede
understanding.
Information is presented
in a rather logical order.
Most sentences have
varied structure and are
well constructed. The text
generally keeps the
interest of the audience.

Report

Writing

Information is
presented in a logical
order. Sentences have
varied structure and
are well constructed.
The text effectively
keeps the interest of
the audience.

Spelling &
Grammar

There are no
misspellings or
grammatical errors.

There are few spelling

and/or grammatical
errors.

2
There are several
problems with the
preparation of the
dataset (e.g. most
variables are not
properly defined,
missing values are
not marked
appropriately, textual
to numerical
conversion of values
is mostly inconsistent
across variables).
Several errors exist
in the calculation of
the mean and
Standard Deviation.
The p value is
identified, but the
interpretation of its
value is false.
Effect size is
calculated, but the
interpretation of its
value is false.
There are several
flaws in the
interpretation of the
results.

1
There are many
problems with the
preparation of the
dataset (e.g. nearly
all variables are not
properly defined,
missing values are
not marked
appropriately,
textual to numerical
conversion of values
is inconsistent
across variables).
Many errors exist in
the calculation of the
mean and Standard
Deviation.
The p value is
wrongly identified.

It is somehow
difficult to
understand and
follow the reporting
of the results.

It is rather difficult
to understand and
follow the reporting
of the results.

There is little logical

order in the
presentation of
information. Some
sentences have
varied structure and
are well constructed.

There is little sense

that the text is
organized in a
logical way. It is
difficult to
understand the
sentences and they
are annoyingly
repetitive.
There are several
errors in spelling
and/or grammar.

There are some

spelling and/or
grammatical errors.

Effect size is not

calculated or its
calculation is wrong.
There are a lot of
flaws in the
interpretation of the
results.

This rubric is licensed under a Creative Common License Attribution 4.0 International. Everyone is free to share and/or adapt the rubric even for
commercial purposes as long as appropriate credit to the author is provided. This citation may be used: Konstantinidis, A. (2016). Analysing the
results of a mock experiment. Research Methods for Language Professionals module, Master of Arts in Digital Technologies for Language
Teaching programme, University of Nottingham, UK. Retrieved from: [url]