MEASUREMENT AND DATA COLLECTION

VRV

MEASUREMENT

It is an instrument in a research study a device

used to measure the concept of interest in a research project.

A device used to collect scientific data, often electronic in nature

An technical instrument of any kind that relies on research results of its performance and accuracy

LEVELS OF MEASUREMENT:

1:5 says that the second number is five times as large as the first.

5-10, 15-20, 21-25

0, 1, 2, 3, .

Name. Number

RELIABILITY AND VALIDITY

If an instrument is not reliable it cannot possibly be valid. In evaluating an instrument, the researcher cannot consider validity apart from reliability.

Unfortunately many published studies fail to give reliability and validity data on instruments used to measure study variables.

(Burns & Grove, 2007)

VALIDITY

Validity in relation to research is a judgment regarding the degree to which the components of the research reflect the theory, concept, or variable under study (Streiner& Norman. 2000)

Internal validity refers to the likelihood that experimental manipulation indeed was responsible for the differences observed.
External validity refers to the extent to which the results of the study can be generalized to the larger population (Polit & Hungler, 1999)

Types of validity

These are used to judge the accuracy of an instrument:

Content validity

Predictive validity Concurrent validity, Construct validity.

Conti.

Content validity It is the extent to which different items in the assessment measure the trait or phenomenon. High level of content validity indicates that test items accurately reflect the trait being measur ed. E.g: To assess anxiety, it included questions about known

symptoms of anxiety such as muscle tension and a rapid pulse

rate

Predictive validity: It is the ability of an assessment measure

to predict someones future behavior in related but different situ ation.

E.g : making accurate predictions of future behavior.

Conti.

Concurrent validity It reflects how well different measures of the same trait

agree with another. it can be expected to give results very

similar to other measures of same characteristic.

Construct validity
It is the extent to which a theoretical construct such as a personality trait can be empirically defined.

RELIABILITY ( )

It is defined as a characteristic of an instrument that reflects the degree to which the instrument provokes consistent respo nses. E.g. a scale developed to measure intelligence might not be reliable for measurement of personality.
(Polit & Hungler, 1999)

Types: (1) stability, (2) internal consistency (3) Equivalence (4) Internal consistency

Conti.
1. Stability or Test-retest reliability
It refers to degree to which research participant response change overtime. Test-retest method is used to test stability of the tool.

In this method an instrument is given to the same individuals on two occasions within relatively short duration of time.

Conti.
2. Internal consistency It is a measure of reliability that is frequently used with scales designed to assess psychosocial characteristics.

Conti.
3. Equivalence or Inter-rater ( reliability It is often concern when different observers are using the same instrument to collect data at the same time.

4. Internal consistency It is the extent to which tests or procedures assess the same characteristics, skill or quality. It is a measure of the precision between the observers or instruments used in a study.

E.g. A researcher designs a questionnaire to find out about college students' dissatisfaction with a particular textbook.

DATA COLLECTION

DATA

Definition: The term data means groups of information that represent the qualitative or quantitative attributes of a variable or set of variables ( . ) Data are typically the results of measurements and can be the basis of graphs, images, or observations of a set of variables.

TYPES OF DATA

PRIMARY DATA :
which are collected afresh and for the first time, and thus happens to be original in character. E.g Surveys, , Focus groups, Questionnaires , Personal interviews

SECONDARY DATA : which have already been collected by someone else and which have already been passed through the statistical process. E.g Vital Statistics birth, death certificates Hospital, clinic, school nurse records

CHARACTERISTICS OF DATA

Accuracy Accessibility Comprehensiveness Consistency Currency Definition Granularity Precision Relevancy Timeliness

METHODS OF DATA COLLECTION

Observation Interview

Questionnaire
Survey Case study

OBSERVATION METHOD
It is a technique that involves systematically selecting, watching and recording behavior and characteristics of living beings, objects or phenomena.

Observation of human behavior is a most common data collection technique. Participant observation: The observer takes part in the situation he or she observes.
E.g, a doctor hospitalized with a broken hip, who now observes hospital procedures from within.

Non-participant observation: The observer watches the situation, openly or concealed, but does not participate.

INTERVIEW METHOD
This Method of collecting data involves presentation or oral verbal stimuli and reply in terms of oral verbal responses. Type of interviews as follows: A. Personal Interview: the interviewer asks questions generally in a face to face contact B. Telephonic interview: when it is not possible to contact the respondent directly, then interview is conducted through telephone.

Conti C. Structural interviews: in this case, a set of predecided questions are there. D. Unstructured Interviews: in this case, we dont follow a system of pre-determined questions E. Focused interviews: attention is focused on the given experience of the respondent and its possible effects. F. Clinical interviews: concerned with broad underlying feeling or motivations or with the course of individuals life experience, rather than with the effects of the specific experience, as in the case of focused interview.

Conti
G. Group interviews: a group or 6 or 8 individuals is interviewed. H. Individual interviews: interviewer meets a single person and interviews him

I. Selection interviews: done for the selection of peoples for certain jobs.
J. Depth interviews: it deliberately aims elicit unconscious as well as other types of material relating especially or personality dynamics and motivations.

QUESTIONNAIRE METHOD

This method of data collection is quite popular, particularly in case of big enquires.

Construction of questionnaire

Should be in General form Question sequence Make it short (shorter is better)

For every question, ask yourself How am I going to use this

data? Make it simple (Use simple wording + provide clear and concise instructions) Make it interesting (Consider varying the questioning format)

Types of questions

Direct Question Indirect Question Open ended Question Closed question Dichotomous question Multiple choice question

Formulating questions

Measure one thing at a time

Ex: do you think the recent accession of your country to the WTO will enhance your export and joint-venture opportunities? Ex: what action did you take the last time a Customs officer asked you for a bribe? Ex: From which country do you import your wheat? a. USA b. Australia c. Argentina d. EU

Avoid leading questions or assumptions

Ensure that your question can accommodate all possible answers

Use balanced Scales Ex: The recent trade reforms has resulted in many farmers losing income? Strongly Disagree, Disagree, Somewhat disagree, Undecided, Agree

Produce variability of responses Ex: Are you familiar with trade facilitation? Yes, No

Conti.

Do not expect respondents to know answers to very specific questions

Ex: How many percent of your staff has attended WCO trainings in the past year?___

Do not use unfamiliar words or abbreviations Do not use terms for which the definition can vary (if unavoidable, define the term in the questionnaire) Avoid Branching

Ex: Do you rely on export credit insurance to limit your risks? a. Yes, b. No (If No,

go to question 5)

Do not ask respondent to rank order more than 5 items in a list

Scales can provide good alternatives

Use open-ended question sparingly

Conti.

Survey method

It is one of the common methods of diagnosing and solving of research problems undertaking surveys. It is a systemic way of collecting data from population through the use of personal interviews or other data gathering devices

E.g :Scales

Likert scale

Rating scale

cumulative or Guttmann scale

Data collection process

Principles

The collection "instruments" are forms, questionnaires, automated collection screens, and file layouts used to collect the data. Data collection includes all the processes involved in carrying out the

data collection design to acquire data. Data collection operations can

have a high impact on the ultimate data quality.

The data collection method should be appropriate to the data complexity, collection size, data requirements, and amount of time available.

Specific data collection environmental choices can significantly affect

error introduced at the collection stage Conversion of data on paper to electronic form (e.g., key entry, scanning) introduces a certain amount of error which must be controlled.

Third party sources of data may introduce some degree of error in their
collection processes.

Review