Chapter 3 Describing Data: Numerical

Chap 3-1

Chapter Goals
After completing this chapter, you should be able to:


Compute and interpret the mean, median, and mode for a set of data Find the range, variance, standard deviation, and coefficient of variation and know what these values mean Apply the empirical rule to describe the variation of population values around the mean

Chap 3-2

Chapter Topics


Measures of central tendency, variation, and shape

  

Mean, median, mode, geometric mean Quartiles Range, interquartile range, variance and standard deviation, coefficient of variation Symmetric and skewed distributions Mean, variance, and standard deviation The empirical rule and Bienaym-Chebyshev rule
Chap 3-3

Population summary measures

 

Chapter Topics
(continued)


Five number summary and box-and-whisker plots Covariance and coefficient of correlation Pitfalls in numerical descriptive measures and ethical considerations

 

Chap 3-4

Describing Data Numerically

Describing Data Numerically

Central Tendency Arithmetic Mean Median Mode

Variation Range Interquartile Range Variance Standard Deviation Coefficient of Variation

Chap 3-5

Measures of Central Tendency

Overview Central Tendency

Mean
n

Median

Mode

!
i!

n
Midpoint of ranked values Most frequently observed value

Arithmetic average

Chap 3-6

Arithmetic Mean


The arithmetic mean (mean) is the most common measure of central tendency


For a population of N values:

N

x1  x 2  .  x N ! ! N N
i !1


Population values

Population size

For a sample of size n:

n

!
i!

.  n

Observed values
Chap 3-7

Sample size

Arithmetic Mean
(continued)
  

The most common measure of central tendency Mean = sum of values divided by the number of values Affected by extreme values (outliers)

0 1 2 3 4 5 6 7 8 9 10

0 1 2 3 4 5 6 7 8 9 10

Mean = 3
1  2  3  4  5 15 ! !3 5 5

Mean = 4
1  2  3  4  10 20 ! !4 5 5
Chap 3-8

Median


In an ordered list, the median is the middle number (50% above, 50% below)
0 1 2 3 4 5 6 7 8 9 10

0 1 2 3 4 5 6 7 8 9 10

Median = 3

Median = 3

Not affected by extreme values

Chap 3-9

Finding the Median



The location of the median:

edian osition !
 

n

osition in the ordered data

If the number of values is odd, the median is the middle number If the number of values is even, the median is the average of the two middle numbers

n 1 is not the value of the median, only the 2 position of the median in the ranked data

Note that

Chap 3-10

Mode
     

A measure of central tendency Value that occurs most often Not affected by extreme values Used for either numerical or categorical data There may may be no mode There may be several modes

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14

0 1 2 3 4 5 6

Mode = 9

No Mode
Chap 3-11

Review Example


Five houses on a hill by the beach

$2 K

House Prices: $2,000,000 500,000 300,000 100,000 100,000

$ $3 K K

$1

K $1 K
Chap 3-12

Review Example: Summary Statistics

House Prices:


Mean:

$2,000,000 500,000 300,000 100,000 100,000 Sum 3,000,000

( 3,000,000/5) = $600,000

Median: middle value of ranked data = $300,000 Mode: most frequent value = $100,000
Chap 3-13

Which measure of location is the best?



Mean is generally used, unless extreme values (outliers) exist Then median is often used, since the median is not sensitive to extreme values.


Example: Median home prices may be reported for a region less sensitive to outliers

Chap 3-14

The Relative Positions of the Mean, Median and the Mode

15

Shape of a Distribution
 

Describes how data are distributed Measures of shape



Symmetric or skewed

Left-Skewed
Mean < Median

Symmetric
Mean = Median

Right-Skewed
Median < Mean

Chap 3-16

Dispersion
Why Study Dispersion?


A measure of location, such as the mean or the median, only describes the center of the data. It is valuable from that standpoint, but it does not tell us anything about the spread of the data. For example, if your nature guide told you that the river ahead averaged 3 feet in depth, would you want to wade across on foot without additional information? Probably not. You would want to know something about the variation in the depth. A second reason for studying the dispersion in a set of data is to compare the spread in two or more distributions.
17

Measures of Variability
Variation
Range Interquartile Range Variance Standard Deviation Coefficient of Variation

Measures of variation give information on the spread or variability of the data values.
Same center, different variation
Chap 3-18

Range
 

Simplest measure of variation Difference between the largest and the smallest observations: Range = Xlargest Xsmallest

Example:
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14

Range = 14 - 1 = 13
Chap 3-19

Disadvantages of the Range



Ignores the way in which data are distributed

7 8 9 10 11 12 7 8 9 10 11 12

Range = 12 - 7 = 5


Range = 12 - 7 = 5

Sensitive to outliers
1,1,1,1,1,1,1,1,1,1,1,2,2,2,2,2,2,2,2,3,3,3,3,4,5
Range = 5 - 1 = 4

1,1,1,1,1,1,1,1,1,1,1,2,2,2,2,2,2,2,2,3,3,3,3,4,120
Range = 120 - 1 = 119
Chap 3-20

Interquartile Range


Can eliminate some outlier problems by using the interquartile range Eliminate high- and low-valued observations and calculate the range of the middle 50% of the data Interquartile range = 3rd quartile 1st quartile IQR = Q3 Q1
Chap 3-21

Interquartile Range
Example: X
minimum
25%

Q1
25%

Median (Q2)
25%

Q3
25%

maximum

12

30

45

57

70

Interquartile range = 57 30 = 27

Chap 3-22

Quartiles


Quartiles split the ranked data into 4 segments with an equal number of values per segment 25%
Q1

25%
Q2

25%
Q3

25%

The first quartile, Q1, is the value for which 25% of the observations are smaller and 75% are larger Q2 is the same as the median (50% are smaller, 50% are larger) Only 25% of the observations are greater than the third quartile
Chap 3-23

Quartile Formulas
Find a quartile by determining the value in the appropriate position in the ranked data, where
First quartile position: Q1 = 0.25(n+1)

Second quartile position: Q2 = 0.50(n+1) (the median position) Third quartile position: Q3 = 0.75(n+1)

where n is the number of observed values

Chap 3-24

Quartiles


Example: Find the first quartile

Sample Ranked Data: 11 12 13 16 16 17 18 21 22

(n = 9) Q1 = is in the 0.25(9+1) = 2.5 position of the ranked data so use the value half way between the 2nd and 3rd values, so Q1 = 12.5

Chap 3-25

EXAMPLE Mean Deviation

The number of cappuccinos sold at the Starbucks location in the Orange Country Airport between 4 and 7 p.m. for a sample of 5 days last year were 20, 40, 50, 60, and 80. Determine the mean deviation for the number of cappuccinos sold.

26

EXAMPLE Variance and Standard Deviation

The number of traffic citations issued during the last five months in Beaufort County, South Carolina, is 38, 26, 13, 41, and 22. What is the population variance?

27

EXAMPLE Sample Variance

The hourly wages for a sample of parttime employees at Home Depot are: 12, 20, 16, 18, and 19. What is the sample variance?

28

Population Standard Deviation

  

Most commonly used measure of variation Shows variation about the mean Has the same units as the original data


Population standard deviation:

N

(x
!
i !1

 )

N
Chap 3-29

Sample Standard Deviation

  

Most commonly used measure of variation Shows variation about the mean Has the same units as the original data


Sample standard deviation:

S!

(
i!

 )

n-

Chap 3-30

Calculation Example: Sample Standard Deviation

Sample Data (xi) : 10 12 n=8
! 1  1 x

14

15

17

18

18

24

Mean = x = 16
1 x n 1 1 1 6 8 1 . x

1 6

1 6

1 6

1 6

A measure of the average scatter around the mean

Chap 3-31

Measuring variation

Small standard deviation

Large standard deviation

Chap 3-32

Comparing Standard Deviations

Data A
11 12 13 14 15 16 17 18 19 20 21

Mean = 15.5 s = 3.338

Data B
11 12 13 14 15 16 17 18 19 20 21

Mean = 15.5 s = 0.926 Mean = 15.5 s = 4.570

Chap 3-33

Data C
11 12 13 14 15 16 17 18 19 20 21

Advantages of Variance and Standard Deviation



Each value in the data set is used in the calculation Values far from the mean are given extra weight
(because deviations from the mean are squared)

Chap 3-34

Chebyshevs Theorem


For any population with mean and standard deviation , and k > 1 , the percentage of observations that fall within the interval

[ +k ]
Is at least

100[1  (1/k )]%

2
Chap 3-35

Chebyshevs Theorem
(continued)


Regardless of how the data are distributed, at least (1 - 1/k2) of the values will fall within k standard deviations of the mean (for k > 1)


Examples: At least within 1 ) 2 ) 3 ) (1 - 1/12) = 0% ..... k=1 ( (1 - 1/22) = 75% ........ k=2 ( (1 - 1/32) = 89% . k=3 (

Chap 3-36

The Empirical Rule



If the data distribution is bell-shaped, then the interval:

contains about 68% of the values in s the population or the sample

68%

s1
Chap 3-37

The Empirical Rule



s2 s

contains about 95% of the values in the population or the sample contains about 99.7% of the values in the population or the sample

95%

99.7%

s2

s
Chap 3-38

Coefficient of Variation
   

Measures relative variation Always in percentage (%) Shows variation relative to mean Can be used to compare two or more sets of data measured in different units

s C V !

%
Chap 3-39

Comparing Coefficient of Variation



Stock A:  Average price last year = 50  Standard deviation = 5

s 5 CVA ! 100 ! 100 ! 10 50



Stock B:
 

Average price last year = 100 Standard deviation = 5

s CVB ! x

$5 100% ! 100% ! 5% $100

Both stocks have the same standard deviation, but stock B is less variable relative to its price

Chap 3-40

z Scores


For any x in a population or sample, the associated z score is

x  mean z ! standard deviation

The z score is the number of standard deviations that x is from the mean
 

A positive z score is for x above (greater than) the mean A negative z score is for x below (less than) the mean

Five Number Summary

1. 2. 3. 4. 5.

The smallest measurement The first quartile, Q1 The median, Md The third quartile, Q3 The largest measurement Displayed visually using a box-and-whiskers plot

Box-and-Whiskers Plots


The box plots the:

    

first quartile, Q1 median, Md third quartile, Q3 inner fences outer fences

Box-and-Whiskers Plots


Continued

Inner fences


Located 1.5vIQR away from the quartiles:

 

Q1 (1.5 v IQR) Q3 + (1.5 v IQR)

Outer fences


Located 3vIQR away from the quartiles:

 

Q1 (3 v IQR) Q3 + (3 v IQR)

Box-and-Whiskers Plots


Continued

The whiskers are dashed lines that plot the range of the data


A dashed line drawn from the box below Q1 down to the smallest measurement Another dashed line drawn from the box above Q3 up to the largest measurement

Box-and-Whiskers Plots

Continued

Outliers


Outliers are measurements that are very different from other measurements


They are either much larger or much smaller than most of the other measurements

Outliers lie beyond the fences of the box-andwhiskers plot



Measurements between the inner and outer fences are mild outliers Measurements beyond the outer fences are severe outliers

Using Microsoft Excel



Descriptive Statistics can be obtained from Microsoft Excel



Use menu choice: tools / data analysis / descriptive statistics

Enter details in dialog box

Chap 3-48

Using Excel


Use menu choice:

tools / data analysis / descriptive statistics

Chap 3-49

Using Excel
(continued)

Enter dialog box details

Check box for summary statistics Click OK

Chap 3-50

Excel output
Microsoft Excel descriptive statistics output, using the house price data:
House Prices: $2,000,000 500,000 300,000 100,000 100,000

Chap 3-51

Weighted Mean


The weighted mean of a set of data is

n

w ! w
i i!


 w2

 .  wn wi
2

Where wi is the weight of the ith observation

Use when data is already grouped into n classes, with wi values in the ith class
Chap 3-52

Approximations for Grouped Data

Suppose a data set contains values m1, m2, . . ., mk, occurring with frequencies f1, f2, . . . fK


For a population of N observations the mean is

K

fm
i

!


i!1

! fi
i !1

N
K

For a sample of n observations, the mean is

fm
i

x!

i !1

n ! fi
i!1

Chap 3-53

Approximations for Grouped Data

Suppose a data set contains values m1, m2, . . ., mk, occurring with frequencies f1, f2, . . . fK


For a population of N observations the variance is fi (mi  )2

2 K

i !1

N
K

For a sample of n observations, the variance is

fi (mi  x)2 s2 !
i !1

n 1
Chap 3-54

The Sample Covariance



The covariance measures the strength of the linear relationship between two variables The population covariance:
N

(
ov ( , y) ! W


 Q )(y i  Q y ) N

i!

The sample covariance:

(
( , )!s !
 

 )( i  ) n 1

i !1

Only concerned with the strength of the relationship No causal effect is implied
Chap 3-55

Interpreting Covariance


Covariance between two variables:

x and y tend to move in the same direction x and y tend to move in opposite directions x and y are independent

Cov(x,y) > 0 Cov(x,y) < 0 Cov(x,y) = 0

Chap 3-56

Coefficient of Correlation


Measures the relative strength of the linear relationship between two variables Population correlation coefficient:

!


Cov (x , y)
X Y

Sample correlation coefficient:

Cov (x , y) r! sX sY
Chap 3-57

Features of Correlation Coefficient, r

  

Unit free Ranges between 1 and 1 The closer to 1, the stronger the negative linear relationship The closer to 1, the stronger the positive linear relationship The closer to 0, the weaker any positive linear relationship

Chap 3-58

Scatter Plots of Data with Various Correlation Coefficients

Y Y Y

r = -1 Y

X Y

r = -.6

X Y

r=0

r = +1

r = +.3

r=0

X
Chap 3-59

Using Excel to Find the Correlation Coefficient



Select Tools/Data Analysis Choose Correlation from the selection menu Click OK . . .

Chap 3-60

Using Excel to Find the Correlation Coefficient

(continued)

Input data range and select appropriate options Click OK to get output

Chap 3-61

Interpreting the Result

Scatter Plot of Test Scores

r = .733 There is a relatively strong positive linear relationship between test score #1 and test score #2
Test #2 Score

100 95 90 85 80 75 70 70 75 80 85 90 95 100

Test #1 Score

Students who scored high on the first test tended to score high on second test

Chap 3-62

Obtaining Linear Relationships



An equation can be fit to show the best linear relationship between two variables: Y=
0

1X

Where Y is the dependent variable and X is the independent variable

Chap 3-63

Least Squares Regression



Estimates for coefficients 0 and 1 are found to minimize the sum of the squared residuals
The least-squares regression line, based on sample data, is

y ! b0  b1 x


Where b1 is the slope of the line and b0 is the yintercept:

sy Cov(x, y) b1 ! !r 2 sx sx

b 0 ! y  b1x
Chap 3-64

Chapter Summary


Described measures of central tendency



Mean, median, mode Symmetric, skewed Range, interquartile range, variance and standard deviation, coefficient of variation

Illustrated the shape of the distribution



Described measures of variation



 

Discussed measures of grouped data Calculated measures of relationships between variables



covariance and correlation coefficient

Chap 3-65