Top Banner
Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company
20
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Numerical descriptors

BPS chapter 2

© 2006 W.H. Freeman and Company

Page 2: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Objectives (BPS chapter 2)

Describing distributions with numbers

Measure of center: mean and median

Measure of spread: quartiles and standard deviation

The five-number summary and boxplots

IQR and outliers

Choosing among summary statistics

Using technology

Organizing a statistical problem

Page 3: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

The mean or arithmetic average

To calculate the average, or mean, add

all values, then divide by the number of

individuals. It is the “center of mass.”

Sum of heights is 1598.3

Divided by 25 women = 63.9 inches

58.2 64.059.5 64.560.7 64.160.9 64.861.9 65.261.9 65.762.2 66.262.2 66.762.4 67.162.9 67.863.9 68.963.1 69.663.9

Measure of center: the mean

Page 4: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

n

nx....xxx

21

x 1598.3

2563.9

Mathematical notation:

x1

n ixi1

n

woman(i)

height(x)

woman(i)

height(x)

i = 1 x1= 58.2 i = 14 x14= 64.0

i = 2 x2= 59.5 i = 15 x15= 64.5

i = 3 x3= 60.7 i = 16 x16= 64.1

i = 4 x4= 60.9 i = 17 x17= 64.8

i = 5 x5= 61.9 i = 18 x18= 65.2

i = 6 x6= 61.9 i = 19 x19= 65.7

i = 7 x7= 62.2 i = 20 x20= 66.2

i = 8 x8= 62.2 i = 21 x21= 66.7

i = 9 x9= 62.4 i = 22 x22= 67.1

i = 10 x10= 62.9 i = 23 x23= 67.8

i = 11 x11= 63.9 i = 24 x24= 68.9

i = 12 x12= 63.1 i = 25 x25= 69.6

i = 13 x13= 63.9 n =25 =1598.3

Learn right away how to get the mean using your calculators.

Page 5: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Your numerical summary must be meaningful

Here the shape of the distribution is wildly irregular. Why?

Could we have more than one plant species or phenotype?

6.69x

The distribution of women’s height appears coherent and symmetrical. The mean is a good numerical summary.

3.69x

Height of 25 women in a class

Page 6: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Height of plants by color

0

1

2

3

4

5

Height in centimeters

Num

ber

of p

lants

red

pink

blue

58 60 62 64 66 68 70 72 74 76 78 80 82 84

A single numerical summary here would not make sense.

9.63x 5.70x 3.78x

Page 7: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Measure of center: the medianThe median is the midpoint of a distribution—the number such

that half of the observations are smaller and half are larger.

1. Sort observations from smallest to largest.n = number of observations

______________________________

1 1 0.62 2 1.23 3 1.64 4 1.95 5 1.56 6 2.17 7 2.38 8 2.39 9 2.510 10 2.811 11 2.912 3.313 3.414 1 3.615 2 3.716 3 3.817 4 3.918 5 4.119 6 4.220 7 4.521 8 4.722 9 4.923 10 5.324 11 5.6

n = 24 n/2 = 12

Median = (3.3+3.4) /2 = 3.35

3. If n is even, the median is the mean of the two center observations

1 1 0.62 2 1.23 3 1.64 4 1.95 5 1.56 6 2.17 7 2.38 8 2.39 9 2.510 10 2.811 11 2.912 12 3.313 3.414 1 3.615 2 3.716 3 3.817 4 3.918 5 4.119 6 4.220 7 4.521 8 4.722 9 4.923 10 5.324 11 5.625 12 6.1

n = 25 (n+1)/2 = 26/2 = 13 Median = 3.4

2. If n is odd, the median is observation (n+1)/2 down the list

Page 8: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Mean and median for skewed distributions

Mean and median for a symmetric distribution

Left skew Right skew

MeanMedian

Mean Median

MeanMedian

Comparing the mean and the median

The mean and the median are the same only if the distribution is

symmetrical. The median is a measure of center that is resistant to

skew and outliers. The mean is not.

Page 9: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

The median, on the other hand,

is only slightly pulled to the right

by the outliers (from 3.4 to 3.6).

The mean is pulled to the

right a lot by the outliers

(from 3.4 to 4.2).

P

erc

en

t o

f p

eo

ple

dyi

ng

Mean and median of a distribution with outliers

4.3x

Without the outliers

2.4x

With the outliers

Page 10: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Disease X:

Mean and median are the same.

Mean and median of a symmetric distribution

4.3

4.3

M

x

Multiple myeloma:

5.2

4.3

M

x

and a right-skewed distribution

The mean is pulled toward the skew.

Impact of skewed data

Page 11: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

M = median = 3.4

Q1= first quartile = 2.2

Q3= third quartile = 4.35

1 1 0.62 2 1.23 3 1.64 4 1.95 5 1.56 6 2.17 7 2.38 1 2.39 2 2.510 3 2.811 4 2.912 5 3.313 3.414 1 3.615 2 3.716 3 3.817 4 3.918 5 4.119 6 4.220 7 4.521 1 4.722 2 4.923 3 5.324 4 5.625 5 6.1

Measure of spread: quartiles

The first quartile, Q1, is the value in

the sample that has 25% of the data

at or below it.

The third quartile, Q3, is the value in

the sample that has 75% of the data

at or below it.

Page 12: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

M = median = 3.4

Q3= third quartile = 4.35

Q1= first quartile = 2.2

25 6 6.124 5 5.623 4 5.322 3 4.921 2 4.720 1 4.519 6 4.218 5 4.117 4 3.916 3 3.815 2 3.714 1 3.613 3.412 6 3.311 5 2.910 4 2.89 3 2.58 2 2.37 1 2.36 6 2.15 5 1.54 4 1.93 3 1.62 2 1.21 1 0.6

Largest = max = 6.1

Smallest = min = 0.6

Disease X

0

1

2

3

4

5

6

7

Yea

rs u

nti

l dea

th

“Five-number summary”

Center and spread in boxplots

Page 13: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

0123456789

101112131415

Disease X Multiple myeloma

Yea

rs u

ntil

deat

h

Comparing box plots for a normal and a right-skewed distribution

Boxplots for skewed data

Boxplots remain true

to the data and clearly

depict symmetry or

skewness.

Page 14: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

IQR and outliers

The interquartile range (IQR) is the distance between the first and third quartiles (the length of the box in the boxplot)

IQR = Q3 - Q1

An outlier is an individual value that falls outside the overall pattern.

How far outside the overall pattern does a value have to fall to be considered an outlier?

Low outlier: any value < Q1 – 1.5 IQR

High outlier: any value > Q3 + 1.5 IQR

Page 15: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

The standard deviation is used to describe the variation around the mean.

2

1

2 )(1

1xx

ns

n

i

1) First calculate the variance s2.

2

1

)(1

1xx

ns

n

i

2) Then take the square root to get

the standard deviation s.

Measure of spread: standard deviation

Mean± 1 s.d.

x

Page 16: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Calculations …

We’ll never calculate these by hand, so make sure you know how to get the standard deviation using your calculator.

2

1

1( )

1

n

is x xn

Mean = 63.4

Sum of squared deviations from mean = 85.2

Degrees freedom (df) = (n − 1) = 13

s2 = variance = 85.2/13 = 6.55 inches squared

s = standard deviation = √6.55 = 2.56 inches

Women’s height (inches)

Page 17: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Software output for summary statistics:

Excel—From Menu:

Tools/Data Analysis/

Descriptive Statistics

Give common

statistics of your

sample data.

Minitab

Page 18: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Choosing among summary statistics

Because the mean is not

resistant to outliers or skew, use

it to describe distributions that are

fairly symmetrical and don’t have

outliers.

Plot the mean and use the

standard deviation for error bars.

Otherwise, use the median in the

five-number summary, which can

be plotted as a boxplot.

Height of 30 women

58

59

60

61

62

63

64

65

66

67

68

69

Box plot Mean +/- sd

Hei

ght i

n in

ches

Box plot Mean ± s.d.

Page 19: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

What should you use? When and why?

Arithmetic mean or median?

Middletown is considering imposing an income tax on citizens. City hall

wants a numerical summary of its citizens’ incomes to estimate the total tax

base.

In a study of standard of living of typical families in Middletown, a sociologist

makes a numerical summary of family income in that city.

Mean: Although income is likely to be right-skewed, the city government wants to know about the total tax base.

Median: The sociologist is interested in a “typical” family and wants to lessen the impact of extreme incomes.

Page 20: Numerical descriptors BPS chapter 2 © 2006 W.H. Freeman and Company.

Organizing a statistical problem

State: What is the practical question, in the context of a real-world setting?

Formulate: What specific statistical operations does this problem call for?

Solve: Make the graphs and carry out the calculations needed for this problem.

Conclude: Give your practical conclusion in the setting of the real-world setting.