Top Banner
Estimation Procedures Point Estimation Confidence Interval Estimation
47

Estimation Procedures Point Estimation Confidence Interval Estimation.

Dec 20, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Estimation Procedures Point Estimation Confidence Interval Estimation.

Estimation Procedures

Point Estimation

ConfidenceInterval

Estimation

Page 2: Estimation Procedures Point Estimation Confidence Interval Estimation.

Three Properties of Point Estimators

1. Unbiasedness

2. Consistency

3. Efficiency

Page 3: Estimation Procedures Point Estimation Confidence Interval Estimation.

Estimate Number Error 1 +6 2 +8 3 -10 4 +2 5 -6

Error 0 0 0 -1 0

The estimates in green are more efficient(smaller standard error) but the estimatesin red are unbiased

Page 4: Estimation Procedures Point Estimation Confidence Interval Estimation.

xMEANThe Sampling Distribution ofxMEAN for ‘large’ samples

Page 5: Estimation Procedures Point Estimation Confidence Interval Estimation.

The standard error (s.e.) of estimation for xMEAN is given by

s.e. = /n where is the population standard deviation and n is the sample size

Page 6: Estimation Procedures Point Estimation Confidence Interval Estimation.

s.e. = /n Q. Why is the standard error (s.e.)

directly related to A.If the population is more varied

(dispersed) it is more difficult to locate the ‘typical’ value

In which case are you likely to predict the population mean more accurately??1. The age distribution of all students in

English schools, or2. The age distribution of all students in

English sixth form colleges?

Page 7: Estimation Procedures Point Estimation Confidence Interval Estimation.

Q. Why is the s.e. inversely related to the sample size?

A. The larger the n, the more ‘representative’ the sample is of the population and hence the smaller sampling error

s.e. = /n

Page 8: Estimation Procedures Point Estimation Confidence Interval Estimation.

Confidence Interval (CI)Sometimes, it is possible and

convenient to predict, with a certain amount of confidence in the prediction, that the true value of the parameter lies within a specified interval.

Such an interval is called a Confidence Interval (CI)

Page 9: Estimation Procedures Point Estimation Confidence Interval Estimation.

The statement ‘ [L, H] is the 95%

CI of ’ is to be interpreted that with 95% chance the population mean lies within the specified interval and with 5% chance it lies outside.

Page 10: Estimation Procedures Point Estimation Confidence Interval Estimation.

Two points to appreciate about the CI

A. The larger the standard error, longer is the CI, ceteris paribus

B. The higher the level of confidence, the longer is the CI, ceteris paribus

Page 11: Estimation Procedures Point Estimation Confidence Interval Estimation.

The area shaded orange is approximately98% of the whole

-2.33 0 +2.33

Page 12: Estimation Procedures Point Estimation Confidence Interval Estimation.

The area shaded orange is approximately95% of the whole

-1.96 0 +1.96

Page 13: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example1 (Confidence Interval for the population mean): Suppose that the result of sampling yields the following:

xMEAN = 25 ; n = 36. Use this information to construct a 95% CI for , given that = 16

Page 14: Estimation Procedures Point Estimation Confidence Interval Estimation.

Since n >24, we can say that xMEAN is approximately Normal(, 2/36).

Standardisation means that (xMEAN - )/(/6) is approximately z.

Now find the two symmetric points around 0 in the z table such that the area is 0.95. The answer is

z = 1.96.

Page 15: Estimation Procedures Point Estimation Confidence Interval Estimation.

Now solve (xMEAN - )/(6) = 1.96.

 (25- )/(16/6) = 1.96 to get two values of = 19.77 and = 30.23. Thus, the 95% CI for is [19.77 30.23]

Page 16: Estimation Procedures Point Estimation Confidence Interval Estimation.

Question: How is the length of the CI related to the standard error?

Answer: Ceteris Paribus, the CI is directly related to standard error

Page 17: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example 2 :(Confidence Interval for the population mean): Suppose that the result of sampling yields the following:

xMEAN = 25 ; n = 36. Use this information to construct a 95% CI for , given that = 32

Page 18: Estimation Procedures Point Estimation Confidence Interval Estimation.

Now solve (xMEAN - )/(6) = 1.96.

 (25- )/(32/6) = 1.96 to get two values of = 14.55 and = 35.45. Thus, the 95% CI for is [14.55 35.45]

Compare with the 95% CI for [19.77 30.23] for

Page 19: Estimation Procedures Point Estimation Confidence Interval Estimation.

Question: How is the length of the CI related to the level of confidence?

Answer: Ceteris Paribus, the CI will be longer the higher the level of confidence.

Page 20: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example 3 :(Confidence Interval for the population mean): Suppose that the result of sampling yields the following:

xMEAN = 25 ; n = 36. Use this information to construct a 90% CI for , given that = 16

Page 21: Estimation Procedures Point Estimation Confidence Interval Estimation.

Solve (xMEAN - )/(6) = 1.645.

 (25- )/(16/6) = 1.645 to get two values of = 20.61 and = 29.39. Thus, the 90% CI for is [20.61 29.39]

Compare with the 95% CI for [19.77 30.23]

Page 22: Estimation Procedures Point Estimation Confidence Interval Estimation.

1. The sample size n is ‘small’

The CLT does not work! To do any kind of parametric analysis we need the population to be normally distributed

Case 1: The population standard deviation is known

Theory: If X is normal(2 ) then xMEAN is also normal(2 /n)

Some Procedural Problems inParametric Analysis

Page 23: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example4: (Confidence Interval for the population mean with small samples):

Suppose that the result of sampling from a normal population with = 4 yields the following:

Page 24: Estimation Procedures Point Estimation Confidence Interval Estimation.

xMEAN = 25 ; n = 18. Use this information to construct the 90% CI for , Since X is normal(2 ) then xMEAN is

also normal(2 /18)

(xMEAN - )/(4/) = 1.645.(25- )/(4/ ) = 1.645

= 26.55, or = 23.45

The required CI is [23.45, 26.55]

Page 25: Estimation Procedures Point Estimation Confidence Interval Estimation.

1. The sample size n is ‘small’Case 2: The population standard deviation

is unknownTheory: If X is normal(2 ) then xMEAN is

also normal(2 /n) with unknown

Theory: If xMEAN is normal(2 /n) with unknown, then (xMEAN –)/s/n

has a t-distribution with (n-1) degrees of freedom.

s ≡ ((xi – xMEAN)2/(n-1) for raw data,

s ≡ (fi(xi – xMEAN)2/(n-1) for grouped data

Page 26: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example5: (Confidence Interval for the population mean):

Suppose that the result of sampling from a normal population yields the following:

Page 27: Estimation Procedures Point Estimation Confidence Interval Estimation.

xMEAN = 25 ; n = 18. Use this information to construct a 95% CI for , given that s2 = 16

First, note that as is unknown, we use s for .

But since n < 24, we can only say that xMEAN has a t-distribution with 17 degrees of freedom.

Now find from the t-distribution table the two symmetric values of t such that the area in between them is 0.95.

Page 28: Estimation Procedures Point Estimation Confidence Interval Estimation.

The answer is t = 2.11. Now solve

(xMEAN - )/(s/6) = 2.11(25- )/(16/6) = 2.11

to get two values of L = 20.36 and H= 29.63. Thus the 95% CI for is [19.37, 30.63].

Page 29: Estimation Procedures Point Estimation Confidence Interval Estimation.

2.The population standard deviation( is unknown but the sample size is ‘large’:

We estimate by either of the two estimates, s or where

s ≡ ((xi – xMEAN)2/N for raw data,

ands ≡ (fi(xi – xMEAN)2/N for grouped

dataThen we proceed as in Example1

above.

Page 30: Estimation Procedures Point Estimation Confidence Interval Estimation.

The Sampling Distribution of theSample proportion (p)

Suppose that the population mean = 0.6 and consider the following statistical process

Sample Number Value of p

1 0.48 2 0.54 3 0.65 - -

100 0.5

Page 31: Estimation Procedures Point Estimation Confidence Interval Estimation.

This is the distribution of p providedn and n(1-are

p

p Sample Proportion

Density

Page 32: Estimation Procedures Point Estimation Confidence Interval Estimation.

p

Density

p Sample Proportion

This is the distribution of p providedn and n(1-are

Page 33: Estimation Procedures Point Estimation Confidence Interval Estimation.

p

Density

p Sample Proportion

This is the distribution of p providedn and n(1-are

Page 34: Estimation Procedures Point Estimation Confidence Interval Estimation.

As n gets largerp

Density

p Sample Proportion

Page 35: Estimation Procedures Point Estimation Confidence Interval Estimation.

and larger….

p

Density

p Sample Proportion

Page 36: Estimation Procedures Point Estimation Confidence Interval Estimation.

p

Density

and larger….

p Sample Proportion

Page 37: Estimation Procedures Point Estimation Confidence Interval Estimation.

p

Density

and larger….

p Sample Proportion

Page 38: Estimation Procedures Point Estimation Confidence Interval Estimation.

pThe distribution gets more compactaround the mean value (

Density

p Sample Proportion

Page 39: Estimation Procedures Point Estimation Confidence Interval Estimation.

The distribution gets more compactaround the mean value (

p

Density

p Sample Proportion

Page 40: Estimation Procedures Point Estimation Confidence Interval Estimation.

The distribution gets more compactaround the mean value (

p

Density

p Sample Proportion

Page 41: Estimation Procedures Point Estimation Confidence Interval Estimation.

The distribution of the sample proportion(p ) for three sample sizes: n1 < n2 < n3

p

Density

Sample Size: n2

Sample Size: n1

Sample Size: n3

Page 42: Estimation Procedures Point Estimation Confidence Interval Estimation.

Properties of p

1. p is an unbiased estimator of the population mean

E(p ) =

2. Standard error of p (s.e.p) is given by s.ep = {/n}

Therefore, p is a consistent estimator of

Page 43: Estimation Procedures Point Estimation Confidence Interval Estimation.

Example1: (Confidence Interval for the population proportion): Suppose that the result of sampling yields the following:

Page 44: Estimation Procedures Point Estimation Confidence Interval Estimation.

p= 0.4 ; n = 36.

Use this information to construct a 98% CI for .

First, we do the validity check. This requires n 5 as well as n(1-) 5.

Because we don’t know what is, we use p in the place of .

Page 45: Estimation Procedures Point Estimation Confidence Interval Estimation.

Since p = 0.4 and n > 30, the validity check is satisfied.

We can therefore say that p is approximately N(2/36) where 2 =

).Standardisation means that (p-/6 is

approximately z. Now find the two symmetric points

around 0 in the z table such that the area is 0.98. The answer is

z = 2.33.

Page 46: Estimation Procedures Point Estimation Confidence Interval Estimation.

Now solve(p-/6 = 2.33(0.4-/6)= 2.33

In this expression we do not know what is, so we don’t know what is.

We use 0.4 as a point estimator for and calculate an estimate for * = 0.49

Page 47: Estimation Procedures Point Estimation Confidence Interval Estimation.

(0.4- )/ 0.49/6 = 2.33 to get two values of L = 0.21 and H =

0.59.Thus the 98% CI for is [0.21

0.59]