Top Banner
Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1
40

Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Jan 17, 2016

Download

Documents

Jacob Skinner
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

1

Fixed Effects ModelsEvaluation Research (8521)

Prof. Jesse Lecy

Page 2: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

WHY PANEL DATA IS BETTER

Page 3: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Is this program effective?

Outcome(more isbetter)

O1 x O2

Program

Time=1 Time=2

Page 4: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

What about now?

Outcome(more isbetter)

Treatment: O1 x O2

Control: O1 O2

Program

Time=1 Time=2

Control Group

Treatment Group

Page 5: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

What about now?

Outcome(more isbetter)

Treatment: O1 x O2

Control: O1 O2

Program

Time=1 Time=2

Treatment Group

Page 6: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

What about now?

Outcome(more isbetter)

Treatment: O1 x O2

Control: O1 O2

Program

Time=1 Time=2

Control Group

Treatment Group

Page 7: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

The context –

the initial level of outcomes for treatment and control groups

– is important !

Page 8: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

And Group Structure Matters

When individuals are isolated by geography or institution they develop differently. This geographic / group structure matters a great deal in social sciences.

Page 9: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

NOW FOR FIXED EFFECTS MODELSWhat would this same concept look like in regression terms?

Page 10: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

8 9 10 11 12

91

01

11

21

3

Return on Investments to Infrastructure by State, 1970-1986

Public Infrastructure (log)

Gro

ss E

con

om

ic A

ctiv

ity (

log

)

Each color represents data from a state over the 17-year study period.

Levels of spending and levels of economic development represent the specific characteristics of a group (a state in this case).

What is our inference about the policy impact of increased infrastructure spending when we use all of the data together, and does it change when we take into account group structure.

(data from Baltagi & Pinnoi 1995)

Page 11: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Heterogeneity Bias

Bias that results when you try to determine the impact of a program or policy and you don’t take into account group structure.

Page 12: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Differences Between “Levels” and Changes in Levels

• If you are looking at the relationship between foreign aid and the standard of living within a country, there is a large potential for bias because the countries that receive the most aid are going to be the poorest countries.

• As a result, if you regress the standard of living onto aid – simply looking at the levels of living standards and the levels of foreign aid – you will incorrectly conclude that foreign aid actually hurts nations.

• If we think about it more like an experiment, we would want to randomly assign levels of aid to different countries to see if it helps. That is not politically feasible, so instead we might think of a different experiment. What if we took all of the countries that are receiving aid, and we randomly assign them a one-unit increase or a one-unit decrease in aid. So they still receive close to the same levels of aid as the previous year, but they get a small boost or a small shock.

• We are moving from an examination of the “levels” of foreign aid to changes in foreign aid.

Page 13: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

LivingStandards

Aid

This is what the “levels” data will look like. Note that poor countries NEED the most aid, so the direction of causality is opposite of what this regression suggests. We cannot interpret the slope as a program impact here.

Page 14: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

LivingStandards

Aid

This is what the “levels” data will look like. Note that poor countries NEED the most aid, so the direction of causality is opposite of what this regression suggests. We cannot interpret the slope as a program impact here.

Change in Living

Standard

Change in Aid

If we look at changes in the levels of aid for one specific country, we can look at how that change either increases or decreases the standard of living in the country.

Change in Living Standard

Less aid

More aidSpecific Country

Page 15: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

LivingStandards

Aid

What the relationship looks like when you estimate the policy impact using all of the data from many countries.

Change in Living

Standard

Change in Aid

The relationship focusing on one country over time.

Between Country

Within Country

Page 16: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

LivingStandards

Aid

The fixed effect model does this by examine changes that occur within-group over time.

Change in Living Standard

Change in Aid

By adding an intercept for each group, you are putting them on the same axis so now you can estimate a common slope while taking into account the effects of the unique history/culture of the groups.

Page 17: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Cross-Section Variation (Levels)

Page 18: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Regression Model:

eDosagebbBP 10

Page 19: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Within Group Variation

Page 20: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Another Example

Page 21: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Why are the slopes the same?

Price

MakeMileage

Page 22: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

When to use Fixed Effects?

Y

Time-InvariantGroup-Level

TraitPolicyVariable

Page 23: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

The “Fixed Effect” is a catch-all variable for anything about the group that is “fixed” across time

• “Culture”• Race• Gender• IQ• Management or Productivity• Ability

Y

Fixed TraitX1

Even if we cannotmeasure it,

we can get rid of it!

Page 24: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Isolating Change Over Time

Change in Y

Change in X

Page 25: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

GenderbEdubbIncome o 21

How it works mathematically:

GenderbEdubbIncome

GenderaEduaaIncome

GenderaEduaaIncome

tttt

tttt

210

1121101

2222102

If any covariate is time-invariant:

Page 26: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

“Fixed Effects” Regression Model

eSbSbSbDosagebBP 321 4321

Page 27: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

“Fixed Effects” Regression Model

eSbSbSbDosagebBP 321 4321

Note – there is no intercept term! Why is this?

321 SSSC

Perfect Multicollinearity

C S1 S2 S31 1 0 01 1 0 01 0 1 01 0 1 01 0 0 11 0 0 1

Page 28: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Management Bias (Mundlak, 1965)

Ag Inputs

FarmProductivity

Organizational Culture

Agricultural Inputs

Farm Productivity b

β

Page 29: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Bias Can go in the Other Direction

X

Y

Page 30: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Difference in Fit

ΔX ΔYXt=1

Xt=2

Yt=1

Yt=2

Page 31: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Difference in Fit

Page 32: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Requires Panel Data

X Y Gender

1 8 Male

3 6 Female

2 5 Female

2 3 Male

ID X Y Observation (Time)

A 1 8 1

A 3 6 2

B 2 5 1

B 2 3 2

Time Y

1 8

2 6

3 5

4 3

Cross Section

Panel Data

Time Series

Page 33: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Data for the Homework

8 9 10 11 12

91

01

11

21

3

Return on Investments to Infrastructure by State, 1970-1986

Public Infrastructure (log)

Gro

ss E

con

om

ic A

ctiv

ity (

log

)

-0.4 -0.2 0.0 0.2 0.4

-0.2

-0.1

0.0

0.1

0.2

0.3

0.4

Return on Infrastructure Investments for Six States, 1970-1986

Public Infrastructure (residuals)

Gro

ss E

co

no

mic

Activity (

resid

ua

ls)

Page 34: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Data for the Homework

8 9 10 11 12

91

01

11

21

3

Return on Investments to Infrastructure by State, 1970-1986

Public Infrastructure (log)

Gro

ss E

con

om

ic A

ctiv

ity (

log

)

-0.4 -0.2 0.0 0.2 0.4

-0.2

-0.1

0.0

0.1

0.2

0.3

0.4

Return on Infrastructure Investments for Six States, 1970-1986

Public Infrastructure (residuals)

Gro

ss E

co

no

mic

Activity (

resid

ua

ls)

Page 35: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Why does this happen?

EconomicGrowth

StateCharacteristics

PublicSpendingOn Infrastructure

EconomicGrowth

PublicInfrastructure

Tax Base

?

Tech Boom

+

+

+

Page 36: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Running a Fixed Effects Model in SPSS

Page 37: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Running a Fixed Effects Model in SPSS

Page 38: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Running a Fixed Effects Model in SPSS

Uncheck this

Page 39: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

Running a Fixed Effects Model in SPSS

Page 40: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.

General Linear ModelCommand

Linear Regressionwith Dummies

and no Intercept