The National Picture on Child Outcomes for Early Intervention and Preschool Special Education

The National Picture on Child Outcomes for Early Intervention and Preschool Special Education

Kathy Hebbeler, ECO at SRILynne Kahn, NECTAC and ECO at FPG

Division for Early ChildhoodOctober 30, 2012

Overview

• National numbers and the quality of the state data

• The findings for FY 2010-11 • Findings over the last 3 years• State variation and data quality

2Early Childhood Outcomes Center

3Early Childhood Outcomes Center

OSEP Reporting Requirements: Child Outcomes

• Positive social emotional skills (including positive social relationships)

• Acquisition and use of knowledge and skills (including early language/ communication [and early literacy])

• Use of appropriate behaviors to meet their needs

If you have not seen the two-pager….

4Early Childhood Outcomes Center

www.the-eco-center.org

State Approaches to Outcomes Data, 2010-11

Approach Part C

(N=56)

Preschool

(N=59)

COS* 7 pt. scale

43/56 (77%) 36/59 (61%)

One tool statewide

7/56 (13%) 9/59 (15%)

Publishers’ online analysis

3/56 (5%) 6/59 (10%)

Other 5/56 (9%) 8/59 (14%)

*Child Outcomes Summary Rating

• States are in various stages with regard to building their child outcomes measurement systems

• Some phrased in• Some changed approaches

6Early Childhood Outcomes Center

Child Outcomes: What we know

3 Methods Methods for Calculating National Estimates

1. States with the highest quality data weighted by child count to represent all states*

2. All states weighted by child count

3. All states averaged (each state weighted as 1)

7Early Childhood Outcomes Center

*The data we will be presenting for the national picture

Identifying the States with Highly Questionable Data

Criteria for eliminating states:• Not reporting data on enough children• Odd patterns in the data• Review of method reported suggested the

data were of questionable quality

8Early Childhood Outcomes Center

Continued increase in the number of states included

9Early Childhood Outcomes Center

08-09

09-10 10-11

Pt. C 19 29 39

Part B Preschool 15 33 36

Number of States that Met Criteria for Inclusion in the National Analysis

10Early Childhood Outcomes Center

OSEP Reporting Categories

Percentage of children who: a. Did not improve functioningb. Improved functioning, but not sufficient to move nearer

to functioning comparable to same-aged peers c. Improved functioning to a level nearer to same-aged

peers but did not reach itd. Improved functioning to reach a level comparable to

same-aged peerse. Maintained functioning at a level comparable to same-

aged peers

3 outcomes x 5 “measures” = 15 numbers

Illustration of 5 Possible Paths

0

10

20

30

40

50

60

70

1 6 11 16 21 26 31 36 41 46 51 56

Age in Months

Sco

re

Maintained functioning comparable to age peers

Achieved functioning comparable to age peers

Moved nearer functioning comparable to age peers

Made progress; no change in trajectory

Did not make progress

• And now the data….

12Early Childhood Outcomes Center

And now the data….

13*Based on 39 states with highest quality data

14*Based on 36 States with the highest quality data.

The Summary Statements

1. Of those children who entered the program below

age expectations in each outcome, the percent who

substantially increased their rate of growth by the

time they turned 3 [6] years of age or exited the

program.

2. The percent of children who were functioning within

age expectations in each outcome by the time they

turned 3 [6] years of age or exited the program.

15Early Childhood Outcomes Center

16*Based on 39 states with highest quality data

17*Based on 36 States with the highest quality data.

Part C: Trends over Time

18Early Childhood Outcomes Center

Part C: Trends over Time

19Early Childhood Outcomes Center

Part B Preschool: Trends over Time

20Early Childhood Outcomes Center

21Early Childhood Outcomes Center

Part B Preschool: Trends over Time

Looking for Patterns

22Early Childhood Outcomes Center

Early Childhood Outcomes Center

23

24

%

Early Childhood Outcomes Center

25

Part C: States continue to report on more children

Total Number of Children States Included in the Child Outcomes Data

Number of children reported

Number of States and Jurisdictions

2007-08(N=56)

2008-09(N=56)

2009-10(N=54)

2010-11(N=54)

99 or less 13 6 5 4

100-499 25 16 9 10

500-999 6 13 10 7

1,000-1,999 9 11 10 13

2,000+ 3 10 20 22

27Early Childhood Outcomes Center

Early Childhood Outcomes Center 28

Total Number of Children Included in Progress Data

Number of children reported

Number of States and Jurisdictions

FFY 2007(N=58)

FFY 2008(N=58)

FFY 2009(N=58)

FFY 2010 (N=59)

10 or fewer 1 1 1 1

10-99 11 7 6 7

100–499 14 6 4 2

500-999 10 12 10 8

1000–1999 8 7 9 5

2000–2999 5 10 11 12

3000–4999 5 11 9 13

5000-8999 3 3 7 9

9000+ 1 1 1 2

Part B Preschool: States continue to report on more children

Early Childhood Outcomes Center

29

30Early Childhood Outcomes Center

%

75th Percentile

50th Percentile

25th Percentile

Minimum

Maximum

Outlier

Variation across states percent “a” : Part B 619 2010-11

Variation across states percent “b” : Part B 619 2010-11

Variation across states percent “c” : Part B 619 2010-11

Variation across states percent “d” : Part B 619 2010-11

Variation across states percent “e” : Part B 619 2010-11

Variation across states in greater than expected growth (Summary Statement 1) :

Part B 619 2010-11

Variation across states in exits at age expectations (Summary Statement 2) : Part B 619 2010-11

Variation across states percent “a” : Part C 2010-11

Variation across states percent “b” : Part C 2010-11

Variation across states percent “c” : Part C 2010-11

Variation across states percent “d” : Part C 2010-11

Variation across states percent “e” : Part C 2010-11

Variation across states in greater than expected growth (Summary Statement 1): Part C 2010-11

Variation across states in greater than expected growth (Summary Statement 2): Part C 2010-11

Part C Improvement Activities#

states Topic/theme

11 Training/TA on evidence based practices, effective practices, family centered services, DAP

5 TACSEI/CEFEL

3 Training/TA on social emotional development (not TACSEI/CEFEL specific)

3 Training/TA on more functional IFSP outcomes2 Revised IFSP format to enhance practices4 Training/TA on Literacy2 Training/TA on RBI2 Training/TA on ASD2 Training/TA on PSP

7Other topics:  coaching, instruction, self-help, transition practices, Special Quest, assistive technology, relationship based services in NE

46

Conclusions

• The data show good outcomes for many children who attend Part C and Part B, Preschool.

• The data quality continues to get better.• The data will be a powerful tool for

program improvement when– The data are consistently good at the local level– States and local programs consistently use it.

47Early Childhood Outcomes Center

For more information….

www.the-eco-center.org

48Early Childhood Outcomes Center