The National Picture on Child Outcomes for Early Intervention and Preschool Special Education Kathy Hebbeler, ECO at SRI Lynne Kahn, NECTAC and ECO at FPG Division for Early Childhood October 30, 2012
Feb 08, 2016
The National Picture on Child Outcomes for Early Intervention and Preschool Special Education
Kathy Hebbeler, ECO at SRILynne Kahn, NECTAC and ECO at FPG
Division for Early ChildhoodOctober 30, 2012
Overview
• National numbers and the quality of the state data
• The findings for FY 2010-11 • Findings over the last 3 years• State variation and data quality
2Early Childhood Outcomes Center
3Early Childhood Outcomes Center
OSEP Reporting Requirements: Child Outcomes
• Positive social emotional skills (including positive social relationships)
• Acquisition and use of knowledge and skills (including early language/ communication [and early literacy])
• Use of appropriate behaviors to meet their needs
If you have not seen the two-pager….
4Early Childhood Outcomes Center
www.the-eco-center.org
State Approaches to Outcomes Data, 2010-11
Approach Part C
(N=56)
Preschool
(N=59)
COS* 7 pt. scale
43/56 (77%) 36/59 (61%)
One tool statewide
7/56 (13%) 9/59 (15%)
Publishers’ online analysis
3/56 (5%) 6/59 (10%)
Other 5/56 (9%) 8/59 (14%)
*Child Outcomes Summary Rating
• States are in various stages with regard to building their child outcomes measurement systems
• Some phrased in• Some changed approaches
6Early Childhood Outcomes Center
Child Outcomes: What we know
3 Methods Methods for Calculating National Estimates
1. States with the highest quality data weighted by child count to represent all states*
2. All states weighted by child count
3. All states averaged (each state weighted as 1)
7Early Childhood Outcomes Center
*The data we will be presenting for the national picture
Identifying the States with Highly Questionable Data
Criteria for eliminating states:• Not reporting data on enough children• Odd patterns in the data• Review of method reported suggested the
data were of questionable quality
8Early Childhood Outcomes Center
Continued increase in the number of states included
9Early Childhood Outcomes Center
08-09
09-10 10-11
Pt. C 19 29 39
Part B Preschool 15 33 36
Number of States that Met Criteria for Inclusion in the National Analysis
10Early Childhood Outcomes Center
OSEP Reporting Categories
Percentage of children who: a. Did not improve functioningb. Improved functioning, but not sufficient to move nearer
to functioning comparable to same-aged peers c. Improved functioning to a level nearer to same-aged
peers but did not reach itd. Improved functioning to reach a level comparable to
same-aged peerse. Maintained functioning at a level comparable to same-
aged peers
3 outcomes x 5 “measures” = 15 numbers
Illustration of 5 Possible Paths
0
10
20
30
40
50
60
70
1 6 11 16 21 26 31 36 41 46 51 56
Age in Months
Sco
re
Maintained functioning comparable to age peers
Achieved functioning comparable to age peers
Moved nearer functioning comparable to age peers
Made progress; no change in trajectory
Did not make progress
• And now the data….
12Early Childhood Outcomes Center
And now the data….
13*Based on 39 states with highest quality data
14*Based on 36 States with the highest quality data.
The Summary Statements
1. Of those children who entered the program below
age expectations in each outcome, the percent who
substantially increased their rate of growth by the
time they turned 3 [6] years of age or exited the
program.
2. The percent of children who were functioning within
age expectations in each outcome by the time they
turned 3 [6] years of age or exited the program.
15Early Childhood Outcomes Center
16*Based on 39 states with highest quality data
17*Based on 36 States with the highest quality data.
Part C: Trends over Time
18Early Childhood Outcomes Center
Part C: Trends over Time
19Early Childhood Outcomes Center
Part B Preschool: Trends over Time
20Early Childhood Outcomes Center
21Early Childhood Outcomes Center
Part B Preschool: Trends over Time
Looking for Patterns
22Early Childhood Outcomes Center
Early Childhood Outcomes Center
23
24
%
Early Childhood Outcomes Center
25
Part C: States continue to report on more children
Total Number of Children States Included in the Child Outcomes Data
Number of children reported
Number of States and Jurisdictions
2007-08(N=56)
2008-09(N=56)
2009-10(N=54)
2010-11(N=54)
99 or less 13 6 5 4
100-499 25 16 9 10
500-999 6 13 10 7
1,000-1,999 9 11 10 13
2,000+ 3 10 20 22
27Early Childhood Outcomes Center
Early Childhood Outcomes Center 28
Total Number of Children Included in Progress Data
Number of children reported
Number of States and Jurisdictions
FFY 2007(N=58)
FFY 2008(N=58)
FFY 2009(N=58)
FFY 2010 (N=59)
10 or fewer 1 1 1 1
10-99 11 7 6 7
100–499 14 6 4 2
500-999 10 12 10 8
1000–1999 8 7 9 5
2000–2999 5 10 11 12
3000–4999 5 11 9 13
5000-8999 3 3 7 9
9000+ 1 1 1 2
Part B Preschool: States continue to report on more children
Early Childhood Outcomes Center
29
30Early Childhood Outcomes Center
%
75th Percentile
50th Percentile
25th Percentile
Minimum
Maximum
Outlier
Variation across states percent “a” : Part B 619 2010-11
Variation across states percent “b” : Part B 619 2010-11
Variation across states percent “c” : Part B 619 2010-11
Variation across states percent “d” : Part B 619 2010-11
Variation across states percent “e” : Part B 619 2010-11
Variation across states in greater than expected growth (Summary Statement 1) :
Part B 619 2010-11
Variation across states in exits at age expectations (Summary Statement 2) : Part B 619 2010-11
Variation across states percent “a” : Part C 2010-11
Variation across states percent “b” : Part C 2010-11
Variation across states percent “c” : Part C 2010-11
Variation across states percent “d” : Part C 2010-11
Variation across states percent “e” : Part C 2010-11
Variation across states in greater than expected growth (Summary Statement 1): Part C 2010-11
Variation across states in greater than expected growth (Summary Statement 2): Part C 2010-11
Part C Improvement Activities#
states Topic/theme
11 Training/TA on evidence based practices, effective practices, family centered services, DAP
5 TACSEI/CEFEL
3 Training/TA on social emotional development (not TACSEI/CEFEL specific)
3 Training/TA on more functional IFSP outcomes2 Revised IFSP format to enhance practices4 Training/TA on Literacy2 Training/TA on RBI2 Training/TA on ASD2 Training/TA on PSP
7Other topics: coaching, instruction, self-help, transition practices, Special Quest, assistive technology, relationship based services in NE
46
Conclusions
• The data show good outcomes for many children who attend Part C and Part B, Preschool.
• The data quality continues to get better.• The data will be a powerful tool for
program improvement when– The data are consistently good at the local level– States and local programs consistently use it.
47Early Childhood Outcomes Center
For more information….
www.the-eco-center.org
48Early Childhood Outcomes Center