First 5 Kern Annual Report Fiscal Year 2010-2011 Presented By JIANJUN “JJ” WANG, Ph.D.
Dec 27, 2015
Focuses of the Annual Report
1. Meet state requirements to justify the return on state investment Results-Based Accountability: Identify what works for
whom in which context.
2. Facilitate program improvement “Define success as turning the curve away from the
baseline or beating the baseline” (Friedman, 2005, p. 58) – It is particularly important when decrease of the state revenue seems inevitable (as tobacco consumptions dwindle down).
What Works: Fact Finding, Outcome Assessment, and Trend Evaluation
Descriptive Data to Count Service Outputs # of Children Born with Low Birth Weight
# of Mothers Involved in Breastfeeding
# of Families with Insurance Coverage
Assessment of Service Outcomes
“Not everything that counts can be counted, and not everything that can be counted counts.”
-- Albert Einstein
Analysis of Variable Relations
State-Recommended Evaluation Framework
Three levels of data will be collected, evaluated and reported on in order to provide answers to different categories of questions. These levels include: Descriptive data;
Outcome data; and
Data produced through applied social research methods. (First 5 California, 2005, p. 5)
Structure of the Report
Chapter 1: First 5 Kern Overview
Chapter 2: Impact of First 5 Kern-Funded Programs
Chapter 3: Effectiveness of Service Integration
Chapter 4: Turning the Curve
Chapter 5: Conclusions and Future Directions
Fact Finding: Descriptive Results on Service Counts
Sormano and Neville-Morgan (2009) pointed out, “Data is more compelling when aggregated” (p. 18). In the Health and Wellness area, the number of funded
programs increased from eight in the last year to 11 this year.
Five new programs have been added to the Parent Education and Support Services area, making a total of 18 funded programs this year.
Approximately $1 million were added to expand services in Early Childcare and Education.
Programs Highlighted in the State Report
Programs covered in the local report to the state: Community Action Partnership of Kern 2-1-1 program
Bakersfield Adult School Health Literacy Program
Delano School Readiness Initiative
Indian Wells Valley Family Resource Center
Children’s Health Initiative
Successful Application Stipend
GBLA’s Domestic Violence Reduction Project.
Fact Finding: Health and Wellness
Figure 5: Relation Between Low Birth Weight and Family Income
Blue: Regular Weight, Red: Low Birth Weight
Fact Finding: Health and Wellness
Figure 6: Lack of Regular Dental Checking in Single Parent Families
See a dentist/hygienist less than a year: Yes (red), No (blue)
Fact Finding: Parent Education and Support Services
Figure 19: Trend of Resolving Immigration Barriers
__________ * Recall is defined as a post-test administration.
Fact Finding: Parent Education and Support Services
Figure 20: Trend of Expanding Insurance Coverage
Outcome Assessment: Parent Education and Support Services
Figures 21 & 22: Change of Parent Beliefs on Child Fearing
Arvin
Shafter
Outcome Assessment: Parent Education and Support Services
Figure 25: Improvement of Substance Abuse Condition Through Parent Education
Fact Finding: Balance Service Coverage in Kern County (Figures 27 & 28)
Results of ASQ-3 36th Month Assessment
Focus Area 2
Outcome Assessment: Early Childcare and Education (Table 10 reference)
ASQ Domains Focus Area 2 Focus Area 3
Gross Motor 93 90
Fine Motor 78 78
Communication 74 71
Problem Solving 90 83
Personal Social 85 73
Outcome Assessment: Early Childcare and Education
Figure 33: Invariant Language Combinations across Ages 4 and 5
Outcome Assessment: Early Childcare and Education (Table 12)
Program Site df t p Effect Size
Arvin 31 11.07 .0001 4.20
BCSD 101 7.48 .0001 1.49
Delano 29 8.50 .0001 3.16
Greenfield 13 8.69 .0001 4.82
Lamont 74 4.05 .0001 0.94
Lost Hills 21 6.83 .0001 2.98
Mojave 5 10.01 .0002 8.95
McFarland 22 7.72 .0001 3.29
Shafter1 15 5.68 .0001 2.93
Shafter2 13 6.39 .0001 3.54
Taft 37 18.50 .0001 6.08
Fact Finding: Outreach Activities Across Programs (Table 14)
Outreach Activities Number of Programs
Establish an MOU with partners 13
Develop brochure 35
Develop/disseminate annual reports 9
Develop poster 10
Make press release 13
Participate in collaborative meetings 39
Participate in community gatherings 24
Participate in health fair 25
Publish educational book 7
Publish newsletter 14
Seek funding opportunities with partner agencies 34
Sustain partnerships for more than one year 38
Fact Finding: Integration of Services Across Programs
Figure 38: Referrals to Enhance Service Accessibility in the Local Context
Service for clients referred from other agencies: Blue – No, Red – Yes.
Fact Finding: Integration of Services Across Programs
Figure 40: Proportion of Coordinated Services Across Different Funding Levels
Services coordinated by the county, state, or nation: Blue – Yes, Red – No
Outcome Assessment: Integration of Services Across Programs
Figure 45: Translation Services Across Different Funding Levels
Translation services offered: Blue – Yes, Red – No
Outcome Assessment: Integration of Services Across Programs
Figure 51: Effectiveness of Integration Services
Outcome Assessment: Integration of Services Across Programs
Figure 53: Increase of Program Visibility Through Local Partnerships
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 17)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 18)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 19)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 20)
Program Site Year Percent Pattern*
Buttonwillow 2009-10 3
2010-11 53
IWV 2009-10 27
2010-11 89
McFarland 2009-10 43
2010-11 76*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 21)Program Site Year Percent Pattern**
Buttonwillow 2009-10 50
2010-11 82
Henrietta Weill
2009-10 61
2010-11 73
IWV 2009-10 83
2010-11 90
MVIP 2009-10 73
2010-11 86
Neighborhood Place
2009-10 71
2010-11 79
SENP 2009-10 44
2010-11 62
Wind in the Willows
2009-10 64
2010-11 75 *Percent of “yes” response in the blue and red bars, respectively. **Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 22)Program Site Year Percent Pattern*
Arvin 2009-10 33
2010-11 42
Delano 2009-10 46
2010-11 82
Homeless Center
2009-10 47
2010-11 55
Greenfield 2009-10 41
2010-11 50
MVIP 2009-10 49
2010-11 59
Shafter 2009-10 29
2010-11 64
Taft 2009-10 48
2010-11 58 *Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the Curve” Since 2009
Additional results are available in the annual report, including: More nursery school attendance for children after
age 3;
Fewer children were exposed to cigarette smoke;
More children received all shots recommended by doctors;
More children being read to twice or more times per week.
Conclusions
Based on the results from fact-finding, outcome assessment, and trend evaluation, First 5 Kern, through its funded partners, has: Extended the current longitudinal data gathering
beyond the annual monitoring of First 5 Kern performance;
Incorporated more explanatory and outcome variables to justify the Results-Based Accountability (RBA) on each Result Indicator (see the next slide);
Strengthened its leadership role in the area of service integration.
Additional Information fromProgram-Specific Instruments
Program-Specific Instruments include:
1. Anger Management Assessment
2. Be Choosey Be Healthy
3. Child Assessment Summer Bridge
4. Comprehensive Need Assessment
5. Eyberg Child Assessment
6. Incredible Years Parenting Scale
7. Richardson’s Student Behavior Assessment
8. School Readiness Articulation Survey
9. Substance Abuse Assessment
Introduction to New Recommendations
Statement from Kris Perry, Executive Director,
First 5 California
Regarding First 5 California Project Legacy
Due to declining revenues, First 5 California can no longer fund programs at their current levels. We anticipated this situation and are prepared to address it in a fair and equitable manner.
Our aim is to fulfill the objectives of our strategic plan, be responsible stewards of tax dollars and help ensure all children enter school ready to achieve their greatest potential. To accomplish this, we created First 5 California Project Legacy to serve as a “Roadmap to the Future” by establishing two to three Signature Programs and innovative Pilot Projects for children 0 to 5 and their families.
Introduction to New Recommendations
Three Signature Programs identified by the State Commission:
a child program
a parent program
a teacher program
Source: http://www.ccfc.ca.gov/Help/program_development.asp
New Recommendations
1. Identify/develop “signature programs” through a balanced consideration between the existing partners with exemplary track records and new partners with strong potential to deliver groundbreaking services;
2. Collect timely feedback from service providers to enhance performance tracking;
3. Invite input from service providers on additional evidences that should have been gathered to represent their outcome-based contributions.