First 5 Kings County

First 5 Kings CountyEvaluation Services Request for ApplicationBidders Teleconference – February 22, 2012

ObjectivesProvide a summary of the

approach First 5 Kings County has chosen to conduct Evaluation Activities

Review components necessary for submission of application

Answer questions from perspective applicants.

The Big Picture

The First 5 Kings County Children and Families Commission is seeking qualified applicants to conduct program specific evaluation of its funding investments. The selected Evaluator will use data collected and corresponding charts established from funded programs and other information to assess the contribution of program outcomes to community-level improvements for young children. The Evaluator will be required to assess the impact of programs and services on targeted groups in Kings County and to make suggestions for program and system improvements.

First 5 Kings County Evaluation Approach

Historical ContextFrom it’s inception until 2009, the

Commission utilized external contractors to complete local evaluation efforts.

In 2009, in an effort to save money, the Commission embarked upon a process meant to establish a peer evaluation System.

First 5 Kings County Evaluation Approach

External Contractors Used CSU Bakersfield – the commission engaged in

a multi-county endeavor for evaluation services across valley First 5 organizations. This contract ended when the lead researcher departed and established an independent research firm.

Pathways and Insights – the commission hired this firm to complete formative evaluation services for Kings County. The contractual relationship ended when the partners within the firm terminated the organization.

First 5 Kings County Evaluation Approach

External Contractors Used Applied Research Center – the commission hired

this firm to complete evaluation services for Kings County. The contractual relationship ended when a competitive RFP was published and UCLA Center for Healthier Children, Families, and Communities was chosen as the successful proposal.

UCLA’s Center for Healthier Children, Families, and Communities – the Commission maintained a relationship with this contractor for 3 years, and has as a result completed evaluations on all major Initiatives/Programs of the Commission. This contractual relationship ended in September 2009.

First 5 Kings County Evaluation Approach

Historical ContextIn 2009, in an effort to save money,

the Commission embarked upon a process meant to establish a peer evaluation System.

First 5 Kings County Evaluation Approach

Peer Evaluation SubcommitteeDetermined evaluation would occur at

the programmatic levelDetermined only programs funded over

$100,000 per year would be evaluatedDetermined that programs would be

evaluated every other year (bi-annually).Determined that programs would be

responsible for data collection and creation of all charts/tables necessary for analysis.

First 5 Kings County Evaluation Approach

Peer Evaluation SubcommitteeUtilized a significant portion of the

existing evaluation framework (as established by UCLA) to develop a plan for future efforts.

Worked with contracted providers to determine what data could be reasonably collected/managed given diminished resourced

Established funding threshold which would trigger evaluation, and timeframe of each evaluation effort.

First 5 Kings County Evaluation Approach

Current ApproachCommission identified the need to

utilize an external evaluator to conduct actual analysis and produce evaluation reports.

First 5 Kings County Evaluation Approach

Expectations for Evaluation Services: Conduct evaluation methodologies that are

based upon goals, results, performance measures and indicators as outlined in the First 5 Kings County Evaluation Plan (Appendix 4).

Act as the Evaluation liaison with funded programs, gathering all necessary information on program implementation and program impact to enable recipients to demonstrate the effectiveness, efficiency, and systemic collaboration of the program to the First 5 Kings County Commission.

First 5 Kings County Evaluation Approach

Expectations for Evaluation Services:Measure program and service performance,

producing an annual evaluation report which includes (but is not limited to) the following:

Outcomes-based accountability that range from formative program evaluation and process improvement, to summative profiles of intended versus actual performance, and result and impact studies.

Provides program costs and benefit measurements with like programs as designated.

Produce at least quarterly progress reports to program personnel and key decision makers.

First 5 Kings County Evaluation Approach

Compensation for Evaluation Services:$25,000 per year for a total of 2 yearsMaximum amount of funding available

not to exceed $50,000.

Application Components

Preparing an ApplicationApplications must be typewritten in a

12 point font on 8 ½ by 11 paper.In order for your application to be

considered, it must supply all of the information requested, in the order requested, in the RFA.

Application Due Date: March 9, 20094:00 p.m.

Application Components

Cover LetterExecutive SummaryNarrativeReferencesSample of Previous Evaluation

Work Product

Application Components

Cover LetterPlease utilize the format presented in

Appendix B of the RFA document.

Application Components

Executive SummaryProvide a one page summary of the

application.

Application Components

NarrativeCan be no longer than 10 pagesMust address each question posed in

the RFA in the order requested. Applicant/Organizational Capacity Evaluation Experience Staffing

Can include additional information, but must be contained within the 10 page limitation.

Application Components

ReferencesPlease provide three references,

include name and telephone number.

Application Components

Sample Work ProductPlease provide written evaluation

report(s) the applicant/organization has completed

Selection Process

Complete applications will be scored by a group of two or more readers.

Applications scoring 70% or higher will be considered for the interview panel.

Selection Process

Application Review CriteriaApplicant/Organization Capacity (25%)Evaluation Experience (50%)Staffing (25%)

Selection Process

Application Interview PanelAn Interview Panel, which may be

comprised of First 5 Kings County Commissioners and/or other panel members as designated, will interview the applicant’s who have met the scoring requirement.

A formal recommendation will be made by the interview panel to the full Commission on April 3, 2012

Selection Process

Contract/Evaluation Activities Begin:Contract to be negotiated in AprilActivities to begin July 1, 2012

Questions?