Results Based Accountability
Sue Gallagher, Director of Research, Planning and AnalysisChildren’s Services Council of Broward County
[email protected] | 954-377-1000
School Board of Broward CountySeptember 11, 2013
www.cscbroward.org
Results Based Accountability (RBA)
The Fiscal Policy Studies InstituteSanta Fe, New Mexico
Websitesresultsaccountability.com
raguide.org
Book - DVD Orders amazon.com
resultsleadership.org
www.cscbroward.org
Results Accountability
Made up of two parts
Performance Accountability about the well-being ofCLIENT POPULATIONS
For Programs – Agencies – and Service Systems
Population Accountability about the well-being ofWHOLE POPULATIONS
For Communities – Cities – Counties – States - Nations
www.cscbroward.org
PERFORMANCE ACCOUNTABILITYFor Programs, Agencies and Service Systems
The Fiscal Policy Studies InstituteSanta Fe, New Mexico
resultsaccountability.comraguide.org
www.cscbroward.org
1. The first purpose of performance measurement is to improve performance.
2. Avoid the performance measurement equals punishment trap.
3. Build bottom-up and top-down use of PMs simultaneously.
A Leader’s Approach to Data
www.cscbroward.org
How Much did we do?
( # )
How Well did we do it? ( % )
Quantity Quality
Performance Measures
www.cscbroward.org
Effort How hard did we try?
Effect Is anyone be9er off?
Performance Measures
www.cscbroward.org
How much did we do?
How well did we do it?
Is anyone be=er off?
Quan?ty Quality
Effe
ct Eff
ort
# %
Program Performance Measures
www.cscbroward.org
How much did we do? How well did we do it?
Is anyone be=er off?
# Clients/customers served
# AcBviBes (by type of acBvity)
% Common measures e.g. client staff raBo, workload raBo, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost
% Skills / Knowledge (e.g. parenBng skills)
#
% AItude / Opinion (e.g. toward drugs)
#
% Behavior (e.g.school a9endance)
#
% Circumstance (e.g. working, in stable housing)
#
% AcBvity-‐specific measures e.g. % Bmely, % clients compleBng
acBvity, % correct and complete, % meeBng standard
Point in Time vs. Point to Point Improvement
Separating the Wheat from the ChaffTypes of Measure Found in Each Quadrant
www.cscbroward.org
Quan?ty Quality
Efficiency, Admin overhead, Unit cost Staffing ra?os, Staff turnover Staff morale, Access, Wai?ng ?me, Wai?ng lists, Worker safety
Customer Sa?sfac?on (quality service delivery & customer benefit) Cost / Benefit ra?o Return on investment
Client results or client outcomes
Effec?veness Value added Produc?vity
Benefit value
Process Input
Effect
Effort
Cost TQM
1. Did we treat you well?
2. Did we help you with your problems?
*
Product Output Impact
* World’s simplest complete customer sa?sfac?on survey
RBA Categories Account forAll Performance Measures (in the history of the universe)
www.cscbroward.org
1. To Ourselves Can we do better than our own history?
2. To Others When it is a fair apples/apples comparison.
3. To Standards When we know what good performance is.
Comparing Performance
www.cscbroward.org
1. Dataa. Population indicators Actual turned curves:
movement for the better away from the baseline.
b. Program performance measures: customer progress and better service:
How much did we do? How well did we do it? Is anyone better off?
2. Accomplishments: Positive activities, not included above.
3. Stories behind the statistics that show how individuals are better off.
Different Kinds of Progress
www.cscbroward.org
LR
UR
www.cscbroward.org
Customer Result: _______________ Performance Measure (Lay definiBon) Performance
Measure Baseline
Story behind the baseline -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ (List as many as needed)
Partners -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ (List as many as needed)
Three Best Ideas – What Works 1. -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ 2. -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ 3. -‐-‐-‐-‐-‐-‐-‐-‐-‐No-‐cost / low-‐cost
ONE PAGE Turn the Curve Report: Performance
Sharp Edges
4. -‐-‐-‐-‐-‐-‐-‐-‐-‐ Off the Wall
www.cscbroward.org
POPULATION ACCOUNTABILITYFor Whole Populations in a Geographic Area
The Fiscal Policy Studies InstituteSanta Fe, New Mexico
resultsaccountability.comraguide.org
www.cscbroward.org
Core RBA Concepts
RESULTA condition of well-being for children, adults, families or communities.
Children born healthy • Children ready for school
INDICATORA measure which helps quantify the achievement of a result.
Rate of low-birthweight babies • Percent ready at K entry Crime rate • Air quality index • Unemployment rate
PERFORMANCE MEASUREA measure of how well a program, agency or service system is working.
How much did we do? How well did we do it? Is anyone better off? =
Customer Results
Popu
latio
nPe
rfor
man
ce
www.cscbroward.org
IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE?
1. Safe Community2. Crime Rate
3. Average Police Dept response time4. An educated workforce5. Adult literacy rate6. People have living wage jobs and income7. % of people with living wage jobs and income
8. % of participants in job training who get living wage jobs
RESULT
INDICATOR
PERF. MEASURE
RESULT
INDICATOR
RESULT
INDICATOR
PERF. MEASURE
www.cscbroward.org
Broward CountyPopulation Results for Children, Families and Communities
• Children are Physically and Mentally Healthy• Children are Ready to Succeed in School
• Children Successfully Transition to Adulthood• Children Live in Stable and Nurturing Families • Communities are Safe and Supportive
www.cscbroward.org
How PopulaBon
& Performance Accountability
FIT TOGETHER
www.cscbroward.org
Contribu?on rela?onship
Alignment of measures
Appropriate responsibility
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATION ACCOUNTABILITY
Healthy Births Rate of low birth-‐weight babies Stable Families Rate of child abuse and neglect Children Succeeding in School Percent graduaBng from high school on Bme
CUSTOMER RESULTS
# of inves?ga?ons completed
% completed within 24 hrs of report
# repeat Abuse/Neglect
% repeat Abuse/Neglect
PERFORMANCE ACCOUNTABILITY Child Welfare Program
POPULATION RESULTS
Child Welfare Program
www.cscbroward.org
www.cscbroward.org
Every ?me you make a presenta?on
use a two-‐part approach
Result: to which you contribute to most directly.
Indicators:
Story: Partners: What would it take?: Your Role: as part of a larger strategy.
Popula?on Accountability
Program: Performance measures:
Story: Partners: Ac?on plan to get be=er:
Performance Accountability
Your Role
www.cscbroward.org
3 -‐ kinds of performance measures. How much did we do? How well did we do it? Is anyone be9er off?
RBA in a Nutshell 2 – 3 -‐ 7 2 -‐ kinds of accountability PopulaBon accountability Performance accountability
7 -‐ quesBons from ends to means in less than an hour.
plus language discipline Results & Indicators Performance measures
www.cscbroward.org
THANK YOU !
WEBSITES: www.raguide.org www.resultsaccountability.com
BOOK ORDERS: www.trafford.com www.amazon.com