FPSI/RLG 1 The Five W’s and How of Results-Based Accountability™ Social Outcomes Measurement Conference Sydney, AU Adam Luecking Results Leadership Group www.resultsleadership.org MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
May 30, 2015
FPSI/RLG 1
The Five W’s and How ofResults-Based Accountability™
Social Outcomes Measurement Conference
Sydney, AU
Adam LueckingResults Leadership Group
www.resultsleadership.org
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Agenda• Results-Based
Accountability:Who, what, when, where, why & how?
• Questions and Answers
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBATo implement the 5 conditions of Collective
Impact
• Common language
• Shared measurement
systems
• Mutually reinforcing
activities
• Continuous communication
• Backbone support
organization
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBATo create Measurable Impact
Measurable Impact
akaTurning the
Curve
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBATo know you are making a
difference
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBATo bring precision to your passion
How much did we do?How well did we do it?Is anyone better off?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Where RBA?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Who RBA?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
How RBA?•Introduction to core concepts
•Population Accountability•Performance Accountability
•Turn the Curve Thinking•Tie it all Together
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Two Key Principles for Achieving Measurable Impact
1. Starting with ends, working backwards to means
2. Data-driven, transparent Decision Making
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
2 - - Kinds of Accountability
3 - Kinds of Performance Measures. • How much did we do? • How well did we do it? • Is anyone better
off?
7 - Questions from ends to means in less than an hour (aka. Turn the Curve Thinking)
• Population accountability • Performance accountability
RBA in a Nutshell2-3-7
FPSI/RLG 16
Results-Based Accountability is made up of two parts:
about the well-being ofCLIENT POPULATIONS
about the well-being ofWHOLE POPULATIONS
Population Accountability
Performance AccountabilityFor Communities – Cities – Counties – States - Nations
For Programs – Agencies – and Service Systems
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 17
DEFINITIONSDEFINITIONSRESULT RESULT
INDICATOR INDICATOR
PERFORMANCE MEASUREPERFORMANCE MEASURE
Children succeeding in school, Safe communities, Clean environment
Rate of high school graduation, Crime rate, Air quality index
1. How much did we do? 1. How much did we do? 2. How well did we do it? 2. How well did we do it? 3. Is anyone better off? 3. Is anyone better off?
A condition of well-being for children, adults, families or communities.
A measure which helps quantify the achievement of a result.
A measure of how well a program, agency or service system is working.
PO
PU
LA
TIO
N
PO
PU
LA
TIO
N
AC
CO
UN
TA
BIL
ITY
AC
CO
UN
TA
BIL
ITY
PE
RF
OR
MA
NC
E
PE
RF
OR
MA
NC
E
AC
CO
UN
TA
BIL
ITY
AC
CO
UN
TA
BIL
ITY
Three types:Three types:
Language Discipline[ ]
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 18
Why Distinguish Population from Performance Accountability?
ENDS
MEANS
RESULT&
INDICATORS
A STRATEGY
& PERFORMANCE MEASURES
Customer resultService delivery
A question
of
versus
Ends
Means
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 19
Interagency System
Program A
Comprehensive Strategy/Partners
Agency/ProgramPerformance Measures
Interagency Service System Performance Measures
EN
DM
EA
NS
Indicator
Children Live in Safe And Stable Homes
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
1. Doing the right things?
1. Doing the right things?
2. Doing those things right?2. Doing those things right?
Population Accountability
FPSI/RLG 20MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 21
Population
+ Geographic Area
+ Condition of Well Being
= Result
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Populations?
• All people in Sydney
• All Australians
• All children prenatal to 5 years old
• People with developmental disabilities
• People that enjoy water sports
FPSI/RLG 22MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Geographic Area?
• Australia• New South Wales• Sydney• Glebe
FPSI/RLG 23MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Conditions of Well Being?
• Healthy• Safe • Living with Dignity• Economically Secure • Succeeding in School
FPSI/RLG 24MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 25
Selecting Indicators
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 26
Criteria for
Selecting IndicatorsCommunication Power
Proxy Power
Data Power
Does the indicator communicate to a broad range of audiences?
Does the indicator say something of central importance about the result?Does the indicator bring along the data HERD?
Quality data available on a timely basis.
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 27
Choosing IndicatorsWorksheet
Result_______________________
Candidate IndicatorsCommunication
PowerProxyPower
DataPower
H M LMeasure 1
Measure 2
Measure 3
Measure 4
Measure 5
Measure 6
Measure 7
Measure 8
HDataDevelopmentAgenda
H M L H M L
H L
H H H
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Performance Accountability
FPSI/RLG 28MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Selecting Performance
Measures
FPSI/RLG 29MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 30
How much did we do?
The Three Kinds of Program Performance Measures
How welldid we do
it?
Is anyonebetter off?
Quantity Quality
Eff
ect
E
ffo
rt
# %
RBA Guide
Page 7
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 31
Selecting Headline Performance Measures
How much did we do? # Clients/customers served
# Activities (by type of activity)
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 32
Selecting Headline Performance Measures
How much did we do?How well did we do it?
% Common measurese.g. workload ratio, staff turnover rate, % staff fully trained, unit cost
% Activity-specific measurese.g. % timely intakes, % accreditation standards met
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
RLG 33
Selecting Headline Performance MeasuresHow well did we do it?
Is anyone better off?
#/% Skills / Knowledge(e.g. cognitive, social, physical)
#/% Attitude(e.g. toward language, parenting)
#/% Behavior(e.g. reading to child at home)
#/% Circumstances (e.g. child care, transportation)
How much did we do?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 34
How much did we do?
Health Plan or Practice
How well did we do it?
Is anyone better off?
Number ofpatientstreated
Percent ofpatients treated
in less than1 hour
Quantity Quality
E
ffec
t
Eff
ort
#children
fullyimmunized
%children
fullyimmunized
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 35
How much did we do?
Education
How well did we do it?
Is anyone better off?
Quantity QualityE
ffec
t
Eff
ort
Number ofstudents
Student-teacherratio
Number ofhigh schoolgraduates
Percent ofhigh schoolgraduates
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 36
How much did we do?
Fire Department
How well did we do it?
Is anyone better off?
Number ofresponses
ResponseTime
Number of firerelated deaths
(in catchment)
Rate offire deathsper 100,000
Quantity QualityE
ffec
t
Eff
ort
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 37
How much did we do?
Not All Performance Measures Are Created Equal
How well did we do it?
Is anyone better off?
LeastImportant
Quantity QualityE
ffec
t
Eff
ort 2nd Most
Important
3rd MostImportant
MostImportant
Least
Most
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
How much did we do?
The Matter of Control
How well did we do it?
Is anyone better off?
Quantity Quality
Eff
ect
Eff
ort
LeastControl
PARTNERSHIPS
MostControl
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Turn the Curve Thinking™
FPSI/RLG 39MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 40
Story behind the baseline
Partners (with a role to play in turning the curve)
What Works
Strategy (w/ Budget)
Result or Program:
DataBaseline
How are we doing?
Why?
Help?
Options?
Propose to do?
Turn-the-Curve Thinking™: Talk to Action
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 41
Result or Program:____________Turn-the-Curve Thinking™ Talk to Action
Data Baseline
How are we doing?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 42
The Matter of Baselines
Baselines have two parts: history and forecast
History ForecastTurning the Curve
OK?
Return* onInvestment
* The “ROI” is not financial, it is Results
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 43
Data Baseline
Result or Program:_____________Turn-the-Curve Thinking™: Talk to Action
Story behind the baseline Research Agenda Why?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 44
Force Field Analysis
Factors Contributing?
Factors Restricting?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 45
The Story Behind the Baseline Root Causes (ask “Why?” five
times)
Positive and negative
Prioritize – which are the most important to address to “turn the curve” of the baseline?
Research agenda?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 46
DataBaseline
Story behind the baseline
Result or Program:_____________
Research Agenda
Turn-the-Curve Thinking™ Talk to Action
Partners (with a role to play in turning the curve)Help?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 47
Partners Who are partners who may have
a role to play in turning the curve?
Does the story behind the curve suggest any new partners?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 48
Data Baseline
Story behind the baseline
Partners (with a role to play in turning the curve)
Result or Program:______________
Research Agenda
Turn-the-Curve Thinking™: Talk to Action
What Works Research AgendaOptions?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 49
What Works Options for actions to “turn the
curve”?
Research-based?
Low-cost/no-cost?
Off-the-wall ideas?
Research agenda?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 50
Data Baseline
Story behind the baseline
Partners (with a role to play in turning the curve)
What Works
Result or Program: _______________
Research Agenda
Research Agenda
Turn-the-Curve Thinking™: Talk to Action
Criteria: Leverage; Feasible; Specific; Values
StrategyPropose to do?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 51
Action Plan Leverage: will turn the curve of the
baseline?
Feasible (a.k.a. “reach”)?
Specific: who, what, when, where, how?
Consistent with values?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Population and
Performance Accountability
FPSI/RLG 52MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Results and Indicators
Result: to which you contribute to most directly.
Indicators:
Story:
Partners:
What would it take?:
Your Role: as part of a larger strategy.
Population Accountability
Program:
Performance measures:
Story:
Partners:
Action plan to get better:
Performance Accountability
Service Systems, Agencies, Divisions, Programs andPerformance Measures
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 54
State, Region, City,
Neighborhood …
E.g., InteragencyCollaboration
Agency
Population
Accountability
Performance
Accountability
Performance
Accountability
Organizationwith
“System” with
Community with a
its clients
its clients
whole population
Population and Performance Accountability: Agency
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
A Schematic for Results-Based Budgeting and Grant Making
RLG/FPSI 55
1.Community Result
2.Indicators
3.Story Behind the Baselines
4.Strategy Programs Program A Program B Program C
Local __________ Federal __________ Businesses _________ Civic __________ Non-profits _________
Program A
Performance Measures
Story Behind the Baselines
• Action Plan & Budget
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Management, Budgeting & Strategic Planning
Management
Monthly or quarterly performance
assessment and action planning using the framework./steps.
Use framework / steps at all levels of
implementation in the agency.
RLG/FPSI 56
Budgeting
Use the Performance Report format for
budget hearings and budget submissions to
present current performance and what
will be done next year to improve.
Budget priorities informed by the Strategic Plan
Strategic Planning
Population Level Results & Indicators, comprehensive
strategy among and all stakeholders
Agency Level
Each department’s role in comprehensive strategy.
Agency’s multi-year priorities.
Population Accountability
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Management, Budgeting & Strategic Planning
ManagementMonthly or quarterly
performance assessment and
action planning using the
framework./steps.
Use framework / steps at all levels of
implementation in the agency.
RLG/FPSI 57
BudgetingUse the Performance
Report format for budget hearings and
budget submissions to present current
performance and what will be done next year to
improve.
Budget priorities informed by the Strategic Plan
Strategic Planning
Population Level Results & Indicators, comprehensive
strategy among all stakeholders
Agency Level
Agency’s role in comprehensive strategy.
Agency’s multi-year priorities.
Pro
gram
Acc
ount
abili
ty
Program
Accountability
Program
Accountability
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
FPSI/RLG 58
Agency/Division/ProgramAGENDA
1. New data
2. New story behind the curve
3. New partners
4. New information on what works.
5. Changes to action plan/ budget
6. Adjourn
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
When RBA?
Now!