Top Banner
Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org TM "TURNING THE CURVE"
47

Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Dec 22, 2015

Download

Documents

Vivian Owen
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Outcomes BasedAccountability

The Fiscal Policy Studies Institute

Websitesraguide.org

resultsaccountability.com

Book - DVD Ordersamazon.com

resultsleadership.org

TM

"TURNING THE CURVE"

Page 2: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

SIMPLE

COMMON SENSE

PLAIN LANGUAGE

MINIMUM PAPER

USEFUL

Page 3: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Outcomes-Based Accountabilityis made up of two parts:

Performance Accountabilityabout the well-being of

CUSTOMER POPULATIONSFor Services – Agencies – and Service Systems

Population Accountabilityabout the well-being of

WHOLE POPULATIONSFor Communities – Cities – Counties – States - Nations

Page 4: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Outcome-Based Accountability

COMMON LANGUAGE

COMMON SENSE

COMMON GROUND

Page 5: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

THE LANGUAGE TRAPToo many terms. Too few definitions. Too little discipline

Benchmark

Target

Indicator Goal

Result

Objective

Outcome

Measure

Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic

Lewis Carroll Center for Language DisordersMeasurable urgent systemic indicatorsCore qualitative strategic objectivesYour made up jargon here

Page 6: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

DEFINITIONS

Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy

Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate

1. How much did we do? 2. How well did we do it? 3. Is anyone better off?

OUTCOME or RESULT

INDICATOR or BENCHMARK

PERFORMANCE MEASURE

A condition of well-being for children, adults, families or communities.

A measure which helps quantify the achievement of an outcome.

A measure of how well a program, agency or service system is working. Three types:

Popu

latio

nPe

rform

ance

Children born healthy

Rate of low-birthweight babies Percent ready at K entry

Children ready for school

crime rate

Safe communities

air quality index

Clean Environment

unemployment rate

Prosperous Economy

INDICATOR

OUTCOME

PERFORMANCE MEASURE

Popu

latio

nPe

rform

ance

= Customer Outcome

1.

2.

3.

Page 7: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

From Ends to Means

ENDS

MEANS

From Talk to ActionPo

pula

tion

Perf

orm

ance

OUTCOME

INDICATOR

PERFORMANCEMEASURE

Customer outcome = EndsService delivery = Means

From Talk to Action

Page 8: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

POPULATIONACCOUNTABILITY

Fiscal Policy Studies InstituteSanta Fe, New Mexicowww.resultsaccountability.comwww.raguide.org

For Whole Populationsin a Geographic Area

Page 9: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Community Outcomesfor Christchurch, NZ

1. A Safe City

2. A City of Inclusive and Diverse Communities

3. A City of People who Value and Protect the Natural Environment

4. A Well-Governed City

5. A Prosperous City

6. A Healthy City

7. A City for Recreation, Fun and Creativity

8. City of Lifelong Learning

9. An Attractive and Well-Designed City

Page 10: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Every Child Matters – Children Act

Outcomes for Children and Young People

Being Healthy: enjoying good physical and mental health and living a healthy lifestyle.

Staying Safe: being protected from harm and neglect and growing up able to look after themselves.

Enjoying and Achieving: getting the most out of life and developing broad skills for adulthood.

Making a Positive Contribution: to the community and to society and not engaging in anti-social or offending behaviour.

Economic Well-being: overcoming socio-economic disadvantages to achieve their full potential in life.

Page 11: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

City of London Ontario, CanadaPriority Results

● A Strong Economy

● A Vibrant Diverse Community

● A Green and Growing City

● A Reliable Infrastructure

● A Safe City

Source: Draft Strategic Plan Sept 2011

Page 12: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

New Zealand

Coventry, UKSanta Cruz, CA

Halton Ontario

Page 13: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 14: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 15: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Leaking Roof(Outcomes thinking in everyday life)

Experience

Measure

Story behind the baseline (causes)

Partners

What Works

Action Plan

Inches of WaterBASELINE

? Fixed

Not OK

Turning the Curve

Action Plan #2

Page 16: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Baseline & Story

Outcomes

Indicators

Page 17: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Rebound

Page 18: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

6.00%

8.00%

10.00%

12.00%

14.00%

16.00%

18.00%

20.00%

Ncle 14.5 14.5 16.8 14.5 17 15 11.9 10.6 9.5 9.3

1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Source: Connexions Tyne and Wear, UK

Newcastle, UK

Revised 9 Nov 2007

Nov 08 – Jan 09

8.5

Page 19: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 20: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

no. of Tagged Sites visited

02000400060008000

1000012000140001600018000

2001

/02

2002

/03

2003

/04

2004

/05

2005

/06

2006

/07

2007

/08

2008

/09

2009

/10

year

no

. of

site

s

2001/02

2002/03

2003/04

2004/05

2005/06

2006/07

2007/08

2008/09

2009/10

Christchurch, New ZealandNumber of Graffiti Sites

FY 2002 to FY 2010

Page 21: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Hull, UK"Woundings"

Page 22: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Performance Accountability

For Services, Agencies and Service Systems

Fiscal Policy Studies InstituteSanta Fe, New Mexicowww.resultsaccountability.comwww.raguide.org

Page 23: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

“All Performance Measures

that have ever existed

for any service

in the history of the universe

involve answering two sets of

interlocking questions.”

Page 24: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

HowMuchdid we do?

( # )

HowWell

did we do it?

( % )

Quantity Quality

Service Performance Measures

Page 25: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

EffortHow hard did we try?

EffectIs anyone better off?

Service Performance Measures

Page 26: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Effort

Effect

HowMuch

HowWell

Service Performance Measures

Page 27: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much service did we deliver?

Service Performance Measures

How welldid we

deliver it?

How much change / effect

did we produce?

What quality of change / effect

did we produce?

Quantity Quality

Effe

ct

Effo

rt

O

utpu

t

In

put

Page 28: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Service Performance Measures

How welldid we do it?

Is anyonebetter off?

Quantity Quality

Effe

ct

Effo

rt

# %

Page 29: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Education

How well did we do it?

Is anyone better off?

Quantity Quality

Effe

ct

E

ffort Number of

studentsStudent-teacher

ratio

Number of 16 olds with 5 A to C

GCSE’s

Number of fixedterm exclusions

Percent of 16 yr olds with 5 A to C

GCSE’s

Rate of fixedterm exclusions

Page 30: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Pediatric Practice

How well did we do it?

Is anyone better off?

Number ofpatientstreated

Percent ofpatients treated

in less than1 hour

Quantity Quality

Effe

ct

E

ffort

#children

fullyimmunized

(in the practice)

%children

fullyimmunized

(in the practice)

Page 31: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Drug/Alcohol Treatment Program

How well did we do it?

Is anyone better off?

Number ofpersonstreated

Percent ofstaff withtraining/

certification

Number of clientsoff of alcohol & drugs - at exit - 12 months after exit

Percent of clientsoff of alcohol & drugs - at exit - 12 months after exit

Quantity Quality

Effe

ct

E

ffort

Page 32: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Fire Department

How well did we do it?

Is anyone better off?

Number ofresponses

ResponseTime

Quantity Quality

Effe

ct

E

ffort

# of fireskept to

room of origin

% of fireskept to

room of origin

Page 33: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Not All Performance Measures Are Created Equal

How well did we do it?

Is anyone better off?

LeastImportant

Quantity Quality

Effe

ct

E

ffort

MostImportant

Least

Most

AlsoVery Important

Quality

Page 34: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

The Matter of Control

How well did we do it?

Is anyone better off?

Quantity Quality

Effe

ct

E

ffort

LeastControl

PARTNERSHIPS

MostControl

Page 35: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How much did we do?

Performance AccountabilityTypes of Measures found in each Quadrant

How well did we do it?

Is anyone better off?

# Clients/customers served

# Activities (by type of activity)

% Common measurese.g. client staff ratio, workload ratio, staffturnover rate, staff morale, % staff fully trained, % clients seen in their own language,worker safety, unit cost

% Skills / Knowledge (e.g. parenting skills)

#

% Attitude / Opinion (e.g. toward drugs)

#

% Behavior (e.g.school attendance)

#

% Circumstance (e.g. working, in stable housing)

#

% Activity-specific measures

e.g. % timely, % clients completing activity, % correct and complete, % meeting standard

Point in Timevs.

2 Point Comparison

# %

Page 36: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

LR

UR

Primary v. Secondary

Direct v. Indirect

Internal v. External

Baseline & Story

Page 37: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 38: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 39: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 40: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 41: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

How Population

&Performance Accountability

FIT TOGETHER

Page 42: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

Contributionrelationship

Alignmentof measures

Appropriateresponsibility

THE LINKAGE Between POPULATION and PERFORMANCE

POPULATION ACCOUNTABILITY

Healthy Births Rate of low birth-weight babiesStable Families Rate of child abuse and neglect Children Ready for School Percent fully ready per K-entry assessment

CUSTOMERRESULTS

# ofinvestigations

completed

% initiatedwithin 24 hrs

of report

# repeatAbuse/Neglect

% repeatAbuse/Neglect

PERFORMANCE ACCOUNTABILITY

POPULATIONRESULTS

Child Protective Services

Page 43: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off?

OBA in a Nutshell2 – 3 - 7

2 - kinds of accountability Population accountability Performance accountability

7 - questions from ends to means in less than an hour. Baselines and Turning the Curve

plus language discipline Outcomes & Indicators Performance measures

Page 44: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Page 45: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

“If you do what you always did,

you will get what you always got.”

Kenneth W. JenkinsPresident, Yonkers NY NAACP

Page 46: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.

------Book - DVD Orders------amazon.com

resultsleadership.org

THANK YOU !Websites

raguide.orgresultsaccountability.com

Page 47: Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.