Outputs, Outcomes, and Logic Models Community Training Institute 2013 Ashley Brundage, Senior Director of Community Impact Grants United Way of Metropolitan Dallas
Dec 07, 2014
Outputs, Outcomes, and Logic Models
Community Training Institute 2013
Ashley Brundage, Senior Director of Community Impact Grants
United Way of Metropolitan Dallas
Topics and Objectives
Why Use Outcomes?• Learn value of outcome measurement
Logic Models• Clearly explain how to construct the logic model
Outputs• Clearly explain outputs
Outcomes• Provide an in-depth discussion on developing
outcomes
2
Why Use Outcomes?
3
4
The importance of Evaluation and Outcome based programing
The measurement
of Results
Analysis & Learning
Action & Improvement
Accountability
Benefits of Outcome Measurement
• Increased accountability to donors and the community
• Enhance marketing and fundraising messages
• An improved image and greater visibility in the community
• Greater success in retaining, maintaining and/or increasing dollars
5
“The American public has extended you the right to avoid taxation in exchange for your commitment to create real social value. You owe it to the public to make a real effort to track your performance and report to them on how you are doing in your work.”
from Enterprising Nonprofits
Questions that Outcomes Answer
• Did the program achieve is intended goals/impact/etc.?
• How does the program contribute to the agency’s strategic goals?
• Is this program worth the cost?
• Did the program reach the target population?
• How can implementation be improved?
• Is this program still relevant or viable?
• Is what was promised being achieved?
• Is the program working?
• What is the program accomplishing?
• How does this program compare to others?
• Did we reasonably accomplish what we committed to do?
• How have participants changed as a result of our program?
6
Logic Models
Logic Models: Purpose
What is a Logic Model?• If Then• Visual representation of the program’s intent
Why are Logic Models necessary?• Help to assess the program’s effectiveness.• Illustrate the client’s progress through the
program• Developing a realistic picture of what the
program can expect to accomplish• Helps tell your story and the difference you’re
making
8
Logic Models: Resources & Activities
9
Resources• Identify all inputs that
make the activities possible.
• List all the “what” and “who” that is necessary to delivering the activities.
• People, materials, meeting space, etc.
Activities• What will participants be
doing?• Prioritize, what activities
will help to achieve the outcomes?
Resources & Activities Example
Resources• Staff
• Curriculum
• Funding
• Awareness handouts
• Conference room
• Projector
Activities• Child abuse
awareness presentations
• Distribution of awareness handouts
10
ACTIVITY BREAK
11
Activity Break: Resources and Activities
Think about a program at your agency to evaluate.
• Needs to have a clear target population.
• Needs to have a clear method of providing services.
• Focus on one for the purposes of this training today.
Fill in the Resources and Activities of your program.
Work in pairs to help each other.
What did you find difficult about this part? Easy?
12
Outputs
13
Logic Model Component: Outputs
Primary Activities
Outputs
What do clients do?
What is produced?
14
Outputs Example
Outputs:
• Educators will teach 200 people about the signs of child abuse.
• Educators will give 10 hour long presentations.
• Outreach staff will distribute 1,000 child abuse awareness handouts.
15
Activity Break: Develop Outputs
With your partner,
Discuss your program’s activities
Develop your outputs
Fill in the output column of your logic model
Share with the group one output from each of your programs
What did you find difficult about this part? Easy?
16
Outcomes
18
What is outcomes based planning and evaluation?
“Not how many worms the bird feeds its young, but how well the fledgling flies”
United Way of America, 2002
Logic Model Component: Outcomes
• What is an Outcome?
• Outcomes are the benefits/client change for participants during or after their involvement with a program.
• Outcomes may relate to a change in knowledge, skills, attitudes, values, behavior, condition, or status.
• Satisfaction is not an outcome.
Example:
Educators increase the audience’s awareness about signs of child abuse.
19
Indicators
• What is an Indicator?
• Indicators are specific observable, measurable characteristics or changes that represent achievement of the overall impact.
• Specific statistics calculated to summarize the program’s level of achievement.
Example:
Percent of target audience that remembers key points of lecture.
20
Building an Outcome
21
What your clients do
How you want your clients to change
Indicator of Change
Outcome Statement
Outputs Outcome Indicator
Building an Outcome
22
Attend presen-tations
Increased Awarenes
s
Increased Pre/Post
Test scores
Audience will have increased
awareness of child abuse as
measured by an increased score from their pre to post test taken before and after the presentation.Outputs Outcome Indicator
Activity Break: Outcome Statements
• Look at your activities and outputs you have for your program so far.
• What outcomes do you want to see?
• What indicators will determine those outcomes?
• Develop at least one Outcome Statement for your program and share with the group.
23
Outcomes: SMART
S• Specific
M• Measurable
A• Action-Oriented
R• Realistic
T• Timed
24
Outcomes: The SMART Format
X% (number) of clients will improve by X% or achieve X
in a specific time frame.
25
Outcomes: Example
80% (160) of 200 clients will increase their post test score by 20% above their pre test score after attending one child abuse
awareness presentation.
26
Activity Break: Outputs vs Outcomes
Check under seat
Read out loud
Is yours an Output
or an Outcome?
27
Activity Break: SMART Outcomes
28
• Using the Outcomes statement developed earlier
• Add SMART Criteria
• Fill in the Outcomes column on Logic Model
• Report to Group Examples
Logic Model Components: Impact
Impacts are organizational, community, and/or system level changes expected to result from program activities, which might include improved conditions, increased capacity, and/or changes in the policy arena.
Ex: Improved health and well being in North Texas.
29
Activity Break:
Add your impact statement to your logic model.
Share examples with the group.
30
Logic Models: Tips
31
“I think you should be more explicit here in Step Two.”
A common problem is that activities and strategies often do not lead to the desired outcomes.
Check your ‘if-then’ statements and ensure that they make sense and lead to the outcomes you want to achieve.
A logic model makes the connections EXPLICIT.
Activity Break: Logic Model Exercise
• Individually circle what you think needs adjustment
• Share with the group what you identified as problem areas and why
Using the logic model example provided
32
Questions?
Thank You!