Program Planning for Impact

Program Planning for Impact

Fatima Perkins, MSLIS,MNOIOLUG Spring Program

Indiana Wesleyan University North, IndianapolisFriday, May 16, 2014

Welcome and Introductions

Introduce yourself and briefly state what was your favorite library program and why?

What would you like to learn within the next hour?Today – we will consider elements of program planning and evaluation.

What is your program portfolio?

• Music• History • Exercise• Writing• GED/ESOL

What is a program/service?

• A program is a planned event with goals/objectives and an expected audience.

• A service is an on-going planned event with goals/objectives and an expected audience.

• Program vs service – used interchangeably

What drives you to creating/Guiding Factors?

• Library’s Strategic Plan• Community Assessment• Customer surveys• Demographics/Census Bureau• Other community stakeholders• Grants/donations

Factors to Consider

• Program Significance• Budget • Staffing/Partnerships and collaborations• Program Design• Implementation• Evaluation

How do you know your program has impact?

What should you use to determine impact?

• Feedback ( customer, speakers, staff)• Surveys• Complaints• Participation/Attendance• Formal evaluation ( outcome based

evaluation)

Why is evaluation important?

• Determines goals/objectives have been achieved

• Shows intended outcomes have been achieved/program makes a difference

• Identifies weaknesses• Demonstrates library engagement/impact• Keeps stakeholders focused/Satisfy funders• Accountability

Outcome Based Evaluation

. An approach to determine whether goals/outcomes have been achieved.

What are outcomes?

Outcomes are results that benefit people due to a change in skills, knowledge, attitude, behavior, condition, or life status.

Process vs Impact

Process evaluation looks at how efficient a program/service is.

WhereasImpact evaluation looks at whether a program has made a difference.

What is a logic model?

A depiction of a program showing what the program will do and what it is to accomplish.

( University of Wisconsin – Extension, Cooperative Extension, Program Development and Evaluation, 2014)

Primary tool for OBE: Logic Model

• Inputs• Activities• Outputs• Outcomes– Initial– Intermediate– Long-term

What are inputs?

Inputs are resources needed to have a achieve the outcome. – Staffing– Equipment– Facility– Funding– Consultant

What are Activities?

• Activities are tasks that need to occur in order to achieve the outcome. Shows what the program does.

• Scheduling• Coordination• Marketing• Purchasing• Recruiting• Meetings

What are outputs?

• Outputs are the products of the activities. Generally framed in numbers/percentages.– #/%Participants served– #/%Interviews held– #/%Website hits– #/%Programs held– #/%Volunteers recruited– #/%Items circulated

What are outcomes?

Outcomes are results that benefit people due to a change in skills, knowledge, attitude, behavior, condition, or life status.

Criteria for developing an outcome

• Customer focused/singular• Measures change• Objective• Specific• Identifies who• Describes customer change that can be

related to the program/service

Types of Outcomes(OBE: Outcomes-Based Evaluation-RUSA, Midwinter 2014)

Outcomes versus OutputsIllustrating the difference – Participant exercise

Outputs

7 workshops1 million items circulated75 participants100 backpacks distributed283 career sessions15 volunteers recruited

Outcomes• Participants know basic

English• Customers improve access

to quality materials• Students are aware of

community resources• Volunteers learn story-time

standards

Categories for Outcomes

• Immediate/Initial/Short-term• Intermediate• Long-term/Permanent

Logic Model Exercise

• Ready Set Go…• Complete the logic model with your group-

three items for each category.• Reconvene• What did you come up with

Library ABC-Reading is Fundamental

The library has joined community stakeholders to improve the community’s poor reading scores. They have a year long program for K-3rd grade students – Reading is Fundamental. The library has received a $100,000 grant for the program. The program must include volunteers, workshops, study sessions, creative programming, parent engagement, three community partners etc.

Completed Logic Model

• Included in packet

Moving Forward

• Choose the outcomes to measure• Select indicators• Collect data• Analyze the data• Create a report• Report findings to stakeholders

Resources

• http://www.imls.gov/applicants/obe.shtm• http://www.liveunited.org/outcomes/resources/

MPO/ecerpts.cfm• http://www.wkkf.org/Pubs/Tools/Evaluation/Pub

3669.pdf• Workbook: Outcome Measurement of Library

Programs(September 2000, Division of Library and Information Services, Florida Department of State)

• OBE: Outcomes-Based Evaluation ( RUSA, Midwinter 2014)

Thank you for participating in Program Planning for Impact

Fatima Perkins, MSLIS,MNO