Knowledge without boundaries. Outcome evaluation of PLIP projects: what, why and how? Ugne Lipeikaite PLIP Impact Manager .

Knowledge without

boundaries

Outcome evaluation of PLIP projects: what, why and how?

Ugne LipeikaitePLIP Impact Manager

www.eifl.net

What is outcome evaluation?

• Outcomes are changeschanges in attitude, behavior, skills, knowledge or situation of target audience brought be a project

• Library outcome - the eventual resultresult of using library services, the influence the use had, and its significance to the user

• Outcome evaluation - if a program says it will change the lives of a certain population

group, how does it proveprove it actually did?

Project

Vehicle to get to the destination

Outcomes

Intended destinations

Monitoring

Whether we are on the right road

Outcome evaluation

Whether we have arrived at out destination

Why doing this?• Evaluation is the gathering of meaningful

data that that informsinforms, improvesimproves,

or confirmsconfirms. It is a tool for :

• Management decisions

• Accountability for your

resources

• Library advocacy

What to measure?

Inputs - Inputs - something something

that is put in that is put in to achieve to achieve

resultresult

e.g. number of staff,

computers

Inputs - Inputs - something something

that is put in that is put in to achieve to achieve

resultresult

e.g. number of staff,

computers

Activities –Activities –number of number of

tasks which tasks which must be must be

completed completed to achieve to achieve

resultresulte.g. training,

events, services installed

Activities –Activities –number of number of

tasks which tasks which must be must be

completed completed to achieve to achieve

resultresulte.g. training,

events, services installed

Outputs - Outputs - immediate immediate countable countable result of a result of a activitiesactivities

e.g. number of sessions

organized, number of

people trained

Outputs - Outputs - immediate immediate countable countable result of a result of a activitiesactivities

e.g. number of sessions

organized, number of

people trained

Outcomes – Outcomes – benefits and benefits and or changes or changes resulting resulting

from from performance performance of the activityof the activitye.g. increased

income, improved

employment prospects

Outcomes – Outcomes – benefits and benefits and or changes or changes resulting resulting

from from performance performance of the activityof the activitye.g. increased

income, improved

employment prospects

OUTCOME MAPOUTCOME MAP

Example - Macedonia

InputsInputs13 laptops, 13 laptops, printer,printer,43 books on 43 books on of job searchof job search

InputsInputs13 laptops, 13 laptops, printer,printer,43 books on 43 books on of job searchof job search

Activities – Activities – basic basic computer computer skills andskills andinteractive interactive trainings trainings “How to find “How to find a job”a job”

Activities – Activities – basic basic computer computer skills andskills andinteractive interactive trainings trainings “How to find “How to find a job”a job”

Outputs – Outputs – 82 82

unemployed unemployed people people trainedtrained

Outputs – Outputs – 82 82

unemployed unemployed people people trainedtrained

Outcomes – Outcomes – Out of 82 Out of 82 trained trained

people 39 people 39 (47,56%) (47,56%)

have have successfullsuccessfully found jobs y found jobs

Outcomes – Outcomes – Out of 82 Out of 82 trained trained

people 39 people 39 (47,56%) (47,56%)

have have successfullsuccessfully found jobs y found jobs

How to measure?

• PredefinedPredefined outcomesoutcomes – what PLIP is aiming to achieve together with you?

• Individualized indicators Individualized indicators - what will tell you that change is occurring/has occurred, and capture trends over time?

• Agreed data collection plan Agreed data collection plan and tools

Sources of data• Library statistics

• Surveys

• Interviews and focus

groups

• Analysis of documents (reports, minutes of meetings, policy documents…)

• Case studies (groups and/or individuals)

Thank [email protected]