Ppt co is field test - sirocco messerli

Funded by: Implemented by:

Common Outcome Indicators – a field test Practical application of the new SDC tool on result measurement in VSD

Siroco Messerli Team Leader Employment Fund Secretariat e & i f2f workshop, Thun May 12, 2013

FUNDED BY IMPLEMENTED BY

Assessment of systemic

change

How does Employment Fund measure result?

Tracer and impact study

Result-based

payment to

T&Es for

outputs and

outcome

Monitoring of

training & job

placement by T&E

Verification of

employment and

income by Fund

Secretariat

Mandate contract

with result

agreement

Competitive procurement

FUNDED BY IMPLEMENTED BY

Why are COI needed in a Programme?

DO YOU KNOW… …how many percent of the participants are gainfully employed?

… whether the participants’ earnings are above the minimum income level? … how long it takes a participant to generate income of the size invested into his empowerment?

… whether your programme fosters collaboration with the private sector and actual job placement?

…whether your contributions to qualification frameworks, standards and curricula are significant?

…to what extent your programme contributes to systemic change in terms of legal frameworks and central TVET institutions? …whether the participants are using the acquired competence, skills and knowledge at the workplace?

…what the employers think about the participants performance?

…whether the training and employment promotion measures are relevant for improving the employability of the participants?

…to how many trainers and counsellors your programme reaches out?

… what is the scale of your programme with regards to the total number of potential participants?

…what is the outcome of your programme in terms of replication & upscaling in national systems

FUNDED BY IMPLEMENTED BY

What time & efforts are needed?

 Largely determined by quality of existing M&E system of the Programme  Reasonable time investment, in case of EF:

 30 minutes to read and understand the working guide  ½ day for discussions with COOF & Ministries (referencing & assessing

systemic change)  1 work day for filling the spread sheet  1 work day for generating/ analysing additional data

 Aim for integration into regular M&E system

FUNDED BY IMPLEMENTED BY

Who are the end-users?

Programme implementer

Government authorities

SDC

Critically review results achievement

Communicate goals properly

Think holistically

Strengthen M&E system

Prove resp. assess competence

Compare results over

time & among

programmes

Report outcome of VSD interventions internally

Report to parliament & taxpayers

Foster alignment & harmonisation

Outcome orientation

Use data for project steering

Draw lessons learnt for policies and own programmes

FUNDED BY IMPLEMENTED BY

Where does the tool need improvements?

Well elaborated & applicable to large range of different programmes, but tool should:  Show the change (within & between the COI > include year-wise and accumulated

data)  Measurement period needs to be defined (year, phase, programme, sector

involvement)  How to stimulate national Government authorities to contribute to assessment?  Referencing (to assess scale & systemic change) is a lot of guesswork and based on

usually imperfect national data sources  Challenging to measure scale at outcome level  Scale: measure also the outreach of institutions  How to defined sustained employment?  How to measure in-kind income?  SDC’s ‘share’ of outcome in multiple donor programmes?  Communication of low scale percentages

(EF: < 1% of target group!) to wider stakeholders?  Value for money (e.g. per capita cost; cost-benefit analysis):

Do we need a fifth COI?

Join us thisThursday in the COI working

group

FUNDED BY IMPLEMENTED BY

Thank you for your attention!