© IMPACT CONSULTING 2009 MONITORING AND EVALUATING CSI PROJECTS: knowing and showing what we achieve Grant.net meeting, Santam offices 3 November 2011 Presented by: Jerushah Rangasami
Feb 16, 2016
© IMPACT CONSULTING 2009
MONITORING AND EVALUATING CSI PROJECTS: knowing and showing what we achieve
Grant.net meeting, Santam offices3 November 2011
Presented by: Jerushah Rangasami
© IMPACT CONSULTING 2009
Presentation outline
1. The context: M&E for CSI
2. Why evaluate?
3. Theory of change and theory of action
4. Different types of M&E
5. The Emthunzini Trust grantmaking model
6. Impact Consulting’s approach to supporting M&E for
grantees
© IMPACT CONSULTING 2009
The context
• Challenging economic climate and increasing community needs pressure on projects to show funders their outcomes and impact
• Corporate donors are more understanding of value of impactful projects and want to know what has changed in the world as a result of their funds
© IMPACT CONSULTING 2009
The context
• There is a move towards showing outcomes
• The majority of projects in SA:– Have minimal M&E in place– Unaware of / do not have a programme theory– Report activities and outputs only (donors often require only this)
• But projects can’t show their outcomes if they don’t know them.
© IMPACT CONSULTING 2009
Why evaluate?
Other intentions? • marketing/fundraising • decision-making (re-funding)
Source: Davies/Dart (2005): MSC guide, on http://www.mande.co.uk/docs/MSCGuide.pdfx
© IMPACT CONSULTING 2009
Case study: Infant mortality and nutrition
© IMPACT CONSULTING 2009
Impact evaluation vs other types of M&E
Evaluation Activities
Programme outcomes/
effects
Outcome Evaluation/Impact
Evaluation (Summative)
Conceptualisationand design of
programme
Clarificatory/theory evaluation
(also needs ax,feasibility study)
First version(s)of programmeimplemented
Processevaluation(Formative)
“Mature”version of
programmeimplemented
ProgrammeMonitoring(Formative/Summative)
Project Cycle
© IMPACT CONSULTING 2009
Theory of change and theory of action
Theory of change
Theory of action
Positive reinforcement
Negative reinforcement
Gold star on chart
Go out for ice-cream
Withhold pocket money
© IMPACT CONSULTING 2009
Theories of change/logic models--------------- Change theory -----------------
----------- Action theory ----------
© IMPACT CONSULTING 2009
The Emthunzini model
• Santam’s Emthunzini Trust is pioneering a new model to address the lack of knowing and showing outcomes
• They capacitate projects with M&E mentoring so that they can effectively report on their outcomes
• Impact Consulting provides the mentoring and builds learning through the process
© IMPACT CONSULTING 2009
The Emthunzini donor model
Aspects of the funding model:
• A genuine interest in and action towards building capacity for projects
Capacity building
• A focus on project outcomes – and creative and visual reporting
Outcomes reporting
• Both in reporting structure and activitiesFlexibility
• Including ‘buffer time’ in the cycle for project set up and systems developmentGrant cycle
© IMPACT CONSULTING 2009
Impact Consulting’s approach to mentoring for outcomes
• M&E facilitation and mentorship model with an emergent process, unique to each organisation
• Action learning approach with critical reflection as a tool
• Building outcomes thinking
© IMPACT CONSULTING 2009
M&E for outcomes model
Orientation workshop
Series of M&E
mentoring workshops
Report review
Field visit (tools and
visual outcomes)
Community of practice
Donor Funded project
• Establish culture of donor relationship
• Intro to M&E
• Intro to M&E• Meet donor, ask questions• Set expectations and timeframes• Interact with other projects
Strategy &
planning
Develop M&E
framework
Tools & reporting template
• Invited to attend workshops
• Kept informed on project progress
• Review drafts and provide comments
• Ensure preservation of project ownership
• Receive outcomes reports of a high std
• Admin burden absorbed by Impact
• Assist with identifying & capturing visual outcomes
• On the ground help with using tools and conducting M&E
• Visual reporting• Invited to visit the
projects on site
• Learn about grantees’ experiences with projects and M&E
• Communication with all projects
• Share learnings and best practices
• Identify synergies between projects
Continuous com
munication &
maxim
um
participationCritical steps
© IMPACT CONSULTING 2009
Successes and challenges of the model
Successes• Balancing the project’s needs against those of the donor• Maintaining project’s ownership of their work• Using participatory methods with projects
Challenges• Buy-in and participation from the
projects (initially see us as donor)• Slow process to outcomes thinking,
change management needed• Balancing Impact Consulting’s
demand for deliverables and nurturing M&E capacity building
© IMPACT CONSULTING 2009
Questions and
Feedback
Contact: Jerushah Rangasami082 776 [email protected]