L’avaluació participativa: Tapping the power of youth One day conference on youth empowerment University of Barcelona May 16, 2017 Brad Cousins COVE Research Team Brad Cousins, University of Ottawa Lyn Shulha, Queen’s University Bessa Whitmore, Carleton University Nathalie Gilbert, University of Ottawa Hind Al Hudib, University of Ottawa Contact: [email protected]
44
Embed
L’avaluacióparticipativa: Tapping the power of youth One ... · L’avaluacióparticipativa: Tapping the power of youth One day conference on youth empowerment University of Barcelona
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
L’avaluació participativa: Tapping the power of youth
One day conference on youth empowerment
University of Barcelona
May 16, 2017
Brad Cousins
COVE Research Team Brad Cousins, University of Ottawa
• Background on Collaborative Approaches to Evaluation (CAE)
• Youth Participatory Evaluation (YPE)
• Principles for CAE
• Moving the principles forward
– Practical use and application
– Ongoing inquiry
Background on Collaborative Approaches to Evaluation
Terms
• Evaluation: Systematic inquiry to judgethe merit, worth or significance of a [program]; provide evidence for decision making.
• Collaborative approach to evaluation (CAE): evaluation where trained evaluators work in partnership with members of the program community to produce evaluative knowledge.
Members of the CAE Family• Collaborative evaluation
Principle: Monitor and Respond to Resource Availability
Time
“The program manager was able to
devote 25% of paid work time towards
the evaluation . . . . It was not
something extra.”
MONITOR AND
RESPOND TO
RESOURCE
AVAILABILITY
Principle: Monitor Evaluation Progress and Quality
Evaluation
Design “ Due to lack of experience on my
part as a young evaluator I did not
engage the client in troubleshooting
problems as they arose as much as I
should have and they spiralled out of
control, resulting in inconsistent data
collection across sites, and problems
with the quality of the data collected.”
MONITOR
EVALUATION
PROGRESS AND
QUALITY
Principle: Promote Evaluative Thinking
Inquiry
Orientation
The organization was committed to
the evaluation and very open about its
strengths and weaknesses in doing the
work.”
PROMOTE
EVALUATIVE
THINKING
Principle: Optimize The Influence of Evaluation
Practical
Outcomes“There was a great deal of process
learning: stakeholders were given a
chance to reflect on their program by
being involved in creating the logic
model and identifying evaluation
questions. They said often that this
was just as, or even more helpful than
the final report summarizing
findings.”
FOLLOW
THROUGH TO
REALIZE USE
Moving the CAE Principles Forward
Use and Application
– Retrospective analysis and critique
– Prospective planning, framing, doing
– Education/training design & delivery
– Evaluation policy review
– Cross cultural translation/use
– Framework for research on evaluation
– Other?? (e.g., conference synthesis)
Practical Resources
• Brochure document
• Indicators document
Ongoing Inquiry
• In what ways can/do the principles support evaluation practice?
• To what extent can these principles help to plan, or offer guidance throughout the process?
• To what extent can these principles informstakeholders or educate non-evaluators?
• To what extent are they responsive to contextual complexities?
• Do the principles align with existing approaches of evaluation? Do some principles more than others complement these models?
• Are the principles useful to novice evaluators? Or are they best reserved for evaluators with experience?
• Do the principles resonate in cross cultural contexts?
Ongoing Inquiry
Toward compendia of field studies
• You are invited!
• Criteria: – Field trial must implicate program community
partners working with evaluators in evaluation knowledge production
– Field trial by definition implicates systematic inquiry and evidence generation
COVE PublicationsCousins, J. B., Whitmore, E., & Shulha, L. M. (2013). Arguments for a
common set of principles for collaborative inquiry in evaluation. American Journal of Evaluation, 34(1), 7-22.
Cousins, J. B., Whitmore, E., & Shulha, L. M. (2014). Let there be light: Response to Fetterman et al. 2014. American Journal of Evaluation, 35(1), 149-153.
Shulha, L. M., Whitmore, E., Cousins, J. B., Gilbert, N., & Al Hudib, H. (2016). Introducing evidence-based principles to guide collaborative approaches to evaluation: Results of an empirical process. American Journal of Evaluation, 37(2), 193-215.
Cousins, J. B., Shulha, L. M., Whitmore, E., Gilbert, N., & Al Hudib, H. (2016). How do evaluators differentiate successful from less-than-successful experiences with collaborative approaches to evaluation? Evaluation Review, 40(1), 3-28.
Whitmore, E., Cousins, J. B., Al Hudib, H., Shulha, L. M., & Gilbert, N. (2016). Reflections on the meanings of success in collaborative approaches to evaluation: Results of an empirical study. Canadian Journal of Program Evaluation.1(3), 328-349
Cousins, J. B., Al Hudib, H., Whitmore, E., Shulha, L. M., & Gilbert, N. (forthcoming). Whose at the wheel? Implications of evaluator versus stakeholder control in collaborative approaches to evaluation. . Paper presented at the American Evaluation Association, Atlanta. Oct 2016.