WELCOME to the webinar “Cultural Responsiveness in Equity-focused Evaluations” 15 March 2012 This Live Webinar will start at 2:00 PM, New York time. All microphones & webcams are disabled and we will only enable microphones during the Q&A portion. Therefore, you will not hear any sound/noise till the beginning of the webinar.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
WELCOME to the webinar
“Cultural Responsiveness in
Equity-focused Evaluations” 15 March 2012
This Live Webinar will start at 2:00 PM, New York time.
All microphones & webcams are disabled and we will only enable microphones during
the Q&A portion.
Therefore, you will not hear any sound/noise till the beginning of the webinar.
Series of 17 live webinars on
“Equity-focused Evaluations” Interact live with 28 world-level evaluators
This series of webinars addresses the challenges and
opportunities in evaluating the effects of policies, programmes
and projects to enhance equitable development results, with a
special focus on the effects to the most excluded, marginalized
and deprived groups.
“Evaluation for Equitable Development Results”
will be available early 2012
Available in MyM&E
The book will be available at MyM&E Virtual Library
www.mymande.org
Colin KIRK
Penny HAWKINS
Evaluation to accelerate progress towards
equitable development
6 September 2011
9:30 AM NY time
Belen SANZ
Flaminia MINELLI
Human rights and Gender equality in evaluations
21 September 2011
9:30 AM NY time
Marco SEGONE
Michael BAMBERGER
How to design, implement and use equity-
oriented evaluations
4 October 2011
11:30 AM NY time
Saville KUSHNER
Case study evaluation as an intervention for
promoting equity
11 October 2011
9:30 AM NY time
Bob WILLIAMS
Martin REYNOLDS
Systems approach (CSH) to address ethical
issues
14 November 2011
3:00 PM NY time
Patricia ROGERS
Richard HUMMELBRUNNER
Program theories and LogFrames to evaluate
pro-poor and equity programs
22 November 2011
4:00 PM NY time
Michael Quinn PATTON
Developmental Evaluation
6 December 2011
11:30 AM NY time
Webinars on Equity-focused Evaluation 2011
Webinars on Equity-focused Evaluation 2012
Donna MERTENS
Methodological guidance in evaluation for Social
Justice
24 January 2012
9:30 AM NY time
Jennifer GREENE
Values-Engaged Evaluation
15 February 2012
1:00 PM NY time
Michael Quinn PATTON
How to evaluate interventions in complex
dynamic environments?
28 February 2012
11:30 AM NY time
Rodney HOPSON
Katrina BLEDSOE
Cultural Responsiveness in Applied Research
and Evaluation Settings
15 March 2012
2:00 PM NY time
Juha UITTO
Oscar A. GARCIA
Evaluating equity-focused public policies. The
case of Brazil and Mexico
27 March 2012
9:30 AM NY time
Katherine HAY
Sanjeev SRIDHARAN
A healthy discomfort? Development, equity and
evaluation
Ten Questions that Evaluations of Health Equity
Initiatives should answer
May 2012
Julian BARR
Robbie GREGOROWSKI
Evaluation of climate change interventions for
excluded populations
11 June 2012
1:00 PM NY time
Guy THIJS
Francisco GUZMAN
Evaluation of the ILO’s strategy to eliminate
discrimination in employment and occupation
19 June 2012
9:30 AM NY time
Sulley GARIBA
Evaluation of pro-poor urban interventions
28 June 2012
1:00 PM NY time
Webinars on Equity-focused Evaluation 2012
Interact with Questions and Answers
Type here
Keynote Speakers
Rodney HOPSON, Duquesne University, President of the
American Evaluation Association
Katrina BLEDSOE, Education Development Center,
Washington
Agenda 2:00 – 2:05 PM Welcome and introduction
Marco Segone, Systemic Management, UNICEF
Evaluation Office
2:05 – 2:20 PM Rodney Hopson, Duquesne University, President of the
American Evaluation Association
2:20 – 2:35 PM Katrina Bledsoe, Education Development Center, Washington
2:35 – 2:55 PM Questions and Answers
Moderator: Stewart Donaldson, Dean & Chair of
Psychology School of Behavioral & Organizational Sciences,
Claremont Graduate University
2:55 – 3:00 PM Wrap-up: Penny Hawkins, Evaluation Office,
The Rockefeller Foundation
“Cultural Responsiveness in Equity-focused Evaluations”
Rodney K. Hopson ([email protected]) Duquesne University (Pittsburgh, PA)
Katrina Bledsoe ([email protected]) Education Development Center, Inc. (Washington, DC)
Acknowledgements • Marco Segone, Systemic Management, UNICEF Evaluation Office
• Collaborative and funded work from lectures, co-presentations, research grants, published papers: NSF, CA Endowment, American Evaluation Association (w/ CDC: Karen Kirkhart), American Educational Research Association, Relevance of Culture in Evaluation Institute @ ASU (PI Stafford Hood), Lincoln University Department of Psychology, Manchester Metropolitan University Education and Social Research Institute
• AEA and AEA/CDC Professional Development Workshop Series (w/ Donna Mertens)
• Chapter on Decolonizing evaluation in a developing world:
Implications and cautions for Equity-focused Evaluation (EFE), in
UNICEF book series Evaluation for equity. Fostering development
results
Layout and Format of
Webinar • Reflective
Consider how culturally responsiveness is framed
Consider background, relevance of topics that relate
to culturally responsiveness
Consider how cultural responsiveness is related to
conducting equity-focused evaluations
• Interactive
Opportunities to briefly dialogue with presenters
Opportunities to consider ways of thinking culturally
responsively in evaluation practice
Webinar Learning
Objectives:
• Identify what cultural responsiveness and by
extension, what cultural competence means
• Discuss the evaluation process in the context of
working with underserved communities, in
particular, in development settings
• Identify strategies for assisting evaluators and
agencies in becoming culturally responsive in
equity-focused evaluations
Webinar Framing Questions
• What is cultural responsiveness and how is
addressed in equity-focused evaluation?
• Why is culture important to consider in
development context?
• What are the implications for including the
attention to culture in equity-focused
evaluation?
Opportunities for considering cultural
responsiveness in evaluation: local
• Role of primary inclusion of participants:
• “As Lincoln (1991) points out, most people
who evaluate social programs know very
little about the minority program
participants’ world view, the
appropriateness of program interventions
in meeting their needs, or programs’ personal consequences for these clients
(Madison, 1992).
Opportunities for considering cultural
responsiveness in evaluation: international
and development settings
• Using one set of methodologies in one cultural context
and applying to others:
• “...evaluators must exercise great caution in trying to
apply the methodologies, models, and categories
devised in and for the developed world in “Third World
[developing]” countries...different views of reality and the
nature of change lead to different assumptions about
appropriate goals, treatment, and evaluation models
(Cuthbert, 1985).
• Approach/model used to guide evaluation
• System and culmination of evaluation strategies
• Theoretical and political positioned (as are all evaluations)
Demographic, sociopolitical, and contextual dimensions, locations, perspectives, and characteristics of culture matter
Privileging lived experiences, esp. communities and populations of color
Avoiding the phenomenon of “evaluating down”
Culturally Responsive
Evaluation
(Hopson, 2009)
Theoretical and Practical
Intersection of CRE: Advocacy,
Race, Power, Equity
Decolonizing/ indigenous positions, epistemologies,
and frameworks
Critical theories and epistemologies of race,
ethnicity, culture
Social agenda and advocacy theories, models and
approaches in evaluation
Why consider culturally
responsiveness in evaluation?
• Continued flurry of evaluation discussion in
conference meetings, periodicals, and special
meetings, BUT:
• Limited understanding and consideration in
evaluation mainstream
• Growing, but still lack of courses and training
opportunities that pay attention to cultural
context, relevance, responsiveness,
competence in evaluation
• Many research and ethical procedures often include cultural communities as passive participants. Consequences of this approach include: Unintentional ethical violations
Inappropriate theoretical and methodological designs
Lack of cultural community participation in research and evaluation
Concerns include: Inappropriate use of data and dissemination of
research
Concerns about the power differential between researcher/evaluator and participants/communities
Why consider culturally
responsiveness in evaluation?
Challenges in Conducting
Evaluation in Development
Contexts
• Evaluations must be flexible and context specific.
Must decide if what is considered a gold standard in one
setting is appropriate in another. Culturally informed,
responsive, and competent evaluations can enhance equity
Need to acknowledge that evaluators cope with challenges
posed by the need to use evaluation as a tool for
transformation, and not just ex-post assessment
Thus, evaluations committed to equity and social justice must
keep in mind that the evaluative process is a collaborative
process, a synergy between all parties dedicated
Culturally Responsive
Evaluation Framework
• Step 1: Prepare for the evaluation.
• Step 2: Engage stakeholders.
• Step 3: Identify the purpose of the evaluation.
• Step 4: Frame the right questions.
• Step 5: Design the evaluation.
• Step 6: Select and adapt instrumentation.
• Step 7: Collect the data.
• Step 8: Analyze the data.
• Step 9: Disseminate and use the results. (Frierson, Hood, Hughes, & Thomas, 2010)
Cultural Responsive
7 Collect the data
8 Analyze the data
3 Identify purpose of the evaluation
4 Frame the
right questions
1 Prepare for
the evaluation
5 Design the evaluation
6 Select and adapt instrumentation
2 Engage
stakeholders
9 Disseminate and
use the results
Relationship building
Understand situational underpinnings
Historical archival data to build context
Discussion of values
Discussion of research agendas
Setting boundaries including ground rules for
respect
Use of focus or discussion groups to add
community voices to have them contribute to
research design development,
Conducting Culturally Responsive
Evaluations with Agencies and
Organizations
• Helps to re-negotiate power relationship between high
level stakeholders, evaluators, and program
consumers.
• Helps to design methodology that is most appropriate
for the context.
• Forces high level stakeholders to consider the intersect
between race/ethnicity, socioeconomic status, etc., and
past history in determining the types of programming
that will be most appropriate.
Positive Outcomes of Culturally
Responsive Evaluation
...for Multicultural and Culturally
Competent Evaluation
• Avoiding ethnocentrism means embracing multiple
cultural perspectives
• Culture is central to the evaluation process
• Culturally and ethnically diverse communities have
contributions to make in redefining field of evaluation
(Hopson, 2003)
Summary of Webinar
• Culture matters and affects every evaluation
• CRE encourages the consideration of a variety of
factors in conducting evaluations in agencies and
communities
Consideration of cultural context and factors can provide a more
responsive and accurate evaluation
Can help insure a focus on equity in evaluation
THANK YOU!
Questions and Answers
Stewart Donaldson, Dean & Chair of Psychology
School of Behavioral & Organizational Sciences,
Claremont Graduate University
MODERATOR
Audience Questions
Wrap-up
Penny Hawkins, Rockefeller Foundation Evaluation
Office, is the former Head of Evaluation for the New
Zealand Aid Program, Ministry of Foreign Affairs and
Trade and Vice-Chair of the OECD-DAC Network on
Development Evaluation. She is a past President of the
Australasian Evaluation Society, a founding board
member of the International Organization for Cooperation
in Evaluation (IOCE) and an IPDET (International
Program for Development Evaluation Training) faculty
member.
Next webinar, 27 March 2012,
9:30AM New York time
Juha Uitto, Deputy Director, Evaluation Office of UNDP
“Evaluating the contribution of UNDP to equity-focused
public policies. The case of Brazil and China.”
Oscar A. Garcia, Senior Evaluation Adviser, Evaluation Office
of UNDP
Evaluation of Webinars
Survey
Your opinion/feedback is important to us, therefore
we ask that you complete this short evaluation on
today’s webinar.
http://3.15.2012.questionpro.com
Related Documents
