YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation

vv

THINGS TO KEEP IN MIND• This webinar will be recorded and available on

our website along with the presentation slides and other resources about the topic

• If you have trouble with the audio quality, please try calling in with a phone

• Please be sure to fill out the evaluation that will be sent to you following the webinar

Copyright  Lions  Quest  Canada  2014

@ CERPYDLakehead University

Poll #1What you most interested in learning about today?

a) Logic modelsb) Indicatorsc) Outcome measures

GUEST PRESENTERSJessica NobleCentral Hub ManagerYouthREXYork University

Corliss BeanResearch and Evaluation SpecialistYouthREXYork University

Eugenia DuoduVisions of Science Network of Learning

Outline1. Logic Models• Template available

2. OutcomeEvaluation

3. Indicators

4. Measures & Toolkit

5. CES Example

Why Evaluate?

• Supports program and strategic planning

• Helps communicate your program goals and progress

• Serves as a basis for ongoing learning to make your program more effective

What is a Logic Model?“… a picture of how your program works –the theory and assumptions underlying the program. This model provides a road map of your program, highlighting how it is expected to work, what activities need to come before others, and how desired outcomes are achieved.”

- W.K. Kellogg Foundation Evaluation Handbook, 1998

Poll # 2Have you created a logic model for your program?

qYES

qNO

Logic Models• Summarize the key elements of your program

• Explain the rationale behind program activities

• Describe the link between activities and outcomes

• Provide an opportunity for stakeholders to discuss the program and agree on its description and intended results

• Serve as a useful communication tool to describe your program to others

Logic Model Template Available

Quick  Tips  Before  We  Begin:  

Tip #1- When beginning to create your logic model you may want to consider-

What stakeholders should I involve?

• Stakeholders might include program staff, program clients, funders,

community representatives, and volunteers

• Their perspectives can enrich your program logic model by clarifying

expectations for the program.

Tip #2- Logic models take time!

• It is important to gather the feedback of your programs key stakeholders

• Take time to create, review, and revise your logic model

Logic Model Template Available

Elements of Logic Models

Resources/

InputsActivities Participation Outcomes Impact

Outputs Intended Outcomes

Who participates in these activities?

What are the outcomes and long

term impacts associated with these activities?

Create,  Review,  Revise,  Update!ü Does your organization have adequate resources to implement the

activities and achieve the desired outcomes?

ü Have you included all the major activities needed to implement your program and achieve expected outcomes?

ü Would the activities list enable someone who is unfamiliar with your program to understand its scope?

ü Have you expressed your outcomes in terms of change?

ü Have you identified who/what will experience that change, and over what time period?

ü Have you considered a variety of perspectives?

Linking Logic Model to Outcome Evaluations

What is Outcome Evaluation?

• Helps assess a program’s effectiveness at achieving its intended outcomes

Next steps: Moving from outcomes to indicators to measurement

• How do I measure the outcomes in my logic model?

• How do I select appropriate indicators for my expected outcomes?

What is an indicator?• Observable and measurable

“milestones” of the intended outcome– What you see, hear, read, etc.,

that indicates whether you're making progress toward your outcome target

Outcomes

Measures

Indicators

Examples of IndicatorsOutcome Indicator MeasureEngagement in School

Increased schoolattendance

• Number of full days one has attended school for year/month

• Change in number of full days attended school over time

Increased homework completion

• Frequency of on-time homework completion

Improved Academic Performance

Increased test scores

• In-class test scores• Standardized test scores

Improved grades • Test grades• Report card

Get SMART• Quantitative indicators should be SMART:–Specific

–Measurable

–Attainable

–Relevant

–Timely

Qualitative Model

SPICED–Subjective–Participatory– Interpreted and Communicable–Cross-checked and Compared–Empowered–Diverse and Disaggregated

YouthREX Inventory of Measures• Developed based on the Stepping Up 7 themes and 20

outcomes to foster well-being in youth

• WWW.YOUTHREX.COM/MEASURES

CES CASE EXAMPLE:Visions of Science Network

for Learning

Lessons LearnedMeasure selection

o Program Involvemento Ongoing collaboration with frontline staffo Relevant to youth

Transparencyo Accountable to youth

Critical of your own organizationo How do you know your program is working?

Ongoing reflectiono Program Improvement based on youth voice

Questions?

Join Us!Thursday AUGUST 1811:00am – 12:00pmAsk Us Anything About Program Evaluation

Thursday SEPTEMBER 112:00pm – 1:00pmSupporting trans youth wellbeing