Effective Youth Evaluation in CNEP

Effective Youth Effective Youth Evaluation in CNEPEvaluation in CNEP

Debra Garrard-FosterCNEP State Nutrition Ed. Program Coordinator Brenda SheikCNEP EvaluatorJune 2013

What is Program Evaluation?What is Program Evaluation?

Program Evaluation:Program Evaluation:

The thoughtful process of focusing The thoughtful process of focusing on questions and topics of concern, on questions and topics of concern, collecting appropriate information, collecting appropriate information,

and then analyzing and interpreting and then analyzing and interpreting the information for a specific use and the information for a specific use and

purpose.purpose.

Why Evaluate Youth Programs?Why Evaluate Youth Programs?

CNEP evaluates youth programs to:CNEP evaluates youth programs to:Help us improve the program

- Are youth learning the most important concepts?

Help us improve our teaching - Is there a better way to communicate

what we are trying to teach, or is it working “as is” in our program?

Help others understand the value of our program

- Provides program information and accountability to program funders

New Youth Evaluation System New Youth Evaluation System

• National committee commissioned to look at youth evaluation in EFNEP

• Goal was to have a uniform set of evaluation questions used by all EFNEP programs

• Committee released “starter” questions in early October 2012

• Committee will continue to test reliability and validity of the questions

• Additional changes to questions likely


• Questions are not curriculum-specific, rather they are based on the goals and objectives of CNEP

• Two year phase in time for project with full use by FY 2015

• Questions are intended for use with WebNEERS system

• Evaluation tools only in English


• During the phase-in period OSU CNEP has:– Determined best strategies for using

evaluation questions with our groups– Determined best method for matching

pre and post evaluations

We need your help as front-line youth We need your help as front-line youth NEAs to help make this transition a NEAs to help make this transition a

good one!good one!

Youth QuestionsYouth Questions

The National Committee Prepared 4 The National Committee Prepared 4 Sets of Evaluation Tools:Sets of Evaluation Tools:

1.Kindergarten to Second Grade

2.Third Grade to Fifth Grade

3.Sixth Grade to Eighth Grade

4.Ninth Grade to Twelfth Grade

The evaluation tools include questions The evaluation tools include questions aligned with what children should be learning aligned with what children should be learning

about nutrition…about nutrition…

WHAT TOOLS WILL CNEP USE?WHAT TOOLS WILL CNEP USE?

3RD GRADE TO 5TH GRADE TOOL• Will be used with 3rd and 4th grades

Parent and/or child can opt out

Child will use ID code on pre/post

Youth pre/post matched

NEAs will use survey script (at first!)

Data entry in WebNEERS

Other Changes?Other Changes?

Required by IRB

Sent from and returned to school

Give at least one week to return

Teacher to help track

Parent/Guardian Information SheetParent/Guardian Information Sheet

PARENTS’/YOUTH CHOICESPARENTS’/YOUTH CHOICES

1.No return/no signature= Evaluation OK

2.Tell child to opt out = NO Evaluation

3.Child opts out on own = NO Evaluation

4.Parent signs & returns = NO Evaluation

No Evaluation if parents not given form or No Evaluation if parents not given form or time to complete! time to complete!

No evaluation No evaluation means no evaluations are even handed to the child……it does not mean that the child can take the survey and then the survey can be destroyed.

Youth Pre/PostYouth Pre/PostStudents will now write ID on pre/post

Can use student’s 2 or 3 initials or school assigned ID for surveys

No student names on surveysDo not make any changes to surveys or write school or teacher names, etc.

Be consistent with IDs……use same method of ID on both sets of pre and post

Youth Pre/Post MatchedYouth Pre/Post Matched2-3 student initials or school assigned student ID……unit may want to decide!

Prefill date and indicate pre or post before copied.

NEANEA is to match each student’s pre and post

Submit unmatched:(same initials, absent from pre or post, etc.)

Script: instructions for student code keeps all on same question reassures not a TEST!

Use at first……you will know when you can stop.

ScriptScript

IMPORTANT!

Data EntryData EntryYouth groups entered as always

Matched surveys entered into Youth Checklist tab

Select 3rd-5th tool and “Add Checklist”

Enter student ID, survey dates and responses

You can’t enter more checklists than you have youth enrolled in the group

1. Parent Info Form to schools2. Complete youth group enrollment3. Pre Survey at/before first lesson

(did any parent opt out?)4.4. SubmitSubmit group enrollment to unit

office/hold Pre Survey5. Lessons6. Post Survey at last lesson

Start to Finish ProcessStart to Finish Process

7. Match Pre/Post and complete exit form.

8.8. SubmitSubmit exit form, matched pre/post and mismatched surveys to unit office

SubmitSubmit paperwork as soon as that step is complete. Do not hold till quarterly reports!!!

Start to Finish Process (cont.)Start to Finish Process (cont.)

What are your questions so What are your questions so far?far?

THIRD TO FIFTH THIRD TO FIFTH GRADE EVALUATION GRADE EVALUATION

TOOLTOOL

33rdrd – 5 – 5thth Grade Questions Grade Questions

Thanks Texas! Thanks Texas! This presentation was adapted from a PowerPoint prepared by

(we still plan to beat you in football!!)

Questions?Questions?

Effective Youth Evaluation in CNEP

Documents