Concepts in Dental Public Health Ch 7

7/27/2019 Concepts in Dental Public Health Ch 7

1/21

Concepts In Dental PublicHealth

Program Evaluation

Chapter 7


2/21

Purpose Of Program

Evaluation Evaluation answers the question: Was the

program successful in reducing or eliminating

the identified need or problem? Did the program accomplish what is was

designed to do?

How could the program be improved?

Should the program be continued? Does the program merit funding?

Should the program be expanded?


3/21

Program EvaluationHelps:

1. Develop good practice

2. Make good use of scarce resources

3. Provide feedback to staff andparticipants

4. Shape policy development


4/21

Most Importantly: Program evaluation is the contribution

to the provision of quality services to

people in need!


5/21

Types Of Evaluation Formative (process evaluation)

Summative (outcome evaluation)


6/21

Formative Evaluation Occurs during implementation process

Points out problems with the process

Identifies opportunities forimprovement with the process

Helps determine if program is operatingas expected.


7/21

Summative Evaluation Occurs after the intervention

Results are compared with goals andobjectives to determine the impact ofthe program on the communitieshealth.


8/21

Evaluation Two types: Qualitative and

Quantitative

Best if used together for evaluation

Give information as to whether and byhow much a program had an impact.


9/21

Qualitative Evaluation Helpful when long term changes are

expected

They tell us why something changed,what factors are involved

Can cause program improvements more

quickly than quantitative methods Tell what people did and did not like

about the program


10/21

Intermediate Outcomes Method to measure educational program

effectiveness

Ex: intention to quit smoking, improvementin plaque levels, agreement to get sealants,or decreased sugar intake.

Intermediate variables: knowledge, attitudes,behaviors (measurement of these helps todetermine program effectiveness)


11/21

Stakeholders Who are they?

1. Policy makers

2. Funding agents

3. Community representatives


12/21

Stakeholders Why are they important in the

evaluation process?

*The relevance and credibility of theresults and long-term participation isincreased when the stakeholders are

included in the evaluation process.


13/21

Framework For Evaluation1. Engage stakeholders

2. Describe program

3. Focus evaluation design

4. Gather credible evidence

5. Justify conclusions6. Ensure use and share lessons learned

(Page 99, Table 7-1)


14/21

Evaluation Designs Post program only

Pre-program and post program

Pre-program and post program with acomparison group

Pre-program and post program with acontrol group


15/21

Post Program OnlyAssessed after program is completed

Least useful design

No baseline measurement taken tocompare results with

Only useful when a specific outcome is

desiredAmount of change that occurs cannot

be measured


16/21

Pre-Program and Post

ProgramAllows for assessment of amount of

change

Baseline measurement is taken prior toprogram begins

Same measurement/same way/before

and after Does not account for changes in target

group that are not related to program


17/21

Pre/Post With A Comparison

Group Comparison group does not receive the

program

Comparison and target group areassessed before and after program

Comparison group must be similar to

target group (gender, age, SES,education) and in similar situation


18/21

Pre/Post With A Control Group Most reliable evaluation method

Participants are randomly assigned from

same group to target or control group

Random-each person has equal chanceof being assigned to either group


19/21

Data Collection Methods Review Table 7-3, page 102-103


20/21

Management Information

Systems Helps organize data

Data is needed to manage program

Data is needed to help make decisionsabout a program


21/21

Information To Be Tracked Number and types of services

performed

Sealants retained over a period of time

Numbers of attendees

Responses to evaluation forms

Concepts in Dental Public Health Ch 7

Documents