Promoting Rational Drug Use in the Community Monitoring and evaluation
Promoting Rational Drug Use in the Community Monitoring and evaluation.
Apr 01, 2015
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Promoting Rational Drug Use in the Community
Monitoring and evaluation
Monitoring and evaluationPromoting Rational Drug Use in the Community 2
WHO
Objectives Session on Monitoring and Evaluation
Understand functions of monitoring and evaluation
Define what should be monitored Formulate evaluation questions Identify methods Make a plan for monitoring and
evaluation
Monitoring and evaluationPromoting Rational Drug Use in the Community 3
WHO
Place of Monitoring and Evaluation in the Planning Cycle
Problem
Goal
Objective
Activity
Monitoring
Evaluation
Monitoring Refers to Activities
Evaluation refers to Objectives
Monitoring and evaluationPromoting Rational Drug Use in the Community 4
WHO
Functions of monitoring
See that everything goes according to plan
Find out if there are unexpected difficulties
Adjust plans
Monitoring and evaluationPromoting Rational Drug Use in the Community 5
WHO
Functions of Evaluation
Prove that the intervention worked Assess if costs were reasonable Convince others that intervention
works Share experiences - to allow
replication
Monitoring and evaluationPromoting Rational Drug Use in the Community 6
WHO
Indicators
Indicators are needed for both monitoring and evaluation
Monitoring requires process indicators
Evaluation requires outcome indicators
Planning to collect indicators is an important part of any plan
Monitoring and evaluationPromoting Rational Drug Use in the Community 7
WHO
What to monitor
Formative research(RAP) done? Intervention pre-tested? Activities implemented according to
plan? Are costs in accordance with
budget? Are staff carrying out assigned
duties? Is collaboration with others taking
place?
Monitoring and evaluationPromoting Rational Drug Use in the Community 8
WHO
How to monitor
Record keeping Making reports on activities Field or supervisory visits Regular project/programme
meetings
Monitoring and evaluationPromoting Rational Drug Use in the Community 9
WHO
What to evaluate?
Preparation
Planning
Implementation
Effect
Monitoring and evaluationPromoting Rational Drug Use in the Community 10
WHO
Preparation
How was the problem identified?
Was formative research done
Who is involved in the intervention
How comprehensive is the intervention (consider the factors which cause the problem)
Monitoring and evaluationPromoting Rational Drug Use in the Community 11
WHO
Planning
What objectives were set?
Which activities were planned?
What target audiences were identified?
Were the interventions pre-tested?
Was a plan for monitoring and evaluation made?
Monitoring and evaluationPromoting Rational Drug Use in the Community 12
WHO
Implementation
Which of planned activities were carried out?
What messages were disseminated?
How many people did the message reach?
Did the target audience pay attention?
Did the target audience understand?
What problems were encountered
Monitoring and evaluationPromoting Rational Drug Use in the Community 13
WHO
Effect
Change in knowledge?
Change in behaviour?
Change in health service quality?
Change in policy?
Improvements in health?
Negative or unexpected effects?
Monitoring and evaluationPromoting Rational Drug Use in the Community 14
WHO
Four evaluation designs
Randomised control design
Quasi experimental design
Time-series design
Pre-post design
Monitoring and evaluationPromoting Rational Drug Use in the Community 15
WHO
Four evaluation designs
Randomised control design
intervention groupreceives education random assignment of
intervention andcontrol group; measure change
at the beginning after intervention of the intervention
control group receivesno education
Quasi-experimental designintervention groupreceives education
specifically selectedintervention andcontrol group; measure change
at the beginning after interventionof the intervention
control group receivesno education
Type of design Action Measuring change
Monitoring and evaluationPromoting Rational Drug Use in the Community 16
WHO
Four evaluation designs
Time-series design
measure baselinemeasure changetwice (for exampleat one + six monthintervals) after
at the beginning of implement intervention
interventionthe intervention
and ask questionsto find out whypeople changedbehaviour
Pre-post design
measure baselinemeasure change
at the beginning of implement intervention after intervention
the interventionand ask questionsto find out whypeople changedbehaviour
Type of design Action Measuring change
Monitoring and evaluationPromoting Rational Drug Use in the Community 17
WHO
Define key outcome measures
Review communication objectives Identify what behaviours are likely to
change Limit the number of outcome measures But, measure more than one dimension Choose outcome measures that can be
clearly defined and reliably measured
Monitoring and evaluationPromoting Rational Drug Use in the Community 18
WHO
Examples of key outcome measures
The percentage of childhood diarrhea cases treated with antidiarrhoeal medicines
The percentage of total antimalarial sales which included an adequate dosage
Monitoring and evaluationPromoting Rational Drug Use in the Community 19
WHO
Methods
Review of project documents, including monitoring reports
Semi-structured interviews Short quantitative surveys Focused weekly illness recalls
(change in common health problems)
Structured observations
Monitoring and evaluationPromoting Rational Drug Use in the Community 20
WHO
Problems in proving effects
Contamination
Intervention changes over time
Difficult to measure mix of methods
Unplanned interventions by others
Confounding factors
Monitoring and evaluationPromoting Rational Drug Use in the Community 21
WHO
Summary guidelines
Decide at beginning of an intervention how you will evaluate
Prepare good outcome measures Evaluate process and effect Look for short- and long-term change Encourage participation of target
audience Share successes and failures Make an evaluation plan
Monitoring and evaluationPromoting Rational Drug Use in the Community 22
WHO
An evaluation plan
Statement of communication objectives
Evaluation questions Key outcome measures Evaluation design/methodology Data collection methods Plan for data processing and
analysis Plan for dissemination of results
Monitoring and evaluationPromoting Rational Drug Use in the Community 23
WHO
will depend on the complexity of behaviour, its reinforcement in culture,the presence/absence of opposing forces and the resources at your disposal
Short term
knowledge,skills, awareness
Medium term 1-3 yrs
behaviour change
Longer term <5 yrs
Change in health
What can be achieved?
Monitoring and evaluationPromoting Rational Drug Use in the Community 24
WHO
Activity 1: Evaluate a shopkeeper intervention/Uganda Read the description, page 16 Formulate: Evaluation questions Select key outcome measures Advise on study design: quasi-
experimental or time-series design? Propose limited set of data-
collection methods
Related Documents
