Results Based Management: Working with Indicators By Will Postma & Dwayne Hodgson
Dec 05, 2014
Results Based Management: Working with
Indicators
By Will Postma
& Dwayne Hodgson
Contents
1. What are Indicators?
2. Examples of Indicators
3. SMART ++ Indicators
4. Making Indicators Useful & Accessible
1. What Are Indicators?
Indicators tell us how well our project is working.
They can describe both the activities that we’re doing, and whether we are achieving our expected results in a community project.
Indictors can include both…
Numbers that describe how much things have changed…..
Conversations or Stories that describe what the change is like and how it helped the community.
Example: If we were taking a trip…
Our indicators could include…
the speed we’re driving at. the number of kilometers
we’ve traveled The sign posts along the
side of the road that announce the towns we’ve passed through
Photos of the natural landmarks --- hills, mountains, rivers – we see.
A story describing the highlights of our trip
Example: If we were playing football…
Our indicators could include… The number of goals
scored A play by play commentary
of a great goal The number of red and
yellow cards The number of goals
scored The stories of the coach
and players about what the winning the game meant for them.
2. Examples of IndicatorsIn the next slides, we will show some examples of indicators for outputs, and immediate, intermediate and ultimate outcomes for the following types of projects:
1. Education2. Children’s Participation3. HIV/AIDS4. Water & Sanitation
A Word of Caution!
Please note that these are only examples of indicators from other projects.
You will need to develop your own indicators that make sense locally.
1. Education
Education
Outputs Indicators
Teachers trained in new methods of education
# of teachers trained
School supplies and uniforms provided
# of children (boys & girls) who received new school supplies and uniforms
School buildings repairs # of school buildings repaired
Parent-Teacher Associations (PTAs) Mobilized
# of PTA’s organized
Education
Immediate Outcomes Indicators
Primary schools have improved, safe infrastructure and/or equipment to accommodate and retain increased enrolment.
# of primary schools that meet minimum standards for space, sanitation, and structure.
Improved capacity of teachers to provide active and relevant learning environment for girls and boys.
# of teachers and/or on inclusive teaching methodologies, participatory learning techniques, gender equality in education and child friendly school model
Increased access to good quality of education.
% boys and girls living within 10 km who can attend schoolQuality of education as assessed by supervisors
Education
Intermediate Outcomes Indicators
Increased numbers of socially excluded girls and boys who complete a full cycle of primary schooling.
Annual school retention rates of socially excluded boys and girls in SCC targeted schools (versus control schools).
Civil society groups and networks advocate effectively for boys’ and girls’ rights to education.
# and description of advocacy actions by right to education groups and networks.
Education models developed by SCC implemented by relevant duty bearers (Government, NGOs, CBOs).
# of duty bearers (Gov’t, NGOs, CBOs) implementing education models developed by SCC.
Education policies, laws and programs increasingly reflect gender equality and girls’ and boys’ rights to education.
# and significance of changes to existing/new laws, policies, programs addressing children’s right to education.
Education
Ultimate Outcomes Indicators
Literacy in community increases % change in number of youth literacy levels for youth graduating from school (vs. baseline)
The spirit and intent of the Convention on the Rights of the Child (UNCRC) is reflected in governments’ child-related policies, regulations, programs and services.
Examples from country reports to UN Committee on the Rights of the Child demonstrating increasing application of CRC articles.
Level of fulfillment of the recommendations of the Committee on the Rights of Children by Government.
Socially excluded girls and boys realize their inherent rights.
Annual increase in the percentage of the public budget assigned to the National Action Plan for Children and Adolescents 002-2011
Your Turn: EducationRecall, that one of the education immediate
outcomes level results was: Improved capacity of teachers to provide active
and relevant learning environment for girls and boys
An indicator of this immediate outcomes result could be:
• # of teachers using inclusive teaching methodologies, participatory learning techniques, gender equality in education and child-friendly school models.
Your Turn: EducationPerhaps other, complementary indicators could
be:
• # of students looking forward to going to school each morning
• # of parents of students sensing greater interest among students in learning
• # of students sharing stories at home about new learning during the day.
What other complementary indicators might community members choose?
Your Turn: EducationIn small groups, name three results of a good education project.
For each result, name one way that you would know if the result had been achieved and that the community is benefiting?
Would these indicators be helpful for the community to measure, report on, learn from?
Would partners, other stakeholders such as donors also find these indicators helpful in knowing the level of progress taking place?
2. Children’s Participation
Children’s Participation
Outputs IndicatorsChildren’s clubs established. # of children’s clubs established and
trained on child rights issues
Girls and boys trained on child rights, harmful child work, the needs of working children and the importance of education
# of girls and boys trained on child rights, harmful child work, the needs of working children and the importance of education
Representatives from children’s clubs participated in quarterly CCPN meetings
# of children’s representatives per community participate in the quarterly CCPN meetings.
Children’s clubs supported to implement action plans.
# of children’s clubs that receive regular support to implement their action plan.
Children’s Participation
Immediate outcomes Indicators
Increased ability to communicate CP messages
# children clubs that organize regular recreational activities (at least one activity per week) to stimulate and communicate CP messages
Increased awareness of CRC amongst children
# of children in targeted communities are aware of the CRC
Enhanced capacities of girls, boys and youth to demand their right to quality, relevant education.
% of boys and girls participating in school child rights clubs or other spaces for children to meet, organize and act.
Level of understanding of boys, girls and youth of what their right to education means
Children’s ParticipationIntermediate outcomes Indicators
Children’s groups advocate for rights to be free from exploitative child work
Increased communication and interventions by children, parents, child protection agencies and communities regarding harmful child work, the nature of the violation of their rights and mechanisms to protect child workers
Stories of how children, parents, child protection agencies and community members explain the importance of preventing harmful child work.
Examples of where children, parents, child protection agencies and community members intervened to protect child workers
Harmful child work in SCC-targeted areas reduced.
# of child graduates from SCC programs returning to the worst forms of child work.
# and description of children’s rights campaigns undertaken by chidlren’s groups
Children’s Participation
Ultimate outcome Indicators
Increased realization of inherent rights by socially-excluded girls and boys as per the spirit and intent of the Convention on the Rights of the Child (UNCRC).
• Country reports to UN Committee on the Rights of the Child demonstrating increasing application of CRC articles.
• Level of fulfillment of the recommendations of the Committee on the Rights of Children by Government.
• Annual increase in the percentage of the public budget assigned to the National Action Plan for Children and Adolescents 2002-2011
Your Turn: Children’s Participation
Recall, that one of the child participation immediate outcomes level results was:
Enhanced capacities of girls, boys and youth to demand their right to quality, relevant education.
An indicator of this immediate outcome could be:
• # of child-friendly groups and spaces for children to meet, organize and act.
Your Turn Children’s Participation
Perhaps other, complementary indicators could be: • Level of satisfaction of girls, boys and youth with
contributions of government to their education • # of examples of billboards, posters and other IEC
materials, produced by the government and promoting the right of children to education
• # of actions or events where girls, boys and youth feel they have increased the community’s understanding of quality education
What other complementary indicators might community members choose?
Your Turn: Children’s ParticipationIn small groups, name three results of a good child
participation project.
For each result, name one way that you would know if the result had been achieved and that the community
is benefiting?
Would these indicators be helpful for the community to measure, report on, learn from?
Would partners, other stakeholders such as donors also find these indicators helpful in knowing the
level of progress taking place?
3. HIV/AIDS
HIV/AIDS
Outputs Indicators
CBOs established and strengthened to provide counseling, care and support services to children affected by HIV/AIDS.
# of community based organizations established and strengthened to provide quality counseling, care and support services for children affected by HIV AIDS
Children sensitized on ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours
# of children, including sales girls, sex workers, child workers and school children sensitized on ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours
Peer educators trained. # of girls and boys trained as peer educators to reach children in their communities
PLWHA support groups formed. # of PLWHA support groups formed.Average size of PLWHA groups.
HIV/AIDS
Immediate Outcomes Indicator
Increased knowledge among children about ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours
Scores on simple verbal knowledge test re: ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours
Improved access to essential services for Orphans and Vulnerable Children (OVCs).
# of OVCs receiving quality counseling, psycho-social support, medical care and referral services by trained partners and caregivers. # of linkages established between OVCs and health care providers.
Improved perception of duty bearers on means to protect children affected by HIV/AIDS.
# of government representatives and community leaders, parents, legal guardians and community leaders fulfilling their responsibilities to protect children affected by HIV/AIDS.
HIV/AIDS
Increased and more effective advocacy for children’s right to a healthy sexuality and to be protected from HIV/AIDS.
# of civil society groups/networks addressing HIV/AIDS.
Examples of their effective advocacy.
Intermediate Outcomes Indicators
Improved social and legal frameworks, including services, to protect boys and girls affected by HIV/AIDS .
# of changes to existing/new laws, policies or programs addressing children vulnerable to HIV/AIDS.
Adoption by relevant duty bearers of HIV/AIDS prevention and care and support models.
# of duty bearers (Gov’t, NGOs, CBOs) adopting HIV/AIDS prevention and care models
HIV/AIDS
Ultimate Outcome Indicator
Reduction of HIV/AIDS in target communities.
Change in % of children living with HIV/AIDS in target communities
Improved quality of life for PLWHA in targeted communities.
Stories of improvement in quality of life for PLWHA.
Your Turn: HIV/AIDS
Recall, that one of the HIV/AIDS intermediate outcomes level results was:
Adoption by relevant duty bearers of HIV/AIDS prevention and care and support models.
An indicator of this intermediate outcomes level result could be:
• # of duty bearers (Gov’t, NGOs, CBOs) adopting HIV/AIDS prevention and care models
Your Turn: HIV/AIDSOther complementary indicators might be:
• # of examples in the community where community members benefited from improved HIV/AIDS care models
• # of visits from government health staff (home care workers, nurses) to patients
What other complementary indicators could there be, that may also be indicators chosen by community members?
Your Turn: HIV/AIDS
In small groups, name three results of a good HIV / AIDS response project.
For each result, name one way that you would know if the result had been achieved and that the
community is benefiting?
Would these indicators be helpful for the community to measure, report on, learn from?
Would partners, other stakeholders such as donors also find these indicators helpful in knowing the
level of progress taking place?
4. Water & Sanitation
Water & Sanitation
Outputs Indicators
Water purification packets distributed. # of water purification packets distributed# of households receiving a water purification packet
Community health workers trained on necessary skills and knowledge to mobilize communities on sanitation, hygiene promotion and child protection
# of CHW who complete training course and pass test of knowledge and skills.
Water sources including wells and hand pumps, cleared, repaired and/or installed.
# of water sources cleared, repaired and/or installed
Water & Sanitation
Immediate Outcomes Indicators
Water sources operational and maintained.
# of water sources that are operational at least 80% of the time
More convenient access to clean water.
# of households with access of up to 20 litres / person / day of clean water within 100 metres of their house.
Increased access to clean water for boys and girls in schools
# schools with functioning, clean water sources
Increased knowledge and skills of Community Health Workers have to mobilize communities on sanitation, hygiene promotion and child protection
# of CHW who pass a basic test on necessary skills and knowledge to
Water & Sanitation
Intermediate outcomes Indicator
Increased use of clean water for cleaning, cooking, bathing and other household uses.
# of people using clean water for cleaning, cooking, bathing and other uses.
Water sources protected and maintained by local management committees.
# of water sources protected and maintained monthly by local management committees.
Citizens advocate local government to ensure their right to water.
Description of advocacy efforts by citizens to ensure their right to water.
Water & Sanitation
Ultimate Outcome Indicator
Improved health for families Stories that illustrate changes in quality of life as a result of provision of water and sanitation facilities.
Children realize their right to clean water.
Examples of where children realize their right to clean water. % of children in target area who can realize this right.
Your Turn: Water & Sanitation
If one of the Water and Sanitation immediate outcomes level results was:
Increased access to clean water for drinking, personal hygiene and cooking needs.
An indicator of this intermediate outcomes level result could be:
• # of individuals in 100 communities able to access clean water for drinking, personal hygiene and cooking needs.
Your Turn: Water & Sanitation
Other complementary indicators could be:
• # of women and men who can say that women’s work load has been made easier
• Level of satisfaction among community members that water is fairly and equally accessible to all in the community
What other complementary indicators might community members choose?
Your Turn: Water & SanitationIn small groups, name three results of a good water
and sanitation project.
For each result, name one way that you would know if the result had been achieved and the community
is benefiting?
Would these indicators be helpful for the community to measure, report on, learn from?
Would partners, other stakeholders such as donors also find these indicators helpful in knowing the
level of progress taking place?
For our projects, we want to use indicators that will be SMART but also people-focused, user-friendly
and community-empowering
3. SMART++ Indicators
7 Characteristics of a Good Indicator (Part 1)Characteristics Questions to Ask… Very Much Somewhat Little
Simple Will this indicator be easy to collect?Will the information be simple to analyze?Can you collect the data at an affordable, reasonable cost?
Measurable Does the indicator really measure the result? Can the indicator be measured and analyzed by different people consistently? Can the indicator be used to compare results across different communities or groups?
Achievable Will this indicator help us to know whether or not the result is being achieved?
Relevant Is the information from this indicator relevant for managing the project and for decision-making?
Time-bound Is the indicator sensitive to change, over the life of a project? Can a baseline and a a target be established for this indicator?
7 Characteristics of a Good Indicator (continued)Characteristics Questions to Ask… Very Much Somewhat Little
ParticipatoryWill local staff and community members (not just leaders or those more formally educated) be able to participate in the measurement of this indicator?
EmpoweringAre local staff and communities empowered by choosing, using and reporting on this indicator?
Does it allow them to celebrate change and reflect critically on this change?
4. Making Indicators Useful & Accessible
Donors
OtherStakeholders
Community
Useful to Everyone!
A plant growing (seed, sprout, sapling, tree)
Traveling down a road (1st, 2nd, 3rd and 4th destination)
Other local measurement examples used by other organizations:
Steps in the preparation of a food such as maize,
with the end product being the cooked meal
Other local measurement examples used by other organizations:
Other local measurement examples used by other organizations:
A spider web, from Cambodia, used to
indicate progress and which areas still need to
be developed
What other suggestions do you have for developing and tracking indicators that are SMART++… and useful to everyone??
Conclusion: Proverbs from Africa
A boat does not know who is the leader; when it turns over, everyone gets wet.
A boat cannot go forward if each rows his own way
If you wish to go fast, walk alone; if you wish to go far, walk together
Contact Us
We’d love to hear your feedback and suggestions on how to improve this module. Please write us @
Will [email protected]
Dwayne [email protected]