Research methodology for caadp m&e m&e framework, caadp indicators & sadc risdp indicators

Phot

o: D

avid

Bra

zier

/IW

MI

Phot

o :T

om v

an C

aken

berg

he/I

WM

IPh

oto:

Dav

id B

razi

er/I

WM

I

www.iwmi.org

Water for a food-secure world

Comprehensive Africa Agriculture Development Programme (CAADP) Monitoring and Evaluation Framework and links to the Survey Questionnaire

Regional Methodology WorkshopBirchwood Hotel

21 June, 2012Pretoria

www.iwmi.org


Goal of CAADP • Help African countries reach and maintain a higher

path of economic growth through agriculturally-led development that reduces mass poverty, food insecurity and hunger.

Targets of CAADP • 6% average annual growth in the agriculture • MDG 1 - reduce poverty and hunger by half by 2015, • Allocating 10% of national budgets to agriculture

Goal and targets of CAADP

www.iwmi.org


CAADP is a strategic framework to guide investments across four specific pillars, as well as investments in strengthening institutional capacity across the pillars:

1. Extending area under sustainable land management and reliable water control systems

2. Improving rural infrastructure and trade-related capacity for market access

3. Increasing food supplies and reducing hunger4. Agricultural research and technology dissemination

and adoption

Four Pillars of CAADP

www.iwmi.org


The CAADP country roundtable process is the main process to monitor and evaluate at the country level.• inclusive participation of stakeholders to ensure that credible

and relevant evidence is used in the design of a CAADP investment program that is aligned with the CAADP principles and targets across the four CAADP pillars

• Significant stages in the process lead up to signing of a country CAADP compact and then design, technical review, implementation and monitoring and evaluation of the investment program.

CAADP Implementation

www.iwmi.org


Purpose of CAAD M&E FrameworkThe M&E framework was developed by ReSAKSS , endorsed in 2009 and validated 2010

• To monitor progress towards the successful implementation of CAADP

• Supports mutual, peer and progress reviews at the continental, regional and national levels respectively.

• Provides a basis for impact assessment of CAADP.• To do this it has identified a set of indicators, data required, laid

out a data collection, and analysis plan

www.iwmi.org


What to monitor?• What to monitor is based on the underlying logic of CAADP to

show how the investments (Inputs) and outputs associated with any one pillar of CAADP interact with the other pillars through complementarity or substitutability of investments to affect achievement of the overall CAADP goals and objectives.

• Also the framework shows how the investment decisions and realization of the various outputs and outcomes are influenced by the conditioning factors e.g. governance and trade and macroeconomic policies.

www.iwmi.org


Generally agreed that the indicators must be SMARTSpecific, Measurable, Achievable, Realistic and Timely

Thus the best indicators are those that best reflect the range of inputs (processes, policies and investments), outputs and outcomes associated with the activities being implemented across the different pillars of CAADP.

What to monitor (2)

www.iwmi.org


• SMART indicators must be the ones that best reflect the range of:

1. Inputs,

2. Outputs

3. Outcomes

associated with the activities being implemented across the different pillars/subsectors of the agriculture sector

Specific, Measurable, Achievable, Realistic and Timely (SMART) Indicators

www.iwmi.org


• SMART indicators must also capture critical landmarks along the pathway (s) of impact e.g.1. Investments made and how these affect agricultural productivity

growth, poverty and hunger2. Investments made in capacity strengthening and how these

contribute to achieving the goals and objectives of the sector3. Investments made and associated outputs in each individual pillar

and how these are affected by investments and outputs associated with other pillars

4. Conditioning factors/exogenous factors – and how these are likely to influence realization of the goals and objectives of the sector

Specific, Measurable, Achievable, Realistic and Timely (SMART) Indicators

www.iwmi.org


Input Level Conditioning/Exogenous Factors

Political economyGovernanceInstitutions

Total Government RevenuePrivate Sector Investments

FDI/OD

Land Management & Water Control

Systems

Rural Infrastructure

Trade Related Market Access

Food Security and Safety Nets

Agricultural Research and Technology

Development

Institutional Capacity Strengthening

Public Investments

Investments in the 4 CAADP

Pillars and Capacity

Strengthening

Inputs

www.iwmi.org


Physical Capital

Irrigation Systems

Rural Roads

Marketing Infrastructure Food Reserve

Facilities

Human Capital

Information, Knowledge and

Technologies

Output Level Conditioning/Exogenous Factors

• Initial conditions of capital • Social services (Education, Health,

Social Security)

Outputs

www.iwmi.org


Sustainable Land

Management

Agricultural Production and Food

Supply

Agricultural

Trade

Outcome Level Conditioning/Exogenous Factors • Resources

• Rainfall • Natural Disasters

• Trade policies • Exchange Rates

• Prices

Outcomes

www.iwmi.org


Intermediate Goal Level

Prices

Income

Poverty

Hunger

Goal Level

Goal level Conditioning/Exogenous Factors • Household Assets and Endowments

• Natural disasters • Conflict

Intermediate Goal level Conditioning/Exogenous Factors

• Non-agricultural production • Employment, • Rural wages,

• Inflation

www.iwmi.org


Source: Benin.S., Johnson M. et al, 2008

Goals

Intermediate Goals

Outcomes

Outputs (Capital)

Input level• Political economy,• Governance• Institutions• Total Government Revenue• Private Sector Investments• FDI/ODA

Output level• Initial conditions of capital• Social services (Educ, Health. SS)

• Outcome level• Resources, Rainfall, Natural • Disasters, Trade policies, • Exchange Rates, Prices

Intermediate Goal level• Non-agricultural production• Employment, Rural wages,

• Inflation

Goal level• Household Assets and

• Endowments, Natural disasters• Conflict

Inputs(Investments)

Conditioning factorsOverall Performance Indicator Framework

www.iwmi.org


• The two figures:

• Help identify a critical set of indicators that in addition to being consistent with the impact pathways, possess sufficient information to address the fundamental question of whether the programme is on track to achieving the desired goal of agricultural growth rate and poverty, hunger reduction targets.

Figure 1 and Figure 2

www.iwmi.org


CAADP and SADC RISDP Indicators

• Achieving a GDP growth of at least 7% a year.• MDG1 by 2015 .• Doubling cropland under irrigation from 3.5% to 7%• Increasing fertilizer use to 65 kg/ha of arable land by

2015.• Increasing cereal yield to 2,000 kg/ha by 2015.• Doubling the adoption rate of proven technologies such

as improved seed varieties, and management of water and land by 2015.

• Increasing livestock production by at least 4% annually

www.iwmi.org


Questionnaire overview

The survey is divided into six broad sections:

• CAADP implementation process• Expenditure and investment indicators• Output indicators (Agricultural technology, diffusion, and

human capital indicators)• Agricultural sector performance indicators (Agricultural

production and trade indicators)• Macro- and socio-economic indicators (Welfare indicators)• Agricultural development strategies, policies and/or plans

www.iwmi.org


CAADP implementation process

The purpose of this indicator is to provide an overview of the progress, if any, the country has made in adapting and implementing the CAADP framework

www.iwmi.org


B: Expenditure and investment indicators

The purpose of this indicator is to collect information on government revenues, budget allocation and expenditures. This information will specifically be used to monitor the country’s progress towards the 2003 Maputo Declaration target of allocating at least 10% of total government budgetary resources to agriculture.

www.iwmi.org


C: Output indicators (Agricultural technology, diffusion, and human capital indicators)

This indicator covers information on the rate of modern input use which specifically includes adoption of improved technologies, sustainable land management practices and stock as well as quality (in terms of qualifications) of agricultural human capital.

www.iwmi.org


D: Agricultural sector performance indicators (Agricultural production and trade indicators)

• The purpose of this indicator is to monitor agricultural output and production performance in the country.

• This information will be used to assess whether and how the country is progressing towards achieving its agricultural growth and performance targets.

www.iwmi.org


E: Macro- and socio-economic indicators (Welfare indicators)

• To assess the extent to which the country is progressing towards achieving the MDGs, specifically MDG1 (on halving poverty and hunger by 2015) and MDG6 (particularly as it relates to combating HIV/AIDS).

www.iwmi.org


F: Agricultural development strategies, policies and/or plans

The purpose of these indicators is to collect information that will be used to review the country’s most recent agricultural development strategies, policies and/or plans (e.g. National Development Plans, Poverty Reduction Strategies (PRSs), Agriculture and/or Food Security Strategies, etc

www.iwmi.org


The indicators are grouped into seven intervention areas (1) enabling environment; (2) implementation process(3) commitments and investments; (4) agricultural growth performance; (5) agricultural trade performance; (6) poverty, hunger, and food and nutrition security; and (7) investment-growth poverty linkages.

Potential Indicators for CAADP M&E

www.iwmi.org


• Governance and economic management• % of population satisfied with political governance by: (i) gender;

(ii) rural/urban; (iii) age group; (iv) sector• Macroeconomic management: (i) deficit to GDP; (ii),revenue to

GDP; (iii) inflation rate; (iv) debt to GDP• Private sector development• Proportion of population with access to financial services for

agricultural and rural development• Proportion of commercial loans for agricultural and rural

development (and as % of Agricultural GDP• §Donor harmonization• Share of ODA for total budget support

Key indicators on enabling environment

www.iwmi.org


• Development of investment program Number of countries at major stages of the roundtable process (see Figure 2)

• Composition of stakeholders involved at each major stage of the process

• Resources and mechanisms for implementation of investment program

• Whether resources have been committed by governments, private sector and development partners

• Whether mechanisms are in place for implementation and M&E

2. Key indicators on implementation process

www.iwmi.org


• Total ODA commitments as % of Agricultural GDP (AgGDP• Total ODA for agricultural R&D and value chains• • Government spending on the agricultural sector as:

• (i) % agricultural budget; • (ii) % of total expenditures; and • (iii) % of AgGDP

• Share of government agricultural expenditures by: Function (research, extension, irrigation, etc) Sub-sector (crops, livestock, forestry, fisheries)• Total private sector investments in the agricultural sector % of

AgGDP

3. Key indicators on commitments and investments

www.iwmi.org


• Percent of agricultural land area under irrigation• Percent of population within 15 minutes, 30 minutes or more than

30 minutes of infrastructure or service• % of agricultural production that is lost post-harvest• %Technology adoption• %agricultural land area under improved technologies (crops and

forestry)• %of total livestock units of improved breeds• % of fish farming under sustainable management• Institutional capacity - Level of training (PhD, MS, BS, Dip Number

of professionals per 1000 persons by: Gender

4. Key indicators on provision, coverage and utilization of services

www.iwmi.org


• Value and volume of agricultural exports and imports

• as % of AgGDP (and contribution by different sub-sectors and major commodities)

• Food trade balance• Share of intra-regional trade• Share of value-added content of trade• Domestic and export-import parity prices by major commodities• Demand outlook and long-term price projections for major

commodities

5. Key indicators on agricultural trade performance

www.iwmi.org


6. Key indicators on poverty, hunger and food and nutrition security

• Poverty incidence ratio• Poverty gap ratio• Share of poorest quintile in national income• Proportion of the population below minimum dietary energy

consumption• Prevalence of underweight children under five years of age• Global Hunger Index• Share of food expenditure

www.iwmi.org


• Percentage change in poverty rate per unit change in AgGDP growth rate

• Value of AgGDP per unit cost of intervention

• Number of people lifted out of poverty or hunger per unit cost of intervention

7. Key indicators on linkages between interventions and CAADP goals

www.iwmi.org


Thank You