Florence Kondylis & Mattea Stein Development Impact Evaluation Initiative.

DIME-GAP Collaboration: Concretely, what are we going to learn?

Florence Kondylis & Mattea Stein

Development Impact Evaluation Initiative

Stock-taking

Agriculture & Local Development: AADAPT launched in Africa, Apr 2009

Since then, launched in 2 more regions Over 40 ongoing impact evaluations

Finance & Private Sector Development: DIME FPD Global launched, Dec 2010

22 ongoing impact evaluations across 4 regions

What work has been done? What are we going to learn?

Outline

3600 tour of DIME-GAP collaboration and ongoing work in both sectors

Detailed project-specific learning plans: Irrigation management in Mozambique Trust and reputation for SMMEs’ market

expansion in RSA

Overview: Agriculture & Local Development

Technology Adoption

Ethiopia- Improved Coffee &

Poultry varieties: Who adopts, and to what

effect?- Farmers innovation

funds: identification and adoption

Tanzania- What’s the impact of partly

relaxing the financial constraint on fertilizer

adoption? - What targeting mechanisms

are best at reaching the intended participants?

Irrigation & Water

GovernanceEthiopia

- What fee collection mechanisms work best?- What’s the impact on the Quality & Quantity

of water used domestically?

Tamil Nadu (India)- What is better water

management?- What incentives best encourage farmers to

adopt “good” management practices?

Farmers’ Groups

Andhra Pradesh (AP)- How can we best

encourage the rural poor to build their own institutions to improve their livelihoods and quality of life (health,

credit, and agricultural interventions)?

Brazil: “Productive Projects”

(Cearà, Recife, Paraiba)

- CDD: What’s the relative effect of proposal facilitation alone

/facilitation + subsidy?

How do we make irrigation sustainable and market-led?

Small-scale irrigation project in Mozambique Not a typical brick-and-mortar project.

Government is asking: How can farmers best manage their irrigation schemes? How to ensure that farmers get high returns?

Interventions of particular interest Market information; Production coordination

(horticulture +); Irrigation Organization formation

Exploit the development path of the project to test each intervention individually and inform implementation on the go (gradual scale-up)

Years 1/2

Mozambique Irrigation: Impact Evaluation Design

Project Area

Market Information 1

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Market Information 2

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Years 2/3 Years 4/5

Years 1/2

Mozambique Irrigation: Impact Evaluation Design

Project Area

Market Information 1

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Market Information 2

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Years 2/3 Years 4/5

Years 1/2

Mozambique Irrigation: Impact Evaluation Design

Project Area

Market Information 1

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Market Information 2

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Years 2/3 Years 4/5

Years 1/2

Mozambique Irrigation: Impact Evaluation Design

Project Area

Market Information 1

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Market Information 2

Coordination Intervention

Women Head of IO

Regular IO

No Coordination

Women Head of IO

Regular IO

Years 2/3 Years 4/5

Overview: What are we going to learn in FPD? (1)

Access to Finance

Cape Verde- Can a

matching grant program relieve

the financial constraints

faced by SMEs, especially

those owned by women?

Financial Literacy

Training/Skills

Development

Uganda- Can skills

development training for small scale

industries improve worker efficiency,

product quality and sales?

- Does it help firms expand from local to

regional markets?- Does it increase

women’s participation in artisanship?

Overview: What are we going to learn in FPD? (2)

Networks/ Information

South Africa- See NEXT:

detailed example…

Institutional Environmen

tSenegal-Does the

computerization of court case entry

improve the efficiency and transparency of the court decision

process?- What is the impact on firms’ perception

of the justice system, and on their

investment decisions?

Cross-country LearningShaping the policy

agenda- Study market failures

that constrain the growth potential of the private sector: access

to finance, market information,

reputation, business environment, skills

supply & demand, …- What is their relative

importance, that is, which present the

most binding constraints for SMEs?

Building a Record: Trust and Reputation for SMMEs’ Market Expansion in RSA

In South Africa, “closed” business networks impose large constraints on Small, Micro and Medium Enterprises (SMMEs) For their supply, Large Enterprises (LEs) rely on an “Old boy club”

of LEs LEs dominate LEs’ supply chain

Lack of network membership presents a barrier-to-entry for SMMEs▪ No record, no reputation, do not inspire trust >> No network entry >> No

market access

LEs could internalize the risk associated with SMMEs’ lack of reputation (price discrimination)▪ In the absence of a directory, very costly for LEs to search and screen

potential suppliers among SMMEs

Some groups are particularly disadvantaged Gender, Race, and Age-based discrimination Despite preferential procurement policies (e.g. Black Economic

Empowerment initiative)

SMEs’ Market Expansion in RSA: Interventions and Identification Strategy

The government proposes to create a virtual “marketplace” for SMMEs 1. Directory of SMMEs

▪ By size, location, sector

▪ Online and accessible through SMS queries

2. Reputation & Track Record Existing business history, relationships & Performance rating system

Reduce LEs’ search costs? Reduce LEs’ screening costs?

Improve SMMEs’ market access and customer base?

Random assignment to Directory Directory + Reputation & Track Record

Measure relative impact by gender, race and age power calculations to ensure measurability

RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)

Target Population:SMMEs in KwaZulu Natal province

Pilot Sample::3,000 SMMEs

Women-owned SMMEs1,000 SMMEs

Directory(500 SMMEs)

Directory+ Reputation & Track Record

(500 SMMEs)

Men-owned SMMEs2,000 SMMEs

Directory(1,000 SMMEs)

Directory+ Reputation & Track Record

(1,000 SMMEs)

RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)

Target Population:SMMEs in KwaZulu Natal province

Pilot Sample::3,000 SMMEs

Women-owned SMMEs1,000 SMMEs

Directory(500 SMMEs)

Directory+ Reputation & Track Record

(500 SMMEs)

Men-owned SMMEs2,000 SMMEs

Directory(1,000 SMMEs)

Directory+ Reputation & Track Record

(1,000 SMMEs)

RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)

Target Population:SMMEs in KwaZulu Natal province

Pilot Sample::3,000 SMMEs

Women-owned SMMEs1,000 SMMEs

Directory(500 SMMEs)

Directory+ Reputation & Track Record

(500 SMMEs)

Men-owned SMMEs2,000 SMMEs

Directory(1,000 SMMEs)

Directory+ Reputation & Track Record

(1,000 SMMEs)

Implications

DIME-GAP works with governments to identify their key learning priorities and support them in getting answers in real time to move their agenda forward Work to place gender a the center of the policy debate▪ Integrate gender into causal chains

▪ Think of gender-sensitive interventions

Bring best technical advice on how to measure gender-disaggregated results▪ Power calculations & Survey instruments that get to the answers

Building and disseminating rigorous evidence on the relative impact of interventions by gender Big step towards making gender equality smart economics

Coordination & Research: Contacts

Radu Ban, DIME

Elena Bardesi, PRMGE

Isabel Beltran, DIME

Rui Manuel Benfica, PRMGE

Alaka Holla, AFTPM

Florence Kondylis, DIME

Nandini Krishnan, AFTRL (AIM)

Mattea Stein, AFTRL (AIM)

Abdoulaye Sy, LCSSD

LSMS Team, DECRG

Large team of external research partners

JPAL, IPA, Yale, UC Berkeley, MIT, Harvard, UMD, etc

Local universities & research centers

Thank You

How do we make demonstration plots work?

Government of Malawi wants to promote “conservation agriculture” (pit planting)

more efficient/responsible fertilizer use

among maize farmers They are asking:

What are the effective strategies to communicate about new technologies with farmers?

How to boost technology adoption?

Malawi Technology Adoption: Impact Evaluation Design

Target population(villages)

Extension Agents

Performance-based incentives

No incentive

Lead Farmer(1/2 men,½ women)

Performance-based incentives

No incentive

Peer Farmers(1/2 men,½ women)

Performance-based incentives

No incentive

Malawi Technology Adoption: Impact Evaluation Design

Target population(villages)

Extension Agents

Performance-based incentives

No incentive

Lead Farmer(1/2 men,½ women)

Performance-based incentives

No incentive

Peer Farmers(1/2 men,½ women)

Performance-based incentives

No incentive

Malawi Technology Adoption: Impact Evaluation Design

Target population(villages)

Extension Agents

Performance-based incentives

No incentive

Lead Farmer(1/2 men,½ women)

Performance-based incentives

No incentive

Peer Farmers(1/2 men,½ women)

Performance-based incentives

No incentive