Global Rice Science Partnership (GRiSP) monitoring and evaluation system for results based management: Progress and future plans

Slide 1

Hope Webber Senior Scientist Monitoring and Evaluation Specialist

IRRI Seminar, 30-April-2015Global Rice Science Partnership (GRiSP)GRiSP M&E:Progress and Future Plans1OverviewTargets of GRiSPObjectives of the M&E StrategyTracking Intermediate Development Outcomes (IDOs): - Action Sites level: Area based household survey - National level - GlobalTracking OutputsTracking Performance of key milestonesData Collection Strategy for milestones and outputsManagement Information SystemFuture Plans

Potential Impacts by 2020Increase of global rice production with 85 million tones paddy over 2010 values.

40 million undernourished people reach caloric sufficiency in Asia, reducing hunger in the region by 7%

Reduce expenditures on rice: 72 million people lifted above the $1.25 poverty line.

Water, nitrogen, and labor efficiencies in rice systems improved on a wide scale, saving 7 billion cubic meters of irrigation water annually

Train a new generation of 1000 rice professionals (50/50% graduate/postgraduate), at least 30% of them women.

Objectives of the M&E StrategyTo develop methods and tools for collecting data to

routinely monitor (track) the performance of GRiSP milestones (indicators), outputs (products) and

periodically evaluate intermediate development outcomes (IDOs) and impact.

Research Activities Research OutputsIntermediateDevelopment Outcomes ImpactScientific discoveries (genes, QTLs etc.)Product development (varieties, mgt practices, etc.)Product adoption by intermediate user (NARES)Product adoption by end user (farmer)Large scaleGRiSP Results framework34 quantitative indicators determined by the CGIAR.Milestones set by GRiSP (internal use)5Intermediate development outcomes (IDO)IDOIndicator1. Increased rice production that meets local and global demandGlobal: production, consumption, and import/export volumes; rice area; average yield; International rice price. National: production, consumption, and import/export volumes; rice area; yield; yield gap; domestic rice price. Action site: yield; yield gap; adoption rates of improved rice varieties and practices to close yield gap; adoption rates of practices and machinery to reduce postproduction losses 2. Increased profitability for rice producers and increased rice affordability for consumersGlobal: rice price; economic producer and consumer surplus (modeled)National: rice price; economic producer and consumer surplus (modeled)Action sites: cost of production; local rice price; farmer profitability; adoption rates of improved rice varieties, production and postproduction practices3. Increased efficiency and value added along the rice value chain Global: rate of mechanization along the rice value chain; cropping intensity in irrigated areasNational: price of locally produced rice versus imported rice; rate of mechanization along the rice value chain; cropping intensity in irrigated areasAction sites: increased resource-use efficiencies during production at farm level; improved postproduction efficiencies that reduce losses and add value at harvest, drying, milling, processing, and storage for value-chain actors; adoption rates of new rice varieties with enhanced value (aroma, improved appearance, reduced chalkiness, appreciated texture, etc.); adoption rates of improved production and postproduction practices; # of successful contractual arrangements along a rice value chain 4. Increased sustainability and reduced environmental footprint of rice production Global: through WLE collaborationNational: through WLE collaborationAction sites: increased resource-use efficiencies during production at farm level; reduced emission of greenhouse gases, pesticide residues, water and air pollution; adoption rates of improved practices Intermediate development outcomes (IDO) (contd.)IDOIndicator5. Increased health and nutrition from rice and from diversificationGlobal: through A4HN collaboration (will, among others, include measure of Disability Adjusted Life Years (DALYs) lost from micronutrient deficiency)National: through A4HN as above; indicators to track delivery/use of products: # of GRiSP varieties released with increased nutritional content (provitamin A, Zn, Fe) and with reduced glycemic indexAction sites: to be decided (include crop diversification)6. Increased capacity and resilience in the rice sector Global: capacity built (# of scholars, # of trained advisors); # of technologies with explicit gender focusNational: # of GRiSP stress-tolerant varieties released; # of approved technologies; strengthened advisory systems (# of trained extension agents); # of policy briefs used to guide investmentsAction sites: # of seed systems/producing groups, farmer groups, learning alliances, contractual arrangements along value chains; youth employment; # of machinery fabricated locally; # of videos, radio scripts, local extension materials7. Gender equity empowerment Indicator 1: Womens control over resources. Mens and womens control over selected key agricultural resources: land, livestock water, forests, common property, seeds, fertilizers, machinery, financial assets and the income from sales of crop, livestock or forest products.Indicator 2: Womens Participation in Decision Making.Decisions over own labor Decisions over own income Decisions made in groups or collective organizationTracking Development outcome indicators

Global Level: World Rice Statistics

At national levelStatistics (national, international), GIS+RS+modelling

At Key Action Sites (Hubs):Regular household surveys (proxy for biophysical indicators)Use of common protocols, CAPIs, data management systems

Underpinned by biophysical data from research Complemented by specific indicators collected at other action sites8Action Sites in Asia: Area Based Household Survey

Map Detailed Map of Survey Area

Objectives of the SurveyTo collect quantitative data from small holder rice farm households in South and South East Asia for the purpose of monitoring progress towards GRiSP intermediate development outcomes (IDOs).

To provide insight into adoption, constraints to adoption, technology targeting, evaluation, and impact assessment.

Sampling of respondents and CriteriaPurposive sampling of regions/states, province/districtsSystematic random selection of blocks/villages and householdsSampling CriteriaAction sites of IRRI Flagship projects: e.g. STRASA, CSISA, CORIGAP, CURE, LIFT, etcExtent of Rice AreaEcosystems: (fresh water, saline water, flood prone, drought prone areas), Irrigated, Rain-fed, Irrigated/Rain-fed.Rice Farm Household

GRiSP IDOsIndicators/others1Survey ProcedureReporting on IDO IndicatorsData Analysis inIRRIData QualityCheck & Cleaning in IRRI HQQuestionnaire(Surveybe)/Sampling methodPretest inCountriesTraining ofTrainers/EnumeratorsSampling/HouseholdInterviews inCountries2345Data qualitycheck andcleaning inCountries6designvalidatemodify789Preliminary ResultsTop Three Varieties Used in Dry SeasonCountryVariety%Total nBangladeshBRRI DHAN 28762460BRRI DHAN 2943BRRI 2811India101013591IR361Swarna0MyanmarThee Htet Yin402000Thee Htat Yin34Malarhmwe12PhilippinesRc 22248793SL 811Rc 2168IR 50404322007VietnamOM 545115OM 421811Top Three Varieties Used in Wet SeasonCountryVariety%Total nBangladeshGuti Sorna212460BRRI DHAN 4916BR 2214IndiaSwarna183591Pooja610104MyanmarHnan Kar212000Sin Thu Kha10Pawsan4PhilippinesRc 22241793SL 818Rc 21618To be collectedVietnamReasons for adoption of rice varieties

Sources of information for adoption of rice varieties

Adoption of post harvest technologies

Lessons LearnedCAPI can be used for long questions (Bangladesh)Combined use of paper and computer (Vietnam)Many rice varieties with local names (all countries)Unit of measurement: Not always very specific (India)Assets: Becoming sensitive (India)Women enumerators were active in data collection. 90% of the enumerators were women (Myanmar)Some villages are very remote to travel/no electricity/no accommodation (Bangladesh, Myanmar)Difficulty in charging batteries to power the tablets (All)

Lesson Learned (Vietnam)

Combined use of paper and computerFarmers Name: Tran Van Chin (HH ID: 11555)Commune: Tan LapDistrict : Tan ThanhProvince : Long An

Bangladesh

INDIA

Respondents - Philippines

Myanmar

National Rice Development and R&D Strategies (NRDS) in Asia

Nine country reports and presentations in a workshop in Malaysia (May-2014)Workshop in Hyderabad 03-Dec-2014Group discussion on:relevance of GRiSP development outcomes to CountriesCommonalities among country strategiesQuantitative targets with a timeline for the development outcomes Logical link between rice sector development goals and research objectivesImpact pathways (from research to product development to development outcomes)

26CORRA Asia Data on NRDS

27CARD Africa Data on NRDS

28GRiSP MIS(IRRI HQ)Donor/Other Stakeholders Strategy for collection of Milestones and outputs dataIRRI: Milestones, Outputs GRiSPDirector Themes/ project leaders & scientistsAfricaRice: Milestones, OutputsCIAT: Milestones, OutputsPartners: Milestones, OutputsTracking performance of outputs (products)2015IndicatorTargetActual1. Number of flagship products produced by CRP 2. % of flagship products produced that have explicit target of women farmers/NRM managers3. % of flagship products produced that have been assessed for likely gender-disaggregated impact 4. Number of tools produced by CRP5. % of tools that have an explicit target of women farmers6. % of tools assessed for likely gender-disaggregated impact 7. Number of open access databases maintained by CRP8. Total number of users of these open access databases9. Number of publications in ISI journals produced by CRP10. Number of strategic value chains analyzed by CRP13. Number of trainees in short-term programs facilitated by CRP (males)14. Number of trainees in short-term programs facilitated by CRP (females)Tracking performance of outputs (products)2015IndicatorTargetActual15. Number of trainees in long-term programs facilitated by CRP (males)16.Number of trainees in long-term programs facilitated by CRP (females)18. Number of technologies/NRM practices under research in the CRP (Phase I)19. % of technologies under research that have an explicit target of women farmers20. % of technologies under research that have been assessed for likely gender-disaggregated impact 23. Number of technologies/NRM practices field tested (Phase II)27.Number of technologies/NRM practices released by public and private sector partners globally (Phase III) 28. Number of policies/regulations/administrative procedures analyzed (Stage 1)33. Number of hectares under improved technologies or management practices 34. Number of farmers and others who have applied new technologies or management practices Current Score Card Red : Not achieved

Yellow : Partially achieved

Green : Fully achieved

Tracking Performance of Key Milestones32Proposed Score Card Red : 0% Not achieved

Yellow : 1-50% Partially achieved

Green : 51-100% Fully achieved

Blue : More than 100% Exceed expectation

Tracking Performance of Key Milestones333. Management Information System for GRiSP M&EA results based management tool for managing IRRI R&D data and reporting on GRiSP intermediate development outcomes (IDO) indicators

Relational database (MySQL, PhP) Web-based

Entities of the MISThemesProduct lineProductsMilestonesBudget,ScientistsPlanning (proposals)Reports (Semi annual, Annual)

Development IndicatorsMonitoring DataMonitoring ReportsEvaluation DataEvaluation ReportsDocumentsGeo-ReferenceProject Indicators

Main elements: Tables, attributes, and relations: 1 to 1, 1 to many, many to many.http://ricestat.irri.org/mistig/index.phpGRiSP M&E Website

36Future PlansMIS database connectivity with AfricaRice, CIAT and partners

Implementation of the MIS: data collection, analysis and reporting

Analysis and reporting on Area based household survey

STRASA M&E

Cross CRP M&E (GRiSP, MAIZE, WHEAT, DRYLAND CEREALS, GRAIN LEGUMES)

MISTIG TeamHope Webber - MyanmarAlice Laborte - PhilippinesValerien Pede - VietnamTri Setyono - VietnamArindam Samddar - IndiaHumnath Bhandari - Bangladesh

M&E /RDM Team

Thank You40