ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1 2nd Results- Based M&E Workshop Overview in Institutionalizing M&E System in Cambodia By Rebecca V Polestico, PhD 19-20 May 2011 2 nd Results-Based M&E Workshop Salon II Raffles Le Royal Hotel Phnom Penh, Cambodia 06/23/22 Institutionalizing M&E System in Cambodia 1
2nd Results- Based M&E Workshop. Overview in Institutionalizing M&E System in Cambodia By Rebecca V Polestico, PhD 19-20 May 2011 2 nd Results-Based M&E Workshop Salon II Raffles Le Royal Hotel Phnom Penh, Cambodia. 2nd Results- Based M&E Workshop. Discussion Points Objectives - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2nd Results- Based M&E Workshop
Overview in Institutionalizing
M&E System in Cambodia By
Rebecca V Polestico, PhD 19-20 May 2011
2nd Results-Based M&E WorkshopSalon II Raffles Le Royal Hotel
Phnom Penh, Cambodia
04/19/23 Institutionalizing M&E System in Cambodia 1
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2nd Results- Based M&E Workshop Discussion Points Objectives Principles of Monitoring and Evaluation -Results-Chain Roles of Monitoring and Evaluation Monitoring and Evaluation System
Description Attributes
Public Sector Management Components Attributes Results-Based
Assessing Capacity Development Skills
04/19/23 Institutionalizing M&E System in Cambodia 2
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2nd Results- Based M&E Workshop
Objective (s) To differentiate Monitoring from EvaluationTo examine the generic components, features and functions of M&E SystemTo identify the capacity skills needed in developing M&E SystemTo adopt the processes in institutionalizing M&E System in RDMs
04/19/23 Institutionalizing M&E System in Cambodia 3
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Definitions
• Monitoring is the continuous assessment of project implementation vis-à-vis schedules and of the use of inputs and services by beneficiaries– Provides managers and
stakeholders with continuous feedback on implementation
– Identifies actual or potential successes and problems early to facilitate timely adjustments
• Evaluation is the periodic assessment of a project’s relevance, performance, efficiency and impact– Managers undertake interim
evaluations during implementation as a review of progress and a prognosis of likely effects.
– Necessary adjustments to project design may be identified. Mid-terms reviews have become popular for the same reason
– Terminal evaluations are conducted at the end and include an assessment of a project’s effects and their potential sustainability
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2nd Results- Based M&E Workshop
04/19/23 Institutionalizing M&E System in Cambodia 5
Monitoring
Reports progress to managers and alerts them to problems
Routinely collects data on these indicators, compares actual results with targets
Translates objectives into performance indicators and set targets
Links activities and their resources to objectives
Clarifies programme objectives
Provides lessons, highlights significant accomplishment or program potential, and offers recommendations for improvement
Explores unintended results
Examines implementation process
Assesses specific causal contributions of activities to results
Analyses why intended results were or were not achieved
Evaluation
Complementary Roles of Results-Based Monitoring and Evaluation
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2nd Results- Based M&E Workshop
04/19/23 Institutionalizing M&E System in Cambodia 6
Monitoring
Analysis and reporting specified
Data Management Systems specified (Data encoding, programming, processing and reporting)
Institutional responsibilities defined
Indicators from planning
Stakeholders engagement
Results dessiminated or shared
Institutional responsibilities defined
Methodology formulated or designed
Evaluation
With reference to APCOP MfDR Framework Attributes of Results-Based Monitoring and Evaluation
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
A paper or computer-based tracking mechanism which is indicator-driven, outcome-led and impact-based derived from developed results of any specified intervention strategy, capturing changes contributing to the effectiveness and efficiency of any program development initiatives and setting.
M&E System Defined
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
M&E System: Description
• Consists of eight components with stakeholders involvement and beneficiary-centred
• Focused on the planning, management, budgeting and resources availability within a timeframe
• It’s the process of getting the results developed (RBM) and managing for developed results (MfDR)
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 199 04/19/23 9Institutionalizing M&E System in Cambodia
1.Review of Project Goals and Objectives
2. Clear statements of measurable project performance objectives for which indicators can be defined
3. Structured set of indicators, covering outputs and their impacts on beneficiaries using the Results-Based Management Logframe
4. Consensus development of evaluation tools for structured and non-structured data gathering techniques
5. Provisions of collecting data and managing project records so that data required for indicators are compatible with existing statistics and available at reasonable cost
6. Reporting and Feedbacking on the data quality assessment, validation and process checks
7. Institutional arrangements on the Formative and or Summative Evaluation (Interim)
8. Information Exchange on the M&E findings for feed back into decision making
Eight Components of M&E System Design
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
2.
Indicators
Or Perfo
rmance
Measures
1. Project Goals, Purposes, Objectives, and Specific Objectives
3. Results-Based Management Logframe
8. Information
Sharing and
Exchange or
Feedback Mechanism
Results
4. Development of tools
and forms
5. Data Management : Data Collection, Encoding and Programming Information Processing and Analysis
7. Interim Evaluation:Formative or Summative
6.In
stitu
tional
Arrangem
ent
M&E System and Capacity Building Framework
M&E System
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Level of Results
1111
MfDR in Rural Development Workshop MfDR in Rural Development Workshop 6/7 December 20106/7 December 2010
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/19/23 Institutionalizing M&E System in Cambodia 12
Cambodia Millennium Development Goal (MDG)
To reduce poverty……
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 11313 04/19/23 13Institutionalizing M&E System in Cambodia
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 114
Brief Look at the Rectangular Strategy
SDPFrameworkProgramsProjectsActivities
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Government Documents
1515 04/19/23 15Institutionalizing M&E System in Cambodia
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
KEY INDICATORS Unit2008Actual
2009 Estimated
2010Projected
2011Projected
2012Projected
2013Projected
Land under crops (cash and industrial crops)
000 Ha 596 645 774 930 1000 1000
Rice: cultivated area million Ha 2.61 2.63 2.65 2.65 2.65 2.65
Production of cattle Million heads 4.20 4.29 4.32 4.38 4.44 4.50
Cultivated area of rubber000 Ha 111.4 128.4 143.4 158.4 173.4 188.4
Yield per hectaretons 0.95 1.10 1.10 1.15 1.20 1.30
Rubber production 000 tons 26.6 38.5 49.5 63.3 78.0 97.5
Fishing Lots Sq. Kms 415 415 415 415 415 415
-Released to Fishery Community % 56.4 56.4 56.4 56.4 56.4 56.4
Fish: Production tons 471 515 617 668 726 788
cover -- % of land area % 59.00 57.59 57.99 58.39 58.79 59.19
Reforested 000 Ha 10.81 18.92 73 73 73 73
Forest Boundary Demarcation km 321 228 413 500 500 500
Forestry Community No. 124 210 300 350 400 450
NSDP: Key Indicators for Agriculture, Fisheries, and Forestry
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
MAFF M&E System and Indicators
MAFF has 5 programs Enhancement of Agricultural Productivity and Diversification Enhancement of Market access for Agricultural Production Strengthen Institutions, Legal, HRD Sustainable Fisheries Resource Management Sustainable Fisheries Resource Management
Each program is broken down into sub-programs – e.g for P1, S1 = soil improvement, S2 = increasing crop production, etc.
Each sub-program broken down into activities – e.g. for S1, A1 = dissemination of compost fertiliser; A2 = crop zoning in communes.
1717
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Questions: Indicator linked to planning?Resource allocated?Implemented? By who?Systems used to track results Established ? Evaluated? Feedback mechanism?
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Core Attribute 1: What to consider
2323 04/19/23 23Institutionalizing M&E System in Cambodia
S/N M&E Core Attribute 1: Indicator Identification, Mapping and Tracking
1 Indicators linked to planning
2 Identified a focal point responsible for collecting the information
3 Defined the indicators using SMART
4 Categorized the indicators as Input, Output, Outcome, or Impact
5 Allocated resources to the activities in achieving the indicator(s)
6 Followed up planned implementation of activities
7 Used customized forms and or tools in tracking the progress of the indicators
8 Reviewed the indicator progress regularly
9 Reported the status of the indicator to the
10 Cascaded the indicators from National or sectors to provinces, districts or agencies
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Core Attribute 2: What to consider in keeping relevant information?
2424 04/19/23 24Institutionalizing M&E System in Cambodia
S/N M&E Core Attribute 2: Tools and Forms
1 Information provided what the indicators needed
2 Developed tools and forms using proper constructs
3 If new- Pilot-tested the tools prior to formal use; or if recurrent- has it been standardized
4 Used generic forms e.g survey questionnaire, checklist, interview format, mission forms, Monthly / quarterly or Annual Forms
5 Duplicated forms and tools
6 Reviewed forms and tools
7 Updated the forms and tools
Others
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Data Collection Methods
Conversationwith concernedindividuals
Community Interviews
Informal/Less Structured Methods
Fieldvisits
Reviews of official records (MIS and admin data)
Participant Observation
Key informantinterviews
FocusGroupInterviews
One-Time Survey
Questionnaires
PanelSurveys
Fieldexperiments
Census
More Structured/Formal Methods
Direct observation
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Core Attribute 3: What to consider in managing information?
2626 04/19/23 26Institutionalizing M&E System in Cambodia
S/N M&E Attribute 3: Database Management
1 Identified a focal point responsible for managing the information
Budgets have medium term horizon linked to planning
Service delivery standards established
Data Processing Methodology specified
Dissemination Methodology formulated
Planning targets aligned to available budgets
Tracking and reporting methodology for budget execution established
Analysis and Reporting Methodology Specified
Stakeholder engagement defined
Core Results Attributes: RDMs
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Country Setting Results-Based Management
PLAN FOR RESULTS• President’s Guidepost (16 areas
for transformative leadership)• PDP• RM• PIP BUDGET FOR RESULTS
• MTEF• OPIF• GAA-NEP• ABM• ICC Programming- only FAPs
consistent with plan are approved
IMPLEMENT FOR RESULTS
• Agency PAPs• ICC Reevaluation
MONITOR RESULTS• ODA Review• BPAR• RM/ OPIF Monitoring• OPES• COA Audit Reports
EVALUATE RESULTS
• SER• MDG Reports ResultsResults
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 13232 04/19/23 32Institutionalizing M&E System in Cambodia
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Results-Based M&E has two handles:
One of Fear and the other is Opportunity
04/19/23 33Institutionalizing M&E System in Cambodia