[email protected] t J OAQUIM B ERNARDO Coordenador Adjunto do Observatório do QREN Deputy Coordinator of the NSRF Observatory.

[email protected]@observatorio.ptt

JOAQUIM BERNARDOCoordenador Adjunto do Observatório do QREN

Deputy Coordinator of the NSRF Observatory

PORTUGUESE NSRF 2007-2013 - OVERVIEW PORTUGUESE NSRF 2007-2013 - OVERVIEW

2

THE INVESTMENT

21.5 M€ of EU Funds, 29.2 M€ of public expenditure and 44 M€ with private investment (current prices)

MAIN STRATEGIC PRIORITIES

Develop the skills of Portuguese - men and women;

Promote sustained growth;

Guarantee social cohesion;

Ensure the qualification of the territory and the cities;

Improve the efficiency of governance.

OPERATIONAL

PROGRAMMES

NSRF and OP Global Evaluation Plan 2007-2013

OVERALL APPROACH TO EVALUATIONOVERALL APPROACH TO EVALUATION

3

The Portuguese NSRF and OP Global Evaluation Plan (GEP) 2007-2013 is based on an approach to

evaluation that assumes the major importance of bridging

None of these issues is independent from one another, so the main goal of the GEP is to

INTEGRATE AND ARTICULATE THE EVALUATION NEEDS OF ALL NSRF AND OP INTEGRATE AND ARTICULATE THE EVALUATION NEEDS OF ALL NSRF AND OP

STAKEHOLDERS, IN A SINGLE PLAN, SO IT’S POSSIBLE TO HAVE A GENERAL STAKEHOLDERS, IN A SINGLE PLAN, SO IT’S POSSIBLE TO HAVE A GENERAL

PERSPECTIVE OF THE MAIN AREAS OF INTEREST OF THE NSRF ORGANIZATIONAL PERSPECTIVE OF THE MAIN AREAS OF INTEREST OF THE NSRF ORGANIZATIONAL

LANDSCAPE AND AVOID REPEATED EXERCISES.LANDSCAPE AND AVOID REPEATED EXERCISES.

NSRF and OP Global Evaluation Plan 2007-2013

OVERALL APPROACH TO EVALUATIONOVERALL APPROACH TO EVALUATION

4NSRF and OP Global Evaluation Plan 2007-

2013

Evaluation Network

NSRF Ministerial Coordination Committee

OP Ministerial Coordination Committees

Managing

Authorities of the

OP

NSRF Observatory

National Coordination Authorities of the ERDF, Coehesion

Fund (IFDR) and ESF (IGFSE)

Monitoring

Committees Other Stakeholders

Ministries

Coordination

OVERALL APPROACH TO EVALUATIONOVERALL APPROACH TO EVALUATION

5

The Global Evaluation Plan 2007-2013 join together a very significant number of

evaluation exercises, all of them with the same values approach:

These exercises are organized in two types of evaluation:

Strategic Evaluation

Operational Evaluation

But strategic evaluations should produce operational

consequences and vice-versaNSRF and OP Global Evaluation Plan 2007-

2013

EVALUATION SCOPEEVALUATION SCOPE

6

The Global Evaluation Plan 2007-2013 has a very large scope, including the following

topics:

Main issues covered: Qualification of the portuguese population, Sustained growth, Social cohesion, Qualification of the cities and the territory and Governance efficiency – connected with the main priorities

Funds actually spent: Structural Funds, Cohesion Fund, National Public Expenditure,

Private Investment

Time period: 2007-2013, with at least annual revision (dynamic/flexible

planning)

Geographical coverage: National, with a regional and/or transnational focus when

necessary

Target groups: Governmental institutions, Public Administration, Enterprises and their associations, Municipalities and their associations, Civil Society

organizations, citizens in general NSRF and OP Global Evaluation Plan 2007-

2013

MAIN EVALUATIONS PLANNED AND TIMINGMAIN EVALUATIONS PLANNED AND TIMING

7

Type Year Evaluation Exercises

GL

OB

AL

EV

AL

UA

TIO

NS

2009

- NSRF GLOBAL IMPLEMENTATION EVALUATION

- OPERATIONAL EVALUATION OF THE OP

- NSRF ENTERPRISE INVESTMENT INCENTIVES SCHEME OPERATIONAL EVALUATION

- OPERATIONAL EVALUATION OF TWO INSTRUMENTS OF URBAN POLICY

2010

- NSRF MACROECONOMIC IMPACT EVALUATION

- EVALUATION OF THE CONTRIBUTION OF ERDF/EAFRD TO THE ESF

INITIATIVES

- EVALUATION OF THE GENDER PERSPECTIVE INTEGRATION IN THE

STRUCTURAL FUNDS

2010-2011

- MID-TERM EVALUATION OF THE OP

- NSRF MID-TERM EVALUATION

2012 - NSRF GLOBAL EVALUATION

NSRF and OP Global Evaluation Plan 2007-2013

MAIN EVALUATIONS PLANNED AND TIMINGMAIN EVALUATIONS PLANNED AND TIMING

8

Type Year Evaluation Exercises

TH

EM

AT

IC/S

PE

CF

IC E

VA

LU

AT

ION

S

2009

- BASIC AND SECONDARY EDUCATION REFORMS

- COST- BENEFIT ANALYSIS OF THE ERDF AND COHESION FUND PROJECTS - INFORMATION DIFFUSION EVALUATION (ERDF AND COHESION FUND)

- ADEQUABILITY EVALUATION BETWEEN THE NATIONAL REGULATIONS AND THE ESF INTERVENTION GOALS

- EVALUATION OF THE SPECIFIC REGULATIONS ELABORATION MODEL (ERDF AN COHESION FUND)

2010

- BASIC AND SECONDARY EDUCATION REFORMS

- ADEQUABILITY EVALUATION BETWEEN THE NATIONAL REGULATIONS AND THE ESF INTERVENTION GOALS

- QUALITY INFORMATION EVALUATION (PHYSICAL AND FINANCIAL) - ERDF AND COHESION FUND INFORMATION SYSTEMS

2011 - QUALIFICATION AND EMPLOYABILITY

- SOCIAL AND PROFESSIONAL INTEGRATION OF IMMIGRANTS

NSRF and OP Global Evaluation Plan 2007-2013

MAIN EVALUATIONS PLANNED AND TIMINGMAIN EVALUATIONS PLANNED AND TIMING

9NSRF and OP Global Evaluation Plan 2007-

2013

Major stages and objectives/aims of the on-going evaluations planned in the GEP:

Operational evaluation stage (mainly 2009) - improve the strategic and operational

management of the OP (information diffusion, selection criteria, monitoring, regulations, etc.) and/or

of specific thematic areas of the NSRF.

Focalized strategic evaluations stage (2009-2010) – global view of the NSRF

implementation and macro-economic impacts, namely in order to contribute to the

portuguese report containing information on the contribution of the OP to the cohesion policy.

Mid term evaluations stage (2010 and mainly 2011) – global view of the performance of

the OP and NSRF (intermediate results and impacts), in order to examine and, if necessary,

review them (article 33.º of the regulation (CE) n.º 1083/2006).

Global strategic evaluation stage (2012...) – general evaluations of the performance of

the NSRF, manly to support the preparation of the next cycle of structural policies in Portugal.

MONITORING AND EVALUATIONMONITORING AND EVALUATION

10NSRF and OP Global Evaluation Plan 2007-2013

OperationalOperational StrategicStrategic

Selection Process

Financial Execution

Outputs

Co

nte

xt/E

nv

iro

nm

ent Impact

Analysis

Operation

Applyment

Outcomes (results) Effects

GlobalEvaluation

Plan

NSRF NSRF (2007-(2007-2013)2013)

ProgrammaProgrammationtion

PROJECT LIFECYCLE

USE OF EVALUATION RESULTSUSE OF EVALUATION RESULTS

11

Based on a learning and improvement approach, the evaluation results will

be used mainly to:

1.Analyse the impacts of the structural funds and the cohesion fund;

2.Determine whether any adjustments are necessary to improve

programme effectiveness in:

Programme strategy;

Results and resources framework;

Regulamentary framework;

Activities…

3.Increase awareness and accountability on achievements;

4.Contribute to ex-post evaluations with valid information.

NSRF and OP Global Evaluation Plan 2007-2013

IMPLEMENTATION AND METAEVALUATIONIMPLEMENTATION AND METAEVALUATION

12

Main concerns:

Launch and follow-up the evaluation exercises (one monitoring team for each

exercise, including a representative of the NSRF Observatory);

Contribute to the development of the evaluation market and methodologies

Plan a metaevaluation. We believe that the evaluation itself should be

formatively and summatively evaluated against its own goals, objectives,

principals and standards of utility, feasibility, property and accuracy, so that its

conduct is appropriately guided and stakeholders can closely examine its

strengths and weaknesses.

NSRF and OP Global Evaluation Plan 2007-2013

[email protected]@observatorio.pt

Thank you for your kind attention

(For more information of the Portuguese NSRF www.qren.pt)