HOW TO EVALUATE A MOBILITY PROJECT Training Unit 11.1 Procedures, tools and roles for the evaluation of a mobility project.

HOW TO EVALUATE A MOBILITY PROJECT

Training Unit 11.1

Procedures, tools and roles for the evaluation of a mobility project.

How to evaluate a mobility project

The evaluation work

It is one process which accompanies another process (for example, the implementation of a plan).

It is also a system which is progressively constructed, with its activities being carried out.

The evaluation is inserted into a decision making cycle which accompanies and supports the running of the project and which can without any doubt be considered an important

learning tool.


The aims of the evaluation can be different:

functional control; quality appreciation; measurement of the effectiveness of the actions

implemented; evaluation of efficiency in the use of resources.

Such aims should be made clear before the start of the project and the whole organisation of the evaluation is

structured accordingly.


It is advisable:

That from the outset the evaluation and monitoring activities proceed in strict alignment with each other as the first feed on

the information that comes from the second ones

where monitoring checks that the managerial and operational decisions taken from the evaluation have the expected outcome.

The integration between the two activities can be done through the formulation of a quality assurance plan which includes both and which for both of them identifies an analytical design and

the operating modes.


The planning of the evaluation process.(Some typical stages always exist, irrespective of rules; in

particular):

Definition of the task; key aspects of the evaluation process are identified, such as the role and interests of the customer, the other subjects involved (beneficiaries, partners, employees,..); and finally the macro evaluation objective (control, negotiation, reporting,..).

Analysis of objectives and formulation of questions for the evaluation; this stage serves to make clear why we evaluate and to define what is important to evaluate.

Assessment of resources; this step is essential to understand what it is actually possible to do.


Specification of methodology, tools, timing, output; on the basis of available resources and the clarity of the task, the methods to be used are identified, the tools and the timings and the products of the evaluation (reports, seminars,.).

Implementation of evaluation analysis; this stage is the very operational transition. In it the selected methodologies are applied, data and information are gathered and are elaborated on to make them usable.

Use of the results of the evaluation; the final component serves to provide the system of reference with the results of the evaluation.


How to evaluate a transnational mobility project

The main specificity of a mobility project is to always have a dual subject to be considered:

on the one hand, the attainment of the general objectives of the intervention;

on the other hand, the achievement of the learning objectives of the beneficiaries in mobility.


The different stages are:

the evaluation of the project, in its organisational, managerial and relational aspects;

the evaluation of the mobility experience (vocational internship or exchange) with regard to the acquired learning and the impact to be seen at the end of the project.

Evaluation activities, like monitoring, must be able to measure the results achieved.


Project Evaluation

Other examples of indicators are:

the level of interest generated by the project;

the rate of implementation of the mobility experiences abroad;

the degree of involvement of partners;

the level of compliance with the expected timing and the execution of the work programme.


Evaluation of the mobility experience

A non-exhaustive list of indicators for the evaluation of the experience abroad includes:

the satisfaction of the participants; the relevance of the work experience completed and the

training stages achieved in respect of the needs analysis; the consistency of the training stages followed during the

vocational training with the participant’s curriculum; the effectiveness of the tutoring work; the acquisition of new skills on the part of the

beneficiaries.


Some evaluation tools The availability of pre-arranged tools is practically unlimited: questionnaires, format, charts, interview

drafts are easily available on the Internet or through the use of materials produced for other

experiences.

Nevertheless:

it is appropriate that whoever is responsible for the evaluation within the projects pre-arranges ex novo tools

which take account of the specific elements of transnational mobility as well as of the characteristics of the beneficiaries.


The most common tool, as already mentioned, is the questionnaire.

Three examples:

The questionnaire edited by the sending organisation.

The questionnaire filled in by the participant.

The questionnaire edited by the host organisation and businesses.

It is appropriate that the host organisations supply the coordinating body with a final report on the work carried out,

together with an evaluation report for each participant.


Content:

The characteristics of an evaluation process: components of the evaluation plan.

Aims and timing steps of evaluation. Planning of the constituent elements of the

evaluation plan. The distinctive features of the mobility

evaluation. The features of some evaluation tools and the

roles involved in their use.

HOW TO EVALUATE A MOBILITY PROJECT Training Unit 11.1 Procedures, tools and roles for the evaluation of a mobility project.

Documents

mobility project evaluation

evaluation tools

transnational mobility

evaluation process

evaluation work

evaluation activities

evaluation of efficiency

evaluation reports