Top Banner
ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 1 1 “Knowledge exchange is knowledge creation” Summary of the ECEtt-Pilot report 1 INTRODUCTION (by G van der Straten) Part 1 : The journeymen apprenticeship method transferred to training for social workers By Georges van der Straten, Trempoline, Belgium Pyramide de mémorisation Introduction 1. The training method 1.1 Phases in the trade (image: Phases of the trades) 1.2 A self training device with three main protagonists: 1.2.1 Network of institutions (diagram: the ECEtt network) 1.2.2 Knowledge exchange concept (image: bottom-up & top-down) a) “A” visits (“A” visits”) b) “B” traineeships (“B” traineeships) c) “C” and “D” traineeships (“C” traineeships + “D” courses) 1.2.3 The trainees as main actors 1.3 Learning process 1.4 Designing one’s training courses with the helpdesks. (im: “tools to travel” + “9 steps for A,B,C”) 1.5 Training objectives 2. Evaluation of competencies 2.1 Competencies and meta-competencies 2.2 The gathering of evaluations on the e-learning platform (im: evaluation and follow-up) 2.3 Final validation of meta-competencies by the panel 2.4 Validation of good practices 2.5 Certification of “C” skills needed for a “D” course 2.6 Feed-back to the employers and to the training organizer Bibliography Part 2: The project progress (by Alban van der Straten) 1. Initial context 2. 2. Adequacy of our objectives with those of EU 3. An original pedagogy 4. Hierarchy of the objectives and the products 5. Reactivity and participation of the partners 6. Paperwork 7. Communication and language issues 8. Crises amongst partners 9. Coaching of the networking 10. Evaluation 11. Good practices 12. Uniting the various layers of the project Part 3: The e-learning community within ECEtt project 1 Full report in French can be requested at [email protected]
15

ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

Aug 16, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 1

1

“Knowledge exchange is knowledge creation”

Summary of the ECEtt-Pilot report1

INTRODUCTION (by G van der Straten)

Part 1 : The journeymen apprenticeship method transferred to training for social workers

By Georges van der Straten, Trempoline, Belgium

Pyramide de mémorisation

Introduction

1. The training method

1.1 Phases in the trade (image: Phases of the trades)

1.2 A self training device with three main protagonists:

1.2.1 Network of institutions (diagram: the ECEtt network)

1.2.2 Knowledge exchange concept (image: bottom-up & top-down)

a) “A” visits (“A” visits”)

b) “B” traineeships (“B” traineeships)

c) “C” and “D” traineeships (“C” traineeships + “D” courses)

1.2.3 The trainees as main actors

1.3 Learning process

1.4 Designing one’s training courses with the helpdesks. (im: “tools to travel” + “9 steps for A,B,C”)

1.5 Training objectives

2. Evaluation of competencies

2.1 Competencies and meta-competencies

2.2 The gathering of evaluations on the e-learning platform (im: evaluation and follow-up)

2.3 Final validation of meta-competencies by the panel

2.4 Validation of good practices

2.5 Certification of “C” skills needed for a “D” course

2.6 Feed-back to the employers and to the training organizer

Bibliography

Part 2: The project progress (by Alban van der Straten)

1. Initial context

2. 2. Adequacy of our objectives with those of EU

3. An original pedagogy

4. Hierarchy of the objectives and the products

5. Reactivity and participation of the partners

6. Paperwork

7. Communication and language issues

8. Crises amongst partners

9. Coaching of the networking

10. Evaluation

11. Good practices

12. Uniting the various layers of the project

Part 3: The e-learning community within ECEtt project

1 Full report in French can be requested at [email protected]

Page 2: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 2

2

(by Andrea Ascari, CeIS-Formazione, Italy)

Abstract

1. Introduction

2. Write or talk

3. Our final target group

4. Miltiple use of the e-learning system

5. Questionnaires

6. An on-line archive of the project

7. Database

8. Agenda

9. Training

10. Support to trainees

11. Descroption of the SC area

12. Description of the trainee’s area

13. Facts

14. Technical data

15. Perspectives

Part 4. Dissemination plan (by José Antonio Jimenez, Proyecto Hombre, Spain)

1. Introduction

2. Dissemination

2.1 First objective (table 1)

2.2 Second objective

2.3 Third objective

Conclusion

Part 5. Evaluation by University of Ghent (by Ilse Goethals)

Introduction

1. Preparation phase

1.1 development of pre-selection criteria

1.2 analysis of the application forms

1.3 assessment of the final training objectives

2. Evaluation method and results

2.1 Method

2.2 Results

2.2.1 Evaluation of the training method by the trainees

2.2.2 Evaluation of the training method by the hosts

2.2.3 Evaluation of the training method by the employers

2.2.4 Final evaluation of the exchange by the C trainees

3. Good practices and implementation project of C trainees

3.1 Good practices

3.2 Implementation project

4. Conclusions and recommandations

Conclusions

Page 3: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3

3

General introduction

This report is the synthesis of a teaching experiment carried out, between 2006 and 2008, by a European network of ten institutions within the “Leonardo da Vinci Pilot” framework. Certain partners are the authors of chapters corresponding to their particular contribution. The goal of this work is to draw attention to the main principles of the journeyman apprenticeship (“compagnonnage” in French, which literally means “companionship”), as applied by ECEtt to the education sector. A detailed report (in French) contains more information about the journeyman tradition and the genesis of the ECEtt network as well as technical details relating to the training process, its financing and the prospects for its practical application. Readers who wish to do so can obtain this more detailed account of the “compagnonnage” process transferred to the professional sectors of education from ECEtt ([email protected]).

Part 1. The journeyman apprenticeship method transferred

to training for social workers

by Georges van der Straten, General Manager of Trempoline NGO

“Memory retention pyramid according to Martin & Savary (1998) I listen: I remember 20% I listen and I see: I remember 50% I listen, I see and I express myself: I remember 70% I listen, I see, I express myself and I act: I remember 90% “

INTRODUCTION

ECEtt-Pilot is an initiative of Trempoline NGO[1] relating to the transfer of the journeyman apprenticeship method to the training of social workers. The ECEtt project began in 2003, initially on a self-funded basis, and went through several phases of development, the last of which was within the Leonardo da Vinci “Pilot” programme 2006-2008[1]. In accordance with this programme, the ECEtt-Pilot project aims to:

o improve quality in training for professionals. o stimulate a culture for developing skills throughout people’s professional life. o increase the capacity of individuals to adapt to organizational and technological changes.

The Leonardo da Vinci “Pilot” programme finances strictly experimental training projects with a view to testing new training methods. Such projects thus involve designing, developing, experimenting with, evaluating and disseminating innovative practices as regards methods, contents, media or products of vocational training. The objective of ECEtt-Pilot is thus to describe and test an innovative method which stimulates training quality as well as the integration of new technologies of communication.

The roots of this project are in the particular context of “therapeutic communities” (TCs) for addicted persons. Thirty years after their birth as original and marginal experiments intended for a small number of drug addicts, the European TCs are confronted with a big challenge: to consolidate their identity and the evidence of their added value or to disappear or see their specific identity being “dissolved” in the medico-psychiatric system. This would threaten their originality which relates to three pillars: a global or

Page 4: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 4

4

holistic approach, the dynamic of the self-help groups and a strong belief in the capacity of the drug addicts to learn life skills and to re-socialize without using drugs. The TCs are thus obliged to adapt and to show their excellence and their added value if they want to survive and preserve their identity. ECEtt is a training project which aims to offer a response to these challenges, not only for the TC world but to all professionals in social education.

1. The training method

In 2001, during a collaboration between the prevention service of Trempoline and the movement of the

“Compagnons du Devoir”2, the initiator of the ECEtt project discovered the principles of the journeyman

apprenticeship method and considered this model as an answer to the professional challenges of TCs. In

2003-2004, he carried out a feasibility study on the transferability of the journeyman model to the training

of professionals working in TCs.

Since 2005, ECEtt has organized numerous training courses and knowledge exchanges based on the model

of the trade-guild. The two main characteristics of such an apprenticeship are: (1) all courses are

personalized; (2) the role of training protagonist is allotted to the trainee rather than to the trainer.

1.1 Phases in a trades

The treatment of substance abusers as conceived by the therapeutic communities does not concern only one

profession but multi-disciplinary teams where staff members, psychologists, social workers, doctors,

lawyers, etc. are in interaction. These multi-specialized teams form a new profession, a young trade, which

has its objectives, its framework, its codes and a certain type of problem-situation to be solved. This trade

starts, like all others, with a phase of “exploration”, then proceeds via “experimentation” and leads finally

to “expertise”.

(introd image: Phases of the trades)

The method of training must be selected according to these phases.

1) Bottom-up exchanges of knowledge for trades in the exploratory and experimental phases.

In exploratory or experimental professional situations, the problems to be solved are relatively

new and poorly understood, the competency requirements are related to very particular

contexts (problem configurations, cultural factors, etc), the trade is in a stage of youth,

development (borderline situations) or crisis. In this stage, relevant techniques have not yet

been described and are not taught in academic courses. In this context, the relevant techniques,

the competencies required and the trainers are not identified a priori. Competencies are

therefore developed by exchanges of knowledge aiming at identifying techniques and

transferable “good practices”. Within this learning context the responsibility for trainees is to

identify training objectives and to permanently negotiate with their host-experts about

exchanges of knowledge according to their specific objectives.

2) Top-down knowledge for trades in the expertise stage. When a technique is controlled, the

problems to be solved are known and analyzed, the trade is mature, there is extensive

experience, the existing professional references address the situations to be solved and the

competency requirements are identified by a broad group of experts. Needed competencies are

then described and can be taught within the framework of traditional courses for which trainers

are identified and the training schemes structured and widely accessible. In this context, the

tools, techniques, trainers and required competencies can be identified a priori by the trainee or

2 www.compagnons-du-devoir.com + attachments.

Page 5: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 5

5

his employer. One can thus name, measure and compare acquired competences a priori/a

posteriori. The responsibility for trainees is to follow and apply the instructions of the trainer.

But although this classical model is appropriate for the transmission of techniques and know-

how, it is not adapted for the transmission of attitudes. Academic courses are in fact

insufficient for trades where attitudes have great importance. The trade-guild makes it possible

to solve this problem thanks to direct contact and identification with experts inducing a of right

attitudes.

1.2 A self-training device with three main protagonists: a network of institutions, the trainees and a self-

tuition toolkit coordinated by helpdesks.

1.2.1 A network of institutions that signed a mutual agreement to open their doors internationally to

professionals that wish to meet expert colleagues in order to discover new approaches and good practices.

With this in mind, ECEtt developed several tools that help partner institutions facilitate the organization of

the knowledge exchange.

(diagram: the ECEtt network)

1.2.2 A knowledge exchange concept allowing the trainees themselves to organize the exchanges of

knowledge and training courses with the support of the partner institutions. The exchanges have four

different formulas: “A” visits (2 days), “B” traineeships (5 days), “C” traineeships (3 X 5 days with three

different hosts) and “D” course (benchmarking and implementation of a good practice in own place of

work ). The trainees can use the toolkit on the ECEtt e-learning platform.

Four basic formulas of training course (A, B, C, D) ensure the flexibility and the complementarity of the

offer in response to different types of learning needs, to the previous experimentation, to trainees’

availability and financial means as well as to the availability of the experts and hosts.

The short “A” training courses for workers currently in employment are used to sensitize the

trainees to the existence or interest of certain techniques. In “A” training courses, the transmission

is done primarily in an explanatory and conclusive way. The expert shows his place of work, his

tools and his know-how and transmits information in the form of detailed description of the task to

be carried out. He gives examples, underlines the key-points, gives useful written or visual

materials and answers questions.

(image “A” visits)

The “B” and “C” training courses aim at the development of capacities relevant to good practice.

The duration of the “B” and “C” training courses allows the experts to put the trainees in situations

where they can take part in the action, to test and discover on the ground how the problem situation

is managed. According to the expertise already acquired by the trainee, the aim in view and the

complexity of the matter, the expert gives instructions, information and tools and intervenes,

supporting autonomy and the aptitude to face the new situations. The written recording and

presentation of good practices are rooted in the experience of the trainees and invite them to make

a transfer to the institution of origin.

(image “B” traineeships)

The “C” and “D” training courses lead the trainees to conceptualize, structure and connect events

and situations to theories, to formulate assumptions, conclusions and concepts which emerge from

their action and to make implementation strategies. The evaluation of meta-competencies by a Jury

of tutors as well as the implementation project open the way to the application of new techniques

and experimentation with new tools.

(image “C” traineeships + image “D” course.)

Page 6: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 6

6

1.2.3. The trainees as main actors in the training process. As mentioned earlier, a trainee actively

organizes his/her own training course, but he/she also contributes to the creation of professional frames of

reference and to the implementation of new practices. The ECEtt training courses are intended for:

a) professionals with a certain level of expertise who wish to improve the quality of their services (bottom-

up transmission). At present, A1, B1 and C1 training courses are intended for professionals who are

looking to improve their knowledge and skills as well as the quality of the services provided by their teams.

The prerequisite for a B training course is two years of professional experience in the field of drug abuse

treatment. For a C training course, trainees should have five years of experience.

b) professionals (or, in a later stage, students) who wish to acquire the particular competencies described in

the cards of good practice (top-down transmission). Students who want to engage in training courses A2,

B2 and C2 must combine this training course with a course in higher education, and prepare it and debrief

it with the teacher in charge of the course.

(image : bottom-up and top-down)

The exchange of knowledge happens ‘bottom-up’ or ‘top-down’:

1. “bottom-up” exchange happens at the level of exploration or experimentation: seeking good practices

and constituting a framework of professional references on the basis of “good practices” described by the

trainees.

2. “top-down” exchanges are at expertise level: the implementation of good practices as described in the

GPs’ database which is accessible on the ECEtt e-learning platform.

The different training courses are conceptualized as consecutive training cycles that focus on lifelong

learning and on quality improvement. The final aim is to become a ‘companion-tutor’. To do so, a trainee

will need to complete several tasks along the way.

The whole process can take up to five or six years, from the starting point of the issue to be solved in the

workplace to the last stage of improvement of outcomes measured at the level of the clients:

Task 1: Preparatory to the trips, the professional is expected to compile a written analysis of the

deficiencies and successes encountered in his own practice (initial situation).

Task 2: During the first cycle, managers and professionals with several years of experience can

undertake A1, B1, C1 trips to identify places of expertise and good practices and to present them to

their team upon their return.

Task 3: Their next main task is to build a strategy for the implementation of a good practice and to

start a benchmarking exercise with their own team. Other colleagues then start top-down exchanges

(A2, B2, C2). This task focuses on the acquisition of (collective) competencies to implement the

good practice.

Task 4: realization of the action plan and experimentation with the new technique.

Task 5: measurement of the impact of the good practice on the quality of care for clients in general.

1.3 Learning process:

All the trip formulas3 involve certain basic skills: the trainees must start using the e-learning platform to

explain the difficulties to be solved in their workplace, they have to build a budget for their trip, to return

3 A1, B1, C1, A2, B2, C2 and D.

Page 7: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 7

7

accounts, to organize the concrete details of a training course abroad, to solve practical, financial, linguistic

problems, to communicate in an effective way with a team speaking another language, to observe, to listen,

to describe interesting practices and to identify what is transferable and in which conditions, to fill in an

evaluation questionnaire concerning the training course and to give feedback to the team of origin. All the

phases of the trip (internal and external preparation, experience during the training course and after return)

imply psychosocial competencies and relational capacities as well as good attitudes: pro-activity,

communication, rigour, initiative, etc. Of course, the level of competencies to be acquired is related to the

preliminary level of experience of the trainee, to the duration of the training course and to the level of

complexity of the good practice. All these actions reinforce their autonomy and their motivation to continue

their training throughout their career.

The process of self-tuition starts with the preparation of the training course and ends when the trainee

receives the feedback of his colleagues or the panel. Each training course is focused on finding responses to

solve issues related to the needs of clients in the institution of origin and on how they are managed in the

host institution. The whole process provides opportunities for learning, including unforeseen

occurrences. The exchanges with the experts make it possible for the trainees to share about their own

experience, about the difficulties and questions encountered, to restructure, to modify their way of thinking,

to enrich their professional background and to receive recognition and affirmation from the expert. At the

end of the training course, the evaluation and feedback recall the experiment and question in order to

examine the trainee’s way of thinking, to integrate old and new knowledge and to imagine a transfer

towards new fields of application.

1.4 Designing one’s training courses with the helpdesks :

For each type of training course, the stages of the exchange of knowledge are given in the ECEtt handbook,

which sets out the general rules for exchanges. The ECEtt e-learning platform gives information and

instructions structuring the cycle of the trip:

Rules of the training courses included in the handbook.

List and presentation of the partner institutions willing to receive trainees.

Database of expertise: list of techniques and tools related to the profession and identification for

each one of them of the training places where there is related expertise.

Database of good practices and competencies related to each one of them.

The travel file comprises the forms to be filled in for the different steps in the cycle as well as the

list of questions for the writing up of the good practices.

(image: tools to travel abroad)

Throughout the cycle of their trip, the trainees are accompanied by six helpdesks helping trainees and

experts in six languages (French, English, Polish, Greek, Italian and Spanish managed by six partner

institutions). These helpdesks also explain to the host-experts what is expected from them when receiving a

trainee. The six helpdesks are assisted in their task by tutors (who are members of their personnel who have

expertise in the concerned topics and know English) in order to help the trainees to organize their trip and

to use the e-learning system. Some tutors have to evaluate and validate competencies of the trainees, others

have to validate the quality of the good practices before publishing them in the frame of reference, and

others collect testimonials of trainees which appear in a newsletter.

The “travel file” puts the trainees in the role of main actor by inviting them to write about the focus of their

journey, taking into account their training objectives and their trip formula. This gives them an overall

picture of where they will be going, which reinforces the coherence of their training course. Each stage of

the cycle of the trip is accompanied by a document to be filled in on line which implements knowledge and

competencies which will be evaluated throughout the cycle thanks to the evaluation forms sent back by the

trainees, by their hosts and by their employers. The questionnaires in the travel file help to put into words

Page 8: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 8

8

events, difficulties, implemented solutions, application contexts and conditions of transfer. The tools of the

trip help the trainee to clarify what he does and what he tests.

(image: 9 steps of A, B, C traineeships)

The forms of the travel file and the various evaluations on the e-learning platform make it possible for the

central office of ECEtt to collect information on the initial needs for the trainees (first series of documents:

1.a and 1b), on their way of organizing their training course (second series of documents 2a and 2b) and on

what they bring back (last series of documents, 3a, 3b and 3c).

1.5 Training objectives

The type of trip varies according to the training objectives. The specific objective of each training course is

recorded by the trainee in his application form (doc. 1a) which he sends to ECEtt central office and to the

potential hosts. The trainee explains the problematic situations which he wants to solve, the questions he

wishes to discuss and the activities that he would like to observe. Based on this information, the host-

experts successively develop a personalized training plan (2b) that corresponds to the expectations and

training objectives of the trainee.

The exchange of knowledge is based on personal experience. The whole training process, the preparation

phase, the actual traineeship and the follow-up phase, are experiences that invite and stimulate trainees to

observe, to reflect, to describe and to critically analyze what they have done, seen and heard, and to look

for possible relationships with their own practice. All the training courses (A, B, C and D) imply a

deepening of the trainee’s own experience. They invite the trainee to innovate, try out and take initiatives,

aiming at solving problems and at improving quality of care for substance abusers. Recording in writing

good practices and questions related to their effectiveness, their relevance, the skills involved and the

prospects for transfer in the context of the institution of origin and the presentation of the resultant

document to the panel require specific knowledge and attitudes. The more advanced the training courses

are (B, C and D training courses), the more the trainees are invited to conceptualize, to make

assumptions, to distance themselves from the general principles, and to explain their conclusions within the

framework of a workshop-panel. The C trainees certified by the panel are invited to use what they have

learned by implementing a good practice in their institution of origin.

One can realise seven types of objectives corresponding to seven types of training courses. Competencies

to be acquired by the trainees vary basically between:

1) seeking good practices (bottom-up)

2) transmission of competencies identified on the good practice cards (top-down)

What? Who for? Learning outcomes

1. B

ott

om

-up:

A1: discovering prospective

new places of expertise for

B or C training courses for

oneself or colleagues.

Experienced

workers or

managers.

Meta-competencies: identification of the

difficulties to be solved, organization of the

training course, resolution of practical, financial,

linguistic problems, effective communication with

foreign fellow-members, evaluation of the training

course and feedback towards its team of origin.

B1: initiation into good

practice research and

lifelong learning through

journeyman tradition.

experienced

workers.

Metacompetencies (idem) + identification and

description of good practices & associated

competencies.

Page 9: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 9

9

C1: comparative research

and validation of good

practices with

implementation project.

experienced

workers.

Metacompetencies (idem) + good practices +

certification of meta-competencies and

introduction of an implementation project + title

of “tutor”.

2. T

op-d

ow

n

A2: visit of a group of

colleagues to an expert in

order to observe a good

practice with a view to

implementing it within the

framework of a “D” project.

Groups of

workers.

Acquisition of a common model of reference

related to a good practice to be implemented by

the team of origin.

B2: training in one selected

good practice +

participation in the action +

drafting and validation of a

good practice.

Workers or

students.

Initiation into the competencies described in the

card good practice selected and validation of an

additional good practice.

C2: comparative training in

several ways of solving the

same problem (several good

practices) + participation in

the action.

Workers or

students.

Integration of basic competencies common to the

three good practices (three places of training

course) and identification of the possible options,

certification of the competencies linked to the

good practice + implementation project.

3.

Imple

D: progressive introduction

of a new practice in

workplace by observing all

the conditions of success +

evaluation of the results.

Workers who

have taken

the C course.

Competencies of project manager, benchmarking

training, certification of masterpiece, and access to

the role of tutor with duty of retransmission and

right to be represented in the ECEtt general

assembly.

2. Evaluation of competencies

2.1 Competencies and meta-competencies

The “bottom-up” transmission mode (research of good practices) does not make it possible to identify in

advance specific competencies for specific good practices which are not yet known. In this case, the point

is to develop meta-competencies which are common for all good practice seekers (pro-activity,

communication, description, analysis, synthesis, etc). On the other hand, when the good practices and

related competencies have been identified during the bottom-up phase, it is possible to be clear from the

beginning between the trainee and his host-expert about the competencies to be developed and evaluated at

the end of the course (top-down transmission). In this case, the good practice card constitutes a guide for

the host in his action of knowledge transmission which enables him to plan the exchanges around focused

methods and tools. The good practices written about by the “B” and “C” trainees are one of the elements

which make it possible to observe and to evaluate competencies of the trainees at the end of the training

process.

As the “C1” training courses were the target of the evaluation of the ECEtt-Pilot project, it is the evaluation

of the “C1” training courses which we will approach here. The objective of the “C1” training courses is to

certify meta-competencies of social workers who seek good practices in order to improve the quality of

their work by implementing new techniques in their workplace. Meta-competencies are primarily attitudes

which characterize pro-active workers who have an analytical and synthetic mind, are effective in

communication and work on the basis of objectives. The B1 and C1 trainees accepted in the ECEtt-Pilot

trial are experienced workers who undertake a search for good practices without being able to guarantee

results a priori. The trainees discover all meta-competencies involved or those that they will have to still

Page 10: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 10

10

reinforce either during or at the end of the process. This relative discretion at the starting point about the

competencies that will be involved is intended to avoid placing an unnecessary stress or burden on

researchers, whose obligation is not to achieve a certain result but to use a certain means and process.

These training courses are however evaluated on the basis of criteria and of indicators of competencies in

terms of knowledge, know-how and attitudes implemented during the 4 stages of the tripcycle. A table of

indicators lists fifty knowledge and know-how items (see indicators in table of evaluation) which give

indications regarding the meta-competencies (attitudes) expected for “C” trainees.

“Meta-competencies” to be qualified as a “C” trainee:

E-L

Report

Panel

1. Pro-active attitude to improving quality in own TC + +

2. Dialogue with own team and hierarchy +

3. Good use of means of communication +

4. Quality contact with hosts +

5. Efficient organisation of traineeship +

6. Remaining focused on own objective + +

7. Capacity of distance, analysis and description of good practice + +

8. Feedback on benefits to the team of origin & panel + openness to reactions

to feedback.

+ +

9. Strategy for starting the implementation process (first success conditions for

a benchmarking exercise):

o how to get commitment from hierarchy,

o choice of a process which is important for clients,

o how to share responsibility with team,

o “draft” for the planning of implementation process

+

10. Debriefing on benefits of the traineeship:

o personal field:

o professional field:

+

2.2 The gathering of evaluations on the e-learning platform:

The evaluations allow the trainees, the hosts and the employers to express their point of view about the

relevance of the training courses, the material conditions and the organization, relational quality, the co-

operation, the encountered difficulties and the way of solving them as well as the teaching method used for

the training. The online evaluation documents comprise open questions, multiple-choice questionnaires and

the good practice forms constitute application exercises. These documents can be compared with the

objectives of the training courses and the evaluation criteria applied to competencies linked to GPs or to

meta-competencies.

(image : evaluation and follow-up)

2.3 Final validation of meta-competencies by the panel.

At the end of each training cycle (A, B or C) the trainees are invited to say, within the framework of their

evaluation, how they plan to take their training course. Do they want to continue the step by organizing a

group visit to the same host-expert? Do “B” trainees want to look further into a “C” cycle (i.e. two

additional training courses with presentation of good practices and an implementation project to a jury)?

Do they want to stop their training course or to continue it with a later training in another training

organizer?

The final evaluation and certification involve two stages:

1) synthesis of the evaluation data gathered by e-learning for each individual.

Page 11: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 11

11

2) a final validation by a panel made up of two experienced tutors from partner institutions.

Synthesis of evaluations on the e-learning platform: after each training course each trainee gives scores and

comments concerning each item of the document “evaluation by the trainee” (doc.3.a). At the end of the

three training courses, he gives a “final evaluation” (doc.3.b) where he makes a global evaluation of his

assets, his degree of satisfaction compared to his initial training objectives, the relevance of the training as

well as the quality of the teaching and the accompaniment offered by the ECEtt helpdesks. Meta-

competencies are evaluated on the basis of a table of synthesis comprising about fifty knowledge and

know-how skills, about each of which two opinions are given by combining the evaluation documents

submitted by the trainees (3a & 3b), by the host-experts (doc.3d), their employers (doc.3e), and their

national helpdesk. All this knowledge and know-how is gathered by categories, enabling the meta-

competencies (attitudes) which are characteristic of the “C1”training courses to be evaluated by a process

of deduction.

(image of the workshops of the panel)

The trainees present themselves at the panel within a workshop made up of three trainees who present, in

turn, their good practice and their implementation project, and two tutors (taking care that trainees are not

evaluated by tutors from their own institution). The tutors are experts appointed by the main partner

institutions who have at least five years of practice in the topics concerned and can communicate in

English. Trainees are invited to start discussion around the GPs and projects presented by each one of them

while the tutors observe how each trainee expresses himself, listens, interacts, takes part in the discussions

and reflects. They focus particularly on the level of maturity and meta-competencies of the trainees. The e-

learning treatment of the evaluation data and the presentation of good practices and implementation

projects to the panel make it possible to certify the trainees’ meta-competencies and their aptitude to start

an implementation project and to validate the good practices which are intended to enrich the professional

frame of reference. The evaluation of the good practices and meta-competencies can underline gaps and

involve recommendations or injunctions aiming at supplementing what would be unfinished.

In the “B2” and “C2” alternative, the mode of validation of competencies undergoes some adaptations:

after their training course, the trainees give to their superior or their teacher a self-evaluation concerning

the competencies indicated in the “good practice card” used as a guiding theme for their training course,

and the host-expert issues a certificate indicating that all the activities related to the good practice and the

planning of the course were accomplished, with comments where appropriate.

2.4 Validation of good practices

After assessing the trainees’ meta-competencies, the tutors examine each good practice and screen it in the

light of five validation criteria : filled in properly, understandable, relevant (ECEtt ethics, EFTC standards),

detailed and informative for others and critical reflection. There are three possible scores: 0 = insufficient, 1

= acceptable and 2 = excellent. A report is submitted to the trainees for each one of their good practices. To

be validated, a good practice cannot include any scores of 0. The trainees are invited to rectify or

supplement the fields for which they would have obtained one zero. Validated practices are published in

the database of good practices which is accessible online. A Wiki system enables published good practices

to be added to by other trainees as well as by the experts of the host centres.

2.5 Certification of “C” skills needed to start a “D” course:

The validation of the good practices and certification by the panel result in a certificate of aptitude to start a

“D” course which will be signed by the representatives of the six helpdesks. After the “C” trainees have

been certified and recognized as ready to launch a process of implementation (“D” course), these trainees

Page 12: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 12

12

are invited to choose two coaches, one in their organization of origin and the other among the foreign

ECEtt tutors. These have a framework and references for the implementation (stages of the benchmarking,

construction of a logical framework, etc) in order to accompany the “D” trainee in putting new techniques

into practice in his work situation and to adjust the strategy so that the implementation answers the problem

for which it was intended. The “D” trainees start with the elaboration of a strategy to motivate their

managers and other colleagues to join the implementation effort and to take part in a new wave of training

visits to host-experts. The coach helps the “D” trainee to analyze the favourable and unfavourable factors in

his work environment and to solve the organization and implementation problems linked to the

implementation of the project.

2.6 Feedback to the employers and to the training organizer

The e-learning platform gives every actor in the training system access to the feedback of the people he was

involved with. Hosts and trainees can see what has been appreciated and what can be improved. The

evaluations of trainees and hosts (3d) also give important feedback to the employer and the team who

granted availability to “their” trainee. And the evaluation of the employer (doc.3e) shows if he perceives a

“return” for the institution in terms of reinforcement of the aptitudes and the motivation of the worker and

if he wishes to continue or repeat this type of training course.

The e-learning platform makes it possible to collect all the evaluations resulting from all the trainees, the

hosts, the employers and the experts in connection with all the training courses and to immediately

visualize the average levels of appreciation and identify the parameters which are in most urgent need of

re-examination. The comments of the trainees, the hosts and the employers concerning the strong points of

the accompaniment by ECEtt and the points to be improved enable the central office to refine the teaching

methods further.

The ECEtt-Pilot trial has been assessed by the University of Ghent which in September 2008 will issue an

evaluation report on the effectiveness and the relevance of the method of journeyman apprenticeship

transferred by ECEtt to the professions of social education.

Conclusions for the ECEtt-Pilot experience

The ECEtt Pilot experiment was a challenge in many ways. First of all, it was essential to focus simultaneously on two targets:

a) the psychopedagogic objectives of the ECEtt network : to reinforce the competencies of the therapeutic communities for drug addicted persons.

b) the mandate to describe and evaluate a professional training process which had to be innovative and transferable and was the main “product” to be delivered to the project’s funding body (the European Union).

The originality of ECEtt-Pilot was the transfer of the “journeyman apprenticeship” method (which has been used for centuries for the training of manual trades for young people from 16 to 26 years) to the lifelong learning of professionals working with addicted people, and more widely, to other professions in the profit or non-profit sectors. The principles of the journeyman traditions may be summed up as follows: transmission of knowledge by a direct contact and on the ground between an expert and an apprentice, a succession of meetings by means of travel, the search for excellence, solidarity through the reception of apprentices and the free retransmission of what one has learned. The training by the journeyman tradition makes it possible to develop particular training courses for each apprentice by entrusting to each of them the role of protagonist in the development of his training course. Each applicant trainee is invited to define what he wishes to learn, to seek one potential host among the expertise centers included in the data bases, to organize his voyage, and to be effective in the exchanges of knowledge in order to bring back good practices to his institution of origin with a view to implementing them and improving the quality of the services.

Page 13: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 13

13

In the case of ECEtt-Pilot, the stage of the concerned profession (therapeutic communities for drug addicts) was a second challenge. Indeed, the training objectives to be achieved by travel could not be described a priori because the experts had not recorded either their good practices or the competencies in a standardized and usable way. The solution has been to involve all the trainees in the identification and the description of the good practices which they were going to discover (bottom-up movement) in order to build together a referential framework of good practices that could be used later on by other trainees who would then be able to travel to specific places of expertise in order to learn particular good practices and competencies described in the referential framework (top-down movement). The synthesis of two processes: a) knowledge exchange and b) knowledge creation, is one of the most powerful aspects of the ECEtt system.

The diversity of the training objectives (60 individual courses correspond to 60 different objectives) and the lack of written definitions of the competencies involved in the sought-after good practices ( ) generated problems around the evaluation criteria to be used after the return from the training course. This unclear situation concerning competencies obliged us to move up to a higher logical level: that of meta-competencies. These are the competencies necessary to seek and identify good practices, to describe them, analyze them, transmit them in one’s team of origin, propose ways of implementing them and ensure that these are pursued further. The evaluation of these meta-competencies (which are common for all the “bottom-up” training courses) was undertaken using the evaluation questionnaires filled out after each training course by the trainees, their hosts and their employers and centralized by the researcher at the University of Ghent. The synthesis of these evaluations was largely facilitated by the e-learning platform which opens up excellent prospects for the development for this type of journeyman apprenticeship. A synthesis of these evaluations was then submitted to a panel of judges, composed of tutor-experts appointed by the partner institutions, before which the trainees presented one good practice of their choice as well as an implementation project. The validation of the good practices and of the meta-competencies of the trainees by the panel leads to the certification of the good practices before these are published in an on line data base as well as to the certification of the trainees’ capacity to move on to the following stage: the “D” course. The certification of the “C” trainees within the ECEtt-Pilot project invites them to set up a process of benchmarking and the implementation of good practices in their own organization and to conclude with the presentation of a “master-piece” to a future panel. This new stage for the certified trainees will also be a new stage for the ECEtt helpdesks who will have to accompany them. This “D” course could be the subject of a new Pilot project for the description of an innovative teaching method.

The journeyman apprenticeship would be impossible without a coherent network of institutions motivated by knowledge exchanges. An enormous effort was made by all the partners in building this network, in developing procedures to solve language and practical problems, in organizing the accompaniment of the trainees at each administrative step. The accounting management of the Pilot project between eight countries presented the coordinator and the partners with a considerable overload of work, without any subsidy available to fund extra staff. The ongoing cooperation between the partners to resolve tensions required a lot of time and goodwill on the part of all. The culture and the values shared by the partner institutions represented a valuable basis of good attitudes for regulating problems without losing any partners.

The majority of the partners created “products” corresponding to their particular expertise: the Irish produced Newsletters, the Greeks offered the talents of their printers, the Polish produced a professional lexicon in seven languages and the Italians developed an e-learning system whose enormous potential for the future development of ECEtt we gradually discovered. This specific contribution of CeIS-Formazione brought to the ECEtt-Pilot project priceless added value which is already the subject of another development project.

As has been described, the core concept of ECEtt is transferable to numerous professional sectors. The brilliant “valorization” project conceived by “Proyecto Hombre” puts an unexpected and impressive light

Page 14: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 14

14

on the development potential of the ECEtt training concept for the caring professions, as well as for other professions of the profit and non-profit sectors.

The evaluation by the University of Ghent has been important for checking the effectiveness of the ECEtt method. The scientific report showed a very high level of quality in the knowledge exchange, and the satisfaction level of all trainees, hosts and employers was surprisingly high. We cordially thank Ilse Goethals for finding pragmatic solutions to overcome all the difficulties and for her constant concern to find tools of research which disrupted the knowledge exchange process as little as possible.

The agreement signed with the Leonardo da Vinci Agency for the ECEtt-Pilot experiment expires on September 30, 2008. To survive and develop, ECEtt has to promote its method and to answer new calls for proposals in connection with priorities established at national or European levels.

The following is a list of possible development routes for ECEtt corresponding to different financing possibilities:

a) Accredited training : “ECEtt-Convergence” is a project submitted to the ESF in partnership with HECE[1] . This project aims at offering post-graduate students accredited training through the exchange of courses in a European network. This project would give social workers the opportunity to broaden their horizons by accredited training courses in connection with their academic curriculum and to discover good practices successfully applied abroad.

b) Development of the e-learning : “ECEtt-Transversality” is a project submitted in partnership with the University of Bologna and CeIS-Formazione to the ICT & Lifelong Learning Programme agency and aims to continue the ECEtt-Pilot experiment while developing the e-learning aspect. It is an original partnership with, on the one hand, the network of the ECEtt partners who continue the creation of referential frameworks and the ongoing training of their personnel and, on the other hand, a university department in psychology which would develop the e-learning system of ECEtt for the benefit of students as well as ECEtt trainees. The originality of this project is the link between a “bottom-up” movement ensured by the professionals of the TCs which seek and describe good practices gathered in a data base and the “top-down” movement of the university students attending training in the good practices described in the ECEtt data base.

c) Self-financing: “ECEtt-Sustainable” is an option of development towards the commercial sector. If the journeyman tradition can be transferred to non-profit sectors, it is possible that it also meets the training requirements for the commercial sector. Many companies practice benchmarking and could structure the knowledge exchanges of their personnel on the basis of the ECEtt model. This type of service could generate profits for the benefit of the exchanges organized by ECEtt in the non-profit sector.

D) Survival by cutting costs : at the end of the two ECEtt-Pilot project years, while decisions on the submitted applications are awaited, the first challenge to take up for ECEtt is to ensure its survival and that of the knowledge exchange network. Without the Leonardo da Vinci subsidies (EU), ECEtt is back in its original precarious financial situation, depending on patronage and co-financing by the partners of the network. While waiting for the answers to the submitted applications (FSE-Convergence and Transversalité), a “minimal” plan based on internal funds and reducing the number of exchanges of training courses has been drawn up on the basis of the formula which made it possible ECEtt to start from 2003 to 2006: patronage and voluntary help. This “minimal” formula could be reinforced by “Mobility” grants within the applications submitted by the helpdesks to the national Leonardo da Vinci Agencies. The capacity of independence lies behind the strength of our model “Les Compagnons du Devoir” and the capacity of ECEtt to survive thanks to the patronage and the voluntary collaboration of partners makes it possible to

Page 15: ECEtt-Pilot Confidential document. Property of Trempoline ...ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 3 3 General introduction This report is the

ECEtt-Pilot Confidential document. Property of Trempoline NGO, Belgium. Page 15

15

escape the alternatives of building projects which are profitable but which depart from ECEtt‘s purpose or of disappearing.

We are very grateful to all those who have made the ECEtt-Pilot adventure possible: the partner teams which have invested a lot of time for free to build this knowledge exchange network, the trainees who took part with enthusiasm, seriousness and indulgence in adjusting the journeymen tradition to their profession, the Trempoline association which provided much of the co-financing from its own funds to ensure the coordination of the project and finally the European Union which placed its confidence in us by subsidizing this research. In addition to the satisfaction of having achieved our goals by delivering the promised “products” in time, this project was for all the partners a school of management which made us discover modern tools and methods for better developing our respective projects.

[1]

“High School Charleroi Europe”, post-graduates in social work.

Bibliography

« Tout savoir sur les Compagnons du Devoir », Ed° Librairie du Compagnonnage, Paris, 2006.

« Compangon du Devoir au XXème Siècle » , Pierre Morin, Ed° Librairie du Compagnonnage, Paris, 1994.

« The Therapeutic Community, theory, model and method », George De Leon, Springer Publishing

Company, New York, USA, 2000.

« Best Practices Substance Abuse Treatment and Rehabilitation”, Canada’s Drug Strategy by Gary Roberts

& Alan Ogborne, Office of Alcohol, Drugs and Dependency Issues Health Canada.

“Maryland Best Practices: an improvement Guide for School-Based Service Learning”, Maryland Student

Service Alliance, Baltimore, USA.

“Staff development toolkit drug and alcohol services”, NHS, National Treatment Agency for Substance

Misuse, EATA & Drug Scope, 2003, UK.

“National Occupational Standards for Child Care at Post Qualifying Level “, 2000.

« Indicateurs de qualité en communautés thérapeutiques », Jesus Martin, ERIT, Fédération Européenne des

Associations d’Intervenants en Toxicomanie, 2003.

“ Le Processus d’Amélioration Continue de la Qualité”, in Les Cahiers de l’Actif, La Grande Motte,

France, 2007.

« Service Standards for Addiction Therapeutic Communities », by Community of Communities & Royal

Colledge of Psychiatrists, London, UK, 2006.

DANOS, Drug and Alcohol National Occupational Standards, 2005.

« Construire une méthode pédagogique » BIEF, Louvain la Neuve, Belgique, 2006.

«Le Benchmarking » Mouvement Wallon pour la Qualité, Belgique 2007.

Guide Qualité pour l’Economie Sociale et Outils de Gestion, AGES, Liège Belgique 2006.