FINAL EVALUATION REPORT - Project development training ... · final evaluation report . community champion training programme 2015-1-uk01-ka202-013597 . july, 2018

FINAL EVALUATION REPORT

COMMUNITY CHAMPION TRAINING PROGRAMME 2015-1-UK01-KA202-013597

July, 2018

COMMUNITY CHAMPION TRAINING PROGRAMME Evaluation report, July 2018

P a g e | 2

Table of content

DESCRIPTION OF THE PROJECT ............................................................................................................... 3

EVALUATION ............................................................................................................................................ 5

PROJECT PROCESSES/PROJECT ACTIVITIES AND PROJECT RESULTS ....................................................... 8

PARTNERSHIP MEETINGS ...................................................................................................................... 11

STAKEHOLDER MEETINGS ..................................................................................................................... 14

LOCAL EVENT ......................................................................................................................................... 16

MOODLE – BUCOVINA RO ..................................................................................................................... 20

MOODLE – CONSTRUKTIVA SE .............................................................................................................. 23

MOODLE – ŠENTPRIMA SI ..................................................................................................................... 26

MOODLE – PADMA UK .......................................................................................................................... 29

MOODLE – PCDT UK .............................................................................................................................. 32

TRAINING – BUCOVINA RO .................................................................................................................... 35

TRAINING – CONSTRUKTIVA SE ............................................................................................................. 39

TRAINING – ŠENTPRIMA SI .................................................................................................................... 43

TRAINING – PADMA UK ......................................................................................................................... 47

TRAINING – PCDT UK ............................................................................................................................. 51

CONCLUSIONS ....................................................................................................................................... 55


P a g e | 3

DESCRIPTION OF THE PROJECT The phrase ‘Third Sector’ is used to collectively describe the loose conglomeration of non-governmental agencies that operate in the community, which include voluntary organisations, not-for-profit & social enterprises.

They typically have a strong service orientation with community participation that is characterised by volunteering activity and self-help projects aimed to promote empowerment at the level of individuals and communities. They are regarded as particularly valuable, given that they tend to have a lower cost base than governmental agencies and because their non-profit status means they are not hindered by short-term financial objectives and are able to devote themselves to issues, which occur across longer time horizons.

The role of the sector has grown rapidly in the past decade with growing emphasis on the need to increase capacity through training in order to ensure that organisations are able to develop their activities and ensure those engaged in community work are adequately skilled to carry out roles effectively.

Whilst provision of training is important for improving capacity of the sector the absence of training and associated skills gaps has been shown to be associated with difficulties meeting quality standards and introducing new working practices. Moreover, non-training organisations are almost twice as likely to close as those that do provide training.

Whilst staff in the third sector are more likely to hold a first degree than those employed in the private and statutory sectors, their qualifications often do not match job roles and particular gaps have been identified in key areas such as management & leadership skills, communication and team working and specialist skills such as marketing and fundraising.

There is no current framework for third sector community training and there is an absence of standardisation and quality control regarding what should constitute core skills, learning objectives and appropriate level of learning.

Many engaged in the third sector work in a voluntary or part-time capacity and fail to enjoy easy access to dedicated training packages. Notably, a substantial minority of third sector organisations do not engage in training at all and this has been attributed directly to the absence of access to relevant training, lack of resources to support training and lack of time to organise and deliver training.

The aims of this project are to develop a common framework for training through meticulous consultation and planning with third sector stakeholders in order to address the aforementioned skills gaps. Secondly, to design and implement a prototype training package in a digital form that will incorporate vocational learning techniques to improve accessibility to training materials and access to best-practice in the field. Thirdly, to provide standardisation and quality control through external scrutiny and accreditation of content, learning outcomes and level of learning in order to best meet the needs of staff working in the third sector. Fourthly, to involve stakeholders in evaluation of the prototype training programme’s implementation in order to identify and correct any shortcomings that occur.


P a g e | 4

The benefits of the project include an opportunity to explore and share best practice and gain cross-sectoral agreement on a core training programme for those engaged as third sector community "champions" in the EU.

The role of the third sector in community development and support has grown exponentially in the past decade, yet evidence points to significant workforce skills gaps that impact negatively on the sector’s overall effectiveness and continued progress. Moreover, there is currently no agreement on a common framework for training (vis-à-vis what should constitute core skills and learning outcomes) and no standardisation in respect of the level or quality of learning. This situation hinders the sharing of learning and best practice between member states and organisations in the third sector and prevents organisations from benchmarking their training against best-practice in the field.

Whilst we were able to glean from our research literature (rationale evidence) that there is a need to develop training for core skills in areas such as management, leadership and development, through our partnership’s preparatory work we were also able to readily identify areas of discrete expertise and excellence, developed by the partners, which we believe should be included in a diet of training to the benefit of the wider community. These areas include, establishing and managing volunteering networks, job coaching and motivational interviewing for job-seekers low in self-efficacy, working with employers to develop apprenticeships, working with troubled families, and working with people who have mental health issues or other disability.

The proposed programme will offer the sector a common framework for training where non exists and one that has been developed in collaboration with third sector stakeholders in order to address current skills gaps. On completion of the project it will provide the wider community with access to an online training package presented in a digital form that incorporates vocational learning techniques. It will facilitate access to best-practice in the field and promote shared learning. It will also provide a means of standardisation facilitated by external review and accreditation allowing the recognition and transfer of learning between organisations and member states, which will be embedded within current EU vocational learning frameworks, such as the EQF at level 3.

Community Champion partners:

Lead partner: Plymouth & District Mind Association – PADMA, United Kingdom Mental Health Charity operating Recovery College. Experienced project -development partner. Partners: Bucovina Institute, Romania NGO working in the field of adult education and rehabilitation of disadvantaged groups. Construktiva, Sweden A social enterprise/work integration/run project in collaboration with local and national partners. Šentprima, Slovenia Private institute for vocational rehabilitation and education, especially for people with mental health problems. Penwith Community Development Trust – PCDT, United Kingdom Charity with aims to support healthy living through education, skills development, volunteering and promotion of community development.


P a g e | 5

EVALUATION WHAT WE MEASURED?

Evaluation (qualitative and quantitative):

PROJECT PROCESSES / PROJECT ACTIVITIES AND PROJECT RESULTS (report template)

o of the process – after each activity;

o the project as a whole: project aims / objectives, work plan and the deathliness,

preparation activities, implementation, intellectual outputs, multiplier events,

partnership, indicators of success, expected results , quality assurance, valorisation

(dissemination and exploitation of results, impact, promotion, dissemination,

sustainability) and users/ stakeholders involvement, financial aspects of the project,

project management, organisation, communication.

STAKEHOLDERS MEETINGS (questionnaire)

o satisfaction (preparation, agenda, content, efficiency, discussion, solutions, tasks,

network, the purpose of the meeting, duration, place).

LOCAL EVENTS (questionnaire)

o satisfaction: registration process, materials provided, speakers, conference facilities,

duration, usefulness, organization.

PARTNERSHIP MEETINGS (questionnaire)

o satisfaction (preparation, agenda, content, efficiency, discussion, solutions, tasks,

network, the purpose of the meeting, duration, place).


P a g e | 6

TRAINING (WORKSHOPS) (questionnaire)

o training aims;

o training content and design;

o pedagogical materials, tools;

o training delivery, facilitators;

o improvement;

o value;

o satisfaction (trainees, trainers).

MOODLE (questionnaire)

o Satisfaction, facilitator, knowledge of, frequency of use, usefulness. HOW WE MEASURED?

- QUANTITATIVE / QUALITATIVE

Gathering information:

- questionnaires (on-line) – all questionnaires templates are available on Huddle;

- report templates;

- focus groups.

QUANTITATIVE EVALUATION

- numbers of meetings;

- training delivery sessions;

- the numbers of people attending local training delivery;

- dissemination and implementation activities;

- the number of press releases;

- number of media reports;

- number of web site visits, web site links and web site ranking;

- project Facebook network page for use by stakeholders.


P a g e | 7

QUALITATIVE EVALUATION

- collaboration of the partners in terms of partnership meetings;

- Huddle platform use for communication;

- web site design;

- project implementation;

- feedback from participants who attend local training delivery to validate the "fitness for

purpose" of the formal level 3 training programme. Testimonial reports are posted on the

project website, together with case studies - two from each partner - gathered as part of the

dissemination plan;

- participant questionnaires;

- the partnership meeting questionnaires.

- Questionnaire surveys were conducted at all local stakeholder activities and training delivery,

to ensure quality of support given to our target groups and those who, in turn, support them.

- Accreditation in each partner country is a prime indicator for success of the project: we

monitor learning outcomes laid down for each module in order that collectively, they form

the Community Champion Training Programme, which is the main objective of the project.

The learning outcomes and student feedback were evaluated for its fitness for purpose by

the local volunteer stakeholder committees as an indicator of achievement for the project, in

terms of potential mainstreaming of future training programme delivery.

HOW OFTEN WE MEASURED?

Evaluation:

- regular (after each activity) - that we were able to make improvements on time;

- final.


P a g e | 8

PROJECT PROCESSES/PROJECT ACTIVITIES AND PROJECT RESULTS (report template)

Evaluation of project processes, activities and results is in final report of the project.

o of the process – after each activity;

o the project as a whole: project aims / objectives, work plan and the deathliness,

preparation activities, implementation, intellectual outputs, multiplier events,

partnership, indicators of success, expected results , quality assurance, valorisation

(dissemination and exploitation of results, impact, promotion, dissemination,

sustainability) and users/ stakeholders involvement, financial aspects of the project,

project management, organisation, communication.

THE AIMS OF THE PROJECT

1. To develop a common framework for training through meticulous consultation and planning with third sector stakeholders in order to address the aforementioned skills gaps.

2. To design and implement a prototype training package in a digital form that will incorporate vocational learning techniques to improve accessibility to training materials and access to best-practice in the field.

3. To provide standardisation and quality control through external scrutiny and accreditation of content, learning outcomes and level of learning in order to best meet the needs of staff working in the third sector.

4. To involve stakeholders in evaluation of the prototype training programme’s implementation in order to identify and correct any shortcomings that occur.

RESULTS

- 5 newsletters - Project logo - Third sector “Community Champion Training Programme” online resource - Web site - Evaluation report - Dissemination report - 10 training modules - E-learning platform - Network of 6 local volunteer stakeholder committees - 5 local multiplier conference events


P a g e | 9

PREPARATION ACTIVITIES

- Prepare reporting templates. - VC to set up Huddle Workspace and invite all partner participants (key staff) to join. - Set tasks in Huddle. - Prepare evaluation plan and questionnaires. - Inform national accreditation bodies of successful application outcome in preparation for

accreditation submission. - Prepare agendas for each meeting; provide travel and accommodation information to each

partner prior to each meeting. - Prepare learning modules and training materials prior to pilot training programme delivery - Design Logo. - Prepare standard attendance sheets for meetings and for local training delivery to show

evidence of numbers attending. - Set up the project web site - create control panel for BUCOVINA to use. - Prepare the dissemination plan. - Prepare Newsletter Template. - Create format for minutes of each meeting. - Translate programme training materials into own language for local delivery (not applicable

to PADMA) before piloting in own country. - Recruit local stakeholder network committees to input into design and to evaluate and

review training programme post-delivery of the pilot. - Recruit 12 (minimum) participants (per partner) to undertake the pilot training programme - Revisit Flow Chart for the project and undertake all planning and preparation highlighted in

the flow chart (see appendices).

PROJECT MANAGEMENT

- Project coordination - Project monitoring&evaluation - Financial management - Communication

IMPLEMENTATION

- 6 partnership monitoring meetings - Huddle - Web site - Progress reports&timesheets - Project evaluation - Dissemination - Project management - Newsletters - Interim and final reports - Volunteer stakeholder committees


P a g e | 10

INTELLECTUAL OUTPUTS

- Community Champion Training Programme - CCTP Interactive e-learning Platform

MULTIPLIER EVENTS

- Bucovina CCTP Conference - Constructiva CCTP Conference - Šentprima CCTP Conference - PADMA, PCDT CCTP Conference

EFFICIENCY AND PERFORMANCE

- of the project, training programme (delivery and outcomes), dissemination.

PARTNERSHIP

- organization - communication - meetings - reports - performance of the tasks - satisfaction


P a g e | 11

PARTNERSHIP MEETINGS Plymouth UK, 25. – 29.4.2016 (n=16) Ljubljana SI, 5. – 9.9.2016 (n=14) Penzance UK, 23. – 27.1.2017 (n=9) Suceava RO, 4. – 8.9.2017 (n=12) Ljubljana SI, 19. – 23.2.2018 (n=22) Ostersund SE, 11. – 15.6.2018 (n=9)

On Huddle:

- evaluation for each partnership meeting

- questionnaire

COMMON AND AVERAGE RESULTS (n=82)

• I received on time all information I needed for my participation at the meeting.

strongly agree 75 %

• The meeting agenda was relevant, adequately prepared and easy to follow.

strongly agree 55 %, agree 40 %

• The meeting was realised efficiently and according to plan.


• There was good balance of topics covered.


• Partners questions were answered, problems discussed and solutions agreed.


• Upcoming tasks were clearly presented and explained.


• Partners exchanged best practises/experiences.


• Partners strengthen their network.



P a g e | 12

• The purpose of the meeting was accomplished.


• The meeting was the right length of time.


• The meeting place was easily accessible.


• Facilities of the meeting room were adequate.


COMMENTS (some)

What did you like and do not like about the meeting?

• excellent organization!!! • I really liked the way sentprima organised the days, excellent and very interesting dinner

places :-) and nice environment • I liked the opportunity to talk face-to-face with other partners, as this is an easier way of

discussion than email/Skype. can\`t really • I particularly like collaboration between all partners. a real bunch of professionals. nothing to

dislike. • enjoyed it all ! it is always a pleasure and great learning experience to hear what other

institutions are doing. • was that it had been well planned and importantly everyone was included in the discussions. • well structured and good that all partners engaged. • I liked exchange of practice between partners and most of all unofficial talk with some of

them on the topics they want to develop for the future possible cooperation. • the partnership, the agenda, the effectiveness • the hospitality of our hosts was wonderful and the organisation of meetings, meals and visits

was faultless. • i very much enjoyed the fact that the partners were very upcoming with the dissemination of

results from their countries and open discussions about accreditations and other topics. • we had a good and practical meeting with pertinent information and rely on subject, liked

group work , free discussion and feedback from each participant. • very much like the \`social restaurants\` for evening meals. • everything was as expected , tasks were strongly understood and agreed by all partners . • everything carried out according to agenda within the timeframe. whilst some matters were

very technical in nature and led to debate, all partners contributed in a friendly and professional manner. the partnership demonstrated its strength in coming together, resolving all challenges, and moving forward with clarity of purpose.

• I liked the openness and supportive nature of the meetings


P a g e | 13

What can we do to improve the project meeting next time?

• more group discussions • take summary notes every day and a quick remembering the day after • more input from other participants with different view should be considered • introduction of each participant at the beginning • all partners should be prepared for the meeting - to carry out the tasks that must be

performed before the meeting • prepare questions before • in case of workshops or working together - it would be useful to have more information in

advance so each partner can prepare before, and then on meeting the discussion would be more effective, because we would have more time to think about our situations...

• could there be an opportunity for partners to present a case study from their work with examples of their biggest challenge and what they learned. this could help us all to learn from other peoples problems. to do this we will need to have a very high level of confidence and trust in each other which i think that we have.

• the meeting in suceava was a example of good practise, how meetings should look like. • the project visit was extremely interesting. i would have liked the opportunity to visit other

projects where training had been completed. if this was not possible i would have been interested to see how broader community projects have been delivered in the host country and the experiences of those involved.

Other comments, concerns or requests?

• thank you Ulla and team for excellent hosting :-) • sentprima has a great team. congratulation to all of u. • good project with great value for Bucovina institute! • a very enjoyable first partnership meeting with a lot of work being done and new friendships

developed. • i would just like to say a big thanks to all involved for making me feel so welcome and being

so understanding. sometimes when you join a project late you feel completely out of your depth and often never feel like you are a part of the process but with this project it has not felt like that. all involved should be really proud of what has been achieved.

• thank you for all the hard work you put into hosting • the meeting was both enjoyable and importantly productive. • please keep your standards this high in future - it was a pleasure to work within the team. • hopes that we all will feel the cctp project valuable for our organisations and find new and

other opportunities for future collaboration • we were really well taken care of. the service and food was beyond excellent and they had a

diverse and exciting program planned for us. • I couldn’t\`t have asked for a more enjoyable time, thank you to the host organisation. • a great partnership meeting, thank you for hosting us Slovenia. • I really enjoyed the trip and found out lots of information and the benefits of the programme

for Romania and look forward to seeing how other partners have brought this project to life.


P a g e | 14

STAKEHOLDER MEETINGS PADMA UK PCDT UK CONSTRUKTIVA SE BUCOVINA RO ŠENTPRIMA SI

On Huddle:

- evaluation for each partner

- questionnaire

COMMON AND AVERAGE RESULTS (N=38)

• I received on time all information I needed for my participation at the meeting.


• The meeting agenda was relevant, adequately prepared and easy to follow.


• The meeting was realised efficiently and according to plan.


• There was good balance of topics covered.


• Partners questions were answered, problems discussed and solutions agreed.


• Tasks were clearly presented and explained.


• Participants exchanged best practises/experiences.

strongly agree 45 %, agree 25 %, neutral 30 %

• Participants strengthen their network.


• The purpose of the meeting was accomplished.


• The meeting was the right length of time.


P a g e | 15

agree 45 %, strongly agree 35 %,

• The meeting place was easily accessible.

agree 45 %, strongly agree 30 %

• Facilities of the meeting room were adequate.


COMMENTS (some)

What did you like and do not like about the meeting?

• liked the positive attitudes and progress in process • I liked the participants • I like that I got more information about the project • the networking and the completion of the project • I really enjoyed the meeting and meeting new people, there was nothing that I did not like

about the meeting • the best was the combination with study visit and stakeholder meeting • absolute magnificent location and accommodation for the meeting • the meeting was wonderfully organised, good exchange of experiences, nothing I can

complain about • like the format , strengthening relationships with partners, there was nothing I didn`t like • we need this kind of education, training • all information were clear and easy to understand , good point meeting

What can we do to improve the meeting next time?

• more time • more stakeholder present at the meeting • we can more learn about each other’s organizations and workplaces; we can more talk about

specific and similar cases at work • make slower whit some verifications and summary moments • meeting was as expected with questions and answer to all questions • continue as this time • plan for what will happen after the project for the network we created • information been presented clearly , people get involved in discussion , nothing to improve • not something I can think of, Ii like that everyone is asked to join with opinions and that we

decide many things together, I like that less on agenda to fit time better Other comments, concerns or requests?

• it was great! • all helpful • the old idea I had was combined whit a new suggestion, its interesting how right time and

occasion might come • pleased to be involved • it was a good meeting


P a g e | 16

LOCAL EVENT BUCOVINA RO (n=34) CONSTRUKTIVA SE (n=21) ŠENTPRIMA SI (n=20) PADMA UK, PCDT UK (n=19)

On Huddle:

- evaluation for each partner

- questionnaire

EVALUATION REPORT

• How satisfied were you with the registration process?

BUCOVINA: very satisfied 80 % CONSTRUKTIVA: very satisfied 60 % ŠENTPRIMA: very satisfied 50 % PADMA, PCDT: very satisfied 75 %

• How satisfied were you with the event materials provided? BUCOVINA: very satisfied 80 % CONSTRUKTIVA: very satisfied 70 % ŠENTPRIMA: satisfied 60 % PADMA, PCDT: very satisfied 60 %

• How satisfied were you with the speakers/presenters? BUCOVINA: very satisfied 100 % CONSTRUKTIVA: very satisfied 60 % ŠENTPRIMA: very satisfied 65 % PADMA, PCDT: very satisfied 65 %

• How satisfied were you with the event facilities? BUCOVINA: very satisfied 80 % CONSTRUKTIVA: very satisfied 60 % ŠENTPRIMA: very satisfied 55 % PADMA, PCDT: very satisfied 85 %

• How satisfied were you with event length? BUCOVINA: very satisfied 60 % CONSTRUKTIVA: very satisfied 60 % ŠENTPRIMA: satisfied 60 % PADMA, PCDT: very satisfied 65 %


P a g e | 17

• The content of the event sessions was appropriate, informative and useful for my work. BUCOVINA: strongly agree 75 % CONSTRUKTIVA: agree 55 % ŠENTPRIMA: strongly agree 60 % PADMA, PCDT: strongly agree 55 %

• The event was well organized. BUCOVINA: strongly agree 85 % CONSTRUKTIVA: agree 100 % ŠENTPRIMA: strongly agree 50 % PADMA, PCDT: agree 100 %

• Support staff was helpful and courteous. BUCOVINA: strongly agree 85 % CONSTRUKTIVA: agree 95 % ŠENTPRIMA: strongly agree 70 % PADMA, PCDT: agree 100 %

COMMENTS (some)

What did you like most about the event?

BUCOVINA: • efficiency • the location, the moderator , the guests • the facilities of the event • the content of the presentation was good and informative • professionalism, involvement of coordinators in community life • interactive discussions • the presentation of the projects, the award of the participants at the program • the way of the presentation of the material and the activities of the program • organization and interactivity • the variety of the information that i received and their utility • the organisation was perfect! we feel welcome! • I learned a lot of new and interesting things and various projects. Thank you!

CONSTRUKTIVA:

• good new contacts • the seminars, the people • good planning, various seminars • important issues • nice staff, beautiful environment • interesting seminars


P a g e | 18

ŠENTPRIMA:

• The subject discussed. • openness, lecturers • A wide range of people of different profiles and professions, with whom we could exchange

views. • the topics discussed on the employment opportunities of the more difficult to employ. I got a

lot of important information and ideas. • examples of good practice and integration of different actors. • suitable length of the meeting • A relaxed discussion • examples from practice. areas where improvements are needed. • The lecturers gave a very clear picture of the problems, supported by examples from practice, • I mostly liked the open communication between the participants of the meeting and the

relatively small number of participants that allowed it. • Diversity of content and comprehensive delivery of useful information. • Presentation of the Resolution on the National Program for Mental Health. • contribution of Šentprima • Practical questions, the presence of representative of the ministry of labour, family and social

affairs • the participation of various stakeholders, the exhibition of products of participants included

in the social inclusion PADMA, PCDT:

• hearing about experiences in partner countries • background to cctp which i did not know about • opportunities for further training alongside our own roles • to find out that there\`s always a solution and hope for every problem; doing our best to

make peoples life to live • learning about the opportunities available • the presentation about Plymouth mind the presentation about community champion training

programme • learning about the specific cctp programme and the modules sound great • meeting and building new contacts; info - not necessarily known already; time to think and

plan future plans • speakers were friendly and knowledgeable. it was well paced; good understanding now of the

project outcomes • passionate people and staff • good to hear from the various speakers and previous projects. wish I`d known about this

earlier • the speakers were all very engaging. they all spoke clearly and loud enough to be heard • very informative (networking)

What did you like least about the event?

BUCOVINA: • there was nothing to dislike • the length of the event • to each module we need examples


P a g e | 19

CONSTRUKTIVA: • everything has been good • not so easy to see pictures and texts at the power points

ŠENTPRIMA:

• everything was fine • the absence of a municipal delegate

PADMA, PCDT:

• slightly lost about erasmus funding • lack of clarity at times • pre-presentation nerves - lack of accessible internet • amount of presentations

Recommendations for further event.

BUCOVINA: • I recommend to the organizers to invite as many people as possible and as often as possible

to such meetings. it is very important • go on like that ! • more frequent meetings • more examples

CONSTRUKTIVA:

• do more events • everything ok

ŠENTPRIMA:

• More events on this topic • We could have a discussion with similar topics, an even deeper conversation, more

interaction with the audience, solving problems from the field, linking and presenting various positive experiences.

• I recommend for other events that could be organized also in other cities in Slovenia on this topic PADMA, PCDT:

• yes - always useful to hear about the great work going on locally - thanks to all involved! • something about future projects and collaborative working • more networking activities and information about Plymouth mind • more attention to detail regarding other countries


P a g e | 20

MOODLE – BUCOVINA RO n=32

On Huddle:

- evaluation

- questionnaire

EVALUATION REPORT

Did you know Moodle before this training?

How often have you been using Moodle?


P a g e | 21

How have you prepared for this training?

The teachers has been responsive on Moodle.

Moodle is generally very easy to use and navigate.


P a g e | 22

The "forums" on Moodle are useful for learning.

COURSE CONTENT FEATURES

OVERALL EXPERIENCE


P a g e | 23

MOODLE – CONSTRUKTIVA SE n=7

On Huddle:

- evaluation

- questionnaire

EVALUATION REPORT




P a g e | 24





P a g e | 25



OVERALL EXPERIENCE


P a g e | 26

MOODLE – ŠENTPRIMA SI n=7

On Huddle:

- evaluation

- questionnaire

EVALUATION REPORT




P a g e | 27





P a g e | 28



OVERALL EXPERIENCE


P a g e | 29

MOODLE – PADMA UK n=8

On Huddle:

- evaluation

- questionnaire

EVALUATION REPORT




P a g e | 30





P a g e | 31

The "forums" on Moodle are useful for learning


OVERALL EXPERIENCE


P a g e | 32

MOODLE – PCDT UK n=16

On Huddle:

- evaluation

- questionnaire

EVALUATION REPORT




P a g e | 33





P a g e | 34



OVERALL EXPERIENCE


P a g e | 35

TRAINING – BUCOVINA RO n=257

On Huddle:

- evaluation for each module

- questionnaire

EVALUATION REPORT FOR ALL MODULES

Module CONTENT

Module DESIGN


P a g e | 36

The facilitator (instructor/teacher) was well prepared.

The facilitator (instructor/teacher) was helpful.

Evaluation of each teacher is in the evaluations for the individual modules.

Module RESULTS


P a g e | 37

SELF-PACED DELIVERY

HOW WOULD YOU IMPROVE THIS MODULE?


P a g e | 38

COMMENTS (some)

What other improvements would you recommend in this module?

• a better communication between facilitators and students • perhaps I would try to teach the content in a more interactive way

What is least valuable about this module?

• I did not find anything that would be least valuable

What is most valuable about this module?

• resources • the information we received • resources, information


P a g e | 39

TRAINING – CONSTRUKTIVA SE n=58

On Huddle:


- questionnaire


Module CONTENT

Module DESIGN


P a g e | 40




Module RESULTS


P a g e | 41

SELF-PACED DELIVERY



P a g e | 42

COMMENTS (some)


• programme together with partners from the project or other partners in Europe to a common cctp, using Google hangout or similar tool and our moodle.

• small test after every module. • if we can have more books


• in Sweden we want to inspire and strengthen people with experiences as new in the country, with disabilities or out of labour market, young persons to use their own ambitions and experiences in a way they can improve and move along the education, job and voluntary work in community. the risk that we do a programme, modules not useful for the students to feel strong and secure in front of others, in similar situations or persons working together with them can\`t be measured here.


• knowledge • learn to think different • to know how poor people live • the teacher • information and relationship. • the statistics that shows how big the voluntary sector are • how old people continue to work • the knowledge about the facts


P a g e | 43

TRAINING – ŠENTPRIMA SI n=56

On Huddle:


- questionnaire


Module CONTENT

Module DESIGN


P a g e | 44




Module RESULTS


P a g e | 45

SELF-PACED DELIVERY



P a g e | 46

COMMENTS (some)


• more videos and practical examples • the subject was well covered, but we could have more time to learn about different aspects of

the disabled. • I find the content of this module very helpful and would like to learn more, so we would need

more time for it.


• couldn’t\`t say. there was nothing that did not fit in. • everything was valuable for me. • The entire lecture is important because only with good knowledge can we help our users. so

talking about a more or less important part of the lecture is pointless. • all information was useful


• practical examples • the ways of adapting of working environment to our users. • the experience of others present at the seminar • acquiring new knowledge and lessons. good practices - examples • reflection about my personal working experiences. • I found all of it very interesting and useful! • learning more about working with families. • learning about the possibilities of social inclusion of persons with disabilities. • as we do not work directly with offenders it was good to hear what institutions are around

which offer them help after.


P a g e | 47

TRAINING – PADMA UK n=41

On Huddle:


- questionnaire


Module CONTENT

Module DESIGN


P a g e | 48




Module RESULTS


P a g e | 49

SELF-PACED DELIVERY



P a g e | 50

COMMENTS (some)


• more support from tutors • more emphasis on mentoring and less on coaching • better training information to complete the module • frontal lesson to clarify well or a more responsive tutor to answer any doubt • no changes is was very interesting • too much repetition • frontal lessons, more focused tutors


• not sure - it was all good stuff, just a lot of it!! • some of the exercises were repetitive • all good • roles of boards and trustees • the detailed questions on coaching - its not as important as mentoring for most people who

work in the voluntary sector.


• recognise the value of volunteers and the contribution they make • I found Dan who I mainly had contact with very helpful, extremely encouraging & supportive. • all learning is useful it either adds to prior knowledge or introduces new concepts-- • content learned • good insights into the physical and psychological changes in older age • the colour coded personality tool was very interesting and gave me a better understanding of

individual personality and how to deal with them. • taking into consideration how best working practice can be reflected in own work and

organisation, utilising experiences of other organisations • all learning is valuable. Either it adds to prior knowledge or introduces new content. • understanding what motives volunteer and tapping into what they want to achieve and

meeting the organisational needs • leadership and management • to recognise that there are many factors around vulnerability and that anyone can be

susceptible at any point in their lives. • task 4 - motivational interviewing - this was most helpful. • recognising that mental health and dependency issues can be interlinked and one can cause

dependency. Recognising that the right motivators are key to working successfully with a client group.


P a g e | 51

TRAINING – PCDT UK n=45

On Huddle:


- additional evaluation made by PCDT

- questionnaire


Module CONTENT

Module DESIGN


P a g e | 52




Module RESULTS


P a g e | 53

SELF-PACED DELIVERY



P a g e | 54

COMMENTS (some)


• there was too much information to wade through • content format could be more stimulating • faster learning • maybe more content • faster pace


• nothing that wasn\`t valuable


• techniques for community mapping • to explore how my organisation can work with people who are released on temporary license

in the future. • the benefits of volunteering to stakeholders. • it has allowed me to see a bigger picture when looking at communities. when establishing

networks i feel encouraged to establish networks outside of the obvious choices. • good pace of learning • how community developers need to work with their communities and how they positively

provide support to them. interesting, relevant practical and clarifying. • knowledge gained will help me support clients better • my own role in community development, how i can participate in asset mapping and valuing

making best use of resources. • the stats on the ted talk film regarding inequalities within different countries in the developed

world and how it correlates to increased social problems. • the source materials • the different coaching models. it will enable me to support learners to be more confident

online. • the key areas and standards for community development practice. allows me to be better

informed about the scope of my role. • empowering, rewarding and interesting module. • it was different to some of the previous training i had done and interesting as a refresher, and

different ideas. i work with clients in • crisis every day as well as supporting volunteers who also have different disabilities and

mental health problems, so this will be used everyday.


P a g e | 55

CONCLUSIONS

The results of evaluations show:

PARTNERSHIP MEETINGS

High level of partner (participants of meeting) satisfaction with the partnership meetings in all evaluated areas (preparation, agenda, content, efficiency, discussion, solutions, tasks, network, the purpose of the meeting, duration, place)

STAKEHOLDERS MEETINGS

High level of stakeholders (participants of meeting) satisfaction with the stakeholder meetings in all evaluated areas (preparation, agenda, content, efficiency, discussion, solutions, tasks, network, the purpose of the meeting, duration, place)

LOCAL EVENTS

High level of participants (participants of local events) satisfaction with the local events in all evaluated areas (registration process, materials provided, speakers, conference facilities, duration, usefulness, organization)

MOODLE

Satisfaction, facilitator, knowledge of, frequency of use, usefulness

1. Did you know Moodle before this training?

partner YES [%] NO [%] BUCOVINA 60 40 CONSTRUKTIVA 70 30 ŠENTPRIMA 15 85 PADMA 0 100 PCDT 75 25

2. How often have you been using Moodle?

partner Every day [%] Every week [%] Every month [%] BUCOVINA 20 80 0 CONSTRUKTIVA 0 50 50 ŠENTPRIMA 0 15 85 PADMA 0 90 10 PCDT 0 0 100


P a g e | 56

3. How have you prepared for this training?

partner

No preparation, but would have

if I have the time [%]

No preparation because I know Moodle before this training [%]

A previous course is

necessary to work with

Moodle [%]

I don’t need previous course

to work with Moodle [%]

BUCOVINA 20 30 15 35 CONSTRUKTIVA 50 0 50 0 ŠENTPRIMA 40 15 30 15 PADMA 40 0 0 60 PCDT 50 10 30 10

4. The teachers have been responsive on Moodle.

partner Strongly agree [%] Agree [%] Neutral [%] Disagree [%]

Strongly disagree

[%] BUCOVINA 15 60 20 5 0 CONSTRUKTIVA 25 25 25 0 25 ŠENTPRIMA 15 60 25 0 0 PADMA 15 10 50 25 0 PCDT 0 0 90 10 0

5. Moodle is generally very easy to use and navigate.

partner Strongly agree [%] Agree [%] Neutral [%] Disagree [%]

Strongly disagree


6. The forums on Moodle are useful for your learning.

Partner Strongly agree [%] Agree [%] Neutral [%] Disagree [%]

Strongly disagree



P a g e | 57

7. Course content features

1 – 5 (very easy to use, easy to use, somewhat difficult to use, difficult to use, did not use)

partner books literature lessons news/ announcements

uploading of files

submitting of assignments

BUCOVINA 1,5 1,5 1,5 3,5 2 2 CONSTRUKTIVA 4,5 3 3,5 3 3 3 ŠENTPRIMA 2,5 1,5 2,5 2 2,5 2 PADMA 4,5 2,5 2,5 3,5 2,5 2,5 PCDT 5 5 5 5 5 5

8. Overall experience

1 – 5 (strongly agree, agree, disagree, strongly disagree, no opinion)

BUCOVINA CONSTRUKTIVA ŠENTPRIMA PADMA PCDT Moodle is straight forward and intuitive. 2 3,5 2 1,5 4 The organization and sequence of the course was easy to navigate. 2 3,5 2,5 1,5 5

I did not have any difficulty completing class assignments in Moodle. 2 3,5 3 2 5

I feel Moodle improved communication with my classmates. 2,5 4 4 4,5 5

I feel Moodle improved communication with my instructor/teacher 2,5 4 3,5 4,5 5

I feel Moodle promoted a sense of community within the course. 2,5 3 2,5 4 5

In my opinion, feel I learned just as well in a Moodle course as I would in a face-to-face tradition course.

2,5 3,5 2 2,5 5

Overall, I would like to see Moodle used in all of my courses.

3,5 4 2 3,5 5


P a g e | 58

TRAINING – all modules

Training aims, training content and design, pedagogical materials, tools, training delivery, facilitators, improvement, value, satisfaction (trainees, trainers).

1 – 5 (strongly disagree - strongly agree)

MODULE CONTENT BUCOVINA CONSTRUKTIVA ŠENTPRIMA PADMA PCDT I was well informed about the objectives of this module 4 3,5 4,5 4 4

This module lived up to my expectations. 4 4 4,5 4 4

The content is relevant to my job. 4 4 4,5 4 4 MODULE DESIGN BUCOVINA CONSTRUKTIVA ŠENTPRIMA PADMA PCDT

The module objectives were clear to me. 4,5 3,5 4,5 4 4

The module activities stimulated my learning. 4,5 4 4,5 4 4

The activities in this module gave me sufficient practice and feedback. 4,5 4 4,5 4 4

The difficulty level of this module was appropriate. 4,5 4 4,5 4 4

The pace of this module was appropriate. 4,5 4 4 3,5 4

MODULE FACILITATOR [average rating of teachers] BUCOVINA CONSTRUKTIVA ŠENTPRIMA PADMA PCDT

The teacher was well prepared. 4,5 4 4,5 3 4 The teacher was helpful. 4,5 4 4,5 3 4

MODULE RESULTS BUCOVINA CONSTRUKTIVA ŠENTPRIMA PADMA PCDT I accomplished the objectives of this module. 4,5 4 4,5 3,5 4

I will be able to use what I learned in this module. 4,5 4 4,5 3,5 4

SELF-PACED DELIVERY The module was a good way for me to learn this content.

BUCOVINA [%]

CONSTRUKTIVA [%]

ŠENTPRIMA [%]

PADMA [%]

PCDT [%]

strongly agree 50 40 40 15 5 agree 45 40 50 50 80 neutral 5 20 10 10 15 disagree 5 strongly disagree 20


P a g e | 59

How would you improve this module?

BUCOVINA [%]

CONSTRUKTIVA [%]

ŠENTPRIMA [%]

PADMA [%]

PCDT [%]

Provide better information before the module. 3 55 0 25 12

Clarify the module objectives. 1 30 8 20 7

Reduce the content covered in the module. 1 2 2 22 12

Increase the content covered in the module. 6 20 3 8 7

Update the content covered in the module. 1 10 0 2 8

Improve the instructional methods. 8 21 2 38 4

Make module activities more stimulating. 19 22 2 15 16

Improve module organization. 14 30 1 12 13

Make the module less difficult. 2 1 0 8 4

Make the module more difficult. 5 3 3 0 3

Slow down the pace of the module. 1 0 8 8 3

Speed up the pace of the module. 2 3 3 0 4

Allot more time for the module. 6 21 12 10 4

Shorten the time for the module. 3 2 12 0 8

Improve the tests used in the module. 21 20 0 15 3

Add more video to the module. 13 50 58 8 4

FINAL EVALUATION REPORT - Project development training ... · final evaluation report . community champion training programme 2015-1-uk01-ka202-013597 . july, 2018

Documents