Core Skills assessment set for level of proficiency Core Skills for 21st Century Professionals 2017-1-ES01-KA203-038589 Intellectual Output 2 Lead partner: ISCAP-IPP This project has been funded with support from the European Commission. This publication reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
59
Embed
Core Skills assessment set for level of proficiency Core Skills ...
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
CoreSkillsassessmentsetforlevelofproficiency
CoreSkillsfor21stCenturyProfessionals
2017-1-ES01-KA203-038589
IntellectualOutput2
Leadpartner:ISCAP-IPP
ThisprojecthasbeenfundedwithsupportfromtheEuropeanCommission.Thispublicationreflectstheviewsonlyoftheauthor,andtheCommissioncannot be held responsible for any use which may be made of theinformationcontainedtherein.
1 Introduction1.1 TheneedoftheprojectCoSki21ThebackboneofCoSki21project is tobridgetheskillsgapwhich is reported (e.g.Mourshed2014;WEF2015, Jones2017)betweeneducational institutions andworking life. A skill gapmeansthatgraduates/employeeshave lacks intheirskills inrespecttotheskillsneeded inaworkingpositionorworkingenvironment.Inespecial,gapsseemtoexistinsocalledsoftskills.
Theseskillsgapsareperniciousforallthestakeholders,whichmeansgraduates,companiesandhigher education. For graduates, lack of some essential skills will probably decreaseemployabilitychancesaswellaspreventcareersuccess.Asrecruitedprofessionalsincompaniesare considered as investments, an optimized staff performance is desired. For businessuniversities, skilledandcompetitivegraduated isagoal for several reasons,oneof themostimportant being that they are measured by the employment rate of graduated. Highemployment rates of graduates provide a competitive advantage to business universities inrelationtootheruniversities.
From the point of view of companies, they have assumed different applications of CMS(competencemanagementsystem)inordertoadministertheirhumanresourcedevelopmentactivities. These particular systems usually include skills maps to be used in the clientorganizations.However,thereisnotnecessarilyanyconnectionbetweentheskillmapsandtheskillsexistinginhighereducationcurricula.
This isonefundamentalorigin for theskillsmapsand it formsanobstacle for thediscussionbetweeneducationalinstitutionsandworkinglife.A‘firststep’tosolvethissituationistocreatecommonframeworkofskillsregardingprofessionalfieldsinvolved.
1. To create a common framework for soft skills, which includes both the ‘needed byorganizations’andthe‘educational’aspect.Thecreationoftheframeworkisenabledbya)anextensivestudyonexistingskillssystemsandb)aquestionnairedesignedfordetectingtheneedsofcompanies
2. as soft skills are ‘newcomers’ in curricula, provide guidelines for evaluating andassessingthem
Theintellectualoutputsarebyalldesignatedtoallstakeholdersintheprocess.Forteachersandcurriculaplannerstheywillprovideanupdatedstate-of-artoncompetencesandskillsneeded,while studentsandgraduates takeadvantage in formofhighermatch forworking life. Formanagers and recruiters, who do not yet apply a competence management system, theseoutputs offer a detailed insight on skills-sets andmethods for fostering them. All practicaldeliverablesarepresentedonthee-Platformoftheproject.
1.3 TheOutput2:coreskillsassessmentsetforlevelofproficiencyThis section is intended tobeusedby thestudents, teachers,andemployers toassess foraspecificsoftskilltheirlevelofproficiency.
Thesoftskillsassessmenthastwoaims:1)aretheuseofthe“CommonFrameworkSoftSkillsReport” from the IO1 to apply themat universities by enabling teachers and staff to assessstudents,companiesandassociatedpartnerstoimproverecruitingprocessanddevelopmentactionsofpersonnel(CEOS,Alumni,GEE–allinvestigationandadministrativesupportatISCAP;
The academicmark is the combinationof theproficiency level achievedby the student in aspecificskillandthegradeattributedbytheteachertothe“setofresults/products”resultedfromtheteachingandlearningprocessinaperiod.
The development of an assessment toolwith a dual goal to assess students and to provideorganizationsthe“studentprofile”regardingtheskillslevelofproficiencyisoneoftheaimsoftheproject.Thisisexplainedindetailfurtherinthisreport.
The perception that the students and employers have about the acquisition and thestrengtheningoftheirsoftskillsisgoingtogenerateinthemtheself-awarenessoftheirlevelofcognitive development in each soft skill. Thus, the appreciation and the recognition byemployerswillenhancethepromotionofthepersonandtheprofessional.
Theroleoftheparticipantsintheprocessofteachingandlearning,suchasteachers,directorsandstaffisveryimportantbecausetheyaretheforefrontinthisprocess.However,asuitabletraining should be provided to those participants, giving them the necessary tools to assesscorrectlythesoftskillspotentiated/developedduringtheacademicprocess.
ThecreationofaframeworkoftheCoreSkillsneededforthe21stcenturyprofessionalsthatcanbetaughtatschoolandthataretheonesthelabourmarketneeds,enablestohaveastrong“two ways path” between what the companies need and what the school can provide. Inaddition,pedagogiesandtheassessmentofthesoftskillsmethodsofteaching/learningisaninnovationbroughtupbythisproject.
Fromseveral studies carriedoutby internationalorganizations, suchas theWorldBank, theUnited Nations Organization, and the European Union Committees, the framework for aneducationforthefuturemustengagethedevelopmentandtheassessment,whileatschool,ofthehardandthesoftskills.
Thehardskillsstudiedalongtheyearsandschoolsaroundtheworldteachthemwell.Itisafact.However,theissueofsoftskillsonlynowisarisingintheeducationfield.Itisalsoafactthatthedevelopmentofseveralsoftskillsamongstudents,atayoungageisquiteimportantto“bringup” the person inside the student and to better prepare them to a future in a dramaticallychanging world, such as the work in a multidisciplinary and transnational context with thepermanentuseoftheprocessesdigitalizationinorganizations.
Soft skills assessment considers and values the experience of the person, such as learningprocessandpersonalgrowth,especiallyintheacquisitionandstrengtheningofthosesoftskillssoughtbycompanies,favouringthustheirrecognition,enhancementandpromotion.
BasedonaqualitativesurveycarriedoutonthreeofthecountriesinvolvedintheProject,Spain,PortugalandFinland,andontheliteraturesurveyatEuropeanlevel,theprojectpartnershiphasidentified the topeight soft skills considered themost important for theprofessional careerdevelopmentofstudents,andtomanagetheworkinglife.
• Thefirstsoftskills’groupcomposedbyskills8,9and11–AdaptabilityandFlexibility(self-control, flexibility and changemanagement, and self-confidence). Self-control istheabilitytomaintainemotionsundercontrol; flexibilityandchangemanagement isthe ability to adapt to different people and circumstances, accept organizationalchangesand,eventually,thechangeofresponsibilities;andself-confidenceistobelievethatyoucansuccessfullyexecuteatask,knowingthatyouwillchoosethebestapproachtosolveaproblem.Thesetofthesethreesoftskillsisadaptabilityandflexibility.
• The third soft skills set ismanaging responsibility (skills 5, 6; 15 and 16): peoplemanagement – know the reality of eachworker in order to persuade them towork
CoreSkillsassessmentsetforlevelofproficiency
Page12of59
together aiming to achieve a common goal: the goodperformanceof the company;leadership – know how to communicate and work in team. Promote workers’autonomy;Networking–establishcontactnetworksthatbringbenefitstotheinvolvedparts; customer orientation – show willingness acting to help to satisfy the clients’needs.
• The fourth soft skills set is timemanagement (skill 3): planning and organization –elaborateplansofaction-orientedtotheoptimizationofresources.
• The sixth soft skills set is team working (skills 7 and 10): work in a team and incooperation–knowhowtointeractwithothers;useactivelistening;acceptdifferentopinions;mutualhelpasanenginetothecompany’sdevelopment;commitmenttotheorganization – have as priority the needs of the company and orient its interestsaccordingly.
• Theninth soft skills set isdecisionmaking (skills2,3and19):orientation togoals–define clear and realistic goals, which contributes to his/her self-motivation. Orienthis/her performance to his/her personal and professional growth; planning andorganization(skill3);strategicorientation–havetheabilitytoconnectalongtimevisionwithcomprehensiveconceptsinday-to-daywork.
• TheeleventhsoftskillssetiscreativityandInnovation(skill18).• The twelfth skills set is critical and structured thinking (skills 20 and 21): analytical
1.6 TheroleofthestakeholdersinvolvedCompanies and organizations from the surrounding communitywere involved through theiranswertothesurveyappliedinPortugal.
Thecompaniesandorganizationshadasignificant role in the identificationof theirneeds interms of skills required to the new environment in business. The Alumni organizationparticipated actively on the survey and in the gathering of data that was essential for thecreationof theassessment“tool”, see through theeyesofmanagersandHR recruiters.The
The students both from TURKU University of Applied Sciences, from UPV and ISCAP-IPPparticipated on the survey released through the community of each one of these HigherEducationInstitutions.
Alongthisprocess,studentsandteacherscalledtoparticipate inmeetingsanddointerviewswiththeaimofhavingtheiropinionabouttheimplementationofthe“skillbox”methodologyin order to support the design of the “Skill Boxes” related and to implement the necessarychanges.
1.7 ManagementSimulationusedatISCAP-IPPAt ISCAP-IPP, the students of the last year of the first cycle of studies from the Course ofAccountingandManagementwereaskedtobeapartoftheprojectinaspecificrole:toassessthe “assessment tool” using it in the classroom context on the subject designated byManagementSimulation.
ThesubjectManagementSimulationallows the intervenient toworkwithactivemethodsofteachingand learningduringacompleteyear.This subject substitutes the internship for thestudentsoftheAccountingandAdministrationCourse.Theaimistoputstudentsdealingwithproblemsofreal(virtual)organizationswheretheyareemployersandmanagers.
Thus,thestudents,byapplicationofthetheoreticalmodelstothefactsofreallife,areledtodevelopandputintopracticethecompetenciesprogressivelyacquiredanddevelopedthroughproblem-situations introduced in the model, using new information and communicationtechnologiesandintegratedsystemsofinformationmanagement.
In each session, and based on a script (guide) the students create and develop all thebureaucraticactivitiesofacompany,organizedingroups,whatpromotesagreatoperationaldynamic,withhighreactivity.Thelearningmodelisbasedonthegroupwork,andstudentsareresponsibleforcarryingoutthetasksframedinthebusinessplanoftherespectivecompany.Theexecutionofthetasksbythestudentsisperformedinbusinessenvironmentlaboratoriesand controlled in person by the teachers. It is a teaching strategy crucial to developcompetencies.
Thesestudentsarelearningaprocessthatwillbeanessentialpartoftheirworkasprofessionals.Theability to thinkautonomouslyand incooperationwith theotherstudents isanessential
• Phase I: Theoretical concepts. Soft Skills involved, educational environment, socio-economic environment. This stage needs the analysis of skillsmaps, and as a resultselectaconcreteskillmapinordertoaskcompaniestodeterminethecoreskills
2.1 FrameworkThefirststageconsistsindefiningtheframeofreference.Thisstageisenteredattheinitiativeof the researcher, or because organizations consider that the soft skills obtained from thepreviousstagesshouldbereviewed.Thisstageistheclassicreview,stateoftheart,orstrategicstudy.Hereresearchersmustcollectthesoftskills,checkifnewoneshaveappearedorevengeneratethesoftskills.
Inthislaststep,youhavehowtheskilldesignersarepossiblypartoftheresearchenvironmentofthefuture.Theresultofthefirststageismadeupoftheskillmaps.Thesemapsmayhaveasmany soft skills as deemed necessary. However, the economics of skills implies that not allpeople,norallorganizations requireahighnumberof skills.Nor should theyhavea limitednumber.Intheanalysisofpreviousintellectualoutputcompetencies,itwasconsideredthatafigurebetween10and20isusuallyadequateforamedium-sizedorganization.
2.2 SoftSkillsselectionandplanOnceyouhavethenecessarysetofcompetenciesforanorganization,youmustperformthecorrespondinganalysis.Forthis,thecorrespondingquestionnaire3Siproposedinthepreviousresultmustbecarriedout.ThisquestionnaireprovidestheCoreSkillsoftheorganizationforaspecific job.CoreSkill isdefinedas the soft skill that thecompanyneeds, theuniversity canprovide and students can acquire. From the questionnaire, and the corresponding selection(classification)process,thesetofcoreskillsisobtained.
The last stage is especially interesting since it involves the completion of the training orimprovementplan.Inthiscase,atoolwillberequiredtoteachasoftskill,perblock.Inthisway,the"custom"designforthetrainingofthecompany'speoplewillbeapriority.
CoreSkillsassessmentsetforlevelofproficiency
Page17of59
2.3 TrainingThe final stageof themethod is that inwhich the trainingoccurs.At this stage students,oremployeesinthecaseoforganizations,areformedwiththe"softskills"blocksthattheyneed.Inthiscase,onlyemployeesneedtoreceivepersonalizedtraining.
Finally, the validation that allows to obtain feedback about the process is important. Thisvalidationmustprovideashort-termresult,aboutwhetherthetraininghasbeencorrectandamedium-term result aboutwhether the selected soft skills really constituted thecoreof theorganization'sneeds.
Theapproachbycompetencesinschoolhasasmainpurposetodevelopinstudentsthecriticalreflexivethinking,makingthemabletoanalyse,decide,planandcommunicatetheirideas.Inthissense, it isfundamentalthedevelopmentofteaching-learningandassessmentstrategiesthatpromotetheachievementofthedesiredlearningresults.2
The“greatclassicalthinkerswhohavestudiedtheproblemsofeducation,saidandrepeatedit:itisuptotheteachertopasstothestudentwhatMankindhasalreadylearnedaboutherselfandnature,allshehascreatedandinventedofessential”.3Accordingtothesamedocument,“oneofthemainpapersreservedtoeducationconsists,firstofall,inendowingHumanityofthecapacitytodominateherowndevelopment.Shemust,indeed,makeeachonetakehisdestinyin his hands and contribute to the progress of the society in which he lives in, basing thedevelopmentintheresponsibleparticipationofindividualsandcommunities”.
UNESCO –UnitedNations Educational, Scientific and CulturalOrganization, defines the fourpillarsofEducation:Learningtoknow;Do;Liveinsociety;andtobe.
1Vieira, D., Marques, A. (2014). Preparados para Trabalhar?, Lisboa: Consórcio MaiorEmpregabilidade/FórumEstudante.
2 Bastos, S., De Oliveira, H., Azevedo, L. (2016). “How to embrace the new challenges ofEducation?TheUseofanInnovativeMethodologyintheteaching-learningprocess,intheintheassessmentandintherelationteacher-studentvs.student-teacherBasedontheSimulatorofBusinessEnvironmenttechnology”.
3Delors, J. (2001).Educação:umtesouroadescobrir.RelatórioparaaUNESCOdaComissãoInternacionalsobreaEducaçãoparaoSéculoXXI.SãoPaulo:CortezEditora,pp.19e82.
P. Perrenoud, one of the authors thatmobilized the idea of competence as an overhaul ofeducationintermsoftheir improvement,definescompetenceasa 'knowledgeinuse'.6Thisnotionisveryclosetothecentreofanotherauthorinthisfield,onprofessionalskills.7Theseauthorsrefertovariouscognitivecapacitiestomobilizeresourcestomeetdifferentsituations.Skills are not themselves knowledge, attitudes, butmobilize, integrate andorchestrate suchresources.
The Project Tuning Educational Structures in Europe (2003) defined competences as “acombination of dynamics of attributes, in relation to knowledge, skills, attitudes andresponsibilities,whichdescribethe learningoutcomesofaneducationalprogramorthatthestudentsareabletodemonstrateattheendofaneducationalprocess.”
TheEuropeanUnionas“Asetofknowledge,skillsandabilitiesrelatedtothetrainingprogramthat allows the student to develop the professional tasks included in the degree programprofile.”
This “knowledge in use” assumed to be the opposite of “inert knowledge”, i.e., speaking ofcompetence refers to the knowledge that translates into effective usability and handling(intellectual,verbalorpractical)andnotcumulativewithwhichcontentisunknowntoactinthe
present,norsolveanysituationorthinkaboutit.Indeed,andasrelated"Developmentofskillsinvolves access to knowledge in its various dimensions and, subsequently, the progressive,integrated and dynamic mobilization of this knowledge, a perspective of continuousreconstruction”.9Despitediscussionsandlackofconsensusintheliteraturearoundtheconceptofcompetence,inthisstudyweconsidertheconceptsofskills,abilities,knowledge,attitudes,traitsandmotiveswithinthecontextofdeliveryofindividual,veryclosetothetriaddesignatedKSA:knowledge,skillsandattitudes.
3.2 LearningskillsLearning isacomplexprocess,which leads to theconstructionofmemories. It isachangingprocess,causedbyseveralstimuli,mediatedbyemotionsthatmayormaynotmanifestintheperson’s behaviour. Theways of learning are numerous, and each person is unique in thatprocess.10
Therearetwocurrentsthatjustifydivergentlytheunderlyingaspectsoflearning,namelytheschoolsoflearningbyassociationandtheonesofcognitivelearning.Thetheoristsofthefirstdefendthatthelearningprocessmadebytheassociation,thatis,istheresultofconnectionsbetweenstimulusandresponses.Thetheoristsofthesecond,thecognitivists,defendthatthisprocess is based on a structured set of perceptions, that allows who learns to realize theexistenceofseveralrelationsandsolvetheresultantsituations.
Amongmanydefinitionsoflearning,itiscommonlyacceptedKimble’s,whodefends11thatitisa process that, prevailingly after an experience produces change, relatively stable, in thebehaviourandorinthesubject’sabilitytooperate.
It is necessary to point out five different social cognitive approaches: the theories of sociallearning,defendedbyBandura(UnitedStates);thetheoryofsociocognitiveconflict(France);
10Azevedo,L.(2012).AvaliaçãodasAprendizagensnoEnsinoSuperior:estudodeumsistemadeavaliação das Unidades Curriculares de Projeto de Simulação Empresarial. (Tese deDoutoramentonãopublicada).UniversidadedeAveiro:Aveiro.
the socio-historical theory, proposedbyVygotsky (Russia) and the cooperative teaching andlearningtheories12.
Thestartingpointofsociocognitivetheory isbasedontheawarenessoftheteachersoftheneedoftakingintoaccountthesocialandculturalconditionsoflearning.Secondly,thereisagreat interest inenvironmental influences (environment, social classes, regional culture, andpopular culture)on learning, to theextent that theverynatureof learning is fundamentallysocioculturalandmusttakeintoaccountthelinksbetweenlearningandlife,i.e.,learninginasituation.
Considering that, the school organization should provide learning situations based onexperience and allow students to work in groups so that they acquired democratic socialbehaviour.Elementssuchassociety,knowledgeandtheindividualwerefundamentalandthecentreofcooperativelearning.13
It is important tomention someof theprinciples of the socio cognitive theory, such as it isdescribed mainly by several authors14: mutual influence, indirect learning, symbolicrepresentation,theperceptionofitseffectiveness,self-regulationandmodelling.
Takingtheseprinciplesintoaccount,itisdifficulttoelaborateateachingtheory,andtherefore,pedagogical strategies, as social cognitive theories of learning insist on mutualinterdependenciesamongalargenumberoffactors.
However,wecanpointout some,as suggest15 theseauthors: thepresentationofbehaviourmodelstostudents,totheextentthatstudentsliketoadoptbehavioursofsomepeopletheyconsiderrolemodels;theassessmentandthejustificationofthevalueofbehaviours;totheseauthor, the learning of a behaviour varies according to the value given to the result, and,therefore, it isnecessarytodemonstratethestudentstheinterestofeachlearning.Studentslearnbetteriftheycanseeforwhatitcanservetheminlifeorinthenextlearning;strengthenthe student inhisbehaviour is fundamental to showapositive reaction to the studentwho
15Gredler,M. E. (1992). Learning and instruction: Theory into Practise. 2ª Ed. Nova Iorque:MacMillan.
CoreSkillsassessmentsetforlevelofproficiency
Page22of59
progressesinlearning,asthisreactionallowshimtobuildapositiveimageofhimselfandfeelcompetent to carry out a task; practice, Bandura recommends to join the practice to theexplanation. Often a socio cognitive teaching strategy is very theoretical and is always bestunderstoodwhenonehasexamples, and, includes fourphases: analysisof thebehaviour tomodel;descriptionoftheadvantageofabehaviour;selectionofabehaviourmodeltoteach;andpreparationofthelearningsequenceanditsimplementation.
Thehumanbeinghasacertain“plasticity”whichdependsonwhatheis,whathedoes,whathewants to do and what he thinks he could do; has ideas, communicates them and actsaccordingly16.
The pedagogical strategies proposed by the defenders of cooperative education may beenunciatedasfollows:toholdthestudentsaccountable,thestudentmustfeelresponsibleforthe group operation. Students commit more if they know they will be rewarded by theirindividualefforts,soitisnecessarytorewardaccordingtothegroupperformanceandgiveextrapointstothestudentandinsistonindividualresponsibilitywheneverthegroupsincludemorethanthreeelements17.
Theteacherisnotonlyapersonwhotransmitsinformationbutperformsseveralfunctionsoffacilitation of individual and group work, and should, in the performance of those same
17 Slavin, R. (1990 (Jan.)). Research on Cooperative Learning: Consensus and Controversy.EducationalLeadership.Vol.47,n.º4,52-54Johnson,D.,&Holubec,J.(1988).CooperationintheClassroom.Edina:InteractionBookCo.
Someauthorsconsiderthefollowingaspectsshouldtakeintoaccountsothatthereisprogressin evaluation: “enable students tomonitor their ownprogress; give regular feedback to thestudents;enableevaluationand learningbypairs/ingroup,and,at last,drawself-evaluationpractices21”.
Accordingtotheseauthors,theassessmentmustbeactive,participated,sharedandcontinuous.New forms of assessment are required to promote interaction (between students, betweenstudents and teachers, always based on retroactivity), and putting the student and his/herlearningexperienceatthecentreoftheprocess.
Assessment is also part of the training process. Training assessment “(…) constitutes anassessmentwayconductedbytheonewholearnsandisaninstrumenttoconstructknowledge
19Mclean, L. (1988). AchievementMeasuresMade Relevant to Pedagogy.McGill Journal ofEducation.Vol.23,n.º3,243-252.
20 Millwood (2014). The Design of Learner-centred, Technology-enhanced Education,phd.richardmillwood.net.
21Figueiredo, J., & Veloso,M. (2010). Avaliação em Ambientes Online. Universidade Aberta.Retirado de http://www.prezi.com/bxvp0epnkerd/cael. McLoughlin, C., & Luca, J. (2001).Quality in online delivery: What does it Mean for assessment in E-learning Environments?ASCILITE 2001 Conference proceedings. Retirado de http.//ascilite.org-au/conferences/melbourne01/pdf/papers/mcloughlinc2.
CoreSkillsassessmentsetforlevelofproficiency
Page24of59
thatthestudentneedstoacquire22.”Formativeassessment“(…)makesavailabletotheteachermoreprecise andqualitative informationabout the learningprocesses, attitudes andall thestudentshaveacquired23.”
Educationalassessmentdefinedasanactofgatheringsystematicinformationconcerningthenatureandthequalityofeducationalobjects26.Assessisanorganizedsetofprocessesthataimtheregulatoryfollow-upofanyintendedlearning,andwhichincorporate,forthisreason,theverification of its achievement.Nevertheless, in order to assess it is indispensable to createmechanisms formonitoring the process to understand it, nailing it and reorienting it in thedesired direction27. To manage the progress of learning, periodic balances of studentacquisitionsaremade.Theseareessentialtosupportapprovalorguidancedecisionsthatlaterare necessary. Contrary to what is the belief, sometimes, continuous assessment fulfils acumulative function,andevena certifyingone,becausenothing replaces theobservationofstudentsatwork,whenyouwanttoknowtheircompetencies.
The assessment of competencies must respect all the characteristics that all authenticassessmentshouldrespect28:includeonlycontextualizedtasks;addresscomplexproblems;help
22Nunziati, G. (1990). Pour construire un dispositif d’évaluation formatrice. CahiersPédagogiques,280,47-64.
28Tardif,J.(1996).Letransfertdescompétencesanalyséàtraverslaformationdeprofessionnels.In Meirieu, Ph., Develay, M. Durand, C., & Mariani, Y. (Eds.) Le concept de transfert deconnaissancesenformationinitialeetenformationcontinue(pp.31-45).Lyon:CRDP.
CoreSkillsassessmentsetforlevelofproficiency
Page25of59
studentstodeveloptheirskills;requiresthefunctionaluseofdisciplinaryknowledge;thereisnotimelimitarbitrarilyfixedwhenitcomestoassessingskills;thetaskanditsrequirementsareknown before the evaluation situation; requires some collaboration between peers; thecorrection considers the cognitive and meta-cognitive strategies used by students; thecorrectiononlyconsiderstheimportanterrorsintheconstructionofcompetencies;correctioncriteriaaredeterminedbyreferencetothecognitiverequirementsofthecompetenciessought;self-assessmentispartoftheassessment;correctioncriteriaaremultipleandprovidevariousinformation on the skills assessed; should determine students’ strengths; the informationextractedfromtheassessmentshouldconsiderthestudents’skills,theirpriorknowledgeandtheircurrentdegreeofdomainofthecompetenciessought;thesameassessmentproceduresare required to all students and the necessary support is available for those who havedifficulties;inaddition,assessmentfollowstherequirementsofecologicalvalidity.
Theassessmentprocedurestouse,havetobewelldelineatedinthepedagogicalpractices,beframedinaformativelogicandshouldbeorientedtowardsaself-regulatoryassessment,asthestudent builds his/her academic coursebasedon the referential of the educational process.Assessmentinacompetency-basedcurriculumorganizeddependingonthemanifestationoftheintended competency. Although Higher Educational Institutions are already aware of theimportance of developing and assessing the soft skills among their students, a minority ofinstitutionshaveformalpracticessuchasCurricularUnitsintegratedintotheofficialcurriculainordertoreachthisaim.InareviewofHigherEducationInstitutionsinitiativesandprojectsaimedat promoting students’ soft skills, only 9%were formal practices30.However, itmay also beachievedbyusingpedagogicalpracticesthatmayfostertheseskillsandwebelievethattheuseofskillboxesmethodologyistherisingsolution.
30 Vieira, D., Marques, A. (2014). Preparados para Trabalhar?, Lisboa: Consórcio MaiorEmpregabilidade/FórumEstudante.
CoreSkillsassessmentsetforlevelofproficiency
Page26of59
4 Assessment-set:trainingsoftskills4.1 TheimportanceabouttrainingskillsThe training of Soft Skills by using the methodology “Skills Boxes” in the learning processpresentsgreatadvantages.Ononehand,thestudentbecomestheactiveagentinthedecision-making process, which makes him feel motivated, facilitating the process of acquiringcompetencies.
On the other hand, there is the time factor, to the extent that the use of the “Skill Boxes”methodologyallowsthestudentstoobtainandtorepeatcertainresultsandtasks inashortperiodoftime-relatedtopractice,whichallowsstudentstoexperienceasmanysituationsaspossibleinreallabourlife.
Assessmentmustbeactive,participated,sharedandcontinuous.Theassessmentmustpromoteinteraction (between students and between students and teachers, always based onretroactivity) and must place the student and his learning experience in the centre of theprocess.
Thecontextoftheconcernsmovestothedomainofthelearningprocessandtotheproceedingscapable of improving it, moreover, makes the student aware of his own learning, bytransformingtheerrorsintoamomentofsolvingaproblem.Thefactthatitdoesnotinterruptthe process of teaching and learningmakes it an integral part of the process and gives it aregulatoryfunction.
Nevertheless,evenbeforeregulating learning,evaluationregulateswork,activities,authorityrelations,andcooperationamongstudents.TheideaunderlyingthisEvaluationSystemisthatthe student learns best if the environment is able to give him answers and regulations indifferent ways, such as the identification of errors, suggestions and counter-suggestions,complementary explanations, revision of the basic notions andwork on themeaning of thetask/project/activity.
However,assessingskillsand,mostimportantsoftskills,impliesthatstudentsareobservedinthe performance of tasks as close as possible to real situations, authentic, using a set ofinstrumentsthatallowthecollectionofevidenceonthedevelopmentofcompetenciesinthestudentsandaboutitsdemonstrationinthesituation.
Thedevelopmentofauniquemodelofassessmentforthissubjecthasgeneratedanawarenessonstudentsof theirownprocessof learning.Why?Becausethemodelofassessment inusepromotes a continuous feedback and communication between teachers and students. Also,studentsareencouragedtodotheirself-evaluationandtheevaluationoftheirpeersinsomeactivities,suchas,thepresentationofareporttoallthecolleaguesoftheclassroom.
Eachcompanythereforehasat itsdisposaltheappropriatetools(computers,printers,scans,phones, fax, etc.) as well as professional software, which includes modules that allow themanagement,inasystematicandintegratedperspective,ofallthesubsystemsofinformationtosupportmanagementdecisions.
As it happens in companies in the labour market, the students (here managers, partners,collaborators) have to meet a schedule, mark the point at the entrance and exit of theclassroom;onceathis/herworkstation (secretarywitha computer andall themeansabovementioned,inadditiontothenecessaryofficesuppliessuchasstamps,stapler,puncher,paper,physical file) and having the script (guide) of the respective session with the tasks to beperformed,theymake ingroup, theirworkdefinedforthatday(session).Theycheck if theyhavemailinthelockersplacedintheclassroomforthateffect,sendthemail,ifitisnecessary,placingitintherespectivelocker(bank,socialsecurity,finances,…)andproceedtothephysicalarchiveofthedocumentsgeneratedinthesession.
them; here continuous assessment is the lever in their process of construction andreconstructionofknowledge.
Thestudents’motivationasanessentialpsychologicalnoteofthenewsystemofeducationandtrainingbasedontheManagementSimulationModel:itisworthmentioningthespontaneousstimulationof theperceptionof self-efficacyof andby the students themselves. In fact, thepersonalevaluationoftheirperformancewillalwaysleadtotheirconsequent(in)satisfaction.Thus,thisprocesscanprovetobeanimportantfactorofmotivation,determiningthedegreeofperseveranceinthesuccessivetasksthattheyface,followingtheproposedproblems31.
On the other hand, the eminently practical and applicable real-life content functions as anexternal factor tomotivation. Students are involved in theprocess, they are themotor thatdevelopsthesystem,iftheydonotcreatetheinputsnecessaryforthefunctioningofthemarket,andthisdoesnotdevelop.
The fact that students can see and realize practical aspects of how to constitute their owncompany,completetheforms,constitute“thecompanyontime”,issuecheckstoemployees,paybillsofelectricityandwater,makeorderstoothercompanies,selltheirproducts,inshort,a whole series of activities of the real companies, gives them confidence, instils in themresponsibility,andthenotionthattheirroleandfunctionarevital.Itislearningbydoinganddoingwell.
TheEvaluationSystemisstructuredintheperspectiveoftheacquisitionofcompetencesanddirectedtothedegreeofsatisfactionandsuccessofthestudent.Assessmentisanintegralpartof the teaching and learning process and contributes to the development of students’autonomy, enhancing their professional skills, through the valuation of the knowledgepreviouslyaccumulatedbytheappropriationof“knowinghowtodo”,of“knowinghowtobe”and“knowinghowtoact”,thatshapetheshowncompetence.
31Oliveira,M. L. (2003). ProjetodeModernizaçãodoEnsinoSuperiordaContabilidadeedaGestão(PECRESC).
Teachersofcurricularunitsofapracticalandinterdisciplinarynatureshouldbeendowedwithpedagogical and technical skills, which enable them to fully comprehend the assumptionsinherenttothecurricularunitsunderanalysis.
Thatiswhyweconsiderfundamentaltheexistenceofaneffectiveandinclusivecoordinationinorder to guide the role of these teachers throughout this process of teaching and learning.Otherwise,wewillhavetheoreticalteachersteachingcurricularunitsofpracticalnature,whichmay result in demotivation of the students and consequently the non-achievement of thecompetencies that are intended to be developed with these practical and interdisciplinarycurricularunits.
TheexistenceofthismodelintheCourseofAccountingandAdministrationandothersinsocialsciences,isimportant,butsothatitcanpourmorecloselytothebusinessrealitythenecessaryknowledgetothefutureprofessional,itwouldbeimportantthecoexistencebetweenthismodeland theobservation internship in several companiesalong thecourse.This internshipwouldallowthestudenttowitnessthebusinessactivitiesincompaniesofdifferentfieldsofactivityandreflectcriticallyontheobserved incontrastwiththe learned inthecurricularunits.Thiscombination results from the fact that the development of competencies in a virtualenvironment is different from its real professional development. Thus, the graduate whenarrivedatthelabourmarketwouldbeacarrierofasetofspecificandgenericcompetenciesthatwould allow him tomake a difference in the destinies of organizations and contributedirectlytothequalityofthese.
32 Costa, N., Martins, I., & Candeias, I. (2010). A avaliação e regulação de desempenhoprofissional(Vol.ColeçãoSituaçõesdeFormação).Aveiro:UniversidadedeAveiro,p.23.
CoreSkillsassessmentsetforlevelofproficiency
Page30of59
Asexplainedaboveeachthree,ourlessoniscompulsorytothestudentstoattend.Thestudentshavetwolessonsina5days’week,inalternateddays,theyworkinateam,manageasimulatedcompany, with a specific business plan. The company must achieve a certain performanceimpliedonthebusinessplangiventothestudentsatthebeginningofthesemester.Everylessonthecompanyhasseveraltasksoractivitiestodothatthe“coordinationandtheteachers”studypreviouslyandbuilda“script”thatthestudentshaveattheirdisposaltwosessionsinadvanceinordertopreparetheworktobedone.
Theinstructionsindicatedintheguideofeachsessionprevailoveralltheotherinformationofgeneral and specific character, presented in other documents, namely in the curricular unitsupportnotebookandintheBusinessPlan.
1. Thedevelopmentofthethemewillbepresentedinawrittendocumentcomposed,atmost,by eight pages (type of letter Arial or Times new roman, size 12, space one and a halfbetweenlines),distributedasfollows:
This Activity, intends to potentiate/develop in students the gathering of information; thesummary must be presented by written and with an oral presentation of the information;differentiatetheessentialfromtheaccessory;reachaconsensusamongthegrouptoaddthemost import informationonthethematic inquestion;divisionoftasksandrolesoftheteammembers; organizationofwork;Monitoring the tasks and time;Write the reportwithin therules;Presentation:writtenreportandOralpresentation.
Teachers, after the oral presentation discuss with the classroom the assessment of thecommunication–oralpresentation,madebythegroup,intermsofbodypostureandlanguage,voice,andthesevencriteriapresentedinthefigureabove.
Each student assessment regarding his personal oral presentation (voice, presentation,argumentation,posture,andotheraspects).
Inordertohavethepossibilityforthestudenttodohisself-assessmentandpeerassessment,thepresentation is recordedand later,after thestudentwatches themovie,eitherwith theteacheroralone,inordertodohisownevaluationandpeerevaluation,usingthesamegridthatisusedbyteachers.Also,afterthepresentationinadeterminedlesson,eachstudentsendstheteachersanemailwithhisself-assessment:thestudentisonlyaskedtothinkofabouttheoralpresentationmadeandtheonethathehadpreparedbefore.
Therelationbetweenteacherandstudentisveryimportantinthisprocess.Thereisameetingwiththegroupofthestudentsandtheteacherinorderforthemtodiscusstheselfandpeerassessmentandtoconfronttheirownassessmentwiththeonethattheteacherhasmade.Onlyin the meeting the teacher reveals the evaluation of the written report and the individualevaluationoftheoralpresentation.And,mostofthetimes,theself-assessmentislowerthantheassessmentmadebytheteacher.
I need feedbacks or encouragement to seek new learning opportunities and toproposemyownideas.Igenerallyexpecttobemotivatedbymychiefatwork.
Ioftenreflectonmyownperformanceasanoccasionfor further jobandpersonalimprovement. I can find self-motivation forces, but I generally prefer to beencouraged.
Igenerallyhaveapro-activeattitudeandask for feedback fromothersonmyownstrengthsandweaknessestoimprovemyself.Ireflectonmyownperformanceandjobexperienceasanoccasiontoimprovemyselfandlookforlearningopportunities.Iamabletomotivatemyself.
I am engaged in a continuing self-improvement and I am able to motivate otherpersonsworkingwithme.
TheTM1designatedbyMasterClass,considersthathumanscanassimilateandpayattentiononly for about 20minutes to a presentation, a lecture, so, it is important to determine thesuitabletoolstouse.Typically,masterclassesaretheoretical,soit isnecessarytomakesurethat the students absorb most of the subject by all necessary means. Teachers must beinnovative,dynamicandcreative.Teachingtoolsarefundamentaltoteaching-learning-process.Theonlywaywehavetomeasureassiduityisthroughtheattendancerate.Althoughinmanyschools, thecurricularunitsof theoreticalnaturearenotmandatory, studentswould indeedhaveanadvantage inparticipating inall classes: listeningaboutacertainsubject isdifferentfromreadingaboutitforthefirsttime.Theteacheristheonewhoassessesandmostofthetimetheteacheralsodecideswhatisgoingtobeevaluated,ifanexam,assiduity,teamwork,orothersituation.
TheTM3designatedbyManagementSimulationISCAP-IPPisaparticularcasewherestudents’assiduityiscontrolledbyatimecard,asincompanies,whentheyenterclasstheyhavetocheck-in,andwhentheyleave,theyhavetocheck-out.Absenceshavetobejustifiedandthestudentsonlymaymissuptosixclasses.Iftheymiss,moretheyflunkthecurricularunit.Theclasseshaveadurationofthreehoursandthestudentshavetomanagetimeinordertocompletealltheproposed tasks. It is important to emphasize the active role of the student in his learningprocess, individuallyandinthegroup,astheassessment isaresultofthesetwoworktypes.Therefore,thestudenthastoberesponsibleand inchargeofhisteammates.Onlythen,thecompanyhas theexpected successandeach studentaswell. Theassessment ismutual: theteacherassessesthestudentandthestudentassessestheteacherandtheirpeers.
The next table presents the relation between teaching and assessment methods withcharacteristicsrelatedtotheSkillstoassess.
The columnshave somecharacteristics that canorientus todecide (or justify) the relationsbetween the Soft Skills and the Teaching Method, and between the soft skills and theassessmentmethod.
The connection between teaching and assessment method must exist, otherwise it is notpossibletoassessskills–hardorsoft,theonlyassessmentpossibleisto“assesstheknowledgeapprehendedbystudents”,andevensoitisnotpossibletoassesstheirlevelofproficiency,oncethereisnot,usually,aclearidentificationofthemaingoalsintendedtoachievewithaspecificsetofinformationworkedwithteachersandstudents.
Activities and tasks todevelopinclasses-Creationand development of all thebureaucratic activities of acompany
Activities and tasks to develop inclasses – continuous evaluation (allsessions are evaluated, so that thestudentsknowandareabletocorrecttheir mistakes and understand theerrors)
WhenweanalysetherelationofTM2–Laboratoryclass,theassessmentmethodsanditsresultsare quite different. There is a wide range of “ways to evaluate or to assess” such as oral
The Assessments methods related with TM 3 result in an exam, several activities/tasks toaccomplishbythestudentsduringtheperiodoftheclassandacontinuousevaluationbythegatheringoftheresultsobtainedbythestudentsontheirperformanceoftheactivitiesmadeineachsession.
Table7.AssessmentmethodvsSoftSkills(1/2)
Assessmentmethod
AdaptabilityandFlexibility
Motivation Managingresponsibility
TimeManagement
Communicationskills
Teamworking
AM1: Domorethana task in adefinedperiod oftime(activities)
Setofthesevenbehaviours:Notanswerorusethephoneinclasses;arriveontime;keeptheworkplace clean and organized; ethics and attitudes; collaboratewith the colleagues in theteam’sbestinterest;organizeanddividetheteamworkbetweenallmembers.
Tohavethecertainthat“Motivation”skillorothersoftskill,arecorrectlyevaluatedtheremustbetheparticipatingofthestudenthimselfintheirownprocessoflearningbytheuseofactivemethods in the process a part is guaranteed but, only a small part. The need to have atransparent process of assessment of the soft skills we need to have evidences such asdocuments,videos,discussionamongstudents,reports,evensmallexamsinordertogivethestudent the possibility to practice the knowledge obtained in a school environment. Also,teacher has to change role and must be a coach in this process to create in students theawarenessoftheexistenceofsomeonethat,whileatschool,istheretohelpthem.Moreover,this “help” from teachers ismaterializedby the constant feedback givenby teacher toeachstudentinordertoallowstudenttoreflectandtocorrectthemistakes.
inaperiod,bythedefinitionofthemaingoalstoachieveandtheoutputrequireditispossibletodefineapercentageof5%ifthestudentpresentedthecorrectoutputandfollowedtherules.Inaddition,theinterventionofthestudentintheprocessofassessmentthroughselfandpeerevaluation allows teachers to have a clear idea of the level of proficiency achieved by thestudent.
In summary, and to clarify the figure above, we can see the parallel between theteaching/learningprocessesforthehard/technicalskillsandthecore/softskills.
A “skill box” is created to teach and assess soft skills, such as: leadership, decisionmaking,communication, and others. The steps defined in a “skill box” are related in order to train,potentiate,developandassessthelevelofproficiencyofaspecificskill.
The inspiration, action, reflection, together create a triangleof significant importance in theprocessofteachingandlearningofsoftskills.Thesethreepartsofthetrianglearepreparedforeachsoftskillinordertopromoteaneffectivemethodontheirtraining.
TheDemingcycle is impliedduring thisprocess, toplan, todo, toactandto reflectare inaconstantinterplay.
CoreSkillsassessmentsetforlevelofproficiency
Page46of59
The information provided to the students is given in a broad range of displays, such asquestionnaire, documents, data, presentations, videos and others. The first input is thedocumentwheretheactivitiesaredescribedforthestudenttostarttheprocess(filesstartwitha0.).This inputwill result inothers typesofdisplays,but thosearecreatedby thestudentsduringthe“Inspiration”(files1.),“Action”(files2.)andReflection(files3.).
Figure7.Skillboxcomposition.
Theassessmentcarriedoutthroughseveralactivitiesperformedbythestudents.Theyareaskedtoreflectabouttheactionsdoneinthepreviousstagesdependingontheactivitycarriedout(files 4.). Any production of the previous stages and the text wrote in the reflectionquestionnairewillbeincorporatedtothestudentportfolio.
their learningprocessatthepreviousphaseattheskillbox.Thistext isnotonlyaplaintext,studentisaskedtoincludepictures,videosorproductsresultedfromthepreviousphases.Forexample,oneoftheskillboxhasasresultamanifestowiththedistinctionsofthevaluesforthestudents.
6.2.2 Externalevaluation:usingupdatedBloom’staxonomytoevaluatesoftskillsThe external evaluation of the soft skills,made by teachers, is performed by using Bloom’staxonomy.
Thistaxonomyhelpsustogofromthesimpletothecomplexactivitiesortaskstobedevelopedby the student. The acquisition of a specific levelmeans that the student hasmastered thepreviousone.
Bloom’s Taxonomy gives us the possibility to organize hierarchically the cognitive processaccordingtolevelsofcomplexityandmaingoalsofdesiredandplannedcognitivedevelopment.
Thecognitivelevelacquiredbystudentsisorganizedinaframeoflearningobjectives,inorderof complexity, such as knowledge, comprehension, application, analysis, synthesis andevaluation.
Toassessaskill-thelowestlevelconsideredbyBloom’staxonomy,istobeabletomemorizeatext, forexample, and them tobeable to talk about it.But if the studentdidn’tmanage tomemorizethefulltexthecan’ttalkaboutallthetext,onlyabouttheparthememorized.So,hisassessmentwouldberelatedwithaspecificlevelontheskill“tomemorizeatext”.
The first three - Knowledge, Comprehension and Application - imply a determinate level ofproficiencyinaskill.Theanalysis,synthesis,evaluationbelongtoahighestlevelofproficiencyandherewecanassesssoftskills.
These rubrics used by the “Skill Box” Methodology are related with Bloom’s taxonomycategories,abovedescribed.
Remember intends to assess the process developedby students during the timedefined toaccomplishaspecifictaskoractivity.Theassessmentpresentedinthisrubricintendstoclarifyifthestudentdevelopedhisstudyadditionallytowhathewasgivenintheclassroomcontext.In addition, the way found to present the necessary information for the completion of theproposedactivityisalsoconsideredtoassess.
Understand implies that students explain/present to the teacher/coach and peers, the“knowledge transmittedby the teacher”withother informationand factsdifferent fromtheones that were given in the classroom context, in order to promote the active role of thestudentsintheirownprocessoflearning.
Toanalysetheinformationstudiedpreviouslyandtorelateitinordertocreatenewknowledge,is essential in the student mind-set to assess the level of proficiency in a specific givensituation/problemcontextualizedinanidentifiedsoftskill.
The “evaluate” rubrics intends also to promote the discussion among the students of thesubjectsofanalysis.Thepresentationofeachpointofview,theargumentationandthereachingofsolutionimpliesacompromisebetweentheinvolvedpartsintheprocess(dependingontheactivityproposedtothestudents).
6.2.3 CommonrubricsproposedThe creation or definition of a scale that takes into consideration all the steps of thedevelopmentlevelofproficiencyofasoftskillwashardtoadjust.
Theevaluationofthe“reflection”stepfromthe“SkillBox”Methodologytakesinconsiderationthe“set”ofelements included in thestudents’portfolio, so thedefinition ina frameof fivelevels,toevaluatesuchdifferentelements(videos,documents,reports,manifestos)wouldbetoodemandingandwouldnotbringaddedadvantagestotheevaluationprocess.
Theassessmentscalecreatedhasthreelevels-theminimum,themaximumandfail.Toassessinawiderframe,itisessentialnottostraighttherangeoflevelinascale,itismoredifficulttodo a correct assessment with five levels in a scale because it is harder to differentiate theelementstobeassessed.
Thedefinitionofthethreelevelscaleisasfollowing:
Fail – the student did not demonstrate to have used a cognitive process to give to theteacher/coachevidencesabouttheacquisitionofaspecificsoftskill.
Minimum–thestudentdemonstratedthathecanunderstandwhatmeansthesoftskillworkedin the “skill box” but he did not demonstrate that he could develop the soft skill in theenvironment. In fact, probably he has the soft skill butwhen it is necessary to apply it in acontext/environmenthedoesn'tdemonstratethereallyimplicationintheprocess.
Maximum (isn’t a “top level”) but the startingpoint of thedesignof a skill box thatwearedeveloping-asoftskillasacognitiveprocess.Weareworkingwithaperson;thismeansthatwe can’t assure that a specific “skill box” is appropriated for a specific person to develop aspecificsoftskill.Thismeansthattherearepeoplewithapotentialsoftskill,butinsteadofusinga “skill box”don’tdevelop the soft skill in the sameway that thehighestpercentageof thestudents.Somaximumisnotthe“maximum”ofasoftskillcanbedevelopedinaperson,itisthemaximumthatasoftskillcanbedevelopedbyusingthe“skillboxes”.
There is not always aunique leader for all theprojects.Dependingon the content, this canchange.Workershavetoknowwhentotakeastepforwardandleadandhowtofacilitateotherstoo.
7.2 InspirationThe“inspiration”isgiving….
There is a myriad of authors that have studied leadership and/or have proposed differentleadershipstyles.Wehavechosensomeofthem:
● JamesC.Hunter.Hisshortnovelillustratesaradicallydifferentapproachinwhichtheleader is serving and backing other acts. This contrastswith themisconception of aleadertobetheonlyguideofthegroup.
Participantsarealsoaskedtothinkaboutconcreteactionsconductedbythemwheretheyactedas a leader.What was the context and the problem, what did they do, and what was the
CoreSkillsassessmentsetforlevelofproficiency
Page55of59
outcomepresented to theothers?Participants can ask for further informationor todiscussotheractionstobetakenandtheirpossibleoutcome.
8 ConclusionsInthisreport,theresultsofaseriesofmeetingsofthepartnerswiththeassociatedpartnersand with representatives of the socioeconomic environment have been transmitted. It isespecially important to highlight that the method presented allows organizations to moveforwardwiththeirownmapsofpersonalizedskills.
Theskillboxhasanovelstructureinwhichtheoreticalconceptsbecomemotivationpriortothesession. The face-to-face session with students or employees, is entirely dedicated to theresolution of doubts and to the realization of dynamic activities that allow applying theknowledgeacquiredinthe"inspiration"phase.Thereflectionpartiswhatprovidesthevisionandpersonalacquisitionofsoftskill.Thispartisthemostinterestingsincesoftskillsareclosertoasessionwhere,sometimes,menarethemajority.