HAL Id: hal-02398007 https://hal.archives-ouvertes.fr/hal-02398007 Submitted on 11 Dec 2019 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. A collection of MOOCs to create digital programs Pierre Rolin, Denis Moalic, Rémi Badonnel, Olivier Berger, Jihane Fouzai To cite this version: Pierre Rolin, Denis Moalic, Rémi Badonnel, Olivier Berger, Jihane Fouzai. A collection of MOOCs to create digital programs. OOFHEC 2019: the Online, Open and Flexible Higher Education Conference, Oct 2019, Madrid, Spain. pp.86-99. hal-02398007
15
Embed
A collection of MOOCs to create digital programs - Archive ...
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
HAL Id: hal-02398007https://hal.archives-ouvertes.fr/hal-02398007
Submitted on 11 Dec 2019
HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.
A collection of MOOCs to create digital programsPierre Rolin, Denis Moalic, Rémi Badonnel, Olivier Berger, Jihane Fouzai
To cite this version:Pierre Rolin, Denis Moalic, Rémi Badonnel, Olivier Berger, Jihane Fouzai. A collection of MOOCs tocreate digital programs. OOFHEC 2019: the Online, Open and Flexible Higher Education Conference,Oct 2019, Madrid, Spain. pp.86-99. �hal-02398007�
RémiBadonnelUniversitédeLorraine,LORIA/INRIA,[email protected]élécomSudParis,Franceolivier.berger@telecom-sudparis.euJihaneFOUZAILaboratoireBONHEURS,UniversitéCergy-Pontoise,[email protected] After thepioneeringage, IMT isnowenteringthedevelopmentandprofessionalizationphase.ThepurposeofthispaperistopresentthedevelopmentofacollectionofMOOCintheareaofNetworks– Telecommunications, how those contents are designed and used in programs for students andprofessionals
Thecreationofafullonlinedegree,bachelorormaster,requirestheavailabilityofalargenumberofcourses,sharingsimilarrulesofdesign(length,structure…)andconsistentvocabulary.FLIRT1projectpurposes were to create a collection of on line lectures in a common technical domain(telecommunications).ThiscollectionprovidesnowasolidbasistocreateeducationprogramseitherforinitialeducationandlifelonglearningcontexttoexperimentrevenuegenerationfromMOOCandbusiness model [1]. This paper provides design rules, use cases and figures about first programsexperimentation.
1. IMTcontextIMT (Institut Mines-Télécom), a network of French graduate engineering schools, is a publicinstitution dedicated to higher education, research and innovation in engineering and digitaltechnology.Alwaysattentivetotheeconomicworld,IMTcombinesacademiclegitimacywithstrongcorporaterelationships.
1 ProjectsupportedbyANRprograminvestissementsd’avenir–FLIRTstandsforFormationsLibresetInnovantes dans les Réseaux et Télécoms – Free and Innovative Courses for Networks andTelecommunications)
13,660 students are studying in Master of Science in Engineering, Master of Science, Master inManagement,ExecutiveMBAandPhD.IMTisstronglyinvolvedintheproductionofMOOCinFrenchand English languages. Since 2013, 45MOOCs have been produced and broadcastedmainly on 2platforms: FUN (France Université Numérique) and EdX.org. Scientific domains covered by theMOOCsareNetworks–Telecommunications (subjectof thispaper), Sciences forengineers, ITandprogrammingandDigital,energyandindustrialtransitions.
Lifelong learning programs, mainly followed by professionals and job seekers, MOOCs areincreasinglyusedbycompanies:theyregularlyusethiskindofflexibletrainingmethodtotrainstaffmembersbyrecommendingaMOOCorofferingthemasaSPOC(SmallPrivateOnlineCourse).
2. ProducingacollectionNetworks and telecommunications fields are historical education domains of 5 IMT engineeringschools for developing professional skills. Although MOOCs have a similar purpose as classicalcourses (acquiring knowledge and skills), pedagogy must be adapted to on line learning. FLIRT1project,fundedbyANR2from2016to2020,aimsatdevelopingacollectionofcontents,intheformofMOOC,sothatconsistentonlinecursuscanbeproposedtostudentsandprofessionalsinlifelonglearningcanbeevaluated.
Knowledge: mainly based on video lectures to establish knowledge and quiz to enforce it andevaluate. Theoretical concepts are developed, vocabulary is defined andmodels (mathematical…)aredescribedandexplained.
Practicalapplication:theassociatedskillsaredevelopedthroughcasestudiesapplyingknowledgetoreal cases. Learner has to apply his/her knowledge to solve a problem, evaluate a situation andproposeasolution…
Know how: these skills development are based on labs to apply knowledge inside “equipment”.Learnerhastosetup,configureandmeasureadescribedsituation.
Durationor organization: 5 to 6 chapters (orweek). A typical chapter (orweek) consists in 4 to 7lectures,ausecaseactivityandanonlinelaboratoryactivity(e.g.,simulation). 2 Agence Nationale de la Recherche program Investissements d’avenir.
First section: contains personal questions (who are you,motivations…) useful to analyze studentexpectations, personal presentation to other students in a dedicated forum, pedagogical teampresentation,aprerequisiteQuizandrecommendationsaboutcourseorganization,workload,skillstargetedbythecourse…
Most teachers implied in the project produced their very first on line lecture. The project alsorecommendsthebuildingofmulti-teachers/schoolsteams.Thishasmanyadvantages:lesswork-loadfor each teacher; benefit from teacher best expertise (practice) on each issue; content reuse byteachersintheirtraditionallecturesandalsoincreaseteachersskillstoonlineeducation(productionand use). As a consequencemanaging the pedagogical team and vocabulary consistency are twocriticalissues.EachMOOChasascientificleader,managingtheMOOCproductionandthesupportofapedagogicalengineer(masteringtheplatformandvideoproduction).
2.2. Common“edition”frameworkWhile different universities and partners are associated to produce MOOCs in the project, is itimportanttoensureconsistencyamongMOOCs.Thus,severaltoolsandprocesseshavebeensetup,toguideandhelpMOOCproducersintheirwaytodevelopMOOCs.
ThePowerPointmodel canbedirectlyusedbyprofessorandgiven to thevideoproduction. Ithasbeen recommended that each video sequence stay below 7 minutes and focus on one or twoconceptsmaximum.
The graph (Figure 2) represents the exercises’ success rate. Columns represent exercises. Onecolumn contains all learners who completed this exercise. It is made up of several groupsrepresentingthelearners’distributionbasedontheirresults(below0.25,from0.25to0.5,from0.5to0.75,over0.75). Thisprovides informationaboutwhere studenthavedifficulties (gradesbelow50%)andhowmanyhavedoneeachexercise(oneexercisepercolumn).
We define as “diligent learners” (one can also say assiduous) students that did the first gradedexercise in week 2 and week 1 exercise(s). This criterion is useful as one knows that a strongproportion of learners drop out during the first week. The “diligent learners” proportion thatcomplete the course, obtains the required global grade for success, is a significantMOOC qualityindicator.
Thegraph(Figure3)displaysthenumberoflearnersperformingeachexercise,basedonwhentheyperformthem.Linesgiveexercises’name.ColumnTotalgivehowmanydidexercisescitedonline,columnsC1,C2,…givegradescollectiondate andhowmanydid theexercisesduringperiodspan(datacollectiondate)C1-C2,C2-C3….Onebubblecontainsnumberof learnerswhocompletedthisexercise. When browsing over each bubble, percentage enrolled students and active students’5percentage are given.On Figure 3 the first graded exercise inweek 2 is ES02 also reading bubble(ColumnTotal,LineES02)gives“diligentlearners”numberandpercentage.
5 An active or started student has got a grade in at least one graded exercise.
6
Figure3:Temporalprogressionalsocalledcumulative
Asanexampleonfigure3above:forexercise“ES02”
• 378learnerstooktheexerciseintotal.
o 283ofthemtookitbeforedatacollectiondate“C1”(i.e.,2019-06-15),
o 35ofthemtookitbetweendatacollectiondate“C1”(i.e.,2019-06-15)andC2(2019-06-22)
o Etc.
MOOCpilot measures many other criteria, including forum performance (number of posts,unanswered questions,most active learners, etc.), individual progression, students list that did anexercise.Interestedreaderwillfindin[PLA18]moreinformation’s.
3.1.2. MOOCglobalevaluation
In order to compare different sessions of the sameMOOC or differentMOOC five indicators arefollowed(Figure4).InaMOOCtheenrolledlearners’proportionthatdoesagradedexercise,namedstartedoractiveorstudents,intheMOOCisalwayslow.Inthisexamplethiswasonly22%andthosethatcontinueafterfirstweek,diligentstudents,isevenlower.
7
Successful studentshaveaglobalgradehigher than the thresholddefined for theMOOC.Figure3canbecomputedwithathreshold,thenlinegradeprovidesdirectlysuccessfulstudentsnumberandpercentage.
Figure4:Commonindicatorsfollowed
3.2. SkillachievementThe final QUIZ asks students to scale their perceived skills level mastering before and after theMOOC. Each student evaluates its personal skill level in the range [0, 10]. The Figure 5 showsstudents responses synthesis for MOOC PRD6 session 8 (spring 2019). A graph shows responsedefinitionandanaverage iscomputed.MOOCPRDsession7(Autumn2019) isalsogiven.Onecanobserve that for two learners’ population, temporally separated, average gain values are prettyclose.
Thecoursestructuredescribedinparagraph2.1providesvaluableargumentstoproposetolearnerseitheronlinefreeaccesstoknowledgeorpaidaccesstoprofessionalskillsassociatedtoacertificatedelivery. For example, MOOC can propose a free access for video lectures and quizzes, whilepremiummemberscanaccesscasestudies,labsandsimulators
4.1. StandaloneMOOC4.1.1. FreeMOOCsessions
MostMOOChavebeenbroadcastedpublicallyonFUNinFrenchlanguage.Pubicis55%inFranceand40% inAfrica (French speaking countries).Wehaveobserved that for thenetworksand telecomsdomain,more than60%of enrolled learners areprofessional occupying a position.Amongwhich50%workinlargecompaniesand50%insmallormiddlecompanies.Themotivationsexpressedbythesetwogroupsaresignificantlydifferent.
SMEsandPMEslearnersexplainthattheyanticipateevolutionbusinessandwanttokeeptheirskillsuptodate.AcomparisonofdifferentMOOC(Figure7)exhibitssignificantdifferencesaccordingtopre-requisiteslevelbuttheMOOCbroadcastingperiodmeritsmoreattention.Onecanobservethatinaverage14.4%enrolledstudentbegins,65%ofstartedbecomesdiligent.Thediligentsuccessrateishigh67.9%.WeakdiligentsuccessratearetypicalofMOOCsdifficulty.PRDrequiresalotofwork(6 to7hoursperweek),Propag-Radioassumesverygoodknowledge inPhysicand targetsmasterdegree students also many enrolled mays have abandoned after pre-requisite quiz. Even whendifficultyandpre-requisiteareclearlypresentedintheMOOCdescriptionmanylearnersenrolled.
Collection impact on enrolment is important. A communication for each new MOOC (or MOOCsession) is made to all enrolled students of otherMOOCs in the collection. Important enrolmentpeaksareclearlyandimmediatelyvisible.
We alsomeasure dual enrolment in theMOOC of the collection. Figure 9 shows dual enrolmentfiguresforMOOCROsession1(morethan10000enrolmentseeFigure7).ThecloseristhepreviousMOOCsession,themorestudentsenroll.OnFigure9FTTHwas3monthbeforeROsession.LANandSRfinished6monthbefore.PRD6tookplaceoneyearbeforeandmoreforPRD5
PRD5 PRD6 LAN SR FTTH1239 1329 1929 1768 246512% 13% 19% 17% 24%
Figure10showsthatsurprisinglythere isstilla learner’sproportionthatdoesnotevenstartwhilepayingforadditionalcontent.DiligentproportionismuchhigherthaninpublicMOOC(seeFigure7).Andonly45%of themobtained thecertificate, this ismuch less than inaclassical teaching.SomelearnersdidachieveaprettygoodgradeintheMOOCbutdidnotmaketheproctoredexam.Queriedby mail all explained that they were not feeling self-confident. Achieving student self-confidenceappearsanonlinecourseweakness.Inaclassroom,directcontactwithotherstudentsandateacherbuildsabetterself-confidence.Onlinestudentsworkaloneandbarelyusetheforumstogethelp,evenwhentheypaythecourse.
One can also observe on Figure 8 that from PRD6 (session 6) to PRD7 (session 7) the skill gaindecreases. This corresponds to the fact that inPRD6all studentshadaccess to thewhole content(equivalenttoQUALIFYINGformula)whileinPRD7mosthadonlyaccesstoDISCOVERYcontent.Self-skillevaluationappearsconsistentwithaccessiblecontentreduction.
4.2. MOOCPrograms
IMToffersseveralMOOCprogramsfordevelopingskills stepbystep. IMTMOOCsareproposed insession mode (as opposed at self-paced or always available). These enables to provide supportlimitedintime(teachingassistantduringthesession)andtocontrolforum(avoidillegalusage).Thedrawbackisthatlearnersmustdoalltheworkduringthesession.
4.2.1. NetworksMOOCprogramonFUN
A threeMOOCs sequence in thedomain “networks and telecommunication” has beenplanned sothatlearnerscanfollowMOOCAALDT(January–February)thenMOOCPRD(March–April)andthenMOOCRQOS(May-June)CommunicationhasbeenmadeonthesequenceasawholeandnotMOOCbyMOOC.OnecanobserveonFigure11that thecommonenrolmentproportion is importantandhigherthanobservedonFigure9.15%haveenrolledinthethreeMOOC.
11
Figure11CommonenrolmentsinsequencedMOOCsessions
But ifwe lookon“started”Figure1(Figure12) resultsaremoredisappointing.There isnoobviousproofofstudentcommonlystarted2MOOCincrease.Theproportionofstartingstudentdecreasesfrom first MOOC to second and third. A possible explanation is that the broadcasting period isprobablythemostimportantcriteriauponstudentavailabilitytoperformMOOCactivities.
4.2.2. “Networksbasics”programwithcertificateThe program “Networks basics” composed of 4 on line courses (ALDDT, PRD, LAN and FTTH seeFigure 6) is proposedwith “Ecole Supérieure Polytechnique” (ESP)Dakar Senegal for 100000 Fcfa(paidatESP).SuccessfulstudentsobtainanIMT-ESPcertificate.Studentworkloadisevaluatedto150hours.Theprogramdurationisonesemester.Itisplannedtoproposetheprogramtwiceayear,forautumnsemesterandspringsemester.ItisImplementedas4SPOC(ie,notpublicMOOCs)onFUNcampusplatform.
Communication is made in newspapers and radio. ESP has enrolled 75 students in 2019 session.SPOCsweresequentiallyopened,oneeverymonthandremainopeneduntiltheendoftheprogram.Weekly mail was sent to students in order to maintain their attention. Teaching assistants wereavailabletoanswertostudentsquestionsbuttheyhadnearlynoquestionontheforum.
Teaching assistant are quite passive and only reactwhen triggered by learners. Conclusion is thatteaching assistant should be more proactive as community managers and coaches to enhancedlearners’interaction,senseofcommunityandmotivation.
Encouraged by observation about public MOOC professional audience (cf. parag 4.1.1) multiplemarketingapproacheshavebeenexperimentedduring theprojectby IMT lifelong learning service(TelecomEvolutionTeV).
The initial businessmodel was to sell programs based on severalMOOCs associated with labs inphysicalspaceswithIMT’sequipmentandacertificate.Itappearedthat100to150hoursprograms
12
donotrespondmarketexpectations:theyaretooheavyforcompaniesandprofessionalswhoprefershort and modular trunks. Shorter modules have been set up such as a single course (SPOC)associatedwith a learner progress survey available tomanager, a teaching assistant to answer tolearners questions. An administrative person to enrolls learner and responds to technical issues(questionsrelatedtotheplatform).Adedicatedplatformthatprovidesacompletionprocess(learnermustdosequentiallythecourse)hasbeenused.Evenifthisproposalgotaverygoodfeedbackwhenproposed tocompanies thenumberof realcustomers remains low.Theuseof forum isalsoquiteinexistentalso itnotworthwhile topay fora learningassistantduringa session if theyactonly in“reactivemode”andnotascoaches.Whenaquestionrelatedtothecontentandneedinganexpertappears, theadministrativeperson relays it toa teacher. Learners’ feedbackwasverypositivebuttheyexpresseddemandsforhandsonactivitiesinphysicalworkshops.
5. OnlineLabsactivitiesMOOCs and SPOCs of the collection include labs using simulators to be installed on the learners’computer.Thisraisesmultipledifficulties.
- Teachersmustprovideinstallationdescriptionandfilesforthedifferentexistingcomputersand operating systems (Macintosh, PC, Unix, Linux…). Providing a virtual machine to beinstalledmaymakethissimplerbutfilestouploadarehuge.Theseissuesrepresentnearly30%ofthepostintheforum.
Consequently a significant effort has been made by the project to provide on line lab access(simulators hosted on a remote server in the Cloud) specifically to allow professional learners toperform lab fromtheircompanyandtoavoidstudents tohavetomastercomputersciencesskills.SolutiondevelopedbyProcancompany (FLIRTprojectpartner) is toperform labhosted inaCloudserverwithall interactioninalearnerbrowserscreen.Teachersconfigureoncethevirtualmachinein the cloud so those learners don’t have to do it. Learners have just to click on a link inside thecourse to access the lab environment in a browser window. This solution is accepted by mostcompanyfirewall.