Top Banner
Learning analytics and learning gains: Multilevel modelling of academic performance Jekaterina Rogaten TEF2016 14/07/2016
20

Jekaterina Rogaten

Apr 16, 2017

Download

Lucia García
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Jekaterina Rogaten

Learning analytics and learning gains: Multilevel modelling

of academic performance

Jekaterina Rogaten

TEF2016 14/07/2016

Page 2: Jekaterina Rogaten

Open University Team

Dr Bart Rienties

Dr Jekaterina Rogaten

Prof Denise Whitelock

Dr Simon Cross

Prof Allison Littlejohn

Page 3: Jekaterina Rogaten

Oxford Brooks University Team

Dr Ian ScottProf Rhona Sharpe

Page 4: Jekaterina Rogaten

University of Surrey Team

Dr Simon Lygo-BakerProf Steven WarburtonProf Ian Kinchin

Page 5: Jekaterina Rogaten

Learning Gains

• Learning gains has been defined as growth or change in knowledge, skills, and abilities over time that can be linked to the desired learning outcomes or learning goals of the course

Page 6: Jekaterina Rogaten

ABC model of Learning Gains

Page 7: Jekaterina Rogaten

ABC model of Learning Gains

Page 8: Jekaterina Rogaten

ABC model of Learning Gains

Page 9: Jekaterina Rogaten

• Web of Science core collection and ERIC

• The time frame of the search 2000 – 2016

• In total 231 studies were identified of which 51 studies were selected.

• All learning gains can be classified into ABC

• Learning gains are primarily used to examine the effect of any particular educational ‘intervention’

Literature Review

Page 10: Jekaterina Rogaten

Literature Review

Cognitive Learning Gains 27

studies

Behaviour-Cognitive

Learning Gains

5 studies

Affective-Behaviour-

Cognitive Learning

Gains

8 studies

Affective-Cognitive

Learning Gains

11 studies

21%

10%

53%

16%

Page 11: Jekaterina Rogaten

Cognitive Learning Gains: a Three-level Growth Curve Model

Level 1

Level 2

Level 3

TMA1

Student1

TMA3 TMA1 TMA2 TMA3 TMA1 TMA2 TMA3TMA2

Student2 Student3

Module1 Module2

TMA1 TMA2 TMA3

Student4

TMA1 TMA2 TMA3

Student5

Module3

Page 12: Jekaterina Rogaten

Faculty of ArtsTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 13: Jekaterina Rogaten

Business and Law

Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 14: Jekaterina Rogaten

Faculty of Education and Language Studies (FELS)

Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 15: Jekaterina Rogaten

Faculty of Health and Social Care (HSC)Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 16: Jekaterina Rogaten

Math, Computing and TechnologyTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 17: Jekaterina Rogaten

ScienceTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 18: Jekaterina Rogaten

Social ScienceTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

Page 19: Jekaterina Rogaten

Results

Faculty

Students

Variation in

students’ initial

achievements

Variation in

students’

subsequent

learning gain

Arts 5,066 31% -

Business & Law 11,154 16% 51%

FELS 7,015 54% 88%

HSC 4,055 65% 72%

Math, Computing & Technology 10,038 46% 77%

Science 5,791 33% 26%

Social Science 2,317 6% 19%

Page 20: Jekaterina Rogaten

Learning analytics and learning gains: Multilevel modelling

of academic performance

Jekaterina Rogaten

TEF2016 14/07/2016