Presentation @LAK13

ADDRESSING LEARNER ISSUES WITH STEPUP!: AN

EVALUATIONJosé Luis Santos, Katrien Verbert,

Sten Govaerts, Erik Duval

http://www.slideshare.net/jlsantoso

1

Wednesday 10 April 13



WHAT DO WE HAVE?• A context

• Courses

• Teaching approach and learning traces

• A learning dashboard

• A research methodology

• A model

• A question

• An evaluation2


3


4


http://lift.do

5


6


7

Govaerts, Sten; Verbert, Katrien, Duval, Erik; Pardo, Abelardo, The Student Activity Meter for Awareness and Self-reflection. Proceedings of CHI Conference on Human Factors in Computing Systems, 2012, Austin, Texas, ACM.


THREE COURSES

Course Students Work setup Topic

Thesis 11 Individual Different

Mume 20 Group 2-3 Same

Peno 36 Group 6 Same

8


OPEN LEARNING APPROACH AND LEARNING TRACES

9



9



9


STEPUP!

http://ariadne.cs.kuleuven.be/stepup/10


http://ariadne.cs.kuleuven.be/stepup/


STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





STEPUP!





DESIGN-BASED RESEARCH

11



Requirement Design & Deployment

ObservationEvaluationAnalysis

11



Requirement Design & Deployment

ObservationEvaluationAnalysis

11

Analysis

Google Analytics

Surveys based on

quality and

Tweets, blogs, time


12


Verbert, K., Duval, E., Klerkx, J., Govaerts, S., Santos, J.L.: Learning analytics dashboard applications. American Behavioral Scientist (2013)

http://abs.sagepub.com/content/early/2013/02/27/0002764213479363.abstract

A MODEL

12




EARLIER EXPERIMENT

13


EARLIER EXPERIMENT

Santos, J.L. , Verbert, K, Duval, E,. Empowering students to reflect on their activity with StepUp!: two case studies with engineering students, Proceedings of ARETL'12 2nd Workshop on Awareness and Reflection, CEUR WS

13


http://www.cs.kuleuven.be/publicaties/lirias/mypubs.php?unum=U0065763






https://lirias.kuleuven.be/handle/123456789/359546




EXPERIMENT

14


SET UP THREE BRAINSTORMING

15


Discuss in groups of 3 or 4 their learning issues

15


Rate learning issues

15


RESULTS• List of 34 issues

16


RESULTS

• List of 7 issues

17


18


GOOGLE ANALYTICS

18


STEP UP! ENABLES ME TO ANALYZE HOW I SPEND MY TIME

Step Up! enables me to analyze how others spend their time

Step Up! helps me to identify group members who does not work well

i3

i119


I THINK THAT SOME STUDENTS MAY OVER-REPORT THE TIME THEY WORK ON THIS COURSE

TO GIVE THE IMPRESSION THAT THEY MORE WORK THAN THEY ACTUALLY DO

20


Step Up! helps me to realize when something goes wrong in the course

i5

Step Up! helps me to plan my time better

i6

21


STEP UP! HELPS ME TO BE AWARE WHICH RESOURCES AND TOOLS I

AND OTHERS USE.i7

Step Up! helps me to gain some insight on how others communicate

i2

22


StepUp! increases my motivation for the course

i4

I think that I am motivated for this course

23


StepUp! increases my motivation for the course

i4

I think that I am motivated for this course

23


STEP UP! PROMOTES COMMENTING ON OTHER BLOGS

Step Up! promotes reading other blogs

StepUp! promotes twitter participation

24


WHAT WE HAVE LEARNT• Methodology

• Different case studies

• individual vs group work

• same vs different work

• New objectives

• efforts vs outcomes

25


ONGOING WORK

http://navi-hci.appspot.com/26


http://navi-hci.appspot.com/

http://navi-hci.appspot.com/

ONGOING WORK

27


Questions?Thanks!

@jlsantoso @svencharleer

http://jlsantoso.blogspot.com


http://svencharleer.com

28









Presentation @LAK13

Documents

learning dashboard

katrien verbert

sten verbert

samepeno36 group

group members

sten govaerts

time i3step

course i4