IMPROVING PERSONALIZED FEEDBACK AT THE WORKPLACE WITH A LEARNING ANALYTICS ENHANCED E-PORTFOLIO MARIEKE VAN DER SCHAAF, UTRECHT UNIVERSITY GERALDINE CLAREBOUT, MAASTRICHT UNIVERSITY www.project-watchme.eu @Project_WatchMe This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619349
17
Embed
IMPROVING PERSONALIZED FEEDBACK AT THE WORKPLACE … · IMPROVING PERSONALIZED FEEDBACK AT THE WORKPLACE WITH A LEARNING ANALYTICS ENHANCED E -PORTFOLIO MARIEKE VAN DER SCHAAF, UTRECHT
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
IMPROVING PERSONALIZED FEEDBACK AT THE WORKPLACE WITH A LEARNING ANALYTICS ENHANCED E-PORTFOLIO MARIEKE VAN DER SCHAAF, UTRECHT UNIVERSITY GERALDINE CLAREBOUT, MAASTRICHT UNIVERSITY
www.project-watchme.eu
@Project_WatchMe
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619349
1. Utrecht University, NL 2. University Medical Centre Utrecht, NL 3. Szent Istvan University, Hungary 4. University of Tartu, Estonia 5. Universitätsmedizin Charité Berlin, Germany 6. University of California San Francisco, USA 7. Maastricht University, NL 8. Mateum, NL 9. University of Reading, UK 10.Jayway, Denmark 11.NetRom, Romania/NL
1 I N T R O D U C T I O N W A T C H M E
Develop complex competences
Integrated in context
Demands long learning trajectories in workplace
Deliberate practice: feedback and reflection
2
IMPROVE USE OF DATA IN E-PORTFOLIO WITH LEARNING ANALYTICS
3
Application of probabilistic student models that enable feedback based on multi sorted assessments
Measurement, collection, analysis and reporting of data about trainees in their contexts, for the purpose of understanding, and optimising learning and the utilising of environments in which it occurs (Solar, 2013)
Personalized feedback
Visualizing learners’ development
I N T R O D U C T I O N W A T C H M E
Presenter
Presentation Notes
THREE WAYS OF PERSONALIZED FEEDBACK
• Regular e-portfolio feedback, e.g. assessment forms
Probabilistic, derived from data in the portfolio: • Performance estimations, based on earlier scores
or narratives • Pedagogical estimations, e.g level of a student’s
frustration, consistency
I N T R O D U C T I O N W A T C H M E
EPASS
Intuitive user interface Monitoring of progress Mobile web application
for entering forms on smartphone or tablet
I N T R O D U C T I O N W A T C H M E
EXAMPLE DATA POINTS E-PORTFOLIO
Aggregation of data points Written or electronic test Skills test in simulation (OSCE) Workplace-based assessment
JIT module appears in EPASS on dashboard, EPA pages and Assessment forms. JIT module on the right side of the dashboard. JIT feedback available on EPA level and Competency level. Currently 2 categories of JIT feedback – Improvement [based on rubrics] and supervisor JIT receives data from the SM and present in the EPASS UI.
• Appears in: • Dashboard • Competency pages
• Visualisations • Timeline • Current Performance • General Overview • Supervisor View
12
VISUALISATION
I N T R O D U C T I O N W A T C H M E
13
EXAMPLE - TIMELINE
How am I developing?
What competencies need my attention?
I N T R O D U C T I O N W A T C H M E
How am I doing right now?
What are my strengths and weaknesses?
14
EXAMPLE - CURRENT PERFORMANCE
I N T R O D U C T I O N W A T C H M E
Presenter
Presentation Notes
.
15
EXAMPLE – SUPERVISOR VIEW
How are my students progressing?
Which of my students require special attention?
I N T R O D U C T I O N W A T C H M E
Presenter
Presentation Notes
Supervisors have a visualisation that shows the progress of all the students they supervise in 1 Timeline. Added value – How are my students progressing? Who needs special attention. In this use case Student 1 seems to have had a ‘lucky strike’, but otherwise stable progress Student 2 stable progress. Student 3 is very inconsistent – maybe check up?
DEMO
www.project-watchme.eu
@Project_WatchMe
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619349