LACE Spring Briefing - WatchMe project overview

www.project-watchme.eu

@Project_WatchMe

Workplace-based e-Assessment Technology for Competency-based Higher Multi-professional Education

.

Marieke van der Schaaf, PC, Utrecht University, The Neth Denise Janssen, Mateum, The Neth.

1.Utrecht University, NL 2.University Medical Centre Utrecht, NL3.Szent Istvan University, Hungary4.University of Tartu, Estonia5.Universitätsmedizin Charité Berlin, Germany6.University of California San Francisco, USA 7.Maastricht University, NL8.Mateum, NL9.University of Reading, UK10.Jayway, Denmark 11.NetRom, Rumania/NL

WATCHME’S AIM

Solve efficiency and quality problems of workplace-based feedback and assessment by means of a mobile electronic portfolio system that is enhanced with a feedback module and a visualization module.

- Develop complex competences- Integrated in context- Demands long learning trajectories in workplace- Deliberate practice: feedback and reflection

Medical expert

Communicator

Collaborator

Manager

Health advocateScholar

Professional

CRITICS COMPETENCY-BASED ASSESSMENT

MOST CRITICS COME DOWN TO THE ANALYTIC APPROACH (E.G. CANMEDS)

Source: Ten Cate

Medical expert

Communicator

Collaborator

Manager

Health advocateScholar

Professional

THE ANALYTIC APPROACH

With nursing staffWith family

With patients

With colleagues

With trainees

…

Source: Ten Cate

Medical expert

Communicator

Collaborator

Manager

Health advocateScholar

Professional

THE ANALYTIC APPROACH

With nursing staffWith family

With patients

With colleagues

With trainees

…

Consultation

Breaking bad newsExplain medicationWith children

With elderly

…Source: Ten Cate

Medical expert

Communicator

Collaborator

Manager

Health advocateScholar

Professional

THE SYNTHETIC FRAMEWORK APPROACH

EPA1

EPA2

EPA3

EPA4

EPA5

Source: Ten Cate

ENTRUSTABLE PROFESSIONAL ACTIVITY

Task based instead of construct based approach

Crucial question: would I entrust this candidate unsupervised with this task? (with my sick mother, animal or teach my daughter/son…)

An EPA is a task that an individual can be trusted to perform unsupervised, in a given professional context, once sufficient competence has been demonstrated. International Competency-Based Medical Education Collaborators, March 18, 2014

Source: Ten Cate

COMBINE EPA APPROACH WITH LEARNING ANALYTICS

Application of probabilistic student models that enable tailored visualised feedback based on multi sorted assessments

Bayesian models provide detailed model of trainees’ entrustability

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

ELECTRONIC PORTFOLIO

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

E A R L I S I G 1 M A D R I D A U G 2 0 1 4

EXAMPLE JUST-IN-TIME FEEDBACK

Before workplace-based assessment is performed

EPASS displays just-in-time feedback concerning learner.

E.g.: “remind your communication skills towards patient. Explain treatment in simple words”.

EXAMPLE JUST-IN-TIME FEEDBACK

QUESTIONS OR WOULD YOU LIKE TO HAVE A LOOK AT EPASS?

CONTACT ME DURING LUNCH BREAK!

THANK YOU FOR YOUR ATTENTION!

Architecture

database

Mobile device

Student Model Database

Learning Analytics Engine

-Online Learning

Just in time Feedback

Aggregated Visualisation

Portfolio system(ePASS)

WPB AssessmentGAME

EPA Matrix

ARCHITECTURE

COMBINING THE COMPETENCY-FRAMEWORK WITH ENTRUSTABLE PROFESSIONAL ACTIVITIES

Medical expert

Communicator

Collaborator

Manager

Health advocateScholar

Professional

+

+

+

+

+

++

++

+

+

+

+

++

++

+

++

++

+

++

+

++

EPA1 EPA2 EPA3 EPA4 EPA5

AssessmentSource: Ten Cate