1 TEACHING PEDIATRIC PERITONEAL DIALYSIS THROUGH SERIOUS GAMING: DEVELOPMENT AND FORMATIVE EVALUATION OF AN ONLINE VIRTUAL SIMULATOR Aleksandra E Olszewski,

1

TEACHING PEDIATRIC PERITONEAL DIALYSIS THROUGH SERIOUS GAMING: DEVELOPMENT AND FORMATIVE EVALUATION OF AN ONLINE VIRTUAL SIMULATOR

Aleksandra E Olszewski, B.S.a, Daniel Hames, M.D.b, Mignon McCulloch, M.D.c, Deborah Stein, M.D.d, Sharon Su, M.D.e, and Traci A. Wolbrink, M.D., M.P.H.a

a Division of Critical Care Medicine, Department of Anesthesia, Perioperative and Pain Management, Children’s Hospital Boston and the Department of Anesthesia, Harvard Medical School, Boston, MA, USA, b Department of Pediatrics, Boston Children’s Hospital, Boston,c Departments of Nephrology and Paediatric Critical Care, Red Cross Children’s Hospital, Cape Town, d Department of Nephrology, Boston Children’s Hospital, Boston, e Department of Nephrology, Randall Children’s Hospital, Portland

2

Disclosures

• I have no financial relationships to disclose.

3

The context

Declining interest in

nephrology1

New generation of learners2

Need for new

teaching strategies

1. Rosner, M, Parker, M, Kohan, D. Nephrology as a career choice: A survey of medical students. J Am Soc Nephrol 2009;20:767A:SA-PO2867

2. Roberts, DH, Newman, LR, Schwartzstein, RM, Twelve tips for facilitating Millenials’ leanring. Med Teach 2012;34:274- 278.

4

Serious games: benefits

For the developer

• Scalability• Distributability• Relative cost• Reusability of materials• Mobile delivery

For the educator

• Augmentation of reality• Manipulation of time• Standardization of

content and assessment• Automated assessment• Opportunity to build on

learning through discreet tasks and levels

• Incorporate adult learning principles

For the learner

• Fun and interactive interface

• Engage through competition

• Practice of relevant skills in a safe way

• Accessibility when convenient and useful

• Capacity for repetition• Self-pacing• Immediate feedback• Anonymity• Expertise developed

through levels

5

Development

6

Development

7

Development

8

Development

9

Development

10

Quality Testing

Think Aloud Protocol testing

Likert scale system usability scale (SUS) surveys

Thirteen subjects : students, fellows, residents, attendings, and nurses

11

Quality Testing Results

Survey ResultsOn a 5-point Likert scale, average ratings were:• Usefulness: 4.885 • Enjoyment: 4.538 • Interest in future use: 4.923 • Clarity of directions: 4.577 • Utility of feedback: 4.692

  Average System Usability Score (Standard Error)

Round 1 75.833 (5.601)

Round 2 94.583 (3.024)

Round 3 94.167 (1.179)

Round 4 94.375 (2.232)

12

Think Aloud Testing Results

Round 1 Round 2 Round 3 Round 4 Round 1 Round 2 Round 3 Round 4 Round 1 Round 2 Round 3 Round 4 Round 1 Round 2 Round 3 Round 4SUS Score Total bugs Total content edits Total UI edits

0

10

20

30

40

50

60

70

80

90

100

Usab

ility

Sco

re, N

umbe

r of E

dits

/Rou

nd

13

Peritoneal Dialysis Simulator

14

Knowledge Guide

15

Tactics

16

Case Simulator

17

Feedback and Hints

18

Future Studies

The simulator will be published soon

on: www.openpediatrics.org• Embedded analytics will allow us to track usage,

scores, and user actions, categorized and analyzed based on user profile.

• Qualitative data from surveys will also be collected.• Ongoing work is necessary to conduct formal

evaluation.

19

Thank youTo Paul Devlin and Robert Brecher of Genuine Interactive, for their creativity and

hard work.

To Traci Wolbrink, Daniel Hames, Mignon McCulloch, Deborah Stein, and Sharon Su, our global team of physicians, for their invaluable expertise and teaching.

For more information, please contact: aleksandra.olszewski@childrens.harvard.edu.