Top Banner
Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario
37

Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

Mar 31, 2015

Download

Documents

Austin Morby
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

Promoting Regulatory Excellence

Self Assessment & Physiotherapy: the Ontario Model

Jan Robinson, Registrar & CEO,

College of Physiotherapists of Ontario

Page 2: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

2

Presentation Outline regulatory context program history current program learnings where to next

Page 3: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

3

Regulatory ContextSelf regulatory modelQuality assurance is mandated ≈7,000 registered physiotherapists 40/60 split public/private care models

Page 4: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

4

Quality Management

Assure quality practice

Promote continuing

competence

Page 5: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

5

➔ not a science ➔ start somewhere

Page 6: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

6

Time when continuing professional development (CPD) hours were primary example

Page 7: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

7

Initial programLearning logCollege Review Program (5 components)Practice Review

Rheumatoid Arthritis Lower Extremity Function Disabilities of Arm, Shoulder & Hand

Page 8: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

8

2001 Program Challenges not used fairness? subjectivity onerous research findings vs. influence on

competence

Page 9: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

9

2002 – 2004 extensive evaluation and program development

Page 10: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

10

Current Quality Management Program evidence based confidential evolves under continu0us evaluation shared accountability

Page 11: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

11

Page 12: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

12

Page 13: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

13

Practice Reflection

Goal : To promote registrant self-assessment, professional accountability and practice reflection to continuously improve the quality of professional performance.

Page 14: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

14

Two mandatory elements portfolio PISA (Professional Issues Self-

Assessment)

Page 15: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

15

Portfolio provides evidence of ongoing learning over fourteen (14) web based tools to

customize

Page 16: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

16

PISA (Professional Issues Self-Assessment) 20 questions change annually interactive, online

Page 17: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

17

Page 18: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

18

Page 19: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

19

Practice Assessment

Goal: To allow registrants to demonstrate competency while providing a positive learning experience.

Page 20: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

20

Practice Assessment Tool

Domains assessed: Practice Issues Billing Professional Portfolio

Review Record Keeping Chart Stimulated

Review

Page 21: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

21

Key success factors tools reliable & valid assessor calibration procedural fairness

Page 22: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

22

Committee Review blinded physiotherapist input all other relevant College data provided

Page 23: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

23

Outcomes

1. Satisfactory no further action2. Self directed Practice Enhancement3. Committee Directed Practice

Enhancement (two options)

Page 24: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

24

Resources for support focus groups video webcasts teleconferences online tutorials interactive tools electronic links to resources

Page 25: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

25

Practice Enhancement

• Goal: To assist registrants to meet competence standards

PTs in clinical practice identified as having gaps in knowledge, judgment, skills and/or abilities.

Page 26: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

26

Post Visit Questionnaire Data

78% response rate 2008/2009 66% response rate 2007/2008 71% response rate 2006/2007

Page 27: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

27

How confident are you that on the whole the Practice Assessment

reflects your practice?

0

10

20

30

40

50

60

%

1 (Low) 2 3 4 5 (High)

2008/09 2007/08 2006/07

Page 28: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

28

020406080

100

%

Practice Billing Portfolio Recordkeeping

CSR

2008/09 2007/08 2006/07

How relevant were the components of the assessment to your practice? Ratings provided as a percentage of those who responded either

4 (relevant) or 5 (very relevant).

Page 29: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

29

Did your participation in this process assist you in identifying any

learning needs?

0

20

40

60

80

%

2008/09 2007/08 2006/07

Yes No

Page 30: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

30

Self identified areas for ongoing learning

0

20

40

60

80

%

2008/09 2008/07 2006/07

Record Keeping Practice Issues CSR Portfolio

Page 31: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

31

How well did the Assessment meet the intended goal?

0

20

40

60

%

1(Low) 2 3 4 5(High)

2008/09 2007/08 2006/07

Page 32: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

32

“I don't need this process to demonstrate my competency or ongoing learning. But I imagine some PTs do, and the process has to be standardized for all. However, I doubt other registered health practitioners … jump through all these hoops!!!!”

Page 33: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

33

“Definitely a positive learning experience. For those of us who actually care that we are doing a good job, it provides a time to reflect and critically evaluate all that we do.”

Page 34: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

34

Page 35: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

35

Continuous Improvement of the Program

currently under review against evidence in area of reflection, more specifically related to

➔ practice drift ➔ self assessment ➔ Feedback

Page 36: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

36

Under Consideration language shift – continuous

improvement; shared learning guided reflection structured in all 3

program components multisource data input – voluntary &

mandatory registrant skill building on effective use

of feedback building communities of practice

Page 37: Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

CLEAR 2009

Annual Conference

September 10-12

Denver, Colorado

37

Questions….