Top Banner
Guide to JMO Assessment Processes for JMOs
30

Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Apr 15, 2018

Download

Documents

dangdieu
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Guide to JMO Assessment Processes for JMOs

Page 2: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

• This PPT has been developed with the support of CPMEC and primarily authored by Debbie Paltridge, Alison Jones and Carmen Crawford.

• We would like to acknowledge the reviewers of the material for their valued contribution’s

Page 3: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Outline 1. What are the requirements for JMO assessment in 2015?

2. Why do we assess JMOs?

3. What is your role in JMO assessment?

4. How does general registration relate to internship?

5. What is the AMC’s role in internship?

6. What happens at the end of JMO year Certification Process?

7. What do you need to know about the nationally available Assessment Form?

8. How do the assessment processes link to the Australian Curriculum Framework for Junior Doctors (ACF)?

9. What are the next steps to support

implementation?

Page 4: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Requirements for JMO assessment in 2015

Page 5: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What are the requirements for JMO assessment in 2015?

• Refer to new National Registration Standard: http://www.medicalboard.gov.au/Registration-Standards.aspx

• New requirements: – Standard requiring assessment against Intern

Outcome Statements

– National form for certifying JMOs completion (mandatory since2014)

– NSW specific term assessment form

Page 6: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Why do we assess JMOs?

Page 7: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Why do we assess JMOs? • Patient safety

– To assist in decisions made about delegation and level of supervision

• To fulfil legal requirements – Doctors with provisional registeration are required to practise

under supervision before being granted general registration – Accreditation requirement to supervise and assess PGY2s

• Clinical oversight – To improve workload management and ensure patient safety

• To assist in directing JMO learning and clinical experience • To make decisions about JMO progression

Page 8: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What is your role in the assessment process?

Page 9: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What is your role in the assessment process?

• As a JMO you are: – an active participant in your learning throughout

prevocational training – actively involved in arranging mid and end of term

assessment meetings with your supervisor – encouraged to actively seek feedback on specific aspects

of your performance. – be both willing and able to receive feedback on your

performance – asked to regularly make honest judgements about your

performance – actively involved in the assessment discussion and any plans for remediation

Page 10: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How does registration relate to internship?

Page 11: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How does registration relate to internship?

• JMOs are granted provisional registration by the Medical Board of Australia (MBA) to complete the PGY1 year

• The PGY1 year is a period of supervised clinical practice. – At least 47 weeks of supervised practice in accredited

terms (core terms of medicine (10 weeks)/surgery (10 weeks)/emergency medical care (8 weeks) and other non core accredited terms)

Page 12: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How does registration relate to internship?

• After satisfactory completion of the intern year, JMOs can apply to the MBA for general registration

– The Medical Board will consider the totality of advice in deciding whether to grant general registration.

– A JMO who has performed marginally or unsatisfactorily in a specified term but who has demonstrated ‘significant’ progress with evidence of remediation may be deemed to have met the standard expected for general registration

by the end of the year.

Page 13: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What is the AMC’s role in internship?

Page 14: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

AMC role in internship

• Accredits medical training programs for the Medical Board of Australia

• Developed standards, guidelines and forms for a national internship framework

• Developed a nationally consistent assessment process based on: – Intern Outcome Statements (aligned with the graduate outcome

statements for medical schools)

– Medical Board of Australia Requirements for Certification and Sign off, and

– A nationally available Term Assessment Form linked to the Intern Outcome Statements

• AMC Prevocational Standards Accreditation Committee oversees national intern standards

Page 15: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What happens at the end of intern year certification process?

Page 16: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What happens at the end of intern year certification process?

• The DPET considers all term reports with the assistance of an Assessment Review Group

• Written confirmation whether the JMO has: – Satisfactory term supervisor reports

– An overall satisfactory rating

– Determination of any additional remediation required e.g. additional time in core terms

Page 17: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What do you need to know about the NSW Prevocational Assessment forms?

Page 18: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Before you are assessed

• Be aware that the forms are one part of the overall assessment process

• Ensure that you are prepared for the assessment discussions

– Be familiar with the assessment requirements

– Reflect on your performance (both personally and through gathering information from others) and complete the forms from your perspective

Page 19: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

The Assessment Forms

• Are a tool for your Supervisor to provide feedback on your performance.

• Based on the Intern Outcome Statements

• Use a 5-point scale with descriptors – Research shows improved reliability of this approach

particularly in large groups of assessors

– Descriptors will guide your assessors to provide an authentic rating of your performance

– Three descriptors have been developed for each Intern Outcome Statement (ratings 1, 3 and 5)

• Not observed option

Page 20: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Example: 2.2 .Communicate clearly, sensitively and effectively with patients, their family/carers, doctors and other health professionals.

Rating Descriptor

5 Communicates effectively in routine and difficult situations: actively listens,

demonstrates appropriate language for the audience (patients, families or other

health professionals) and checks for understanding

4

3 Communicates effectively in routine situations, but some difficulty in adapting

communication to deal with challenging situations

2

1 Rarely communicates effectively: does not actively listen, cannot adapt language

to the audience and rarely checks for understanding

The Assessment Forms

Page 21: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

• There is also a Global rating of your performance on the term (End of Term Assessment Form only)

• In making this rating the supervisor will consider your ability to:

– practise safely;

– work with increased levels of responsibility;

– apply existing knowledge and skills and learn new knowledge and skills as required

The Assessment Forms

Page 22: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

The Assessment Discussion • You should receive regular feedback throughout the

term and consolidate this at your mid and end of term discussions

• Ensure you are clear about what is being assessed and why

• Be willing to tell the supervisor what you need feedback on

• Consider your self assessment ratings • Discuss your supervisor’s assessment decisions,

drawing on the descriptors in the form • Refer to ACF to determine areas you would like

feedback on

Page 23: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What if your supervisor identifies some areas that you need to work on? • Welcome the opportunity to get guidance on

how to perform at a higher level

• Familiarise yourself with the IPAP process: – Where you are rated at a 2 or below and a 3 in some

instances an Improving Performance Action Plan (IPAP) is required.

• Work with your supervisor and DPET to develop this plan

• Ensure you are clear on the next steps and actions required of you

Page 24: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

AMC Intern Outcome Statement (e.g. Domain 1 Statement 1.2)

Issues related to specific outcomes statement

Actions/ Tasks

Responsibility Timeframe Review Date

Supervisor comments on the outcome of remediation:

The IPAP

Page 25: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How do the assessment processes link to the ACF?

Page 26: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How do the assessment processes link to the ACF?

• The ACF is currently used to:

– Guide formal education programs provided to both PGY1s and PGY2s

– Outline the term experiences

– Assist JMS self reflections on their experiences – “What have I learnt on this term?”

Page 27: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

How does the assessment processes link to the ACF?

• The Intern Outcome Statements have been mapped to the ACF domains

• The ACF provides more detailed information to describe the breadth of learning experiences the JMO may have

• The ACF is a good tool to use in your assessment discussions

Page 28: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Next steps to support implementation

Page 29: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

What are the next steps to support Implementation?

• Familiarise yourself with the forms and process

• Understand that your supervisors are familiarising themselves with the new process too

• If unsure, ask your DPET or JMO Manager any questions about the process

• Provide feedback on the process to your DPETs or JMO Managers to inform any future developments

• Actively prepare for your assessment meetings with your supervisor

Page 30: Guide to AMC Intern Assessment Processes - HETI Prevocational... · –To assist in decisions made about delegation ... –asked to regularly make honest judgements ... • Developed

Summary

• Implementation of any new process takes some time for everyone to become familiar with the changes

• JMO assessment is everyone’s responsibility

• The assessment forms are one part of the process

• Active involvement by you will ensure that you get the most out of this process