Introductory Supervision Training Day 3: Evaluation Katherine Hildyard & Katharine Boon June 2015
Aims for the morning…
n To review your learning and development n To consider evaluation from trainee and
supervisor perspectives n To increase awareness of trainee evaluation
– the how and the what n Dealing with difficulties – what happens
when things go wrong and how to handle them
Reviewing Learning and Development
n Clarifying your expectations; what are you hoping to get from today?
n Discuss your learning and development so far
n Identify your needs
Evaluating Competency from Different Perspectives
n ‘Evaluation troubles most supervisors’ n Bernard and Goodyear, 2013
Exercise: 1 – Challenging Scenarios . . .
n Do any of these YouTube clips resonate with you?
n What are the issues relevant to evaluation?
n http://www.youtube.com/watch?
v=wfWvWDymehY
n http://www.youtube.com/watch?v=xlgJI1ZpJ1M
n http://www.youtube.com/watch?
v=PrzlUw8Xdek
Exercise 2
n What does the term ‘evaluation’ mean to you?
n What difficulties/dilemmas can occur in evaluation processes?
n How might these difficulties be overcome?
Understanding the Trainee’s Context
n A model by Michael Carroll of: n – Survival mode n Versus n – Competency mode (frontal lobe)
Frontal Cortex Thinking: The biology of meaning-making
n Plans for the future n Imagination and prediction n Self development n Ability to reflect n Introspection n Ethical decisions n Managing emotions n Creativity and change – “open mind, open
heart, open will”, (Scharmer 2007)
Frontal Lobe Cortex (cont’d)
n Speaking n Writing n Reasoning n Abstracting n Problem solving
(Carroll, Centre for Supervision Training, 2009)
A Compassionate Mind perspective: Gilbert, 2009
Drive seeking and acquisition focused system
Designed to pay attention to advantageous resources and experience ‘activation’ to try to acquire them and pleasure in pursuing and securing them.
Threat and self-protection focused system Designed to attract attention to, detect, process and respond to threats.
Designed to enable a state of peacefulness and openness when individuals are no longer threat focused or seeking resources.
Contentment, soothing and affiliative focused system
Exercise 3
n 1. How can you recognise if you or your trainee are in survival mode?
n 2. What might be useful to help you / your trainee to move into competency mode?
Measures of Supervisor Competency
n Trainee competency – pre and post supervision
n Client outcome (supervisee’s clients) n Supervisee feedback n External ratings / feedback – e.g. ‘the
Session Rating Scale’, supervision of supervision
Issues Relating to Supervisor Competency Evaluation
¡ Generic versus specific model of therapy ¡ Generic versus specific model of
supervision n Method of evaluation – Reliable and
valid measure n Who evaluates – self, supervisee,
supervisor, external person
Evaluating Trainee Competencies: A Model of Good Practice
n Contract with the trainee within the first 2-3 weeks of the placement. Be specific about what is expected using the course documentation as guidance.
n Be explicit about your own model of competence.
n Negotiate the need to ‘challenge’. n Use direct observation (sitting in, audio or video
tapes, live supervision) on which to form your opinion and be explicit about which aspect of the trainee’s work you are assessing.
n Use objective measures if applicable.
Evaluating Competencies: A Model of Good Practice cont’d
n Be aware of any barriers from either you or the trainee, which may affect the possibility of open reflecting on skills.
n Be open throughout (there should be no surprises at formal evaluation points).
n Consider the need for your supervision on being a supervisor.
n Use the clinical tutor for advice and follow the course guidelines if there are any major areas of concern.
A new way of evaluating . . .model specific competencies
n Evaluation of CBT competencies – Roth & Pilling
n CAT, Systemic, Psychodynamic competency frameworks
n Count towards accreditation in a model specific therapy . . .?
Methods of Evaluation:
n Competencies assessed by supervisor using Assessment of Clinical Competence at mid and end of placement on 8 competencies
n Case Studies (1-4) in first 2 years of training
n Log books (self appraisal)
Other Methods of Evaluation - Course
Formal: n Literature review, single case study, service
evaluation, SAQs n Formative feedback from service users and
staff members during clinical skills teaching n Assessment of clinical skills (CSA-RF) Informal: n PBEIS / Core-Net n Research and case study presentations
General Methods of Evaluation
n Live supervision/Joint working n Role-playing within supervision n Formal / objective measures n Feedback from trainee – self report n Feedback from service users/carers
(e.g. Friends & Family Test)
n Feedback from colleagues e.g. team members
n Case notes
n Supervision records n Letters/reports n Audio tapes n Video tapes n Presentations n Exercises/role plays
Tackling Difficulties n Tackle it when you see it – competency mode n Listen to the individual – don’t make
assumptions n Negotiate how and when the feedback can be
given n Be clear and consistent about the message n Avoid a defensive or confrontational
approach n Understand your own philosophy re. learning
(remember Kolb)
Tackling Difficulties (cont’d)
n Don’t ask people to do what you haven’t done yourself
n Deal with the emotion (watch for shame)
n Use the relationship – and be aware of what you bring to this
n Ask for help! n And follow due process
Exercise 5: Role Plays
n Identifying and managing difficulties in evaluation processes
n Managing placement failure issues
n Can you identify a core quality of someone you are supervising?
n How might you use this model to give feedback const ruc t ive ly w i th in supervision – and help you manage difficulties?
You might want to think about the following . . .
Action Plans
n Review what you have learnt today n Consider your learning in the next six
months n Plan what steps you can actively take
to ensure this learning occurs n GAS form