Project lead: Heather Thornton Project team: Diana Davis, Karen Beeton, Sue Murray, Genevieve Ama-Boakye School of Health and Emergency Professions A Process.

Project lead: Heather ThorntonProject team: Diana Davis, Karen Beeton, Sue Murray, Genevieve Ama-BoakyeSchool of Health and Emergency Professions

A Process for Enhancing Student Engagement with Coursework Feedback

Presentation Objectives

• Project aim

• Background

• Activities to date

• Forward plans

• Conclusion

Project Aim

To develop a transferable student self-reflection tool that inspires students to be active learners, making self-assessment, reflection and acting on feedback

integral to written work.

Background to project

There is a need for students to have self-reflection and evaluation skills as part of professional practice.

Feedback on assessment was one of the lowest scoring areas in NSS in HEP.• Initial action was to ensure quality feedback - in 2009/10 every staff

member in HEP attended a workshop on giving quality feedback• The next step was to get students to engage actively with feedback

through self-reflection and evaluation

Existing system in Physiotherapy but there was a perception that there was:• diversity in students’ interpretation of what was self-reflection• variation in the level of accuracy in students’ self-assessment• inconsistent engagement with the task by both staff and students

Project Plan – activity to date

Evaluate the revised student assignment reflection tool.

Pilot the revised student assignment reflection tool. ✔

Developed a revised student assignment reflection tool. ✔

Focus group meeting. ✔

Review existing practice across physiotherapy. ✔

Review existing literature. ✔

Recruit graduate researcher. ✔

Establish a project team. ✔

Key points from the literature

Feedback is an important aspect of learning as it enables “the

development of student self-regulation and error detection” (Hattie &

Timperley, 2007) , it also “enables teachers to determine the level of

engagement from students”. (Munns et al., 2006)

However even when timely feedback is given there is considerable

evidence that suggests it may not be even read, understood or acted upon

(Orsmond, Merry, & Reiling, 2002; Gibbs and Simpson, 2003).

Whilst there is a large body of research around feedback “research on students

perceptions of feedback remains thin”, (Poulos and Mahony, 2008)

Key points from the literature

Students need to engage with the marking criteria in the process of self-

assessment:

“intelligent self-regulation requires that the student has in mind some goals to be

achieved against which performance can be compared and assessed” (Nicol and

Macfarlane-Dick, 2006)

Sadler in 1989 identified three key points in self-regulation:

• Developing a concept of the standard being aimed at (Marking criteria)

• Comparing the actual or current level of performance with the standard (Self-evaluation

and reflection)

• Engaging in appropriate action which leads to some kind of closure of the gap (Taking

action on feedback)

This has been more recently confirmed by research on student perception (Porkorny

and Pickford, 2010)

Document analysis

• Student Self Assessment forms and Tutor feedback forms were randomly selected from StudyNet using the following criteria:

• 3 consecutive academic years (2007, 2008 and 2009)• 2 modules from each level of study (levels 4, 5 & 6)• 5 scripts per assignment• 2 assignments from one module (Cardiorespiratory FT1 & 2)• 2 assignments from similar subject areas (NMS1 and 2)• 2 placement reflective assignments (Health & Well-being and Equality & Diversity)• Feedback forms from a randomly selected individual across all three levels/years ( Level 4

2007; Level 5 2008 & Level 6 2009).

• Review of the assessment forms included:• Comparison of student self assessment v tutor feedback – grade awarded and comments

made• Justification of mark awarded in student self assessment• Account taken of previous feedback.

Document analysis – variations in student reflection

• Justified their mark

•Talked about their experience doing the assignment

• Stated how they have used previous feedback

• Were unsure on what to include

‘…good use of literature and little more

discussion/reflection than with previous assignments’

‘I found it very difficult to keep within the word count

for this assignment, and therefore feel not all of my

knowledge could be demonstrated’.

‘it was commented that my paragraph organisation could

have been better…I have attended study skills sessions and applied techniques and

advice given.’

‘I do not feel this is my best piece of work. I have been debating whether or

not to state this in my reflection and I’m still not

sure if I should’

Comparing staff and student feedback

• Some students do not appear to know how to make improvements based on the feedback given.

• Students received the same feedback more than once, after attempting to make changes using the feedback given the first time.

• Some students were more accurate in self evaluation

• There was greater similarity between self-assessment and staff feedback.

Focus Group findings

Focus group of Physiotherapy students who had used the current tool

Key findings - students’ wanted:

• Clear and specific points on how to improve• Clear points on specific learning outcomes that need to be improved• Action points• Feedback that can be applied to future assignments• Conversational style in feedback• Detailed feedback which justifies the mark given and identifies • weaknesses for individual learning outcomes.

Development of guidance

• Template the students fill in • Staff guidance• Student guidance• Link• Video of student guidance

Pilot - using the revised student assignment reflection tool

Module Level Number of students

Programme

6AHP005: Practice education 5- Service improvement 6 40 Physiotherapy

6AHP055: Applied Research 6 40 Physiotherapy

5AHP0052: Holistic Oncology Management 5 21 Radiotherapy

6AHP0060: Developments in Radiotherapy Practice 6 22 Radiotherapy

5AHP0074: Principles and Applications of imaging Science 2

5 104 Radiography

6AHP0051: Nutrition Healthcare Provision 6 28 Dietetics

6AHP0044: Clinical education –clinical effectiveness 6 28 Dietetics

Forward plans

Bristol Online Survey

Revise in light of feedback from staff and students

Role out across other modules and programmes

Conclusion

• Analysis of initial work in Physiotherapy – document analysis and focus

group• Identified strengths and weaknesses of current system

• Exploration of the literature • Highlighted the benefits for student engagement and enhancement of self -evaluation skills

• Revision of the self assessment tool and development of guidance for staff

and students• Disseminated to the module leads and to the students through StudyNet

• Pilot undertaken using assignments from 7 modules in 4 different

programmes• To ensure transferability across programmes of assessment tool

• Review of outcome - ongoing• Seek opinions regarding ease of use of students (online survey) and staff

We would like to acknowledge the participation of the students in the focus group and the staff who are undertaking the pilot work

Discussion

Any Questions?

EVS

Do you think using this tool will enhance student reflection?

A - Yes, definitely

B - Probably

C - Not sure

D - No, Not at all

EVS

Would you consider using this for your own students?

A - Yes, definitely

B - Probably

C - Not sure

D - No, Not at all

References

Gibbs, G & Simpson, C. (2003). Does Your Assessment Support Your Students’ Learning? Learning and Teaching in Higher Education, 1(1), 3-31.Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81- 112.Munns, G. & Woodward, H. (2006). Student engagement and student self-assessment: the REAL framework. Assessment in Education Principles, Policy & Practice, 13(2), 193-213. Nicol, D.L. & Macfarlane-Dick, D. (2006). Formative Assessment and Self Regulated Learning: A Model and Seven Principles of Good Feedback Practice. Studies in Higher Education, 31(2),199-218.Orsmond ,P., Merry, S, & Reiling K. (2002). The student use of tutor formative feedback in their learning. Presented at Learning communities and Assessment cultures conference: EARLI special interest group on assessment and evaluation. Northumbria: University of Northumbria, 28-30.Porkorny, H. & Pickford, P. (2010). Complexity, cues and relationships: Student perceptions of

feedback. Active Learning in Higher Education, 11(1), 21-30. Poulos, A. & Mahony, M.J. (2008). Effectiveness of Feedback: The Students’ Perspective.

Assessment and Evaluation in Higher Education, 33(2), 143-154. Sadler, D.R. (1989). Formative assessment and the design of instructional systems

Instructional Science, 18, 119-144.

Systems’,