Practical Innovations with Rubrics: If You Build it, They Will Grade!

1ExamSoft Assessment Conference | #ASSESS2015

ExamSoft Assessment Conference

#ASSESS2015

2ExamSoft Assessment Conference | #ASSESS2015

Danielle Birch, BAConnie Remsberg, Pharm. D., Ph.D.

Washington State University College of Pharmacy

3ExamSoft Assessment Conference | #ASSESS2015

Who are We & What do We do?

Washington State University College of Pharmacy

• Danielle Birch: Program Coordinator for Assessment• Connie Remsberg: Director, Advancement of Teaching and

Learning Excellence

4ExamSoft Assessment Conference | #ASSESS2015

Overview

• Rubrics for Knowledge Based Assessments

• Rubrics for Skills Based Assessments– Patient counseling example

• Interactive rubrics lesson• Challenges and benefits• Questions & answer

5ExamSoft Assessment Conference | #ASSESS2015

Let’s hear from you!

6ExamSoft Assessment Conference | #ASSESS2015

Learning Objectives

1. Develop and use rubrics for essay grading

2. Assign multiple rubrics to one assessment

3. Assign multiple graders to specific students

4. Utilize checklist in rubric format to evaluate skills based activities

5. Identify challenges and benefits of adopting computerized rubric technology to assess skills-based assessments

7ExamSoft Assessment Conference | #ASSESS2015

Competency Based• Competency based grading system• Honors- Satisfactory-Fail (H-S-F)• Block Testing

– 3 attempts allotted to reach competency• Test• Retest• ELE

• Rubric Terminology • Longitudinal Reports

8ExamSoft Assessment Conference | #ASSESS2015

Appendix D/ Accreditation

• Accreditation Council for Pharmacy Education (ACPE)

• Longitudinal reporting of Appendix D

0.00%

20.00%

40.00%

60.00%

80.00%

100.00%85.98%

98.83%

58.88%

90.06%84.96%88.65%97.43%

85.90%85.03%82.14%85.51%91.41%

Group Average

9ExamSoft Assessment Conference | #ASSESS2015

Interactive Rubrics LessonTake out your laptops!

(if you haven’t already)

10ExamSoft Assessment Conference | #ASSESS2015

Login• Google: WSU ExamSoft• Email: [email protected]• Password: harrypotter

11ExamSoft Assessment Conference | #ASSESS2015

How to Build A Rubric

12ExamSoft Assessment Conference | #ASSESS2015

Knowledge Based Performance

(essays)

Skills Based Performance

(compounding, patient

counseling)

Rubrics

13ExamSoft Assessment Conference | #ASSESS2015

Rubrics for

Knowledge Based Performance

14ExamSoft Assessment Conference | #ASSESS2015

Assign a Rubric (or 2!) to an Essay

• Post the test, then add the rubric!

Learning Objective #1: Develop and use rubrics for essay grading

Learning Objective #2: Assign multiple rubrics to one assessment

Pg. 1, 11

15ExamSoft Assessment Conference | #ASSESS2015

Learning Objective #1: Develop and use rubrics for essay grading

16ExamSoft Assessment Conference | #ASSESS2015

Assigning Multiple Graders

p.4

17ExamSoft Assessment Conference | #ASSESS2015

Assign Multiple Graders

Learning Objective #3: Assign multiple graders to specific students

Pg. 4

18ExamSoft Assessment Conference | #ASSESS2015

Detailed Grader Report

Learning Objective #3: Assign multiple graders to specific students

19ExamSoft Assessment Conference | #ASSESS2015

Rubrics for

Skills Based Performance

20ExamSoft Assessment Conference | #ASSESS2015

Compounding Lab• Use of rubrics to assess the following

– Compounding products– Compounding records– Professionalism grades

21ExamSoft Assessment Conference | #ASSESS2015

Patient Counseling Assessment

• https://tegr.it/y/1iz1u

22ExamSoft Assessment Conference | #ASSESS2015

23ExamSoft Assessment Conference | #ASSESS2015

Application

• Page 3 of your packet: accessing your assigned rubric• https://www.youtube.com/watch?v=hVb_dXfK44E

Learning Objective #4:Utilize checklist in rubric format to evaluate skills based activities

24ExamSoft Assessment Conference | #ASSESS2015

Review: Challenges and BenefitsChallenges• The move from paper-based to computer-based• Combining multiple rubrics• Half points• Releasing results (delay in registering in the portal)• Cannot preview what the students will seeBenefits• Faculty Collaboration• Efficiency• Much faster• Tracking outcomes• Evaluate grader tendencies• Score quickly and write comments

Learning Objective #5: Identify challenges and benefits of adopting computerized rubric technology to assess skills-based assessments

25ExamSoft Assessment Conference | #ASSESS2015

Bad Example• Ron Swanson Turkey Burger• https://www.youtube.com/watch?v=tq2CwGgz73Q

26ExamSoft Assessment Conference | #ASSESS2015

Q&AI can’t wait to grade

more efficiently!

I loved switching from paper to computer

based rubrics!

This is not my best jump.

I love saving time by assigning multiple

graders!