Using Quality Matters to Evaluate Online Course Design Britt Watwood CTE Brown Bag April 23, 2010
Oct 30, 2014
Using Quality Matters to Evaluate
Online Course Design
Britt WatwoodCTE Brown BagApril 23, 2010
About Quality Matters
•Rubric
•Peer Review Process
QM Rubric Eight General Standards:
1. Course Overview and Introduction2. Learning Objectives 3. Assessment and Measurement4. Resources and Materials5. Learner Interaction6. Course Technology7. Learner Support8. Accessibility
Key components must align.
Alignment: Critical course elements work together to ensure that students achieve the desired learning outcomes.
Course Learning Objectives (2)
Resources, Materials (4) & Technology (6)
Assessment and Measurement (3)
Learner Interactions & Activities (5)
Key sections that must align…
Rubric Scoring
Standards Points Relative Value
17 3 Essential
11 2 Very Important
12 1 Important
TOTALS
40 85
Team of 3 reviewers initially score individually One score per standard based on team majority Pre-assigned point value Yes/No decision; All/None points Consensus is NOT required
For QM Purposes, Quality Is…
• More than average; more than “good enough”
• An attempt to capture what’s expected in an effective online course at about an 85% level
• Based on research and widely accepted standards
85 %
To Meet Expectations…
A course must achieve:
• “Yes” on all 17 of the 3-point “essential” standards.
• A minimum of 72 out of 85 points
72/85 = 85%
Peer Course Review
Feedback
Course
Course Meets Quality Expectations
Course Revision
Instructional Designers
InstitutionsFaculty Course Developers National Standards &
Research Literature
Rubric
Faculty ReviewersTraining
Quality Matters: Peer Course Review
Process
Factors Affecting Course Quality
• Course design QM REVIEWS THIS
• Course delivery (i.e. teaching, faculty performance)
• Course content• Course management system• Institutional infrastructure• Faculty training and readiness• Student engagement and readiness