American Educational Research Association Annual Meeting AERA 53.069 – TICL 6: Advancing the State of the Art: Computer-Based Assessment and Learning Environments New York, NY - March 27, 2008 John J. Lee, Girlie C. Delacruz, Jesse Elmore, & William L. Bewley Video-Based Assessment of a Coach’s Ability to Fault-Check Performance
13
Embed
Video-Based Assessment of a Coach’s Ability to Fault-Check Performance
Video-Based Assessment of a Coach’s Ability to Fault-Check Performance. John J. Lee, Girlie C. Delacruz, Jesse Elmore, & William L. Bewley. American Educational Research Association Annual Meeting - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
American Educational Research AssociationAnnual Meeting
AERA 53.069 – TICL 6: Advancing the State of the Art: Computer-Based Assessment and Learning EnvironmentsNew York, NY - March 27, 2008
John J. Lee, Girlie C. Delacruz, Jesse Elmore, & William L. Bewley
Video-Based Assessment of a Coach’s Ability to Fault-Check Performance
• Background
• Research base
• Assessments
• Design
• Analysis
• Demo
Overview
Background1. Context: Fault Checking Performance on the Range
2. Two Weapon Manipulations Skills: Speed Reload and Tactical Reload
3. Using video-based assessment from four different angles
4. Main research question: Does assessment response format make a difference?
Research Base• Expert-Novice
1. Experts have schemas to reduce cognitive load
2. Expertise Reversal Effect: some task formats may impede performance for experts when inconsistent or unaligned with existing schema
3. Scaffolding: helpful to novices who have little or no prior knowledge
4. Distributed Representations: task’s response format as scaffold
• Assessment Validation
1. Validity – reduce construct irrelevant variance as much as you can
2. Response fidelity more predictive validity than more abstract
Video-Based Assessments
1. Shooter-Skill Diagnostic Task:
Checklist Version
Open-ended Version
2. Shooter-Skill Performance Task:
Proper / Improper Execution
Shooter-Skill Performance Task: Drag and Drop Order
Video-Based Assessments
Video-Based Assessments
Video-Based Assessments
Video-Based Assessments
Video-Based Assessments
Sensitivity to Expertise
Research Question Independent Variable
Dependent Variable
Prediction
1. Do experts perform better on the SSDT that is open-ended because it is more like what they do on the firing line?