Top Banner
Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National Conference on Student Assessment June 2008
15

Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Dec 15, 2015

Download

Documents

Mara Widdowson
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Modified Achievement Testsfor Students with Disabilities:Basic Psychometrics and Group Analyses

Ryan J. KettlerVanderbilt University

CCSSO’s National Conference on Student AssessmentJune 2008

Page 2: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Reliability and Concurrent Validity with a Proficiency Tests

CAAVES Item Mod Data 2008 2

Page 3: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Concurrent Validity with Participation Criteria

CAAVES Item Mod Data 2008 3

Page 4: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

CAAVES Item Mod Data 2008 4

Reading: Descriptive Statisticsfor Unmodified and Modified Tests

Page 5: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Distributions by Group and Condition in Reading

CAAVES Item Mod Data 2008 5

Students without Disabilities, Ineligible

Students with Disabilities, Ineligible

Students with Disabilities, Eligible

Page 6: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Effect Sizes of Modifications on Reading Performance

CAAVES Item Mod Data 2008 6

Page 7: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Group Improvement by Condition in Reading

CAAVES Item Mod Data 2008 7

Page 8: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Mean Item Difficulty by Group and Condition in Reading

CAAVES Item Mod Data 2008 8

* Student abilities were equated using a Rasch model.

Page 9: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

CAAVES Item Mod Data 2008 9

Math: Descriptive Statistics forUnmodified and Modified Tests

Page 10: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Distributions by Group and Condition in Math

CAAVES Item Mod Data 2008 10

Students without Disabilities, Ineligible

Students with Disabilities, Ineligible

Students with Disabilities, Eligible

Page 11: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Effect Sizes of Modifications on Math Performance

CAAVES Item Mod Data 2008 11

Page 12: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Group Improvement by Condition in Math

CAAVES Item Mod Data 2008 12

Page 13: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Mean Item Difficulty by Group and Condition in Math

CAAVES Item Mod Data 2008 13

* Student abilities were equated using a Rasch model.

Page 14: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Upcoming Analyses: Difficulty Change on Individual Items

CAAVES Item Mod Data 2008 14

Students without Disabilities, Ineligible

Students with Disabilities, Eligible

Page 15: Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Conclusions

Assessments can be made more accessible for eligible students (with disabilities who have persistent academic difficulties).

Modifications can change the difficulty of tests and items without invalidating the resulting scores.

Much more work needs to be done!CAAVES Item Mod Data 2008 15