State Assessment Quality Control Oklahoma Maridyth McBee, Ph.D. Assistant Superintendent for Accountability and Assessment Oklahoma State Department of.

State Assessment Quality Control Oklahoma

Maridyth McBee, Ph.D.Assistant Superintendent for Accountability and Assessment

Oklahoma State Department of Education

Three Types of Assessments

Assessments for Grades 3-8

Grade/Subject Math Reading Science Geography

Social Studies/U.S

. History Writing

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Federal and State mandated tests: results used in accountability calculations

State mandated tests

General Assessments for End-of-Instruction

Algebra I

English II

Biology I

U.S.

History

Algebra

II

Geometr

y

English III

4Federal and State mandated tests:

State mandated tests

Quality Assurance Component1

Why External Verification?•Ensuring testing vendor meets contractual expectations•Preventing score reporting and appeals issues•Improving state testing services and future testing contracts

Quality Assurance Component1

• Plan to contract with third party vendor– Verification of equating procedures– Replication of scoring and reporting

• Key issue: ensuring quality and producing score reports rapidly

Quality Assurance Component1• Assessment vendor conducts psychometric analysis, scoring and

reporting• Third party vendor replicates and reports findings to state and

Quality Assurance Component2

• Assessment and Accountability Office works closely with Third Party Data Office and districts to facilitate accurate data in state system

• Use state data for test enrollment• Use state data for demographic and disaggregation• Add data such as teacher of record to allow for use with teacher evaluation

Quality Assurance Component3

• Hold regional face-to-face and web-based training for district test coordinators

• Plan to conduct more web-based training and require participants to pass test of procedural content.

• Daily phone support

Quality Assurance Component4

• Security audits– Desk monitoring– On-site monitoring

• Erasure analysis• Plans for online response change analysis

Quality Assurance Component4

• Follow up to allegations of cheating or misconduct.• Plans to classify allegations with suggested options

for remedy– Job loss– Reassign away from testing– Reprimand– Further training

Critical Issues

• Transparency and Confidence in Results• Fiscal Parameters• High Expectations for Vendors• Partnership with Districts

Further Information

Contact the Office of Assessment and Accountabilityhttp://ok.gov/sde/accountability-assessments