Science MCA-III Updates Minnesota Department of Education Science Assessment Specialist Jim WoodDawn Cameron [email protected]@state.mn.us.

Science MCA-IIIUpdates

Minnesota Department of Education

Science Assessment SpecialistJim Wood Dawn Cameron

[email protected] [email protected]

651.582.8541 651.582.8551

education.state.mn.us 2

MCA Update

• Scorable Item Samplers in 2012-13• Test Design and Simulations• Text to Speech• Reporting: Data and Resources

education.state.mn.us 3

Item Samplers – Teacher Guides

education.state.mn.us 4

Item Samplers – Score reportshttp://www.mnstateassessments.org/itemsamplers.html

Score Report Teacher Guide

education.state.mn.us 5

Test Design and Navigation

education.state.mn.us 6

Science • Grades 5, 8 and high school MCA-III Statewide

scores went up from 2012 • Increase in performance was realized as

standards were more consistently implemented across the state.

2013 MCA Assessment Results Summary

education.state.mn.us 7

2013 State Proficiency Level

education.state.mn.us 8

education.state.mn.us 9

education.state.mn.us 10

education.state.mn.us 11

Comparison of 2012 and 2013St. Paul

Grade 5 Grade 5 State Grade 8 Grade 8 State High School HS State0

10

20

30

40

50

60

2012Series22013

education.state.mn.us 12

Information found in MDE Data Center

education.state.mn.us 13

• Interpreting Science MCA-III Test Scores– Overall scale scores (G01-99)– Scale scores match with the ALD’s

• Strand, Sub-Strand levels– Reported using a different scale score system (1-9)– Standard Deviation– Standard Error of the Mean= SD/√n

Putting it all together

education.state.mn.us 14

Benchmark Analysis

6.1.3.1.1

education.state.mn.us 15

• All data is relative to the state data

• Watch the dotted lines – different colors may overlap in their standard deviation

• Keep an eye on the CLES metric when comparing schools

CAUTION!!!P-values and standard deviation

Food for Thought

• Save time for evaluation of data, individually and as a team

• What inferences can and cannot be made from results?

• Formative vs. Summative strengths– What are you going to do with this data

education.state.mn.us 17

Test Development Process

Test Specs

Storyboard Writing

Item Revie

w

Field Test

Items

Data Revie

w

Operational Item

Pool

Operational Test

Bias Revie

w

Achievement Levels

Storyboard Review

Bias Revie

w

Item Writin

g

education.state.mn.us 18

Get involved!

Assessment Advisory Panels—ongoing

Register to be invited to panels at

http://education.state.mn.us

Educator Excellence

Testing Resources

Register for Advisory panels

education.state.mn.us 19

education.state.mn.us 20

• Broken down by

Sub-strand

HS Benchmark Graphs 2013

education.state.mn.us 21

Grade 5 Grade 8

0.45 – 16% 0.45 – 14%

0.50 – 50% 0.50 – 50%

0.55 – 90% 0.55 – 91%

High School

0.45 – 15%

0.50 – 50%

0.55 – 95%

Interpretation of CLES