Page 1
Using State Data toUsing State Data to Achieve Performance GoalsAchieve Performance Goals
REGIONAL HIGH SCHOOL SUMMITSREGIONAL HIGH SCHOOL SUMMITS
MPR Associates, Inc.MPR Associates, Inc.www.mprinc.comwww.mprinc.com
March-May 2004March-May 2004
Archived Information
Page 2
MPR Associates2
CLOSING THEACHIEVEMENTGAPEffective Performance Measurement Systems
Define valid and reliable measures of student performance
Use appropriate analytic methods
Promote school improvement
Page 3
MPR Associates3
CLOSING THEACHIEVEMENTGAPEssential Elements of NCLB
Adequate Yearly Progress
Assess state, district and school achievement over time
Identify schools in need of improvement
High School Performance Measures Student achievement Graduation rates
Page 4
MPR Associates4
CLOSING THEACHIEVEMENTGAPEssential Elements of NCLB
State Accountability System Single system Statistically valid and
reliable
Populations All Students Subgroups of students
Page 5
Defining Defining TerminologyTerminology
Page 6
MPR Associates6
CLOSING THEACHIEVEMENTGAPHigh School Graduation Rate
In 2000, the high school graduation rate was 86 %
How is graduation determined?
How is student mobility treated?
When does measurement occur?
Page 7
MPR Associates7
CLOSING THEACHIEVEMENTGAPMeasurement Criteria
Statistically valid systems Single measurement
approach Accurate over time Reliable data
Measure Construction Fair Useful
Page 8
Analytic Analytic ConsiderationsConsiderations
Page 9
MPR Associates9
CLOSING THEACHIEVEMENTGAPUnpacking the Data
Aggregate statistics can conceal useful information.
Making the most of your data requires:
Identifying issues of concern
Disaggregating variables
Controlling for factors affecting outcomes
Page 10
MPR Associates10
CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation Rate
State and District Graduation Rate
State District
Grad. Rate 86 % 84 %
Race-ethnicity
White 89 90
Black 84 78
Hispanic 78 68
Page 11
MPR Associates11
CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation
Rate(continued)
State and District Graduation Rate
Urban
State DistrictDistricts
Grad. Rate 86 % 84 % 82 %
Race-ethnicity
White 89 90 86
Black 84 78 78
Hispanic 78 68 62
Page 12
MPR Associates12
CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation
Rate(continued)
District and School Graduation Rates
District School A School B
Grad. Rate 84 % 92 % 78 %
Race-ethnicity
White 90 93 80
Black 78 94 74
Hispanic 68 NA 68
Page 13
MPR Associates13
CLOSING THEACHIEVEMENTGAPA General Model for Examining Student Outcomes
School
Inputs
School
Practices
Student
Outcomes
School
Inputs
School
Practices
Student
Outcomes
Good Evaluation Focuses on more than Student Outcomes:
Data on School Practices andInputs are Also Essential
Page 14
MPR Associates14
CLOSING THEACHIEVEMENTGAPEssential Control Variables
School Practices Curricular offerings and rigor Class scheduling Professional development
School Inputs Student demographics Size and urbanicity Teacher experience
Examples:
Page 15
MPR Associates15
CLOSING THEACHIEVEMENTGAPAdditional Data Sources…
Student Transcripts
Attendance
Subject area grades
Curricular rigor
Mobility & retention
…can provide a broader picture of student performance
Examples:
Page 16
Using Results to Using Results to Promote Promote
ImprovementImprovement
Page 17
MPR Associates17
CLOSING THEACHIEVEMENTGAPImproving Usability
User-tested reporting
Dedicated time for reflection and strategic planning
Building analytic capacity among teachers and administrators
Periodic feedback for overall design of state and local data systems
Page 18
ConclusionConclusion
Page 19
MPR Associates19
CLOSING THEACHIEVEMENTGAPEffective Performance Measurement Systems
Track: Produce valid and reliable data on school and student outcomes
Analyze: Provide policy relevant information across
a range of variables
Improve: Assist policymakers and educators in making better decisions