2016 Accountability data overview

2017 accountability data overview

Topics

Massachusetts Department of Elementary and Secondary Education

2

Changes to 2017 accountability reporting Accountability determinations

High schools Non-high schools Districts

Accountability reports

Changes to 2017 accountability reporting

603 CMR 2.00: Accountability & Assistance for School Districts & Schools Governs the review of the educational programs &

services provided by MA public schools & the assistance to be provided by districts & ESE to improve them

Describes the process for placing schools into Levels 1-5


4

Amendment to MA accountability regulations Approved by the Board on April 18, 2017 Allows ESE to refrain from placing certain schools into

Levels 1-3 at the beginning of the 2017-18 school year Applies to one year only Impacts schools serving grades 3-8 that administer Next-

Generation MCAS tests in spring 2017 Does not impact high schools serving grades 9-12 that do not

administer Next-Generation MCAS


5

Rationale

Transition to new statewide assessment (Next-Generation MCAS)

Opportunity to set a common assessment baseline for new accountability system

Transition to a revised system of district & school accountability under the Every Student Succeeds Act (ESSA)


6

Accountability determinations for high schools

High schools

For the purposes of 2017 accountability reporting: Schools in which the only tested grade is grade 10 Administered legacy MCAS in English language arts, mathematics,

& science in 2017 Did not administer Next-Generation MCAS tests in 2017


8

What will be reported for high schools in 2017? Performance on all accountability indicators

MCAS achievement, MCAS growth, ACCESS growth, graduation rates, dropout rates, dropout reengagement

Minimum group size for reporting = 20 students

Progress & performance index (PPI) data School percentiles Accountability & assistance levels (1-5) Commendations (subset of Level 1 schools) Schools identified for low or very low assessment

participation Schools identified for persistently low graduation rates


9

Progress & performance index (PPI) A measure of progress toward a group’s gap-

narrowing goals Annual PPI shows progress over two years Cumulative PPI represents trend over time

Core indicators (up to 7) ELA, math, & science proficiency gap narrowing (CPI) ELA & math growth (SGP) Annual dropout rate Cohort graduation rate (4- & 5-year)

Extra credit Reducing percentage of students scoring Warning/Failing &/or

increasing percentage of students scoring Advanced (10% or more)

Demonstrating strong growth on ACCESS for ELLs (SGPA of 60 or higher)

Reengaging dropouts (2 or more students) Massachusetts Department of Elementary and Secondary Education

10

Annual PPI = total points / # core indicators Cumulative PPI = (2014*1 + 2015*2 + 2016*3 + 2017*4) / 10

Core indicators Up to 700 points awarded

1. ELA proficiency gap narrowing (CPI) 0, 25, 50, 75, or 100

2. Math proficiency gap narrowing (CPI) 0, 25, 50, 75, or 100

3. Science proficiency gap narrowing (CPI) 0, 25, 50, 75, or 100

4. ELA growth (SGP) 0, 25, 50, 75, or 100

5. Math growth (SGP) 0, 25, 50, 75, or 100

6. Annual dropout rate 0, 25, 50, 75, or 100

7. Cohort graduation rate 0, 25, 50, 75, or 100

Extra credit indicators Up to 200 additional points awarded

ELA, math, science % W/F reduction 25 + 25 + 25

ELA, math, science % ADV increase 25 + 25 + 25

Growth in English language proficiency (SGPA) 25

Dropout reengagement 25


School percentile

Percentiles 1-99 A relative measure that helps the state & districts

focus supports on low-achieving students in low performing schools

Calculated by school type to fairly compare the performance of schools serving the same or similar grades

Calculated using the same indicators as the PPI (achievement, growth, graduation rates, & dropout rates)


12

Accountability & assistance levels

High schools are assigned a level based on a four-year trend The cumulative PPI for all students & high needs students is

used to classify schools into Levels 1 & 2 School percentiles used to determine Level 3 schools (lowest-

performing 20 percent per state law) Adjustments are made to levels based on assessment

participation & graduation rates Schools with low participation (less than 95%) are ineligible

for Level 1 Schools with very low participation (less than 90%) are

ineligible for Levels 1 & 2 Schools with persistently low graduation rates are placed into

Level 3 (2016 4-year rate less than 67% & 2015, 2014, & 2013 5-year rates less than 70%) Massachusetts Department of Elementary and Secondary Education

13

Classifying high schools

Level 1

Level 2

Level 3

Level 4

Level 5

Lowest performing 20% of schools Very low assessment participation Persistently low graduation rates

Description ESE Engagement

High

Lowest performing schools (subset of Level 3)

Chronically underperforming schools (subset of Level 3 & 4)

Not meeting gap narrowing goals Low assessment participation

Meeting gap narrowing goals (for aggregate & high needs students)

Very low

Low

Very high

Extremely high

High achieving, high growth, gap narrowing schools (subset of Level 1)

Commendation Schools

14


Accountability determinations for schools administering Next-Generation MCAS

Next-Generation MCAS schools

For the purposes of 2017 accountability reporting: A school that served any combination of grades 3-8

Includes schools that served a combination of grades 3-8 & 9-12

Administered Next-Generation MCAS tests in grades 3-8 in English language arts & mathematics in 2017 Includes schools that administered Next-Generation MCAS tests in grades 3-8

& legacy MCAS tests in grades 10


16

What will be reported for Next-Generation MCAS schools in 2017? For schools in the elementary, elementary/middle, middle, & middle/high/K-12 school type categories: Next-Generation MCAS achievement results reported with relative

indicator (on assessment reports) Transitional student growth percentiles (tSGPs) Accountability & assistance levels (No level, Levels 4-5) Schools identified for very low assessment participation (Level 3)

Minimum group size for reporting = 20 students

Schools identified for persistently low graduation rates (Level 3)


17

Details

Schools administering Next-Generation MCAS in grades 3-8 that have participation rates below 90% will be placed into Level 3 Applies to any subgroup, & in any subject

Schools serving a combination of grades 3-8 & 9-12 that have persistently low graduation rates for any group will be placed into Level 3 Persistently low: 2016 4-year rate less than 67% & 2015,

2014, & 2013 5-year rates less than 70%


18

Details

Current Level 4 or 5 schools or districts that are not exiting will maintain their level designation 2017 exit criteria not yet determined, but will be consistent

with regulatory requirements

All other schools meeting participation & graduation rate requirements will not receive an accountability level, school percentile, or PPI


19

Example 1: Elementary school

ELA participation

Math participation

Science participation

2017 Level

School A 97% 97% 96% No Level

School B 97% 92% 95% No Level

School C 95% 93% 89% Level 3


20

Example 2: Middle/high school

ELA participation

Math participation

Science participation

Persistently low

graduation rate

2017 Level

School A 97% 97% 96% No No Level

School B 94% 95% 95% No No Level

School C 95% 89% 93% No Level 3

School D 99% 99% 98% Yes Level 3


Accountability determinations for districts

2017 district accountability

Districts that administered Next-Generation MCAS in grades 3-8 will not be assigned an accountability level in 2017, unless: The district has very low (less than 90%) assessment

participation The district was previously designated Level 4 or Level 5 as a

result of a district review or Board action

2017 annual & cumulative PPI data for districts will not be reported

Special education determinations from 2016 will be held constant in 2017


23

Accountability reports

High school report – layer 1


25

The school’s accountability & assistance level, school percentile, & PPI data are displayed



26

Subgroup-specific annual PPI data are displayed



27

Detailed data for each PPI indicator are displayed

Next-Generation MCAS school report


28 The school's accountability level, the reason for the level designation, & detailed assessment participation rate data for each subject & subgroup are displayed

District report


29

The district’s accountability level, the reason for the level designation, the special education determination, & detailed assessment participation rate data are displayed

[email protected] (781) 338-3550


30

mailto:[email protected]

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjClt-t8t7VAhVjwFQKHY5rBXoQjRwIBw&url=http://plotandscatter.com/services/data-question.html&psig=AFQjCNE1xX7LUpeTGCrNFx9ow5vm-UuP8A&ust=1503080746224662

2016 Accountability data overview

Documents