FLDOE “Value-Added Model”

DRE

FLDOE “Value-Added Model”FLDOE “Value-Added Model”

School District of Palm Beach CountyPerformance Accountability

DRE

Background: FLDOE Value-Added Model

• Established by Student Success Act (SB 736)

• Developed by committee of teachers, principals, parents, union representatives, superintendents, school board members, district administrators and postsecondary faculty

DRE

What is the FLDOE “Value-Added Model”?

DRE

The AnswerFlorida

Model

DRE

Thank you for your attention.

Do you have any questions?

DRE

FLDOE Value-Added Model

• Teacher Component

• School Component

• Based on Student Learning Growth– Predictions cannot be different based on student’s

gender, race, ethnicity, or socioeconomic status

DRE

FLDOE Value-Added Model Variables determining student learning growth• Two or more years of prior achievement scores • Gifted status • Attendance • Mobility (number of transitions) • Difference from modal age in grade (indicator of retention) • Class size • The number of subject-relevant courses in which

the student is enrolled• Homogeneity of entering test scores in the class

DRE

FLDOE Value-Added Model Variables determining student learning growth• Students with Disabilities (SWD) status – Language impaired– Hearing impaired– Visually impaired– Emotional/behavioral– Specific learning disability– Dual sensory impaired– Autism spectrum disorder– Traumatic brain injury– Other health impaired– Intellectual disability

• English Language Learner (ELL) status – LY

DRE

FLDOE Value-Added Model

Variables determining student learning growth

TERMS

DRE

The difference between Current test score and Predicted test score

What is the Predicted Student Score?

What is the Student Learning Growth Score?

DRE

What is the Predicted Student Score?

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

85

75

65

55

45

35

25

DRE

What is the Predicted Student Score?

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

PREDICTED SCORE55

The prediction describes typical growth observed among similar students.

Answer:Average of the current

scores of similar students85

75

65

45

35

25

55

DRE

Student Learning Growth is the Amount Above or Below Predicted Score

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

PREDICTED SCORE

Above Predicted Score

Below Predicted Score

ACTUAL SCORE

ACTUAL SCORE

10 20 30 40 50 60 70 80 90 100…

Each prior year test score will

have a Predicted current year test

score.

PRIOR TEST

?

What is the Predicted Student Score Based on Prior Achievement?

5060

70

FLDOE Value-Added Model

• Two or more years of prior achievement scores

• Attendance • Mobility (number of transitions) • Difference from modal age in grade

(indicator of retention) • Class size • The number of subject-relevant

courses in which the student is enrolled

• Homogeneity of entering test scores in the class

• LY

• Gifted status • Language impaired• Hearing impaired• Visually impaired• Emotional/behavioral• Specific learning disability• Dual sensory impaired• Autism spectrum disorder• Traumatic brain injury• Other health impaired• Intellectual disability

PRIOR TEST 10 20 30 40 50 60 70 80 90 100…

PRIOR TEST 10 20 30 40 50 60 70 80 90 100…

Based on Prior Achievement Only

Based on Prior Achievement & Other Variables

What is the Predicted Student Score?

Reading Grade 7Indicators By Degree of ImpactAll other variables being equal

Indicator DSS PointsELL Indicator 32Intellectual Disability -24

Reading Grade 7Indicators Ranked By Statistical Significance

Indicator T-StatisticAchievement: Prior Year 75.667Achievement: Two Prior Years 38.167Enrolled in 2 or more courses 18.354Difference from Modal Age 15.977Attendance 13.571Number of students in Class 1 8.439Homogeneity of Class 2 Prior Year Test Scores 7.182Language Impaired 5.362Specific Learning Disability 5.013Homogeneity of Class 1 Prior Year Test Scores 4.750ELL Indicator 4.673Homogeneity of Class 3 Prior Year Test Scores 3.188Number of students in Class 5 2.385Enrolled in 2 or more class periods 2.289Mobility: Number of School Transfers 2.271Intellectual Disability 2.141

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

DRE

What is the Predicted Student Score?

Calculating Learning Growth of Students

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

Student PY CY Pred Growth

A 20 30 40 -10

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

DRE

Calculating Learning Growth of Students

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

Student PY CY Pred Growth

A 20 30 40 -10

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

DRE

Calculating Learning Growth of Students

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

Student PY CY Pred Growth

A 20 30 40 -10

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

DRE

Calculating Learning Growth of Students

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

Student PY CY Pred Growth

A 20 30 40 -10

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

DRE

DRE

How do you calculate the teacher learning growth score?

• Identify the students assigned to the teacher

• Determine the learning growth of each of the assigned students

• Calculate the average learning growth of the students

TERMS

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

DRE

Student PY CY Pred Growth

A 20 30 40 -10

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

Average 0

Ms. TypicalStudent Growth

Teacher Growth Score = Average Student Growth

Teacher Growth Score = Average Student Growth

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

Ms. Positive Student Growth

DRE

Student PY CY Pred Growth

A 20 30 40 - 10

B 30 55 45 10

C 40 75 50 25

D 50 70 60 10

Average 8.75

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

DRE

Student PY CY Pred Growth

A 20 30 40 -10

B 30 25 45 - 20

C 40 40 50 -10

D 50 70 60 10

Average - 7.5

Ms. Negative Student Growth

Teacher Growth Score = Average Student Growth

DRE

How do you calculate the school learning growth score?

• Identify the students assigned to the school

• Determine the learning growth of each of the assigned students

• Calculate the average learning growth of the students

School Growth Score = Average Student Growth

PRIOR TEST

10 20 30 40 50 60 70 80 90 100…

DRE

Stdt PY CY Pred Growth

G 10 65 35 30H 20 25 45 -20I 30 55 45 10J 40 40 50 -10K 50 55 55 0L 60 45 60 -15M 70 85 70 15N 80 45 75 -30O 90 80 100 -20Avg -4.44

How is the Teacher Value-Added Score Calculated?

DRE

FLDOE Teacher Value-Added ModelConceptual

School Growth

Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

Teacher Growth

- .5 +( ) ( XSchool Growth

)=

DRE

Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS

PY Math CY Math

Predicted Growth

1717 1833 1844.89 -11.891764 1922 1876.31 45.691553 1793 1735.28 57.721683 1886 1822.17 63.83

Avg 38.84

Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER A

PY Math

CY Math

Predicted Growth

1506 1684 1703.86 -19.861997 2059 2032.04 26.961691 1857 1827.51 29.491153 1510 1467.92 42.082036 2108 2058.11 49.891876 2003 1951.17 51.83

Avg 30.06

Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER B

PY Math CY Math

Predicted Growth

1777 1865 1885.00 -20.001898 1954 1965.87 -11.871734 1894 1856.26 37.742001 2075 2034.72 40.281575 1805 1749.98 55.02

Avg 20.24

Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER C

PY Math CY Math Predicted GrowthTEACHER A 1717 1833 1844.89 -11.89

1764 1922 1876.31 45.691553 1793 1735.28 57.721683 1886 1822.17 63.831506 1684 1703.86 -19.86

TEACHER B 1997 2059 2032.04 26.961691 1857 1827.51 29.491153 1510 1467.92 42.082036 2108 2058.11 49.891876 2003 1951.17 51.831777 1865 1885.00 -20.00

TEACHER C 1898 1954 1965.87 -11.871734 1894 1856.26 37.742001 2075 2034.72 40.281575 1805 1749.98 55.02

SCHL AVG 29.13

Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSSCHOOL

Teacher Value-Added Score

Teacher A

Teacher B

Teacher C

Teacher Growth 39 30 20School Growth 29 29 29TChgrowth - Schgrowth 10 1 -9.5 x Schgrowth 15 15 15Tchvas 25 16 6

DRE

Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

DRE

Summary• Based on prior achievement and

selected student characteristics• Student Learning Growth–Difference between current score and

predicted score• Teacher VAM consider both teacher

and school learning growth

DRE

References

• FLDOE Student Growth Implementation Committeehttp://www.fldoe.org/committees/sg.asp

• FLDOE Race to the Top (RTTT)http://www.fldoe.org/arra/racetothetop.asp

• SDPBC Department of Research and Evaluationhttp://www.palmbeachschools.org/dre/Articles.asp