Utah Science Standard Setting

Utah Science Standard Setting

September 2021

Utah Science Standard Setting

RISE

GRADES

4 AND 5

UTAH ASPIRE PLUS GRADES 9

AND 10

VERTICAL ARTICULATION

RISE Standard Setting- July 2021

• Board Rule R277-404 & Code 53E-4-303• Computer Adaptative Assessment• Cluster Based• 6th-8th SEEd Standards Assessed since

Spring 2018• Ordered Scoring Assertion Standard

Setting

RISE Standard Setting- Scale Scores

GradeLevel 2

Approaching Proficient

Level 3Proficient

Level 4Highly Proficient

4 543 553 562

5 543 552 563

RISE Standard Setting- Spring 2021

GradeLevel 1Below

Proficient

Level 2Approaching

Proficient

Level 3Proficient

Level 4Highly

Proficient

4 29% 28% 23% 20%5 29% 26% 27% 18%

RISE Standard Setting- Spring 2021

Level 1 Level 2 Level 3 Level 40%

5%

10%

15%

20%

25%

30%

35%

29%28%

23%

20%

29%

26%27%

18%

Grade 4 Grade 5

Utah Aspire Plus Standard Setting- August 2021

• Board Rule R277-404 & Code 53E-4-304• Fixed Form• Cluster Based• Timed• Predictive ACT Score• Extended Modified (Yes/No) Angoff Standard

Setting

Utah Aspire Plus Standard Setting- Scale Scores

Subject Grade

Proficiency LevelBelow Proficient Approaching

Proficient Proficient Highly Proficient

Science9 100-186 187-210 211-236 237-300

10 100-186 187-209 210-239 240-300

STEM9 100-179 180-208 209-234 235-300

10 100-183 184-209 210-237 238-300

UA+ Standard Setting- Predicted ACT

Grade Proficient Scale Score Cut

Predicted ACT Score Lower Bound

Predicted ACT Score Upper Bound

ACT College and Career Benchmark

9 211 19 23 23

10 210 18 23 23

UA+ Standard Setting- Spring 2021

Subject Grade

Performance Levels

Below Proficient Approaching Proficient Proficient Highly Proficient

Science9 30.7% 33.3% 27.1% 8.9%

10 31.2% 31.7% 30.1% 7.0%

STEM9 25.5% 39.0% 28.4% 7.1%

10 30.4% 36.2% 27.6% 5.9%

UA+ Standard Setting- Spring 2021

Level 1 Level 2 Level 3 Level 40.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

35.00%

30.70%

33.30%

27.10%

8.90%

31.20% 31.70%30.10%

7.00%

Grade 9 Grade 10

Utah Science Vertical Articulation

• The purpose• Ensure the vertical coherence of performance level

classification across grade spans

• The task• Conduct a holistic review of the cut scores that had been

recommended by standard setting panelists, and make final recommendations to USBE

• Proficiency level cut scores were recommended by panelists in three different standard setting workshops:• August 2021: High School (grades 9-10)• July 2021: Elementary (grades 4-5)• September 2018: Middle school (grades 6-8)

Utah Science Vertical Articulation- Scale Scores

Cut Scores

GradeLevel 2 Level 3 Level 4

Approaching Proficient Proficient Highly Proficient

4 543 553 562

5 543 552 563

6 841 849 862

7 841 851 861

8 842 851 861

9 187 211 237

10 187 210 240

Utah Science Vertical Articulation- Spring 2021

4 5 6 7 8 9 100%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

29% 29% 27% 29% 26%31% 31%

28% 25%20%

27%26%

33% 32%

23% 27%34%

26%29%

27% 30%

20% 18% 18% 18% 20%9% 7%

Utah Science Assessment 2021 by Proficiency Levels

Level 1 Level 2 Level 3 Level 4

Questions?