Top Banner
Solidifying the Impact of Your Data Culture: The Bricks and Mortar Patience Oranika and Marcus Vandiver, Ed.D Alabama Department of Education Research & Development Section
28

Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Jan 03, 2016

Download

Documents

phyllis-petty

Solidifying the Impact of Your Data Culture: The Bricks and Mortar. Patience Oranika and Marcus Vandiver, Ed.D Alabama Department of Education Research & Development Section. What is R&D using to analyze/display data?. Statistical Analysis Procedures Displaying Data Software. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Solidifying the Impact of Your Data Culture:The Bricks and MortarPatience Oranika and Marcus Vandiver, Ed.DAlabama Department of EducationResearch & Development Section

Page 2: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

What is R&D using toanalyze/display data?Statistical Analysis ProceduresDisplaying DataSoftware

Page 3: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis ProceduresThe Means ProcedureCorrelationsRegression (Predictive Modeling)

Page 4: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:The Means Procedure

The Means Procedure allows us to view, explore, and compare certain characteristics of continuous variables within certain categories.

Page 5: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:The Means Procedure

The Means Procedure was used to analyze the data from the Instructional Audit Tool.Coded the Auditing ToolIndividual Analysis (if possible)Group AnalysisMeans were compared using identified categories from the auditing tool

Page 6: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:The Means Procedure

Used The Means Procedures to analyze the data from the Instructional Audit Tool

Descriptive Statistics: Minimum, maximum, mean of each individual item, and standard deviation

This Means Comparison Report is categorized by Subject

Other analyses that could be run in addition to the Means Procedure include ANOVA and Measures of Association

Mean Comparison Report by Class Size

Class Size Positive Relationships

Use of Instructional

Strategies

Use of Learning Activities

Use of Student Response Strategies

Level of Student

Engagement

1-10 Mean 2.60 1.71 2.14 2.34 2.86

N 73 73 73 73 73

Std. Deviation .721 .920 .918 .820 .990

11-20 Mean 2.67 2.04 2.23 2.30 2.72

N 264 264 264 264 264

Std. Deviation .581 .910 .868 .799 .821

21-30 Mean 2.63 2.04 2.15 2.21 2.56

N 261 261 261 261 261

Std. Deviation .671 .876 .900 .778 .842

30 or more Mean 2.22 1.55 1.65 1.90 2.28

N 40 40 40 40 40

Std. Deviation .862 .846 .864 .841 .816

Total Mean 2.62 1.97 2.15 2.24 2.64

N 638 638 638 638 638

Std. Deviation .662 .904 .895 .800 .859

Page 7: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:Correlations

Correlation is a statistical measurement of the relationship between two variables. Possible correlations range from -1 to +1.

Page 8: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:Correlations A correlation of –1 indicates

a perfect negative correlation, meaning that as one variable goes up, the other goes down.

A zero correlation indicates that there is no relationship between the variables.

A correlation of +1 indicates a perfect positive correlation, meaning that both variables move in the same direction together.

Page 9: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:Correlations A correlation of –1 indicates

a perfect negative correlation, meaning that as one variable goes up, the other goes down.

A zero correlation indicates that there is no relationship between the variables.

A correlation of +1 indicates a perfect positive correlation, meaning that both variables move in the same direction together.

Page 10: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis Procedures:Correlations

Correlations Explore

Avg. ScoresARMT

Percent IIIARMT

Percent IVARMT

Percent III/IVExplore

Avg. ScoresPearson Correlation

1 -.180* .872** .843**

Sig. (2-tailed) .039 .000 .000

N 132 132 132 132

ARMTPercent III

Pearson Correlation

-.180* 1 -.420** .143

Sig. (2-tailed) .039 .000 .102

N 132 132 132 132

ARMTPercent IV

Pearson Correlation

.872** -.420** 1 .838**

Sig. (2-tailed) .000 .000 .000

N 132 132 132 132

ARMTPercent III/IV

Pearson Correlation

.843** .143 .838** 1

Sig. (2-tailed) .000 .102 .000

N 132 132 132 132

*. Correlation is significant at the 0.05 level (2-tailed).

**. Correlation is significant at the 0.01 level (2-tailed).

Examining the correlations between the identified ARMT percentages of proficiency at levels III, IV, and III and VI combined against ACT Explore average scores.

Page 11: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis:Regression (Predictive Modeling)

In simple linear regression, a criterion variable is predicted from one predictor variable. In multiple regression, the criterion is predicted by two or more variables.

Page 12: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Statistical Analysis:Regression (Predictive Modeling)

For example, you might want to predict a student's university grade point average on the basis of their High-School GPA (HSGPA) and their total SAT score (verbal + math). The basic idea is to find a linear combination of HSGPA and SAT that best predicts University GPA (UGPA).

Page 13: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying DataChartsLine GraphsBar GraphsScatterplotsFilled Maps

Page 14: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data:Charts – ACT Course PatternCourse Pattern N Average

ScoreCourse Value

AddedPercent Meeting

Alg 1, Alg,2, Geom, Trig, & Calc 2693 20.2 4.3 68

Alg 1, Alg,2, Geom, Trig, & Other Adv Math 4663 19.9 4.0 56

Alg 1, Alg,2, Geom, & Trig 3431 17.6 1.7 32

Alg 1, Alg,2, Geom, Other Adv Math 1910 17.8 1.9 32

Other combination of 4+ years 13497 21.0 5.1 65

Alg 1, Alg,2, & Geom 3149 16.4 0.5 11

Other combination of 3 or 3.5 years 1248 17.5 1.6 34

Less than 3 years 1635 15.9 - 7

Zero years/no courses reported 292 16.8 - 20

Page 15: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Line Graphs - PLAN 2020 Graduation Rate

2011* 2012 2013 2014 2015 201640%

50%

60%

70%

80%

90%

100%

72%74%

76%78%

80%75%80%

Gra

duati

on R

ate

Page 16: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data:Bar Graphs – ACT Average Scores

English Math Reading Science All 4 Areas

20.1

19.4

20.5

20 20.120

19.5

20.4

19.920.120.2

19.4

20.7

2020.2

2011 2012 2013

Page 17: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Bar Graphs – ACT College Readiness

English Math Reading Science All 4 Areas

64

31

46

2117

63

31

46

2217

64

30

39

28

18

2011 2012 2013

Page 18: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data:Bar Graphs – ACT College Readiness

English Math Reading Science All 4 Areas

64

31

46

2117

63

31

46

2217

64

30

39

28

18

2011 2012 2013

Page 19: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data:Bar Graphs – Cohort Assessment Analysis

4th ARMT 5th ARMT 6th ARMT 7th ARMT 8th ARMT 11th AHSGE 12th AHSGE 12th (ACT)0%

20%40%60%80%

100%

All Students African American American Indian/Alaska NativeWhite Hispanic/Latino Asian/Pacific Islander

4th ARMT 5th ARMT 6th ARMT 7th ARMT 8th ARMT 11th AHSGE 12th AHSGE 12th (ACT)0%

20%40%60%80%

100%

All Students African American American Indian/Alaska NativeWhite Hispanic/Latino Asian/Pacific Islander

ARMT Math, Level III vs Level IV

Page 20: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Bar Graphs – Metric Shift

Page 21: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Bar Graphs – Metric Shift

Page 22: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: ScatterplotsACT Explorer Mathematics and ARMT Mathematics Level III, 2011

Correlations Explore Avg. Scores

ExploreAvg.

Scores

Pearson Correlation 1Sig. (2-tailed) N 132

ARMTPercent

III

Pearson Correlation -.180*

Sig. (2-tailed) .039N 132

ARMTPercent

IV

Pearson Correlation .872**

Sig. (2-tailed) .000N 132

ARMTPercent

III/IV

Pearson Correlation .843**

Sig. (2-tailed) .000N 132

10.000 11.000 12.000 13.000 14.000 15.000 16.000 17.000 18.000 19.000 20.0000

10

20

30

40

50

60

70

80

90

100

f(x) = − 1.12954312873742 x + 65.0178050610957R² = 0.0323229149860322

Average of Explorer Mathematics Scale Scores by District

Perc

ent P

rofic

ient

on

the

ARM

T M

ath

Leve

l III/

IV b

y Di

stric

t

Page 23: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: ScatterplotsACT Explorer Mathematics and ARMT Mathematics Level IV, 2011

Correlations Explore Avg. Scores

ExploreAvg.

Scores

Pearson Correlation 1Sig. (2-tailed) N 132

ARMTPercent

III

Pearson Correlation -.180*

Sig. (2-tailed) .039N 132

ARMTPercent

IV

Pearson Correlation .872**

Sig. (2-tailed) .000N 132

ARMTPercent

III/IV

Pearson Correlation .843**

Sig. (2-tailed) .000N 132

10.000 11.000 12.000 13.000 14.000 15.000 16.000 17.000 18.000 19.000 20.0000

10

20

30

40

50

60

70

80

90

100

f(x) = 9.9429271832967 x − 114.311165538876R² = 0.760543498481164

Average of Explorer Mathematics Scale Scores by District

Perc

ent P

rofic

ient

on

the

ARM

T M

ath

Leve

l IV

by D

istric

t

Page 24: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: ScatterplotsACT Explorer Mathematics and ARMT Mathematics Levels III/IV, 2011

Correlations Explore Avg. Scores

ExploreAvg.

Scores

Pearson Correlation 1Sig. (2-tailed) N 132

ARMTPercent

III

Pearson Correlation -.180*

Sig. (2-tailed) .039N 132

ARMTPercent

IV

Pearson Correlation .872**

Sig. (2-tailed) .000N 132

ARMTPercent

III/IV

Pearson Correlation .843**

Sig. (2-tailed) .000N 132

10.000 11.000 12.000 13.000 14.000 15.000 16.000 17.000 18.000 19.000 20.0000

10

20

30

40

50

60

70

80

90

100f(x) = 8.81338405455928 x − 49.2933604777807R² = 0.71071879165909

Average of Explorer Mathematics Scale Scores by District

Perc

ent P

rofic

ient

on

the

ARM

T M

ath

Leve

l IV

by D

istric

t

Page 25: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Filled Maps – 2013 Graduation Rate Map

About Tableau maps: www.tableausoftware.com/mapdata

DISCLAIMER: This is an inaccurate depiction of what the graduation rate could look like mapped in the state of Alabama by School District

2011* 2012 2013 2014 2015 201640%

50%

60%

70%

80%

90%

100%

72%74%

76%78%

80%75%

80%

Gra

duati

on R

ate

Page 26: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

About Tableau maps: www.tableausoftware.com/mapdata

Displaying Data:Filled Maps – 2013 ACT Average Scores

DISCLAIMER: This is an inaccurate depiction of what the graduation rate could look like mapped in the state of Alabama by School District

English Math Reading Science All 4 Areas

20.1

19.4

20.5

2020.1

20

19.5

20.4

19.9

20.120.2

19.4

20.7

20

20.2

2011 2012 2013

Page 27: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Displaying Data: Filled Maps

About Tableau maps: www.tableausoftware.com/mapdata About Tableau maps: www.tableausoftware.com/mapdata

Graduation Rate Average ACT Scores

About Tableau maps: www.tableausoftware.com/mapdata

Absentee Rate

About Tableau maps: www.tableausoftware.com/mapdata

Truancy Rate

DISCLAIMER: This is an inaccurate depiction of what the graduation rate could look like mapped in the state of Alabama by School District

Page 28: Solidifying the Impact of Your Data Culture: The Bricks and Mortar

Analytical Software ProgramsExcelBasic analyticsManipulating data (Pivot tables)Merging data (VLookUp)

CognosAccess to dataBuilding reports for analysisCross tabulation

SPSSComplex analyticsMerging data

TableauInteractive visualizationsData and display deploymentAnalytics