This PPT includes all This PPT includes all slides to present a slides to present a district-level district-level overview of PVAAS. overview of PVAAS. This was used with a This was used with a district-wide district-wide elementary faculty elementary faculty group. group.
56
Embed
PPT Presentation Template: This PPT includes all slides to present a district-level overview of PVAAS. This was used with a district-wide elementary faculty.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Viewing Achievement and Viewing Achievement and Progress TogetherProgress Together
Scatter Plots:Scatter Plots:
Grade 11Grade 11
Reading and MathReading and Math
Grade 11 Scatter PlotsGrade 11 Scatter PlotsThe PSSA-PVAAS Scatter Plots visually display the following The PSSA-PVAAS Scatter Plots visually display the following data from the statewide distribution of PSSA results for the data from the statewide distribution of PSSA results for the most current school year.most current school year. AchievementAchievement
• The mean The mean predictedpredicted performance of the cohort. performance of the cohort. • The actual mean performance of all students in the state is displayed The actual mean performance of all students in the state is displayed
for referencefor referenceGrowthGrowth
• School Effect School Effect ≈ Observed Mean – Predicted Mean≈ Observed Mean – Predicted Mean• Standardized School Effect = School Effect relative to its error – Standardized School Effect = School Effect relative to its error –
displays degree of confidencedisplays degree of confidence
The following two slides explain the meaning of each of the The following two slides explain the meaning of each of the regions of an 11regions of an 11thth grade scatter plot. grade scatter plot.
The Scatter Plot The Scatter Plot Coordinate System for Grade 11Coordinate System for Grade 11
Horizontal AxisGrowth Measure in
Standard Errors
Vertical AxisMean
Predicted Scaled Score Growth Descriptor
Boundaries (±2SEs)
2010 Mean Scaled Score
Scatter Plot Regions Scatter Plot Regions and Their Meanings for Grade 11and Their Meanings for Grade 11
The TWO Types ofThe TWO Types ofPVAAS InformationPVAAS Information
Today
Looking Back/Evaluation…
Value-Added Growth Reports For Cohorts of Students
Looking Forward/Planning…
PVAAS Projection Reports For Individual Students
and Cohorts of Students
NO individual measure of student growth..
Student ProjectionsStudent Projections
PVAAS Reporting PVAAS Reporting Projections to Basic, Proficient, and Advanced Projections to Basic, Proficient, and Advanced
Grade Last Tested
Math and Reading: 3 4 or 5 4 5 or 6 5 6 or 7 6 7 or 8 7 8 8 11
Writing: 3 5 4 5 5 8 6 8 7 8 8 11
Science:
3 4 4 NA 5 8 6 8 7 8 8 11
Grade Last Tested Grade Last Tested
How do I know that the projectionHow do I know that the projectionis accurate?is accurate?
The projection is precise, and is created using a model that has been reviewed and approved by four different peer review panels and the GAO (US Government Accountability Office).
The most recent 2008 growth model proposal to USDOE includes information regarding the statistical model and projection reliability study.(http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html)
Recent studies have confirmed that the PVAAS projections (even as far as 3 years into the future) are more reliable at looking at the future performance of a student than the most recent PSSA score.
The PA Growth Standard specifies the minimal acceptable academic gain from grade to grade for a cohort of students. The Growth Standard is met when the students in a school or district on average maintain their relative position when compared to the 2006 statewide distribution of student scores (2006 is the base year).
Estimated mean NCE gain equal or greater than zero. There is evidence that the school has met or exceeded the Growth Standard. All schools can achieve this rating. Estimated mean NCE gain less than zero by one standard error or less. There is slight evidence that the school has not met the Growth Standard. Estimated mean NCE gain less than zero by between one and two standard errors. There is moderate evidence that the school has not met the Growth Standard. Estimated mean NCE gain more than two standard errors less than zero. There is significant evidence that the school has not met the Growth Standard.
PVAAS District ReportPVAAS District ReportGrades 4 through 8 - Math and ReadingGrades 4 through 8 - Math and Reading
What Value-added Gain Means!What Value-added Gain Means!
0 10 20 30 40 50 60 70 80 90 100
NCE Scale
State Mean = 50
Cohort’s Achievement
5th grade60.7
Cohort’s Achievement
6th grade64.6
PVAAS Gain ≈ Change in position from 5th to 6th grade
≈ 64.6 – 60.7 ≈ 4.0 NCE points
PVAAS School ReportPVAAS School ReportHigh School Math and ReadingHigh School Math and Reading
Science and WritingScience and Writing
Based on a Based on a predictive methodology:predictive methodology: A predicted score is calculated for each student;A predicted score is calculated for each student; Mean of predicted scores is calculated for Mean of predicted scores is calculated for
students in a cohort;students in a cohort; Mean of observed scores of students in the Mean of observed scores of students in the
cohort;cohort; School Effect is the difference between the School Effect is the difference between the
Observed and the Predicted Scores.Observed and the Predicted Scores.
Greater Detail – based on % of studentsGreater Detail – based on % of students
Click on Hot Keys for lists of students.
Student Lists from Performance Student Lists from Performance Diagnostic ReportsDiagnostic Reports
PA’s Intent for PVAASPA’s Intent for PVAAS
Another Tool for Continuous Another Tool for Continuous ImprovementImprovement
Measure of Growth to Add to Measure of Growth to Add to Achievement/Status MeasuresAchievement/Status Measures
Not to Be Used in IsolationNot to Be Used in Isolation
PVAAS Help MenusPVAAS Help Menus
PVAAS Help Menus are designed around Frequently Asked Questions that the Core Team and IU staff often receive.
PVAAS Help MenusPVAAS Help Menus
Each Help Menu is organized into 5 common sections:• Navigating: designed to help users navigate through the report and
access all available features.• Understanding: designed to increase users’ understanding of the
key pieces of the report, as well as general assistance with correct interpretation.
• Interpreting: designed to help users gain a deeper understanding of the interpretation of the reports, including tips on analyzing the report for patterns and trends.
• Using: designed to help users gain an understanding of how the report can be used with other data sources for various decision-making purposes.
• Assistance: provides general information on the viewing and printing of reports, as well as state and IU points of contact.
Questions and FeedbackQuestions and Feedback
Questions:Questions:
PVAAS Materials or PVAAS Materials or Statewide ImplementationStatewide Implementation