Getting Started • Log on to this site: http:// bit.ly/EVAAS7 Complete Tasks Before We Begin Section 1.Consensogram Activity 2.Burning Questions 3.Pre-Assessment Questions
Jan 20, 2016
Getting Started
• Log on to this site: http://bit.ly/EVAAS7
Complete Tasks Before We Begin Section
1. Consensogram Activity
2. Burning Questions
3. Pre-Assessment Questions
Making the Most of Your Data:
Beginning-Intermediate Training
Heather Mullins, Region 7 Professional Development Consultant
Greg McKnight, Region 3 Professional Development Consultant
Mary Russell, Region 3 Professional Development Consultant
The Power of EVAAS
Today’s PresentersHeather MullinsProfessional Development ConsultantRegion [email protected]
Greg McKnightProfessional Development ConsultantRegion 3Gregory,[email protected]
Mary RussellProfessional Development ConsultantRegion [email protected]
Agenda
• Welcome, Introductions, Agenda Overview
• EVAAS and Data
• System Overview
• Pre-Assessment
• Reflective Assessments
• Exit Ticket
4
Outcomes
• Explore reflective assessments• Understand the various EVAAS reports • Be able to create custom reports based on a set of
criteria
Resources
Pre-Assessment Results
Poll: I am very familiar with the Education Va...
Poll: I know how to login to the EVAAS website...
Poll: I know how to navigate the EVAAS website...
Poll: I understand EVAAS report names.
Poll: I know how to use the EVAAS website to g...
Poll: I know how to access EVAAS reports for i...
Poll: I am able to analyze the metrics in EVAA...
Poll: I know how to collect evidence from EVAA...
Poll: I know how to collect evidence from EVAA...
Poll: I know how to interpret the following re...
Poll: I am able to communicate the findings of...
Poll: I am able to use data analysis to initia...
It’s Connected
What is Data Literacy?
The understanding needed to:
• Find
• Evaluate
• Utilize
data to inform instruction.
A Data Literate Person Can…
A data literate person possesses the knowledge to gather, analyze, and graphically convey information to support short and long-term
decision-making.
Why does EVAAS matter?
Teachers Principals District Leaders
Table Talk
• Who has EVAAS access in your LEA/Charter?
• How are you currently using EVAAS?
• What benefits/difficulties have you experienced?
• What have you learned?
Benefits and Considerations for Teachers
• Understand academic preparedness of students before they enter the classroom.
• Monitor student progress, ensuring growth opportunities for all students.
• Modify curriculum, student support, and instructional strategies to address the needs of all students.
Professional Development is
the Key• Data Conversations / True PLCs
• Culture of School
• Sensitivity of Data
• Finger Pointing and Blame Game
• Window vs. Mirror
NC Professional Teaching Standards
Standard I: Teachers demonstrate leadership.
Take responsibility for the progress of all students
Use data to organize, plan, and set goals
Use a variety of assessment data throughout the year to evaluate progress
Analyze data
Standard IV: Teachers facilitate learning for their students.
Use data for short and long range planning
Standard V: Teachers are reflective on their practice.
Collect and analyze student performance data to improve effectiveness
Standard 6 for Teachers
Teachers contribute to the academic success of students.
The work of the teacher results in acceptable, measurable progress for students based on established performance expectations using appropriate data to demonstrate growth.
Benefits for Principals• Gain a consolidated view of student progress and
teacher effectiveness, as well as the impact of instruction and performance.
• Bring clarity to strategic planning and function as a catalyst for conversations that must take place to ensure that all students reach their potential.
• Understand and leverage the strengths of effective teachers.
• Use the valuable resource of effective teaching to benefit as many students as possible.
NC Standards for School Executives
Standard 2: Instructional Leadership
• Focuses his or her own and others’ attention persistently and publicly on learning and teaching by initiating and guiding conversations about instruction and student learning that are oriented towards high expectations and concrete goals;
• Creates processes for collecting and using student test data and other formative data from other sources for the improvement of instruction
• Ensures that there is an appropriate and logical alignment between the curriculum of the school and the state’s accountability program
• Creates processes for collecting and using student test data and other formative data from other sources for the improvement of instruction
Standard 8 for School Executives
Academic Achievement Leadership
School executives will contribute to the academic success of students. The work of the school executive will result in acceptable, measurable progress for students based on established performance expectations using appropriate data to demonstrate growth.
Changes in Reporting for 2012-13
2011-12 2012-13
Above
Not Detectably Different
Below
Exceeds Expected Growth
Meets Expected Growth
Does Not Meet Expected Growth
Teacher Ratings Categories
Teachers
1 65432Demonstrate Leadership
Establish Environment
KnowContent
Facilitate Learning
Reflect on Practice
Contribute to Academic
Success
5 Rating CategoriesNot Demonstrated
Developing
Proficient
Accomplished
Distinguished
3 Rating CategoriesDoes Not Meet Expected Growth
Meets Expected Growth
Exceeds Expected Growth
Exceeds Expected Growth
Meets Expected Growth
Does Not Meet Expected Growth
2012-13
Table Talk
• How do you explain the concept of Achievement vs. Growth to others in your district?
Student Achievement
End of School Year
Proficient
Student Growth
End of School Year
Proficient
Start of School Year
Not Proficient
Change over
time
Achievement vs. Growth
Student Achievement: Where are we?
• Highly correlated with demographic factors
Student Growth: How far have we come?
• Highly dependent on what happens as a result of schooling rather than on demographic factors
The EVAAS Philosophy
• All students deserve opportunities to make appropriate academic progress every year.
• There is no “one size fits all” way of educating students who enter a class at different levels of academic achievement.
The EVAAS Philosophy
• Adjustments to instruction should be based on the students’ academic needs, not on socio-economic factors.
• "What teachers know and can do is the most important influence on what students learn." (National Commission on Teaching and America's Future, 1996)
Achievement and Poverty
How is this fair?
Academic Growth and Poverty
No one is doomed to failure.
Proficiency vs. Growth
Scenario Proficient Growth
5th grader begins the year reading at a 1st grade level. Ends the year reading at a 4th grade level.
5th grader begins the year reading at a 7th grade level. Ends the year reading at the 7th grade level.
NO
NO
YES
YES
BREAKReturn in 15 minutes.
44
EVAAS Overview
What is EVAAS?
SAS EVAAS Analyse
s
Writing
ACT
End of Course
End of Grade
LOOKING AHEAD
Planning for Students’ Needs:
Student Projections to Future Tests
LOOKING BACK
Evaluating Schooling
Effectiveness:
Value Added & Diagnostic
Reports
How can EVAAS help me?
Improve the
Education Program
EVAAS: Looking Back
Past Program Effectiveness
Local Knowledge & Expertise
EVAAS: Looking Ahead
Incoming Student Needs
• Answers the question of how effective a schooling experience is for learners
• Produces reports that– Predict student success
– Show the effects of schooling at particular schools
– Reveal patterns in subgroup performance
Value-Added Reporting
• Use to evaluate the overall effectiveness of a district on student progress
• Compares each district to the average district in the state for each subject tested in the given year
• Indicates how a district influences student progress in the tested subjects
District Value Added Report
The School Value Added Report compares each school to the average school in the state.
Comparisons are made for each subject tested in the given year and indicate how a school influences student progress in those subjects.
Value-Added Reporting
• If the Mean NCE Gain is greater than or equal to zero, the average student in this school has achieved a year’s worth of academic growth in a year
• If the Mean NCE Gain is less than zero, the average student in this school has achieved less growth than expected
Mean NCE Gain
Value-Added Reporting
The NCE Base is by definition set at 50.0, and it represents the average attainment level of
students in the grade and subject, statewide.
If the school mean is greater, the average student in the school is performing at a higher achievement level than the average student in the state.
Use to identify patterns or trends of progress among
students expected to score at different
achievement levels
District Diagnostic Reports
District Diagnostic Report
• This report is intended for diagnostic purposes only and should not be used for accountability.
What do you see?
Features of the Diagnostic Report• Quintiles
• Green Zero Line
• Previous Cohort(s)
• Confidence Band
• Whiskers
• 2 Standard Errors
Features of the Diagnostic Report
• Clickable Information
• Reference
• Gain
• Standard Error
District Performance Diagnostic Reports
• Use to identify patterns or trends or progress among students predicted to score at different performance levels as determined by their scores on NC tests
• Students assigned to Projected Performance Levels based on their predicted scores
• Shows the number (Nr) and percentage of students in the district that fall into each Projected Performance Level
Interpreting the Pie Chart
Yellow
Green
Light Red
Your Turn to Interpret
Your Turn to Interpret
Reflective Assessments
Value-Added Reports
Diagnostic Reports Looking for Patterns
School DiagnosticShed Pattern
School DiagnosticReverse Shed Pattern
School DiagnosticTent Pattern
School DiagnosticV Pattern
School DiagnosticOpportunity Gap Pattern
What would an ideal pattern on a Diagnostic Report
look like for closing the achievement gap?
Diagnostic Reports – Desirable Pattern
Diagnostic Report Desirable Pattern
Lunch
Diagnostic & Performance
Diagnostic Reports (Part 2)
Diagnostic Reports – Whiskers
Overview of School Effects
Overview of School Effects (sample data)
Overview of School Effects (sample data)
Overview of School Effects
On Your Own
• Finish the table.
Do this by yourself.
• Use sample data
• Complete your table.
Overview of School Effects
What did you find?
• Interesting Patterns
• Insights
• Areas of Concern
• Areas of Celebration
Overview of School Effects (sample data)
1. Go to the websitewww.ncdpi.sas.com
1. Go to the website ncdpi.sas.com
1. Go to ncdpi.sas.com
2. BOOKMARK IT!
3. Secure & ConvenientOnline Login
Do you see this?
Then Sit Tight!
Overview of School EffectsIt’s Your Turn!
• Find the blank table.
Do this by yourself.
• Using your data
• Fill in your table.
Overview of School Effects
What did you find?
• Interesting Patterns
• Insights
• Areas of Concern
• Areas of Celebration
Student Pattern Report
Student Pattern Report
Key points to remember:
• The report shows growth for the lowest, middle, and highest
achieving students within the chosen group.
• The report can be used to explore the progress of students with
similar educational opportunities.
• Like all diagnostic reports, this report is for diagnostic purposes only.
• A minimum of 15 students is needed to create a Student Pattern
Report.
Student Pattern Report
Student Pattern Report
Key Questions
Student Pattern Report – Key Questions
Different experience?
Different strategies?
Different needs?
Number of hours?
Student Pattern Report – Key Questions
Different experience?
Different strategies?
Different needs?
Number of hours?
Rerun the report with new criteria.
YES!
Student Pattern Report – Next Steps
16 Students who attended for 40+ hours
All 31 Students in the Program
Less Informed Conclusion: We need to change the selection criteria for this program.
More Informed Conclusion: We need to adjust the recommended hours for participants.
CUSTOM STUDENT REPORT
Custom Student Report HANDOUT
Exit Tickets and Feedback
As you reflect on today’s session, use two sticky notes to capture your thoughts on these topics:
1. Greatest Take Away2. Now, I Need…
http://go.ncsu.edu/ncdpi-resa_survey