KEEP And Student Growth Measures
for Building Leaders Lawrence School District, May 14, 2014
Bill Bagshaw, Assistant Director, TLA, KSDE
Kayeri Akweks, Education Program Consultant
TLA, KSDE
Today we will cover:
KEEP Building Leader Evaluation Process
Using Multiple Student Growth Measures
Final Summative Rating
KEEP Repository
WAIVER - Principle 3Supporting Effective Instruction and Leadership
Implement teacher and principal evaluation and support systems that:1. Are used for continual improvement of
instruction2. Use at least 3 performance levels3. Use multiple measures including student
growth as significant factor4. Are used to evaluate on a regular basis5. Provide clear, timely, and useful
feedback6. Are used to inform personnel decisions
Building Leader Process
The Constructs and Components
Building Leader The constructs to be measured in
the evaluation instrument:
Construct 1: Setting Direction
Construct 2: Developing the Learner
Construct 4: Making the Organization Work
Construct 3: Developing Staff
Building Leader Rubric Example
Evaluation Goal Selection
District GoalsBuilding GoalsIndividual Goals
It is recommended that
each Educator selects 2 goals per evaluation cycle:
◦A district ◦or building level goal,◦A personal goal mutually
agreed upon by the Evaluator and the Evaluatee.
Evaluating the Building LeaderThinking through and
discussing the Process - readiness per year?
Goals Selected Student Growth
Measures selected?Timeline for Evaluation?
◦1 Cycle◦2 Cycles
Inter-Rater Agreement DEFINITION:
Reliability refers to the consistency of an assessment.
VALIDITY vs. RELIABILITY: Factual vs. Consistent
EXPECTATION: School district evaluators attend professional
learning activities that address the issue of inter-rater agreement relative to using the KEEP Rubrics.
The same expectations apply to districts using an evaluation system other than KEEP.
Inter-rater Agreement
Evaluatee
Evaluator A Evaluator B
Agreement
Using Multiple Student Growth Measures
Multiple Student Growth Measures Kansas State Assessments used
as a Student Growth Measure are only required for teachers of tested grades and subjects.
Use assessment measures currently in use in your district.
Share credit/responsibility for student growth.
Time for student growth 1-4 years.
Small Group Activity – Share Measures You Currently Use
Get into small groups of 3-4Talk about the grades, subjects,
and measures that you currently use
Write these down on the paper/chart
Choose a person to report outReport out to the larger group
Multiple Measures
Sample Measures for Building Leaders Evaluation Percent of growth of Program-
Enrollment/Participation Amount of time engaged with
data material online products Anecdotal Notes Artifacts Attendance Data Awards and Accomplishments PE Attendance Career Readiness/Success
Rates past Graduation Building test Scores Report Card Data Classroom Observations
Performed Climate Surveys Communication of Professional
Information
Contact Log Discipline Data Dual Credit Course Enrollment Engagement with families Extended Learning Opportunities Graduation Rates Increased # of research-based
instructional practices implemented
Instructional Coach - # of times in the classroom
Involvement in professional organizations
# of students involved in extra-curricular activities
Number of students who went to college
Parent Involvement
Significance Definition
The change in student achievement for an individual student between two points in time, determined using multiple measures
To include gains and progress toward post-secondary and workforce readiness
To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives
17
Multiple Student Growth Measures, Effectiveness, Significance
Evaluations Update
• As of April 1, 2014, 223 D2 Assurance Online Forms have been submitted. All D2 Assurance Online Forms were due on March 1, 2014. Please continue to complete.
• By July 31, 2014, all evaluations systems to be used in Kansas for 2014-2015 will be posted to the Evaluations webpages.
• Student Growth Measures Online Forms are now posted and available to complete on the Kansas Evaluation website. These forms will be completed by principals.
• On June 30th, a data snapshot will be taken of SGMs to be used in Kansas for 2014-2015. This data snapshot will be used within the first evaluations annual report.
Things to Know
Student Growth Measures:
Kansas school districts will include student growth as a significant factor in the evaluation of classroom teachers and building leaders.
State approved student growth measures will document the specific amount of student growth attributable to the teacher or building leader between two identified points in time.
Multiple measures of student growth (more than one) must be met before an educator can be rated as effective or highly effective.
State assessments are one possible measure and are a required measure for all grade levels and content areas that give them. Commercially purchased assessments and locally developed performance assessments may also be used, once they are approved by the KSDE.
KSDE Guidance for school districts:
LEAs should use the commercially purchased and locally developed student growth measures they currently have. State assessments are required as given.
All grade levels across schools in a district should use the same measures.
Local performance assessments should be collaboratively designed, reviewed and used across the district with strict adherence to an inter-rater agreement.
Student Growth Objectives (SGOs) or Student Learning Objectives (SLOs) are to be developed with collaborative districtwide teams.
Next steps:
All districts will identify student growth measures to be used and provide them to the KSDE (in a format to be determined) by June 30, 2014.
A “default list” of student growth measures for LEA
reference will be available and posted on the web by May 1, 2014.
Final Summative Rating
2014 - 2015 All Evaluations
KANSAS Final Summative Evaluation Rating
Three Student Growth Measures
Chosen Instructional
Practice Protocol
FINAL Summative Evaluation
Rating
IPP SUMMARY RATING
SGM SUMMARY RATING
Matrix Works with or Without Percentages
Matrix Used to Determine Summative Evaluation Rating Rules:
1. Must meet all three student growth measures to be considered
highly effective or its equivalent for the Student Growth Measures Summary Rating.
2. Must meet at least two student growth measures to be considered effective or its equivalent for the Student Growth Measures Summary Rating.
3. Must meet at least one student growth measure to be considered developing or its equivalent for the Student Growth Measures Summary Rating.
4. The Final Summative Rating can only be rated one performance level higher than the lowest Summary Rating.
5. When both Summary Ratings are the same, that rating becomes the Final Summative Performance Rating.
NOTE: Kansas State Assessments used as a Student Growth Measure are only required for teachers of tested grades and subjects.
Criteria list for selecting or creating a LOCAL student growth measure are: A. Common assessments must be created in consultation with
a school administrator with expertise in assessments, special education, ELL specialist and content expert.
B. Assessments cover all key subject/grade level content standards.
C. Number of test items should correlate to distribution of % of time spent teaching the content.
D. Assessments should require higher order thinking as appropriate.
E. Assessments should allow high and low achieving students to demonstrate their knowledge.
F. Assessments should measure accurately what it is designed to measure and produce similar results for students with similar levels of ability.
SGMs Default List on the Web
Student Growth Measures Webpagehttp://community.ksde.org/Default.aspx?tabid=5943
SGMs Default List – Elementaryhttp://community.ksde.org/Default.aspx?tabid=5929
SGMs Default List Middle School http://community.ksde.org/Default.aspx?tabid=5930
SGMs Default List High Schoolhttp://community.ksde.org/Default.aspx?tabid=5931
SGMs Trainings Webpagehttp://community.ksde.org/Default.aspx?tabid=5943
SGMs Online Submissions Forms
Student Growth Measures Online Submission Form – Elementary
How the KEEP Repository
Technology Works
Repository ProcessesA Repository is NOT the entire KEEP process.
How is a Data Repository used?USES –
Holds DATAGenerates ReportsAccess for Educator InvolvementUnified SystemOrganizational Tools
Building Leader Self-Assessment Rubric
Building Leader Self-Assessment Rubric
Building Leader Self-Assessment Rubric
Goals – Select Goals, Write Text for Expected Outcome, Add
Goals – After Adding, then Complete and Save, can Print
Artifacts – Select Component and Source of Evidence
Artifacts – Ready to Upload
Artifact Uploaded – in table
Cycles of Conferences - Beginning, Mid, End
Summary Rating Sheet – Construct #1
Summary Rating Sheet – Construct #2
Summary Rating Sheet – Construct #3
Summary Rating Sheet – Construct #4
Summary Rating Sheet – Signatures
New Features in the KEEP Repository for 2014-2015
Page to Document Student Growth MeasuresPage to Document the Final SUMMATIVE
RatingWork Queue as a Dashboard District HR will have access to KEEP at their
District level
See KEEP 2014 Production Software Enhancements.docx
The KEEP Webpages
http://www.ksde.org/Default.aspx?tabid=4400
1. News and Announcements 2. KEEP Repository Registration 3. KEEP Training Materials and Schedule 4. Assurances Information 5. Kansas Flexibility Waiver Materials 6. Archives with Materials of Previous
Trainings and Meetings
Questions ??Contacts:
Bill Bagshaw, Assistant Director, TLA, KSDE
Kayeri Akweks, Education Program Consultant
TLA, KSDE [email protected]