KDE:OAA:DSR: 2/6/20121. 2 TEST SECURITY—addition of new checks and processes to monitor appropriate administration of state- required tests DATA QUALITY—collaborative.

KDE:OAA:DSR: 2/6/2012 1

2

TEST SECURITY—addition of new checks and processes to monitor appropriate administration of state-required tests

DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results

KDE:OAA:DSR: 2/6/2012

Recent loss of certification for Kentucky educators emphasizes a serious issue.

Senate Bill 64 (2012 Kentucky General Assembly) an ACT relating to assessment ethics has been filed. authorize prosecution of violations (a prosecuting

attorney and the Attorney General may investigate allegations of violations and prosecute violations);

require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.

KDE:OAA:DSR: 2/6/2012 3

Senate Bill 64 requirements unlawful for any school district employee to allow

examinees to view assessment questions in advance, copy test booklet contents, provide guidance to assist examinees to arrive at correct answers, change student responses, make answer keys available;

fail to follow test security protocol, fail to report violations, or follow any rules established by the Kentucky Board of Education (KBE);

require superintendent and principal to enforce policies;

require the KBE to adopt statistical guidelines for determining testing irregularities;

4KDE:OAA:DSR: 2/6/2012

Appropriate training for Administration Code and Inclusion rules

Signatures on Appropriate Practices Form and Administration Code

Seating charts that reflect everyone in each testing room (adults and students)

Bubbling of testing room location codes by content area tests on student response booklets

DACs collect BAC certification and KDE collects DAC certification form (provided by KDE, not vendor)

KDE:OAA:DSR: 2/6/2012 5

Certification Form DACs and BACs

E-mail from KDE/OAA and copy in

DAC/BAC manualCompleted at end of

year to reflect all testing

Certification form similar to prior years

KDE:OAA:DSR: 2/6/2012 6

Test window visits Review of seating charts Collection of DAC certification forms Review/audit of randomly collected AAA

Folders for alternate assessment students Analysis of outlier test results by Office of

Education Accountability Analysis by vendors (i.e., erasure and others)

KDE:OAA:DSR: 2/6/2012 7

Analysis by vendor can produce multiple types of information/reports at room, school or district levels.Large score changes for a studentLarge mean score increasesProbability of matched response analysisPrevious year’s distribution around scoresPattern analysisComparison of individual student scores by item type

KDE:OAA:DSR: 2/6/2012 8

Get the facts straight.Record the date and time of the incident.List all involved (i.e., staff, volunteers, students).

Identify content area and test parts impacted.Identify specific content question(s), if applicable.

Record what you learn.Report the incident.

KDE:OAA:DSR: 2/6/2012 9

Support Documents Testing Allegation Reporting Form Notarized Statements written and signed by each individual involved (teacher, proctor, BAC, principal and/or others). One statement signed by multiple individuals is not acceptable.Testing ScheduleSeating Chart

KDE:OAA:DSR: 2/6/2012 10

Support Documents Verification of Administration Code TrainingVerify/Proctor Signature SheetNon-disclosure Agreement (classified/volunteers)Student Name & SSIDFor an allegation involving special education:

verification of student test accommodation(s). verification of Inclusion of Special Populations training. a signed copy of the Code of Ethics, record of testing room and test

administrator for allegations regarding alternate assessment.

KDE:OAA:DSR: 2/6/201211

Correctness must happen first in Infinite Campus

KDE/OAA Student Data Review and Reporting (SDRR) Application will be used for two critical data accuracy functions:

Rosters Required by regulation Record of accountability for all grades 3-12 Testing information for some tests

Data Review (cleanup before reporting)KDE:OAA:DSR: 2/6/2012 12

• Students enrolled a full academic year, any 100 instructional days, shall be included in calculations for Achievement, Gap, Growth and College/Career Readiness.

• Graduation Rate calculations shall include both students enrolled and students earning diplomas.

13KDE:OAA:DSR: 2/6/2012

14

INSERT TABLE

KDE:OAA:DSR: 2/6/2012

Every student enrolled on the first day of the test window must be tested. (Participation rate still reported.)

Every student in grades 3-12 must be placed in a grade for assessment purposes.

Students take the tests associated with the grade in which they are enrolled on the first day of the test window. Grade 3 students are tested whether or not they are exiting

primary or moving to grade 4. If a grade 3 student is in grade 3 again next year, the

student repeats the grade 3 test. If a student skips a grade, the students takes only the tests

associated with the current grade of enrollment.KDE:OAA:DSR: 2/6/2012 15

“A1” means a school under administrative control of a principal and eligible to establish a school-based decision-making council.

“A1” school is not a alternative program operated by, or as a part of, another school.

“Alternative” program means all other education programs not classified as A1.

KDE:OAA:DSR: 2/6/2012 16

START

Has this student been enrolled in

this school for 100 instructional days

this school year?

YES

NO

Student scores will count

in this school’s accountability.

Has this student not been

in any one school but has been enrolled in this district for 100 instructional days

this school year?

Student scores will count in district’s

accountability.

YES

NO

Student scores will count in state’s accountability

only.

Has this student been enrolled in a

school or district outside this districtfor 100 instructional

days this school year?

NO

YES

Student scores will count in

another school’s ordistrict’s

accountability.

Flowchart for Determining AccountabilityFor Students in A1 Schools for the 2012 Kentucky Performance Rating for Educational Progress (K-

PREP) Every student enrolled on the first day of

the testing window will be tested for participation rate purposes. Accountability will be determined

by full academic year.

Has this student been

enrolled in another school in this district for 100 instructional

days this school year?

NO

Student scores will count in other

school’s Accountability.

YES

KDE:OAA:DSR: 2/6/2012 17

Flowchart for Determining Accountability For Students in Alternative Programs for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP)

Accountable to A1 school and/or district where student was enrolled a full academic year or where the student would have attended if not enrolledin the alternativeprogram.

an A1 school’s or

district’s policy?

YES

agovernmentalagency or the court system?

Was the student enrolled

a full academic year in the A1 and alternative

program combined orin the alternativeprogram only?

NO

Was the student enrolledin an A1 school

or district for a fullacademic year

beforeplacement in an

alternativeprogram?

YES YES

Accountable to the state

YES

NO

START: Was the student placed in the

alternative program by:

KDE:OAA:DSR: 2/6/2012 18

The Kentucky Board of Education approved new accommodation rules with revisions to Inclusion regulation on February 1, 2012.

The new rules will impact the 2012-2013 academic year and will impact state-required testing beginning in August 2012.

KDE:OAA:DSR: 2/6/2012 19

All grades (3-8 and HS writing) have separate test booklets and student answer booklets.

Test booklets are larger. New printing process has increased the size

of the test booklets (i.e., number of pages), the occurrence of blank pages and pages with one multiple-choice items.

Bigger books mean more boxes in shipment.

KDE:OAA:DSR: 2/6/2012 20

Tests are timed.

Timing chart has been revised and first-year transitional buffer has been added.

Timing charts display the expected time needed to complete each K-PREP test.

KDE:OAA:DSR: 2/6/2012 21

KDE:OAA:DSR: 2/6/2012 22

KDE:OAA:DSR: 2/6/2012 23

In spring 2012, any student that does not complete Parts B or C in the expected time may use up to an additional twenty minutes, for all content areas except writing.

During the first K-PREP administration, the Kentucky Department of Education will study completion times for Parts B and C. This additional time will be reviewed for its use in future.

KDE:OAA:DSR: 2/6/2012 24

Every English Learner (EL) student in grades k-12 must take an English Language Proficiency (ELP) assessment annually.

ACCESS—ELP test for ELs has an Alternate ACCESS available.

Districts determine the most appropriate ELP assessment to use (ACCESS—grades k-12 or Alternate ACCESS—grades1-12).

The Participation Guidelines for Alternate Assessment are an important reference.

KDE:OAA:DSR: 2/6/2012 25