TerraNova 2014 Training Guide Colleen Rohowsky, Office of the Director,, DoDDS-Europe.

DODDS-EUROPE

TerraNova 2014 Training Guide

Colleen Rohowsky, Office of the Director,, DoDDS-Europe

It is DoDEA policy that all system wide assessments administered in DoDEA measure student performance so that inferences can be made about student achievement in basic skill areas as well as provide a source of information for decision-makers concerning programs and services.

DoDEA Regulation: 2000.06 Colleen Rohowsky, Office of the Director, DoDDS-Europe

DoDEA POLICY

22

3

1. Norm-referenced Student scores are compared with a

“normal” group of students at a grade level

(e.g., TerraNova, 3rd Edition, Multiple Assessments)

2. Criterion-referenced Student scores are compared with the

achievement of specific goals or standards

Colleen Rohowsky, Office of the Director, DoDDS-Europe

ASSESSMENT TYPES

4

Refer to the TerraNova 3rd Edition Assessment Coordinators Manual (ACM) and the publisher’s instructions in the Test Directions for Teachers

Follow procedures:◦ Prior to Test Administration◦ During Test Administration◦ After Test Administration(Reference: TN 2013 ACM pages i-iv)

When test scores are received, report any irregularities to the District ISS Assessment POC

and copy the DODEA-Europe ISS Assessment Coordinator, as consultations with HQ and the test company may be necessary.


THE SCHOOL ASSESSMENT COORDINATOR’S Checklist

5

Norm-referenced

Grades 3 – 9

Five Content Areas Tested: Reading, Language Arts, Mathematics, Science, and Social Studies

Baseline Established -2009

Testing Window: March 10-March 28, 2014


TerraNova

6

Do not discuss test questions or answers with anyone.

This means you may not go back over a test section and review it with students or colleagues.

Consequences for divulging test questions will result in the invalidation of tests and other appropriate action.


CRITICAL: TN TEST PROTOCOL

7

Certified educators must administer the TerraNova. Proctors should not be parents of students in test session. Review plans and procedures prior to testing. Emphasize the importance of test security before, during, and after

testing. Proctors may fill-in student-identifying information on test books. Proctors may make sure students are working in correct place and

marking only one answer for each test question. Proctors may distribute test materials and separate punch-out rulers in

the classroom. Proctors may collect materials at end of the testing session. Test materials must be returned to the School Assessment Coordinator

daily.

(Ref. TN Test Directions for Teachers, p. 2, for more details)


TerraNova Protocol: Test Proctors

8

Reference DoDEA System wide Assessment Program Regulation 2000.06

Some highlights:

TerraNova materials may be distributed to *certified staff only. Students may not have access to any new or completed assessment materials other than their own and then only while they are actually taking the test.

* A certified educator: TP status and employed by the school or DSO or Area Office.


TerraNovaProtocol: Test Security

9

CTB “TerraNova, Test Directions for Teachers” may be reviewed by *certified educators at any time.

DoD Sponsors may review the Teacher’s

Guide to TerraNova and the Student Practice Test at the school to determine any perceived conflict with family values or religious beliefs; they may NOT take these home prior to the administration.

*Educators employed in TP status at school or DSO


TerraNovaSecurity Protocol: Teachers &

Sponsors

10

TerraNova Practice Tests may be taken home by students, after they have completed it in class; it may not be administered at home.

TerraNova Student Test Booklets are NOT available for preview/review by anyone!

TerraNova ACM – not available for review by parents or community

Copying any portion of the TN is prohibited

All TN Student Test Booklets must be coded for student accommodations, if applicable, and shipped (with tracking numbers) for scoring & copies of tracking numbers must be sent to the District CSI/Assessment/Program Evaluation ISS; they forward these to Area Office


TerraNova Security Protocol: Student Test Booklets

11

TN Student Test Booklets will be distributed to TN administrators (certified educators) daily.

The Student Test Booklets will be collected/counted daily by a certified educator and returned to the School Assessment Coordinator or Administrator, who will store these in a locked room or cabinet.


TerraNova Security for Student Test Booklets

Protocol: First Day of Testing

12

The school Assessment Coordinator will inventory and store all TerraNova materials in a secure location (e.g., locked cabinet, drawer, or storage room).

TN Student Test Booklets will not be available to teachers or students at any time, except during the administration of the test.

Community members/parents do not have access to the TN Student Test Booklets or the TN ACM.


TerraNova Security for Student Test Booklets

Protocol: Inventorying, Storing & Restricted Access

13

Administer the Practice Activities in advance of testing—not on the day of testing.

Students must complete the Practice Activity in the classroom.

Teachers will see which students have difficulty with aspects of the test (such as bubbling-in the answers) and can assist them with the mechanics prior to test time.

Students may not take their Practice Activity home for homework.

Once the Practice Activity is completed and reviewed with students by the teacher, students may take it home; it does not have to be returned to the school.


TERRANOVAProtocol: Practice Activities

14

Follow the TN Test Directions for Teachers exactly.

Test directions should be read aloud exactly as written.

Per publisher’s guidelines–administer one content area a day. (Contact DSO & Area Office, if extenuating circumstances would prevent testing in one content area a day.)

(Ref. Test Directions for Teachers, p. 2)

It is permissible to change the order of the tests. (Ref. Test Directions for Teachers, p. ii & p. 3)

Schedule make-ups, if students miss all or part of a test. (Ref. Test Directions for Teachers, p. 2)


TerraNova Protocol: Test Administration

15

Do not allow electronic devices of any kind in the testing area (including cell phones, digital cameras, hand-held scanners, pagers, or games).

Do not allow use of markers, pens, highlighters,

crayons, colored pencils, paint, or correction fluid on TerraNova

(Reference: Back of front cover of TerraNova 3rd Edition Test Directions for Teachers & pages 11 & 12)

Allow Number 2 pencils only; no mechanical pencils.


TerraNova Test AdministrationProtocol: Electronic

Devices/Markers

16

Test questions have been designed and adequate time has been provided so that using a calculator will not offer any particular advantage; however the classroom use of calculators is supported by the National Council for Teachers of Mathematics.

(Reference HQ DoDEA Memorandum dated 12 Nov. 2008) (Reference TN 3rd Edition, Test Directions for Teachers, p. 1) Colleen Rohowsky, Office of the Director, DoDDS-Europe

TerraNova Test AdministrationUse of Calculators & Test Questions

17

Calculators should NOT be used in Part 1 of the TerraNova 3rd Edition, Multiple Assessments, Mathematics test.

All students in grades 3-11 should have access to a calculator during the administration of Parts 2 and 3 of the TerraNova, 3rd Edition, Multiple Assessments Mathematics test

Students should be familiar with the use of the provided calculator prior to testing.


TerraNova Test AdministrationProtocol: Calculators

18

Optional: Four-Function Calculators are not provided with test materials

(Ref. TN Test Directions for Teachers, page 1, Step 1)

The type of calculator provided should be one that students are familiar with in the classroom.

If students have never used calculators in the classroom based on standard classroom practices, it cannot be assumed that they all know how to use a calculator, especially for younger students.


TerraNova Test AdministrationProtocol: Type of Calculator

19

The classroom use of calculators in DoDEA schools has been supported by DoDEA Headquarters in the past through direct purchase of calculators or FADing of money to the Area Offices for their purchase.

Calculators were already purchased and are in DoDDS-Europe schools.

Four-function calculators may be used, but are not provided with test materials.

(See HQ Memorandum dated 12 Nov. 2008)

(See TN 3rd Edition, Test Directions for Teachers, p. 1)


TerraNova Test AdministrationPurchase of Calculators

20

The ESL Alternate Assessment (in the TN test family) is the CAT Survey Plus Mathematics Computation test.

ESL Levels 1 and 2 students should participate in the CAT Survey Plus- (unless the ESL Student/Teacher Team determines the student has advanced enough since the initial testing earlier in the school year and can participate in the TerraNova).

Levels 1 and 2 ESL students in Grade 3 mark their responses in the consumable Grade 3 CAT Plus student book.

Levels 1 and 2 ESL students in Grades 4-11 are to only fill-in the Mathematics Computation section of the CAT Plus answer sheet (page 3 of the answer sheet).

Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372) Colleen Rohowsky, Office of the Director, DoDDS-Europe


TerraNova CAT Survey Plus MathematicsProtocol: ESL Alternate Assessment

21

The LAS Links Form B is also part of the ESL Alternate Assessment and is not administered during the TN test window.

LAS Links Form B: Administered Jan. 27-Mar. 7, by the ESL teachers.

The CAT Survey Plus Mathematics (alternate assessment from the TerraNova family) is administered during the TN test window.

Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372)


Alternate ESL AssessmentsProtocol: ESL Form “B” LAS Links

22

Inclusive education supports the premise that ALL students are to participate in system wide testing.

The “No Child Left Behind” Act also supports this.

Accommodations enable a student to have equal access to participation in DoDEA assessments.


ACCOMMODATIONSReasons Why

23

Any student (including home-schoolers) using test accommodations must have an Individualized Education Program (IEP), a 504 DoDEA Education Plan, or an ELL classification in place, specifying the testing programs the student participates in, the content area appropriate for the student to be tested in, and the accommodations to be used.

(Reference TerraNova 3rd Edition Assessment Coordinator’s Manual pages 10 & 11 & DoDEA Regulation 2000.06, Enclosure 3)

Area Office ISS Student Services 504 POC: John Keating (DSN: 338-7358)


ACCOMMODATIONSRequirements

24

Alternate Assessment (SPED) all grades, as appropriate - must be on IEP

Test window: March - May, 2013

Area Office ISS SPED POCs:

Katharine Heath (DSN: 338-7208)

Maureen Crouse {Kurzweil POC} (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)


Alternate SPED AssessmentProtocol: SPED Alternate Assessment

25

Three Categories of Accommodations

Cat. 1 Least restrictive

Cat. 2 May influence results

Cat. 3 Most Restrictive – may impact results

Accommodations for Special Education students must be annotated in their IEP

See TerraNova, 3rd Edition, Assessment Coordinator’s Manual Spring 2014, p.9-21 for detailed information and guidance regarding accommodations

Area Office SPED POCs: Katharine Heath (DSN 338-7208) Maureen Crouse (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)


ACCOMMODATIONS Categories

26

Home-schooled students who are eligible for enrollment on a space-required, tuition-free basis, may participate in DODEA system wide testing.

School should be contacted in advance of testing.

The sponsor must verify eligibility; photo-IDs for student & sponsor, immunization records (in locations/situations where this is

required), PCS Orders.

Home-schooled students are to be tested in a classroom with their like-age peers at the time normally scheduled for that classroom’s assessment.

Must have a DoDEA IEP if testing with accommodations.


TerraNovaProtocol: Home-Schooled Students

27

Transportation costs will be the responsibility of the child’s sponsor, not the local school.

All students are expected to follow strict classroom behavior expectations while testing.

All students are expected to follow the test administrator’s directions & must report to class on time as students cannot enter the classroom once testing has started.

Home-schooled students’ scores will not be reflected on schools Summary Scores.

DoD sponsor will receive Individual Score Report.


TerraNovaProtocol: Home-Schooled Students

(continued)

28

Scores may be used to make comparisons over time – longitudinal analysis

Scores may be used to evaluate program effectiveness (e.g., Continuous School Improvement)

Scores may help identify areas of concern

Scores may identify students’ skill strengths

Results of each system wide assessment identified to measure student achievement in DoDEA shall be used as one component of an assessment system for major decisions concerning the student’s future leaning activities (DoDEA Regulation 2000.06)


DoDEA System Wide AssessmentsProtocol: Scores

29

Classroom observations Classroom activities Homework assignments Teacher-made tests Criterion-referenced tests Locally SELECTED or purchased

assessments Portfolios Projects


OTHER ASSESSMENT TYPES

30

Highlights from Regulation 2000.06:

Developing, teaching, and/or practicing curriculum objectives based solely on the content objectives of the assessment

Using assessment preparation materials beyond the TerraNova Practice Activities or materials that are not part of a program materials adoption purchased by DoDEA


TerraNovaINAPPROPRIATE/UNETHICAL PRACTICES

31

Excluding students from the TerraNova without appropriate review and sponsor notification (against DoDEA policy)

Teaching to specific questions or tasks

Providing assistance that will inadvertently indicate an answer

Allowing students to use highlighters on the TN is not permitted as the use of highlighters is considered an accommodation and it must be on students’ IEPs (If on the IEP, it is permissible as an accommodation.)


TerraNova Unethical Practices

(continued)

32

Halting all regular instruction weeks or days prior to the test and teaching just those concepts and content objectives on the assessment

Reviewing specific TerraNova items with students before or after the test (unethical and generally illegal)

Using identical or virtually identical questions or items from current or past assessments

Photocopying published assessments in whole or in part for any purpose (copyright infringement)

Prompting students to find the correct answer to any questions except sample items


TerraNova Unethical Practices

(continued)

33

Providing students with a variety of test formats throughout the school year

Assisting students with mechanical acts such as finding the correct place

Reviewing general test directions and procedures prior to the assessment


TerraNova Ethical Practices

34

School Assessment Coordinator may distribute TN Test Directions for Teachers and other supplies prior to test time; but not the TN Student Test Booklets as they are distributed each morning of TerraNova testing

Ensuring that assessment materials are secured at the end of each testing session; students should NOT have access to any of the assessment materials before or after the test administration sessions

Ensuring that teachers not discuss what was on the TerraNova assessment with anyone before, during or after the test


TerraNova Ethical Practices

(continued)

35

Barcode labels are created by CTB by using the student information that has been provided by

DoDEA HQ through ASPEN.

Using the barcode roster, verify that each student’s biographic and demographic information is accurate. If there are any errors in the student’s data – DO NOT use the barcode label.

Affix one barcode label in the designated area on the back cover of the student test booklet AFTER the test is completed.

(Reference the TN ACM Spring 2014, pages 27 & 28 for further details) Colleen Rohowsky, Office of the Director, DoDDS-Europe

TerraNova Protocol: Barcodes

36

DoDDS-EUROPE shipping suspense-

On or Before: April 4, 2014 Must be shipped via a traceable method Please use strapping tape to secure boxes. School Assessment Coordinators send tracking

numbers to appropriate District CSI/Assessment/Program Evaluation ISS & once collected, each district forwards the numbers to the Area Office ISS counterpart.


TerraNovaProtocol: Shipping

37

Bavaria: Dr. Mary Leonhart (DSN: 468-7426) Isles: Dr. Jennifer Simmons (DSN: 226-7227) Kaiserslautern: (acting) Klarissa Jenson (DSN: 489-5907) Mediterranean: Amy Dilmar (DSN: 634-7738)

Area SPED ISSs: Katharine Heath (DSN: 338-7208)

Maureen Crouse {Kurzweil POC} (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)

Area ESL ISS: Jizela Chirichetti (DSN: 338-7372) Area Student Services (504) ISS: John Keating (DSN: 338-7358)

AREA POC: Colleen Rohowsky (DSN: 338-7204)

DODDS - EUROPE DISTRICT & AREA OFFICE

CSI/ASSESSMENTS/PROGRAM EVALUATION & SPED, ESL, STUDENT

SERVICES (504) ISSs

TerraNova 2014 Training Guide Colleen Rohowsky, Office of the Director,, DoDDS-Europe.

Documents

test materials

test scores

test session

test books

test company

test section

tn test directions

divulging test questions