Top Banner
1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013
85

1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Mar 26, 2015

Download

Documents

Chase Perkins
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

1

STAR 2012 Coordinator Training

Dawna Holiday- ShchedrovResearch and Accountability

February 2013

Page 2: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

STAR OverviewVarious RolesTest Security and AffidavitWho is to be tested?Multiple Choice/Writing Test/EAPAccommodations and modificationsTesting rules and restrictionsTesting incidents and irregularitiesTest materials and logisticsCAPA

OVERVIEW

2

Page 3: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Standardized Testing and Reporting (STAR)4 components

California Standards Test (CST) California Modified Assessment (CMA) California Alternate Performance Assessment (CAPA) Standards-based Tests in Spanish

Early Assessment Program (EAP) Joint program of the CDE, CSU and California Community

Colleges

STAR OVERVIEW

3

See page 3 in Test Coordinator’s Manual

Page 4: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

CST Multiple choice tests required for all students in grades 2-11 Writing for Grades 4 & 7

CMA Allow students with disabilities greater access to an

assessment that measures how well they achieve Assessments for students in grades 3 – 11 Writing for Grades 4 & 7 Must meet CMA participation criteria (See Appendix A) Must have an individualized Education Plan to take the CMA May take for some subjects or all

STAR OVERVIEW

4

See page 3 in Test Coordinator’s Manual

Page 5: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

CAPA Individually administered performance assessment for

student who have significant cognitive delays Assessments for students in grades 2 – 11 Cannot take CST or CMA

STS Multiple choice tests that allow Spanish-speaking English

learners in grades 2 – 11 to demonstrate their knowledge of content standards in their primary language. Enrolled in a US school for less than 1 year OR Language of instruction is Spanish

Taken in addition, not in place of CST or CMA.

STAR OVERVIEW

5See page 3 in Test Coordinator’s Manual

Page 6: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

District STAR Coordinator School district testing

calendar Submission of Pre-ID files Place order Prepare and conduct training Provide assistance as needed Collect and inspect materials

from sites/shipments Coordinate shipping

KEY PLAYERS

6See Test Site Coordinator Responsibilities & Page 9 in Manual

Test Site Coordinator Plan logistics at local sites Provide examiner training Manage test securitytest security Organize materials Distribute materials Monitor the test

administration Collect and process test

documents Package material correctly

Page 7: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Test Examiner Must be an employee of a school district or an employee of a

non-public, nonsectarian school (NPS) Parents cannot test their own students Only certificated or licensed employees can administer the

CAPA STS must be bilingual in English and Spanish

Test Proctor Received training to assist the test examiner

Various Roles

7

See Page 9 in Test Coordinator’s Manual & the “from STARt to Finish” flyer

Page 8: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

TEST SECURITY & AFFIDAVITS

8

Emphasis on heightened security Only personnel who are SUSD employees

and have been trained and signed security affidavits may assist with or be present during testing.

All testing materials must be handled in strict accordance with the instructions in the manual

Carefully and completely read before signing

Requires accountability before, during and after test administration

All test examiners and proctors must be trained and sign a security affidavit each each year.year.

See Page 12 in Test Coordinator’s Manual & the “from STARt to Finish” flyer

EXTREMLY IMPORTANT

Page 9: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Who is to be tested? All students in grades 2 -11 MUST MUST participate in STAR testing

unless: Parent exempt

Note: an IEP may NOT exempt a student from testing. The exemption form must be signed prior to testing.

Student enrolled after your site’s first day of testing. School has confirmation that the student completed the

STAR exams at another school.

WHO IS TO BE TESTED?

9

See page 14 in Test Coordinator’s Manual

Page 10: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

REQUIRED FOR ALL STUDENTS IN GRADES/SUBJECTS ELA Grades 2 – 11 (All students) Writing 4th and 7th Math Grades 2- 9 (All students)

7 – 9th depends on current course Science Grades 5, 8, 10

Grade 10 (Life Sciences) History Grade 8, 11

Grade 11 (US History) There is no Gr 8 & 11 US History for CMA, student’s will take CST.

EOC required for student in Math, History and Science

10

ASSIGNMENT OF TEST: REQUIREMENTS

See page 15 in Test Coordinator’s Manual

Page 11: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Review CST and CMA handout in binder CMA may take for some subjects or all

Not all test are available in CMA CMA ELA Available for Grades 2 – 11 CMA Math

Available for Grades 3 – 7 No CMA General Math available, will take CST General

Math Alegbra1 CMA and Geometry CMA Available, (those

eligible between GR 8 – 11 can take) Science CMA for all Grades 5, 8 and 10 (Life Science) No Gr 11 CMA US History will take CST US History

11

ASSIGNMENT OF TEST: REQUIRED

See page 14 in Test Coordinator’s Manual

Page 12: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Math Grades 2 – 6 (rulers only for specific grades) Grade level math test in grade level book

Grade 7 Students in GR 7 will take the CST grade level math, unless

qualify to take Algebra I Algebra 1 test taken only if enrolled in course or completed

during summer 2012 (does not include pre-algebra) If enrolled in geometry in grade 7, must take grade level

math

12

END OF COURSE MATH

See page 16 in Test Coordinator’s Manual

Page 13: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

13

END OF COURSE MATH

Grades 8 & 9All All students in Grades 8 & 9 must take a mathematics test whether or not enrolled in a math course CST for the CST related course if completed course during the

summer 2012 or during 2012-2013 school year Algebra I, Geometry, Algebra II or Summative Math

Grade 8 cannot take summative math; Grade 9 can take the HS Summative Math test

All other students by default take General Math Grades 10 & 11Take an EOC math CST if they completed or will complete a math course in the 2012 summer session or 2012-2013 school year

See page 16 in Test Coordinator’s Manual

Page 14: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Students who completed a math course during the 2012 summer session and who are not taking a math course during the school year will take the CST Math for the summer course

If Math course taken 2012 summer session and during the 2012-2013 school year, will take the CST math test for the course taken during the year

Math chair decision if taking 2 math courses concurrently Summative Math

Completed Alg I, II and Geometry and took Advanced Math course during summer 2012

Completed Alg I, II and Geometry and taking no math course this year

Took CST Summative in previous year will retake, even if not enrolled in Math

14

MATH RULES

See page 16 in Test Coordinator’s Manual

Page 15: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Will not take a math CST In the first year of a multi-year Algebra I course Taking Business math They are not taking a math course (unless they are eligible to

take the CST for Summative Math test)

Retake Math Course Students will retake an EOC if they are repeating the same

course during the 2012-2013 school year

If two math courses, which is taken? -> Site decision

15

MATH RULES

See page 16 in Test Coordinator’s Manual

Page 16: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Science Required : GR 5, 8, and 10 required

Science End of Course GR 9 - 1 take the CST test for related course if completed

during the 2012 summer session or 2012-2013 school year Earth Science, Biology, Chemistry, Physics, Intg. Phys.

Science If course taken during summer and during 2012-2013, course

taken during the year dictates test If completing 2 EOC science during the year -> site decision Retake EOC Science CST exams can be repeated either due to course repetition,

subject repetition, content aligned Example: Biology -> AP Biology or Biology -> Physiology

16

END OF COURSE SCIENCE

See page 16 in Test Coordinator’s Manual

Page 17: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

History/Social Science Requirement: Gr 8 & Gr 11 EOC History

Students in Gr 9 – 11 will take a World Histry if completed in the 2012 summer session or will complete during 2012-2013 school year

Students will retake the World History test if retaking the course

17

END OF COURSE: WORLD HISTORY

See page 19 in Test Coordinator’s Manual

Page 18: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

CAPA (levels I – V) ELA and math grades 2 - 11 Science grades 5, 8, and 10

STS (Standards Test in Spanish) Reading language arts and math Grades 2-11 Must still complete CST or CMA exams

18

ASSIGNMENT OF TEST

Page 19: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

SUSD Testing Window: April 10 – May 8, 2013SECA Testing Window: April 8 – May 05, 2013

Elementary selects from among 4 testing calendars CST Schedule

CMA/STS/CAPA to fit within selected schedule window

Pick- up schedule in binder

Test Calendars

19

Page 20: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Writing test are required CST and CMA Grades 4 and 7 Examiners need to ensure correct test are

given Check IEP’s to determine See bottom of response booklet and DFA

WRITING TEST

20

See page 32-36 and 53-58 in Test Coordinator’s Manual

Page 21: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

When in 2013?March 5, with makeup testing on March 6, 2013Due to Research Annex by 3:00 PM on March 7, 2013

21

WRITING TEST

Page 22: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Joint program between CDE, CSU and CCCAvailable for students in Grade 11Provides opportunity to obtain information from STAR

tests about students’ readiness for college-level English and mathematics

EARLY ASSESSMENT PROGRAM

22See page 3 & 19 in Test Coordinator’s Manual

3 components to English Select questions from CST

ELA 15 augmentation

questions EAP Administered in

March

EAP MathematicsCST Take the Algebra II or Summative MathSelect questions from CST test15 multiple choice questions

Page 23: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Benefit – allows students to prepare for college level English and math courses while still in high school

Most community colleges accept EAP results.

Benefit – allows students to prepare for college level English and math courses while still in high school

23

EAP - Early Assessment Program

See page 3 & 19 in Test Coordinator’s Manual

Page 24: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Each day of testing distribute and collect EAP essay response booklets

No electronic devices during testing

EAP Information

www.calstate.edu/eap

24

EAP - Early Assessment Program

See page 3 & 19 in Test Coordinator’s Manual

Testing Window

March 5 – March 22Due to Research Office by March 27, 2013 by 3:00 PM

Page 25: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Discuss at your table who will take which test:

Grade 8 student with an IEP that says CMA math and the student is in SDC math. What math test is taken?

Grade 2 student with an IEP that says CMA for ELA. What ELA test is taken?

Grade 10 student (block school) completing Biology and Chemistry. Which EOC and grade level science test(s) will be taken?

25

TEST ASSIGNMENT REVIEW

Page 26: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

8 MINUTE BREAK

26

Page 27: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Variations Small group setting or extra time All students may use them if regularly used in a classroom English Learners – see specific listing

Accommodations (IEP or 504 Plan) Change conditions, but not measurement

Modifications (IEP or 504 Plan) Change conditions and measurement Score counted as far below basic for state accountability Score not counted as participating for adequate yearly progress

(AYP)Matrix of test variations, accommodations, and

modifications (pages 86-89 of the Coordinators Manual)

ACCOMMODATIONS AND MODIFICATIONS27

Page 28: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Parents must be notified of the upcoming STAR tests. Parents are not allowed to watch their child take the exam. Teachers who are parents may not administer the exam to their

own child or handle their test materials. Test Administration & Security

#2 Pencils only (use appropriate pencils) Follow directions for 1st day of testing in the DFA: Ensures student has correct documents Ensures students write their name on the documents Ensures coding of test version and math and science tests

taken DO NOT write students’ names in the space where the label goes.

RULES AND RESTRICTIONS

28

Page 29: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Test Administration & Security All tests are untimed. Time estimates in Appendix J (pg. 105 – 109 in manual)

Test parts MUST be completed in one sitting unless specified by an IEP or 504 plan.

Examiners shall ensure there is enough time to complete a part before beginning the part

10 minute break between test parts if taken back to back.

Test parts must be taken in order.

MUST follow the DFA’s exactly as written

29

RULES AND RESTRICTIONS

Page 30: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Students not testing may not stay in the classroom where a test is being administered

If students need to be taken to another room to finish testing, they must be must be escorted by an adult. Do not allow students to walk to another room with test materials by

themselves.

Examiners are expected to actively monitor students during testing to make sure students are: On the correct part of the test

Do not go on to other parts or back to a previously completed part

Do not skip a question on their answer document (so that they are off by one or more)

30

RULES AND RESTRICTIONS

Page 31: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Directions may be clarified, but test questions MAY NOT BE. Test examiners may not discuss any part of the test with anyone. Test examiners may not assist with or coach the students during the

exam. Be encouraging, but not informative. No copies may be made of any parts of the tests or the secure DFAs. Test examiners may not read prompts or passages unless specified by

an IEP or 504 plan. CST ELA multiple choice passages read aloud – is a modification

CMA ELA multiple choice passages read aloud – is Not Allowed

Testing strategies may not be discussed with students during the test administration.

Make sure all tests have been accounted for before allowing children to leave the classroom.

31

RULES AND RESTRICTIONS

Page 32: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Erasures and Analyses - Erasures will be heavily monitored this year.

Staff may not erase stray marks on answer documents unless directly supervised by the site coordinator or principal.

Examiner must not erase ANYHING in answer circles. Only students may erase in bubbles

Avoid teaching students in second and third grade to mark through answer circles to eliminate answers. Such marks MAY NOT be erased by adults

32

RULES AND RESTRICTIONS

Page 33: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Two students were given each other’s pre-ID’s tests and complete part 1 of ELA. What would you do?

A student started bubbling in on the CMA portion of the answer document. What would you do?

A student goes on to part 2 during the administration of part 1. What would you do?

After the answer documents were returned to the coordinator, it was noticed that the students did not write their names on their test books or answer documents.

33

TESTING SCENARIOS

Page 34: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Can simply be avoided by: Keeping all materials secure Following all instructions in the DFA Adhering to regulations outlined on the security affidavits Correctly marking tests taken Monitoring classrooms during testing

#1 Responsibility—Security No unauthorized electronic devices used in classroom during testing

For testing purposes, any electronic device that is not specifically designated as an accommodation or modification in the student’s IEP or Section 504 plan is unauthorized.

MONITORING

34

Page 35: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Testing Irregularities – Circumstances that compromise the reliability and validity of test results If more than 5 % of students tested will affect API and AYP

Testing Incident – occurs before, during or after test administration that does not conform to instructions stated in DFA (ex: disruption, cheating)

Any testing incidents or irregularities must be reported to Dawna immediately. Call or email me with the situation.

Items that must be reported are described in pages 79-81 of the Coordinators Manual

35

INCIDENTS AND IRREGULARITIES

See page 79 – 81 and 82, 83 (Forms) in Test Coordinator’s Manual

Page 36: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

SECURITY AUDITS

36

At randomly selected schools and district offices Before, during, or after testing

What are they looking for: Are materials secure, accounted for, and

locked up when not in use? Are correct administrative procedures being followed? For

example Example: Instructional materials have been removed or

covered. Example: Students are not being coached through the exams. Only appropriate accommodations and/or modifications are

being provided, et. al. No unauthorized electronic devices are being used.

Page 37: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

DIRECTIONS FOR ADMINISTRATION (DFAS) AND ANSWER DOCUMENTS

37

Page 38: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

DFAS AND ANSWER DOCUMENTS

38

DFAs will tell you whether

cardstock rulers or science

sheets are needed.

Beware of unused DFAs by teachers!!

Page 39: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Write teachers’ names on secure DFAs CAPA examiner manuals

All grade 2 manuals (any test)

Specifics for answer documents or test booklets Separate CMA answer documents for grades

8–11

Students taking one or more CMA tests will need to return a CMA AND a CST answer document

Section 7c, “Assessed with CMA”

Staff must complete Section 7c on the CST answer document for each of the CMA tests taken

39

DFAS AND ANSWER DOCUMENTS

Page 40: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

40

Section 9 must be completed if Section 8 = No

Version numbers are on the inside cover of the answer document

Must Complete

DFAS AND ANSWER DOCUMENTS

Changes:

•No CBEDS (section 14)

•No SEID

•English learner program participation definition changes

•CAPA section 1 added

Page 41: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

41

Bubble each exam separately see pages 120-122 of the manual or back page of the DFA

CMA vs CST DFA

IGNORE this

DFAS AND ANSWER DOCUMENTS

Page 42: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

42

CMA Grade 7 Math Answer DocumentGrade 7 math and Algebra I have different numbers of questions

DFAS AND ANSWER DOCUMENTS

Page 43: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

TEST LOGISTICS

43

Page 44: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

No scratch paper is allowed Bubble demographics for non-pre-ID if labels are not available Instructional items must be covered up during testing Do not write the student’s name in the space for the label Scorable documents – answer documents for students who actually sat for

the exam

TEST LOGISTICS: WRITING EXAM

44

Page 45: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Scorable documents one grade level bundle and SGID sheet per test type package with Scorable shipping labels

Non-scorable Voided or unused documents, all DFAs, and ancillary materials Non-Scorable shipping labels on boxes

45

TEST LOGISTICS: WRITING EXAM

Page 46: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Tests and secure DFAs to examiners day of test only All instructional items must be covered up during testing Scratch paper allowed for math and science only – Only if in DFA Be sure to follow DFA instructions for the first day of testing prior to giving the

first test to students, ex: Student’s name and school and version number (inside the answer

document) Batch by grade level – no teacher reports Bubble demographics (front and back) for documents without pre-ID or label Scorable documents – answer documents for students who were enrolled on

your first day of testing – even if they did not test. Your first day of testing is the day you administer your first STAR test.

If they did not test be sure to mark the appropriate code in section A2 of the answer document

See Details in Coordinators Manual46

TEST LOGISTICS: MULTIPLE CHOICE

Page 47: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Scorable documents CAPA, CST, CMA, and STS One SGID for every grade, even if multiple bundles Pack in order as shown on next page. chart on next page Use Scorable shipping labels – only mark the bottom box

counts on the label.

Non-scorable voided or unused documents, test books, CAPA examiner

manuals, secure DFAs, and ancillary materials Use Non-Scorable shipping labels on non-scorable boxes Group items together, no particular order

47

TEST LOGISTICS: MULTIPLE CHOICE

Page 48: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

48

Master File SheetScorable Documents

SGID

SGID

SGID

SGID

SGID

SGID

SGID

SGID

SGID

TEST LOGISTICS: MULTIPLE CHOICE

Page 49: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

No scratch paper is allowed Bubble demographics for non-pre-ID if labels are not available Instructional items must be covered up during testing Do not write the student’s name in the space for the label Scorable documents – answer documents for students who actually sat for

the exam

49

TEST LOGISTICS: EAP

Page 50: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Scorable documents Answer documents for students who sat for the exam Package with Scorable shipping labels

Non-scorable Voided or unused documents and all DFAs and ancillary

materials Non-scorable shipping labels on boxes

50

TEST LOGISTICS: EAP

Page 51: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

51

All Shipping Labels

Leave these blank

Separate box counts for scorables and non-scorables

Page 52: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Pre-ID pre-printed for MC Administration Pre-ID pre-printed for students in the district as of early

January Pre-Id Labels (for anyone who arrived after pre-ids

submitted) Pre-ID labels for students new to the district (out of district,

changes schools in district) Labels will arrive at sites in mid-April

Writing and EAP Write names and ID number on answer document

52

PRE-ID AND LABELS

Page 53: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

CAPA training will be held separately for all CAPA examiners. Date has yet to be determined CAPA examiners must receive training each year

CAPA – 10% of all CAPA students tested must receive a second rating 10% by school by grade Research will randomly select 10% to meet these criteria and will

forward lists to the coordinator Work with Kathleen Kimber at Special Education if this presents a

difficulty Sites are responsible for compiling the manipulatives for

the exam. These should be items regularly used in the classroom for instruction.

53

CAPA

Page 54: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Write questions on the index cards

Research staff will monitor sites during testing.

Binder contents and handouts

54

Additional Questions and Docs

Page 55: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Questions? Dawna Holiday- Shchedrov 933-7105 x2206 Christene Breakfield 933-7105 x2202 Training materials will be posted to the Research website http://ra-susd-ca.schoolloop.com/star

STAR Web links CDE http://www.cde.ca.gov/ta/tg/sr/index.asp ETS http://www.startest.org/ STAR Video link http://www.mavricmedia.com/startest

RESOURCES

55

Page 56: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

56

TESTING DETAILS

REVIEW ON YOUR OWN

Page 57: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Train test administrators and site proctorsAcquire security affidavits – keep at siteA test administrator must be an employee of

the district who has been trained to administer STAR and has signed an affidavit

Only certificated or licensed staff who are trained on administering CAPA may be CAPA examiners

Before Testing

57

Page 58: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Site Training should include Train examiners, proctors, and scribes

All examiners and proctors review non-secure DFAs prior to testing All items regarding rules and restrictions Where to pick up test materials Preparation of room for testing Pre-id information and coding requirements Coding for math, science, and CMA exams

Utilizing exam make-up lists Securing materials and collecting affidavits

Before Testing

58

Page 59: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Inventory Test MaterialsThe Research Office has ordered all materials for sitesEnsure all materials have arrived Braille, large print, CAPA, etc. Box 1 of site boxes will have packing information Utilize the packing slip contained in box 1 to verify your order Verify school name on forms is correct

If any test materials are incorrect or missing, immediately contact Melissa or Christene in Research at 933-7105 x2205 or x2202

Before Testing

59

Page 60: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Site Material Distribution Schedule Immediately after inventorying materials provide

CAPA manuals to examiners if applicable (minimum 5 days before administering the exam). Put teachers’ names on these.

DFAs grades 3-11 – provide to examiners up to 10 days prior to testing

DFAs grade 2 - give to examiners the day of testing. They must be returned at the end of each test. Put teachers’ names on these.

Practice tests should be administered one week prior to the actual test administration (grades 2-4). Used practice tests may be sent home with the student.

Before Testing

60

Page 61: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Testing Materials – Handling and SecuringAll secure materials must be kept in locked storage unless

in useObtain security affidavits from all test examiners,

proctors, and scribesNo portions of the exams may be copiedNo test items may be discussed by anyoneOnly students may look at test questions

Before Testing

61

Page 62: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Testing Materials – Handling and SecuringExam booklets and answer documents may not be

taken homeAfter the test, ALL materials must be accounted forScoring keys for exams may not be developedFollow the Directions for Administration (DFAs)

exactlyPay attention to time charts, say boxes, and areas that may

be translatedDo not read any of the words in the test booklet

except 2nd grade and CAPA examiners or as instructed by the DFA

Only directions may be clarified. Test questions may not be.

Before Testing

62

Page 63: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Review the testing schedule and who will test Who tests? ALL students enrolled on your first day of testing except

Parent exempt (still a scorable document) Students absent the entire test window (still a scorable document) Document why students have not been tested (A2)

Students entering your school after the first day of testing who were not tested elsewhere. (Note – the state does not penalize sites for not testing these students, however, the district expects that you test them)

Students who took a test at another school may retake the test at the current school if the student was enrolled in the current school on the first day of testing

Before Testing

63

Page 64: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Know which students will be taking CAPA and CMA Identify who has been authorized to use

accommodations or modifications during testing and for which exams – make sure test examiners are aware of these

Test parts and writing exam must be administered in a single sitting (unless specified by IEP or 504)

Test parts must be administered in order A minimum 10 minute break is required between parts

and tests

Before Testing

64

Page 65: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Testing variations - for all students Marking in booklets Clarifying directions Small group testing – this is NOT a modification

Testing variations - allowed if regularly used in the classroom Testing individual students separately English Learners – see specific list in the matrix

Know procedures for Pre-id documents and labels Non-pre-id documents

Meet with proctors ahead of time to discuss room set up and how to handle students’ questions

Verify rooms are properly set up for testing

Before Testing

65

Page 66: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Make sure all materials are readyVerify correct test and answer documentsMake sure answer documents match test booklets (grades 4-11)Do not rearrange random order of test booklets

Provide scratch paper and #2 pencils for exams (note: no scratch paper is allowed for the ELA exams)

Highlighters are allowed as wellPrepare a supervised, secondary testing location for students who

will need more timeEnsure DFA instructions are reviewed and understood and read

exactly as directedBe available to answer questions at your site and actively monitor

the testing

Before Testing

66

Page 67: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Students must: Verify that the answer document and booklet is theirs Mark the version number on their exam Write their names on their test booklet and answer documents

Actively monitor testing Students are using a #2 pencil Point out to students if their bubbling of answers is off track or in the

wrong area Encourage distracted students to stay on task

During Testing

67

Page 68: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Keep track of absent students After testing return all test items to the District STAR

Coordinator: Used scratch paper All secure DFA’s All Test booklets All Answer documents

All test administration errors or irregularities must be reported immediately to Melissa Neuburger (directions in binder)

During Testing

68

Page 69: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Have a back-up plan ready in the event that some students need additional time to complete the exam or need breaks (according to IEP or 504 plan)

Upon completion of each exam day: Check that all books and answer documents have been

returned Verify correct coding of exams for math and science Code accommodations or modifications that were used

during testing

During Testing

69

Page 70: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Six steps to complete1. Separate scorable from non-scorable documents2. Inspect and count answer documents3. Complete forms4. Organize materials for return5. Packing materials6. Ship materials back to Educational Research and

Accountability CST, CAPA, STS, CMA

After Testing

70

Page 71: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 1. Separate Scorable from Non-Scorable

Scorable materials Grades 2 and 3 test books (including STS & CMA) Grades 4 through 11 answer documents including STS

(CST and CMA are together on the answer document for grades 4-7)

CAPA answer documents

After Testing

71

Page 72: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 1. (Cont.)Separate Scorable from Non-Scorable

Non-scorable materials: examples Pre-id documents for students who moved before your first

day of testing (marked “Void- moved” DFAs and CAPA examiner manuals Unused or voided test booklets for grades 2-3 All test booklets for grades 4-11 Scratch paper Unused answer documents and labels

Complete list in the coordinator manual

After Testing

72

Page 73: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 2.Inspecting and counting scorable answer documents

Inspect documents for Stray marks in books for grades 2-3, answer docs grades 4-11 Gridding of non-pre-id documents Use of accommodations or modifications Absence reporting Test irregularities (bubbling in section A1) #2 pencil used No tears or tatters on the document Science and math test coding and CMA coding

NEVER – erase ANY student responses on answer document. Documents may only be cleaned up under the supervision of the site

coordinator.

After Testing

73

Page 74: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 2. (Cont.) Inspecting and counting answer documents

Marking answer documentsSection A1 – District and CDE use onlySections A2-A4 - follow instructions in

the manual (codes on back page of DFA)All sections must be bubbled in on non-pre-id documents on both the front

and back sides

After Testing

74

Page 75: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 2. (Cont.) Inspecting and counting answer documents

You should count as scorable the CAPA, CST, CMA, and STS answer documents for: Students who took any or all parts of the exam Students who sat for the exam and did nothing Parent exemptions Students absent the entire test window

After Testing

75

Page 76: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 3.Completing Forms

SGID (Header sheets) CST/CMA and STS will each have their own for each grade level One alone for CAPA for all grade levels (do NOT mark the grade) One per grade level for grades 2-11 Check data on header sheet Mark the instructional materials used (grades 2-8) on the back of the form Make a copy for your files Paper band documents by grade with the SGID sheet Pack in the correct order – see chart in manual Master File Sheet - place on top of your first bundle of documents in box 1 (keep a

copy for your records)

After Testing

76

Page 77: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 4.Organizing Materials for Return

Group all scorable documents after verifying counts Scorable Multiple Choice – orange labels

See manual for instructions Scorable = answer documents for any student enrolled on your first day of testing

Have SGID and master file sheets ready

After Testing

77

Page 78: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 4. (Cont.)Organizing Materials for Return

Group and count secure non-scorable documents Count and verify # of DFAs for Grade 2 CST, CMA, STS, and all CAPA

examiner manuals received in original orders and supplemental orders Count and verify all test booklets received in original orders and

supplemental orders For grades 2 and 3 you will need to add the # of booklets in the

scorable materials and the non-scorable materials to make sure they are all accounted for

Account for all large print and Braille materials

After Testing

78

Page 79: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 4. (Cont.)Organizing Materials for Return

Group all non-secure, non-scorables Follow packing instructions Multiple Choice non-scorable – green labels All grade 3-11 DFAs (have test examiners used them?) Grade 4 through 11 pre-id answer documents and pre-id labels for

students who moved before your first day of testing – all marked “VOID moved”

All scratch paper – bundle and mark “scratch paper”

After Testing

79

Page 80: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 4. (Cont.) Organizing Materials for Return

Keep or discard cardstock rulers, science reference sheets, CAPA stimulus cards

Used practice tests may be taken home by students

After Testing

80

Page 81: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Step 5. Box up materials. Follow the charts in the manual and in your

binder Put labels on the boxes (see manual) and write in the number of

boxes on the lower lines (separate counts for scorable and non-scorable)

Step 6. Return ALL materials to our office by the date shown on the

Warehouse pick-up schedule: Multiple Choice Administration

CST CMA STS CAPA All materials must be to Research by the deadline

After Testing

81

Page 82: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Beginning with the 2012 STAR administration:Security Audits -At randomly-selected schools and district

officesExtensive erasure analyses

Changes to the front of the answer documentsFront: SEID addedBack: NPS movedCAPA (shading of “5”) for Level I ONLY

Writing testsReading aloud prompt now accommodationWriting test can only be given in 1 day

CMA Braille for allGrades 8–11 if Pre-ID, receive both CST and CMA Pre-ID

answer documents

Policy Updates

82

Page 83: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Grades 2-11 Administration (regular District calendar) March 27 through April 30. Actual test dates will vary.Materials due to Research by 3:30 May 2

Grades 2-11 Administration (SECA)April 12 - May 16. Actual test dates will vary.Materials due to research by 3:30 May 18

Grades 9-11 Administration (HCA)March 27-30 and April 11-12.Materials due to research by 3:30 April 18

Test Windows –MC Administrations

83

Page 84: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Inventory shipment within 2 days – notify me if any materials are missing or are insufficient

Writing Exams Delivery to sites around February 28 Site delivers tests and DFAs to examiners the day of the test

only. They cannot be distributed beforehand. Pick-Up - All testing materials must be ready for pickup by 9 am

on March 8. If you miss the pick-up you must deliver the materials to the Research Annex (55 West Flora Street) by 3:30 March 8.

EAP Exams Delivery to sites around February 28 Site delivers tests and DFAs to examiners the day of the test

only. They cannot be distributed beforehand. Return to Research (District Office) by 3:30 on March 28.

Test Materials and Distribution

84

Page 85: 1 STAR 2012 Coordinator Training Dawna Holiday- Shchedrov Research and Accountability February 2013.

Multiple Choice Delivery to sites 5-10 days prior to the test window Regular District Schedule – Week of March 19 Site delivers tests and secure DFAs to examiners the day of the test only.

They cannot be distributed beforehand. May distribute non-secure DFAs earlier (www.startest.org) CAPA test materials – deliver as soon as possible (at least 5 days before

testing) Pick-Up Regular District Schedule

All testing materials must be ready for pickup by 7am on the date given on the warehouse schedule. If you miss the pick-up you must deliver the materials to the Research Annex (55 West Flora Street) by 3:30 May 2.

Test Materials and Distribution

85