Computer Based Testing Overview March 8, 2013

Computer Based TestingOverviewMarch 8, 2013

Joe Dell Brasel, Ed.D.Account ManagerACT , [email protected]

Jennifer StaffordPolicy AdvisorKentucky Department of Education [email protected]

Paul ShoemakerEngineer/ArchitectKentucky Department of Education [email protected]

04/22/2023

1

Agenda• Testing Windows and Sessions• Responsibilities and Deadlines• Technical Components• Prohibited/Acceptable Materials• Online Testing• Resources

04/22/2023

2

Testing Windows• Two remaining EOC test windows:

• April 15-June 15• June 16-July 15 (CBT only)

• Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions.

• Within the 10-day window, schools choose 1 day per subject Note: MC1 and MC2 must be given in order on the same day.

• May schedule multiple content tests on same day.

04/22/2023

3

Two Sessions• Two separate EOC sessions

• Multiple Choice 1 (Paper or Computer)• Multiple Choice 2 (Paper or Computer)

• Sessions are 45 minutes each• Paper sessions are timed by the test administrator.• Computer sessions are timed automatically by the

computer.

04/22/2023

4

Combined Testing FormatsPolicy Change: School staff may choose to combine paper and CBT for multiple choice.

Computer Testing:• Multiple testing sessions can be utilized in a single day.• New Policy: The first computer based test must begin at the same time

as the paper based test. • Note: A 10-15 minute break is allowed between test sessions.

04/22/2023

5

Preparation of District and KEN Network Components• Whitelisting and Caching Configurations

• All KEN Firewall configurations include Whitelisted IP Addresses and URLs to ACT QualityCore and VanGuard/Vantage web-based resources.

• Districts that have internal firewalls or proxy/filter/caching devices must configure them to include the IP Addresses and URLs below, as Whitelisted, non cached external destinations.• qc.vantage.com: 199.7.240.100• browserhawk.vantage.com: 199.7.240.100 • qcbeta.vantage.com: 199.7.240.99

04/22/2023

6

Preparations of Student Testing Devices/Workstations• Hardware Requirements

• ACT QualityCore Hardware Specifications Web Page• http://browserhawk.vantage.com/bhawk/jsp/QualityCore_Va

ntage_System_Requirements_Oct_2011.pdf

• Select Which Workstations Will Serve As Testing Stations• Install VanGuard/Vantage Software

• https://qc.vantage.com/qualitycore/do/log• Run the System Check First

04/22/2023

7

VanGuard/Vantage Webpage

Click on the System Requirements Check

04/22/2023

8

System Check Results Page Sample

04/22/2023

9

VanGuard/Vantage System Check• Known Issues

• Bandwidth Detection – Fails on any bandwidth availability above a T-3 connection. All Kentucky school districts have a minimum connection of 10 Mbt and will most often show a failure on this part of the System Check.

• As of January 2013, IE9 and Apple OSX 10.8 still shows as failed on System Check, but is supported by ACT/QualityCore.

04/22/2023

10

Install VanGuard/Vantage Software

Click on the VanGuard Install04/22/2023

11

VanGuard Install Page

• Click on the appropriate download for your Workstation Device/Type/OS.

• Documentation for all of the installations are on the right side column.

04/22/2023

12

VanGuard Installation• Follow the Instructions as prompted by the Setup

Program.• Once completed you may run a practice test to verify

connectivity. Your DAC will have all necessary Login account information.

04/22/2023

13

Practice Online Testing• Coordination between the District Technology Coordinators

and DACs to verify workstations are ready for online testing• CBT Launch Demo PPT• QC CBT QuickStart LaunchTest

• Teachers/Students may use the Launch Demo to practice the system.

04/22/2023

14

Locating Launch PPT and Testwww.act.org/stateservices/kentucky

http://www.act.org/stateservices/kentucky/ 04/22/2023

15

04/22/2023

16

Online User’s Guide• Online User’s Guide or CBT Manual may be accessed:

• Through the secure online system or • Kentucky EOC website http://

www.act.org/stateservices/kentucky/index.html.

• No support materials will be shipped for online testing.

04/22/2023

17

Steps for Ordering• Confirm Unit Usage (DACs/Designee)• Create/Upload Users & Teachers (DACs/Designee)• Create/Upload Students (KDE/ACT, Local)• Create Class Test Rosters (Local)• Finalize Class Rosters (Local)

Note: Valuable Resources are located at: www.act.org/stateservices/kentucky

04/22/2023

18

Responsibilities• District or School Administrator:

• Conduct Administration Code and Inclusion Training• Confirm Unit Usage per school

• Determine Paper or Computer Testing• Estimate Number of Students Testing

• No automatic overage. DAC/BAC should order additional tests per school.

• Determine Testing Dates• Create/Upload Students (New enrollees)

04/22/2023

19

Create and Upload Students• KDE extracted from Infinite Campus (IC) students enrolled in IC at the high

school level within each district.• ACT created student accounts at the appropriate school. • Student grade levels reflect status in IC as of December 15. Accounts for

students enrolled after this date will need to be created by the school.• 2012 High School Graduates will remain in the Vantage system for one year.

Note: Middle school students taking courses for high school credit will not be included.

04/22/2023

20

Responsibilities• School Administrator:

• Options for Creating Class Rosters: • Name by school, course, teacher, period

• i.e., CCHS, Algebra II, C. Greer, period 5• Name by school, course, teacher

• i.e., CCHS, Algebra II, C. Greer• Name by school, course

• i.e., CCHS, Algebra II

• Note: Separate class roster for extended time for computer based (specific timing).

04/22/2023

21

Responsibilities• School Administrator or Teacher:

• Finalize Class Rosters • Verify all students to be tested are on roster.• No roster in SDRR at this time.• Print or save electronic copy to use as a reference for

accountability in SDRR at the end of school year. • Create seating chart.

04/22/2023

22

Confirming/Assigning Units

04/22/2023

23

Test Form Changes

Click here

04/22/2023

24

Confirming/Assigning Units

Select any school from list

Click dropdown arrow

Choose No Sub-district

04/22/2023

25

Confirming/Assigning Units

04/22/2023

26

Accommodated TestingPaper Only

• R = Reader• A = Audio• B = Braille• LP = Large Print • Scribe

Paper and Computer• Extended Time• Paraphrasing• Manipulatives• Prompting/Cueing• Behavior Modification• Interpreter (sign

language)• Dictionaries/Thesauri

04/22/2023

27

Seating Chart

04/22/2023

28

MaterialsComputerProhibited

• Notes• Foreign language or English

dictionaryAllowed

• Scratch Paper – Please collect and destroy securely.

• Calculators• Reference Sheets (Algebra II)

• Pencil/PaperProhibited• Scratch paper• Notes• Foreign language or

English dictionary• Allowed• Scratch work is to be done

in the test booklet.• Calculators• Reference Sheets (Algebra

II)04/22/2023

29

Resources/Manuals

04/22/2023

30

Retrieve Codes from System

• Test Control Code• Vanguard Exit Code

04/22/2023

31

Student Roster Information• Retrieve student login information from Test Roster section of the online

system.• Print out the Student Login page that contains each student’s QualityCore ID.• Teacher or Student will input the student’s information exactly as it is in the

online system.• QualityCore ID• First Name• Middle Initial (optional)• Last Name• Date of Birth (dropdown menu selection)

04/22/2023

32

04/22/2023

33

Online Testing • Student will choose their correct birthdate from the

dropdown menu and accept the User’s Agreement.

• The student has the option of completing a tutorial before beginning the test.

04/22/2023

34

Student Login Page

04/22/2023

35

Accept User Agreement

04/22/202336

Complete Login

04/22/2023

37

Choose Correct Test

04/22/2023

38

Directions

04/22/202339

Directions (continued)

04/22/202340

Test DisplayTime Remaining

Tools

04/22/2023

41

Student Prompt After Answering

04/22/2023

42

Skipping a Question

04/22/2023

43

Bookmark a Question

04/22/2023

44

Reviewing Online Test• Before the student submits a completed test module, a

review page will display. This page will list all items on the test, the status of each item (answered, unanswered, or bookmarked), and how much time the student has left to review his/her work.

04/22/2023

45

Student Review Page

04/22/2023

46

04/22/2023

47

Take a Break or End the Test

Break

04/22/2023

48

Test Control CodeLocated Two Places• Helpful Hints for a

Smooth Administration document, http://www.act.org/stateservices/kentucky/pdf/QC-KY-CBTHelpfulHints.pdf.

• Secure online system

04/22/2023

49

Test End ControlLocated Two Places• Helpful Hints for a

Smooth Administration document, http://www.act.org/stateservices/kentucky/pdf/QC-KY-CBTHelpfulHints.pdf

• Secure online system

04/22/2023

50

Test Security• Recent loss of certification for Kentucky educators emphasizes a serious

issue.• Senate Bill 137 (2013 Kentucky General Assembly) an Act relating to

assessment ethics has been filed. • Authorizes prosecution of violations (a prosecuting attorney and the Attorney

General may investigate allegations of violations and prosecute violations); • Requires the Office of Education Accountability to periodically review

assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.

04/22/2023

51

Resources• Kentucky QualityCore Website

www.act.org/stateservices/kentucky

• Kentucky Department of Educationhttp://education.ky.gov/AA/distsupp/Pages/EOC.aspx

04/22/2023

52

Contact InformationACT

• ACT Customer Services: • E-mail:

[email protected]• Phone: (866)764-7228

• Joe Dell Brasel, Ed.D.• E-mail: [email protected]

KDE• Assessment Support and Research:• E-mail: [email protected]• Phone: (502) 564-4394

• Jennifer Stafford• E-mail: [email protected]• Paul Shoemaker• E-mail:

[email protected]

04/22/2023

53