DTC Face-To-Face March 2016

8/19/2019 DTC Face-To-Face March 2016

1/109

DTC Face-to-Face

March 16, 2016


2/109

COLLEGE BOARD

SCORE REPORTS

Section 1


3/109

Educator Reporting

Screen Shot Demo


4/109


5/109

Educator Reports – Scores by Institution

View scores by institution for:

+ A State, District or School

+ Each assessment

administered

+ Each administration or

cohort+ Each grade

55


6/109


+ View mean score

comparisons: School,

District, State, Nation

+ View scores for

- Districts/schools in a state

- Schools in a District

- Students in a School

+ View Benchmark

performance and

percentiles

+ Drill through to reports in

lower levels of hierarchy

+ Filter by demographics such

as Race/Ethnicity and Sex

6

NOTE: All data is fictitious.6


7/109


+ Multiple views provided

based on user type and role

+ Individuals can drill up and

down their hierarchy to

view the same report for a

State, District, and School

NOTE: All data is fictitious.7


8/109

Educator Reports – Scores by Institution (More Info)

+ Expand “More Info” views

to view participation,

benchmark, and score

statistics in one place

8NOTE: All data is fictitious.


9/109

Educator Reports – Scores by Institution (More Info)

+ Expand “More Info” views

to view participation,

benchmark, and score

statistics in one place



10/109

Educator Reports – Scores by Institution (Tabular)

10

+ Most graphical reports can

be viewed in a tabular

format

NOTE: All data is fictitious.


11/109

Educator Reports – Creating Custom Groups

+ Educators can create

custom lists for analysis

- Create quick lists when

viewing reports

- Create/manage lists via

List Manager

+ States can create District,

School and Student lists

+ Districts can create School

and Student lists

+ Schools can create

Student lists

+ Lists cannot be imported to

the reporting tool, nor can

they be shared



12/109

Educator Reports – Scores by Demographics

View scores by demographic

groups for:


+ Each assessment administered

+ Key demographics:

- Sex

- Race/Ethnicity

- Highest Level of Parental

Education

- Core Curriculum

- Student Search Service

+ Each administration or cohort

+ Each grade

1212


13/109


+ View mean scores by

demographics- Up to two

demographic levels

available

+ View Benchmark

performance bydemographics

+ Filter by demographics

such as Race/Ethnicity

and Sex



14/109


+ View mean scores by

demographics

- Up to two

demographic levels

available

+ View Benchmark

performance by

demographics


such as Race/Ethnicity

and Sex



15/109

Educator Reports – Score Rosters

View score rosters for:

+ Each assessmentadministered for a given

academic year

+ Roster summaries for a

State, District or School

+ Roster details for a School

1515


16/109

Educator Reports – Scores Roster

+ View score roster

summaries with highlevel details for a State,

District and School

+ Drill down to a detail

Score Roster report for a

School



17/109


+ Score Roster

- Easy to export to excel- Several data points to

hide/show

- Drill to Student Level

Report



18/109


+ Easily create print-ready

files for selectedstudents

- Formatted score labels

- Copy of student paper

score report



19/109

Educator Reports – Student Longitudinal Information

View longitudinal information

for students by:+ Drilling into student records

from reports

+ Searching for a student



20/109


+ Students score history

for entire SAT Suite ofAssessments available in

one place

+ Redesigned assessments

will have detailed score

information, mimickingstudents’ view

+ Pre-redesigned

assessments will have

high-level scores only

2020

10th 11th 10th 11th10 10



21/109


+ Students score history

for entire SAT Suite ofAssessments in one

place

+ Redesigned assessments

will have detailed score

information, mimickingstudents’ view

+ Pre-redesigned

assessments will have

high-level scores only



22/109

Educator Reports – Search

+ States can search for

Districts, schools, andstudents for a given

school

+ Districts can search for

schools and students for

a given school+ Schools can search for

students



23/109

Educator Reports – Search and Dril l-Thru

+ An Educator can drill into a

District or School viasearch and will be

navigated to a Summary

Report for that institution

+ An Educator can drill into a

student via search and willbe navigated to that

student’s score report

(summary and detail)

+ Bread crumb trail provided

to allow an educator todrill up and down a

hierarchy



24/109

Educator Reports – Benchmarks by Institution

View Benchmark performance

for:+ A State, District or School

+ Each assessment

administered


cohort

+ Each grade

2424


25/109


+ View Benchmark

performance comparisons:

School, District, State, Nation

+ View aggregate and student

performance on Benchmarks:

- Need to strengthen skills (red)

- Approaching benchmark

(yellow)- Meet or exceed benchmark

(green)

+ View percent of students

meeting both or no

benchmarks

+ Apply demographic filters

+ Drill-thru to lower levels in

the hierarchy



26/109


+ View Benchmark performance

comparisons: School, District,

State, Nation

+ View aggregate and student

performance on Benchmarks:



(yellow)

- Meet or exceed benchmark

(green)


meeting both or no

benchmarks


+ Drill-thru to lower levels in the

hierarchy



27/109

Educator Reports – Benchmarks by Demographics

View Benchmark performance

for:


+ Each assessment

administered


cohort

+ Each grade

2727


28/109


29/109

Educator Reports – Benchmarks by Demographics

+ View Benchmark performance

for: School, District, State,

Nation

+ View aggregate performance

by demographic groups on

Benchmarks:


- Approaching benchmark(yellow)


(green)


meeting both or no

benchmarks




30/109

Educator Reports – Instructional Planning

View score performance for:

+ State, District or School

+ Each assessment

administered

+ Each administration

+ Each grade

3030


31/109


+ Provides breakout of student

performance, in each Section,

Test and Subscores:



(yellow)


(green)

+ At school-level, ability to see

student in each performance

group

+ See state standards for

subscores

+ Drill-thru to Question Analysis

report



32/109


+ Provides breakout of student

performance, in each Section,

Test, and Subscores:



(yellow)


(green)

+ At school-level, ability to see

student in each performance

group

+ See state standards for

subscores

+ Drill-thru to Question Analysis

report



33/109

Educator Reports – Question Analysis

View question performance

for:


+ Each assessment

administered

+ Each administration and

Form completed

+ Each grade

3333


34/109


+ See performance, by question

+ For disclosed forms- Individual answer choice

performance

- Link to actual question content

(including answer

explanations)

3434

Available only for disclosed forms. PSAT 8/9 is a non-

disclosed form in 2015-2016. PSAT 10 and April SAT

School Day are disclosed forms.



35/109


+ View student produced

responses

+ For non-disclosed

- % Correct / Incorrect

- No question content provided

+ “Unscorable” questions

also displayed

3535






36/109

Educator Reports – Question Analysis– State Standards

+ See your state standards

for Subscores

+ Note: Links to State

Standards will eventually

be provided anywhere a

Subscore is reported;

currently only available inthe Question Analysis

Report



37/109


+ Link to individual student

performance

3737






38/109

Educator Reports – Score Trends by Institution

View score trends for:

+ A State, District orSchool

+ Each assessment

administered

+ 2-5 administrations orcohorts

+ Each grade

3838


39/109

Educator Reports – Score Trends by Institution

39

Screenshot

coming soon!

+ View mean score trend

comparisons: School,

District, State, Nation

+ View score trends for

- Districts/schools in a state

- Schools in a District

- A School

+ Drill-thru to lower levels in

the reporting hierarchy

+ Filter by demographics such

as Race/Ethnicity and Sex

39


40/109

Educator Reports – Score Trends by Demographics

View score trends for:

+ A State, District orSchool

+ Each assessment

administered

+ 2-5 administrations orcohorts

+ Each grade

4040


41/109

Educator Reports – Score Trends by Demographics

41

+ View mean score trends

by demographics

- Up to two demographic

levels available


such as Race/Ethnicity andSex

Screenshot

coming soon!

41


42/109

SAT SCHOOL DAY MONITORING

Section 2

42

SAT School Day


43/109

SAT School Day

Monitoring-School Visits

• Identified High Schools/Test Centers will be visited on April 12 – First year for state accountability – DOE monitors will be announced prior to visit

– College Board staff will also be part of the school visits

• Protocol for observations

– Monitors will receive training prior to visiting – Security, administration, and testing environment protocol

will be observed

• Monitoring Summary for DOE and College Board

– Survey will inform potential improvements for future administrations – Feedback process

43


44/109

SMARTER MONITORING

44


45/109

Smarter Tests Monitoring School Visits

• Elementary & middle schools will be visited during testing

– DOE monitor(s) will be announced prior to visit – Annual process with rotation of districts

• Protocol for observations

– Monitors will receive training prior to visiting

– Security, administration, and testing environment protocol will beobserved

– Possible interviews of teachers, students, & administrators

• Monitoring Summary for DOE and Districts

– Monitors will complete a follow-up survey to help inform possible

improvements for future administrations

– Feedback will be given to schools

45


46/109

SAT ACCESSIBILITY

Section 3


47/109

College Reportable Scores

• Deadline for initial request: Feb. 24• Must be approved by College Board (CB)

• Additional documentation sometimes required

• CB will send scores to a college if the student hasrequested they be sent

• Scores will be used for accountability this year

• If not approved, school should call the CB hotlineand submit appeal – (844) 255-7728

• School should do everything possible to avoidusing State Allowed Accommodation for a collegereportable accommodation – SAA is not college reportable

47

Delaware State Allowed Accommodations


48/109

Delaware State Allowed Accommodations

College Non-Reportable Scores

• College non-reportable score due to:

– Accommodation determined to change construct (meaning) of SAT – Accommodation used by a student who did not have sufficient

supporting documentation to receive an approval

– Accommodation used on Delaware Specific Non-CollegeReportable list

• Deadline: March 28

• CB must be informed (automatically approved)

• Documentation is not required

• Scores will be used for accountability but will not be reported tocollege

• Parent Score Report and School Score Report will indicate thescore is not reportable to a college

• If student wants College Reportable scores, he/she may re-takethe SAT using College Reportable accommodations in future

• If student requests to send to a college, CB will not send thescores

48


49/109

SAT Accommodations Request Process

DTC Monthly Meeting March 16, 2016 49

C t t C ll B d


50/109

Contact College Board

Coordinator Hotline(help with submitting approvals or checking approval status) FAX: (866) 360-0114

By Phone: (212) 713-8333 or (844) 255-7728 (Coordinator Hotline)

By Email: [email protected]

Students and Parents(registration, online account questions) By Phone: 212-713-8333

Delaware Department of Education Website(Accommodations) http://www.doe.k12.de.us/Page/2718

50

http://www.doe.k12.de.us/Page/2718http://www.doe.k12.de.us/Page/2718http://www.doe.k12.de.us/Page/2718http://www.doe.k12.de.us/Page/2718


51/109

SMARTER SCORING WINDOWS

Section 4

S t A t P li i S


52/109

Smarter Assessment Preliminary Scores

• Score reports for parents and schools will arrive by mail in July

• Preliminary online scores will be available earlier according to the following

scoring windows:

52

If Computerized Adaptive Test(CAT) and Performance Task (PT)

for a content area are completed

by this date:

The score wil l be available in theOnline Reporting System (DeSSA

Portal) by this date:

O li R ti S t (ORS)


53/109

Online Reporting System (ORS)


54/109

TECHNICAL ASSISTANCE

REMINDERS

Section 5

Connecting Interim Results with


55/109

Connecting Interim Results with

Digital Library Resources

55

• Smarter received requests from teachers to connectstudent results on interim assessment blocks to

resources in the Digital Library

• Smarter staff developed the first iteration of these

resources. Feedback was requested before continuing

development on a more robust set of resources for the

interim assessment blocks

• Based on survey feedback, SBAC will compile the

survey data and develop additional resources

S l I t i A t Bl k R

http://smarterbalanced.us11.list-manage2.com/track/click?u=180c5db840df3e34c7063101f&id=b877ad7fd0&e=938ba52224http://smarterbalanced.us11.list-manage2.com/track/click?u=180c5db840df3e34c7063101f&id=b877ad7fd0&e=938ba52224


56/109

Sample Interim Assessment Block Resources

56

S l I t i A t Bl k R


57/109

Sample Interim Assessment Block Resources

57

A t S t R


58/109

Access to Smarter Resources

• AVA Access – DeSSA Entry Training is a prerequisite (PDMS #24246)

– Smarter Interim Training is also required (PDMS # 24288)

• Digital Library Access – Different account than IMS

– When locked out of existing account, contact

DeSSA Help Desk – If you need a new account, contact your ISO at the

school or district

58


59/109

TRAINING UPDATES

Section 6

Ne Training A ailable


60/109

New Training Available

• SysAid Online Training

– PDMS # TBD – Not required

– Audience: DTCs and anyone else with administrative license for SysAid

– Purpose: How to submit and monitor SysAid tickets

• Accessibility Coordinator Training – PDMS #24483

– Not required

– Audience:• IEP, 504, ELL, Gen Ed/Supports Coordinators

• Others who need/want the information

– Purpose: Selection and use of accommodations

• School Day SAT Attendance Tool Training – PDMS #24741

– Not required

– Audience: SAT test coordinators, school pupil accounting coordinators

– Purpose: How to use the SAT Attendance tool in eSchoolPLUS

60

DeSSA Entry Training


61/109

DeSSA Entry Training

• Reminder about DeSSA Entry Training – Course #24246 – Completion required to gain access to the TA

Interface

– TAs must take it in addition to test to beadministered

• Smarter Summative TA training

• DCAS EOC TA Training

• Smarter Interim TA Training

– Wait 24-48 hours before logging in to launch• TA Interface• AVA

• Proctored Practice Tests

61

How to Access Training


62/109

How to Access Training

• Make sure users know how and where toregister for and take DeSSA training

• Register in PDMS

• Follow the link in PDMS course record toSchoology

62


63/109

SYSAID TRAINING

Section 7

What is SysAid?


64/109

What is SysAid?

• Web-based application• Originally designed as a system to manage

Information Technology requests for assistance

• Similar software packages are used by call

centers to document customer service calls• SysAid adapted for use by Office of Assessment to

manage requests for assistance regardingstatewide assessment

– Administrative need to track• Timeliness of responses to districts

• Number of requests from districts

• Types of requests from districts

Who Uses SysAid?


65/109

Who Uses SysAid?

• DOE Office of Assessment – “Statewide Assessment” tickets are routed to Office of Assessment

• District Test Coordinators

– Have full administrative licenses – https://SysAid.doe.k12.de.us/EndUserPortal.jsp ORhttps://SysAid.doe.k12.de.us/Login.jsp

• All IMS users

– All users of IMS can log in at the “End User Portal”and submit tickets, receive updates

• https://SysAid.doe.k12.de.us/EndUserPortal.jsp

– They do not have the full functionality that DTCs have

Log in to SysAid

https://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/Login.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/Login.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsp


66/109

Log in to SysAid

• District Test Coordinator logs in:https://SysAid.doe.k12.de.us/EndUserPortal.jsp

OR https://SysAid.doe.k12.de.us/Login.jsp

– Use IMS username/password

Submit a SysAid Ticket

https://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsphttps://sysaid.doe.k12.de.us/Login.jsphttps://sysaid.doe.k12.de.us/Login.jsphttps://sysaid.doe.k12.de.us/Login.jsphttps://sysaid.doe.k12.de.us/EndUserPortal.jsp


67/109


• District Test Coordinator clicks “submit anincident”:



68/109


• District Test Coordinator enters informationinto a ticket – somewhat like an email:



69/109


MUST choose “statewide assessment”

Describe ticket briefly (like emailsubject)

Describe ticket in more detail

Attach related documents

Select an assessment (if applicable)

Select a security level

Submit

Email Updates From SysAid


70/109

Email Updates From SysAid

• Received by Submituser, Request user, and Assigned to user

• When:

– ticket is initiated – ticket status changes

– notes are added

– ticket is assigned toanother user

– DOE wants to send youinformation, On theRecord

How is the Ticket Handled?


71/109

How is the Ticket Handled?

• DOE/Assessment SysAid Administrator (Helen)receives the ticket – Administrator receives an email notifying that the

ticket is in queue

– Administrator logs in and views the queue

– Administrator opens ticket – The ticket is like a file folder – a repository of all

information about the issue

– “Submit user” and “Request user”• usually the same person

• receives email updates on the progress of the ticket – Advantages:

• No need to track multiple emails about the ticket - allinformation is entered

• Tickets are monitored/tracked to ensure timely response

View Your Service History


72/109


• Check on your tickets, edit tickets



73/109


• Review tickets• DTC checks status of tickets, modifies

tickets, selects, prints & exports tickets

– Click on a ticket



74/109


• Review tickets• DTC checks status of tickets, modifies

tickets, selects, prints & exports tickets

– Click on a ticket



75/109


75

View or Edit a Ticket AFTER Submission


76/109

View or Edit a Ticket AFTER Submission

DOE notes and your notes

appear here


77/109

Reporting Accommodations Changes


78/109

(After Item 5)

Security Accoms Change:

More than 5 Items

Accommodations Change at item 7

Student alerted the TA at item 7 that he did not have TTS Items. Student: Bob Jones ID 999999, sch

555 dist 66.

Math CAT

Irregularity

Busytown

Knowledge Base


79/109

Knowledge Base

Knowledge Base


80/109

Knowledge Base

Knowledge Base


81/109

Knowledge Base

Knowledge Base


82/109

Knowledge Base

82

If you have any questions


83/109

If you have any questions . . .

• If you find that there is functionalitydescribed in this presentation that you

think you do not have or you have

questions contact Helen Dennis

– [email protected]

– 302-857-3316

83

mailto:[email protected]:[email protected]:[email protected]


84/109

TEST RESET AND REOPEN POLICY

Section 8

Test Reset and Reopen Policy


85/109

Test Reset and Reopen Policy

• Smarter introduced new, stricter policy in2015

– Now applies to DCAS and EOC also

• The following slides provide detail• This information is posted in the

Accessibility Coordinator training due to its

impact on accommodated testadministrations

• District must submit requests via SysAid

85

Reset and Reopen Definitions


86/109

Reset and Reopen Definitions

• Reset – Erases a student’s test attempt and allows

student to begin a new attempt

– If test is requested to be reset by mistake, AIR

can un-reset, but it takes some time

• Reopen

– Allows student to continue working on a test

despite its having been expired or evenreported

86

Test Reset Requests 1


87/109

Test Reset Requests 1

87

If this . . . . DO this . . . . Security Level

Reset Requests:

If any of the following settings

need to be changed because

they were incorrectly set on a

CAT or PT:

• American Sign Language

• Braille

•

Closed captioning• Translation-stacked

(Spanish) Permissive Mode

• Translations (Glossaries)

Change to accommodations/

supports on a CAT whenstudent has been presented

with five items or fewer.

Request a reset in SysAid and

choose “irregularity” from the

security level drop-down.

These settings cannot be changed

while a student’s test is paused. Areset is necessary to change these

settings after a test is launched.

Pause student test. Change

accoms/supports. Re-launch

student test. Do not request a

reset.

Irregularity

No need to submit.

Security level: “None.”


88/109

Test Reopen Requests 1


89/109


89

If this . . . . DO this . . . . Security

Level

Reopen Requests A student is unable to complete a CAT or PT

test due to a technological difficulty that

results in the expiration of the test.

A student is unable to complete a CAT testbefore it expires (45 days) due to an

unanticipated excused absence (e.g. illness

documented by a medical professional) orunanticipated school closure.

If a student is unable to complete a PT testbefore it expires (10 calendar days) due to an

unanticipated excused absence or

unanticipated school closure.

Submit an incident report in

SysAid to request a reopen.

Choose “irregularity” from

security drop-down.

Submit an incident report inSysAid to request a reopen.


security drop-down.

Submit an incident report inSysAid to request reopen.Choose “irregularity” from

security drop-down.

Irregularity

Irregularity

Irregularity



90/109


90

If this . . . . DO this . . . . Security Level

Reopen Requests

If a student starts a PT

unintentionally—for example,

selects a PT instead of a CAT or

selects a mathematics PT instead

of an ELA PT—and the student is

unable to complete the test

before it expires (10 calendar

days).

A student unintentionally submitsa PT test before he or she has

completed it—for example, a

student submits the ELA PT

before completing part 2.

Submit an incident report in

SysAid to request a reopen.


security drop-down.

Submit an incident report to

request a reopen, but choose

“none” from security drop-

down.

Irregularity

Irregularity

Other Types of Requests


91/109

O e ypes o eques s

• Grace Period Extension – Removes the effect of the 20-minute pause

rule

– Allows students to access items previously

entered despite a pause of 20 minutes or

more since those items were answered

• Segment Permeability

– Removes the rule preventing the student fromreturning to previous sections of the test

91


92/109

SCHOOL DAY SAT ATTENDANCE

TOOL

Section 9

Objectives


93/109

Objectives

• Learn to use the School Day SAT Attendance Tool in eSchoolPLUS and

Cognos

Intended Audience


94/109

• Test Center Coordinators• District/School Test Coordinators

• eSchoolPLUS/Pupil Accounting

Coordinators

94

SAT Attendance Tool


95/109

• Optional tool totrack attendance

• eSchoolPLUS AccountabilityScreen Flags – School Year School

Day SAT

– Pre-registered forSchool Day SAT

Y/N – Attended SchoolDay SAT Y/N

95

Overview


96/109

1. The day before initial administration:• Download a School Day SAT roster from

eSchoolPLUS/Cognos in Excel format

2. After test administration:• Update the “Attended” field for each student in the

roster in Excel and use Y for Yes for each studentthat attended

3. Upload the “Attended” field flags to eSchoolPLUS

4. Download a new roster the day before make-uptest to reflect enrollment changes

5. Take attendance on make-up day6. Upload the “Attended” field flags to eSchoolPLUS

96

Before Test: Download Roster of

St d t Wh R i d t T t


97/109

Students Who are Required to Test

97

To generate the roster:1. Login to IMS

2. Select eSchoolPLUS

3. Click on “Cognos Reporting”4. Select “Standard DOE Public Folders

Shortcut”

5. Select “Standard DOE Public Reports”

6. Select “DeSSA Reports”

7. Select “SAT School Day Attendance”

After Test: Update the “ Attended” Fieldsin Roster


98/109

in Roster

98

Upload the Roster to eSchool


99/109

p

1. Save the roster file as a text file called SATAT.txt.

Delete all columns except student ID and Y indicatorand re-save

2. Login into eSchoolPLUS and select “Upload File”from left menu. Upload your file called SATAT.txt.You will see the file on your home screen under

“Reports”3. Go to “Utilities,” “Upload/Download,” “Run Upload”

4. Select the upload called SATAT

5. Set Run Mode to “Run upload,” updating the

database6. Check both “Insert New Records” and “UpdateExisting Records”

99

Upload the Roster to eSchoolPLUS(continued)


100/109

(continued)6. Continued: Your screen should look like this:

7. Select “Run.” The upload will show up on your home screenunder “Tasks: Schedule”. In a minute or two, it will move to“Tasks: Current.” When it is complete, you will see a newInterface Upload Log under Reports

100

Make Up Day Upload


101/109

p y p

101


102/109


103/109

Contact the Office of Assessment

(302) 857-3391

[email protected]

Please e-mail any additional questions or comments

103

mailto:[email protected]:[email protected]:[email protected]


104/109

PLANNING

THE 2016-2017 ASSESSMENT CALENDAR

Section 10

Current Testing Calendar 2015-2016


105/109

105

Input Needed for Developing DRAFT2016-2017 Testing Calendar


106/109

2016-2017 Testing Calendar

This is a draft based on this year’s wind ows.

• Please discuss and bring feedback to the March DTC meeting.

106


107/109

DESSA SCORE REPORTS

PROVIDING ADDITIONAL INFORMATION

Section 11

Updated Mock-Ups


108/109

DTC Monthly Meeting March 16, 2016 108

DTC Questions


109/109

DTC Face-To-Face March 2016

Documents