UTIPS Core Roll-Out Fall, 2011 Julie Quinn, Data and Delivery Coordinator Assessment and Accountability Utah State Office of Education.

UTIPS Core Roll-Out

Fall, 2011

Julie Quinn, Data and Delivery Coordinator

Assessment and Accountability

Utah State Office of Education

Fall, 2011 Utah State Office of Education

2

3

Overview• Web-based, using HTML 5 Browsers

– Safari, Firefox 4, Google Chrome– Internet Explorer (IE) 9 with Chrome plug-in

(not preferred)– IE 10 will be supported 2012

• Servers housed at UEN

Fall, 2011 Utah State Office of Education

Development Philosophy

• Maintain UTIPS assessment functionality– If the feature exists in MyUEN, use MyUEN

• Design intended to reduce training hours– Focus on creating quality assessments and

using data to improve student learning

• Flexibility for standards and item pool

• Improved reports and data access (coming soon)

Fall, 2011 Utah State Office of Education

4

Common Core

• Common Core State Standards (CCSS)– Math is now in UTIPS Core– ELA (coming soon)

• Math CCSS item alignment now available• New math items written for CCSS (coming

soon)

• Educators may align their own items to CCSS and/or other Utah State Standards

Fall, 2011 Utah State Office of Education

5

Support

• Training issues/requests as well as item quality or alignment issues

– [email protected] – Emails may be forwarded to LEA trainers

• USOE directly supports LEA trainers

Fall, 2011 Utah State Office of Education

6

UTIPS Core Access

• Each school district has a unique URL – http://districtname.utips.org– Examples:

http://iron.utips.org; http://charter.utips.org

• All users must have an account– Educators AND students– Enrollment Codes place users into

organizations

Fall, 2011 Utah State Office of Education

7

User Structure• Educators

– Unique username and password are selected– CACTUS validation option– After account creation, folders and tests from

the old UTIPS system may be imported

• Students– Username is Student’s LEA ID

• Chaters use LEA ID + Students’s ID (e.g., 4G123)

– Password is selected

Fall, 2011 Utah State Office of Education

8

Creating Accounts

• A user is invited to join an organization by being provided with a Enrollment Code– Examples: schools, classes, groups of teachers– Multiple Enrollment Codes may be used per account

• Enrollment codes – assign roles and organizations– are created from within an educator’s account– are time limited

Fall, 2011 Utah State Office of Education

9

Sharing Assessments

• Educators may share assessments by adding others as participants– The test owner selects users to be added as

participants for individual tests– A sub-organization may be created (e.g., CTE

IT, Piute Math Teachers), educators are invited with a passcode

Fall, 2011 Utah State Office of Education

10

Fall, 2011 Utah State Office of Education

11

Predict CRT Scores?

Blueprint tests and item pool questions

are NOT designed

to predict a student’s performance

on a CRT.

UTIPS is a screening tool.

12

Flexibility

Educators can build assessments using

1. The USOE item pool,• Blueprint tests (CCSS later)• Individual items by content standards

2. Their own items,

or…

A combination of both.

Fall, 2011 Utah State Office of Education

UTIPS Flexibility

• Media can be attached to questions– Images– URLs– Documents (coming soon)– Spreadsheets (coming soon)– Presentations (coming soon)– Audio files (coming soon)

Fall, 2011 Utah State Office of Education

13

14

A Formative Tool• Formative assessment meta analysis:

Black & Wiliam (1998)1

• Information to be used by teachers and students as feedback, to modify teaching and learning activities

Fall, 2011 Utah State Office of Education

Elements Of anAssessment Event

1. Is the assessment high-quality?

2. Do teachers have access to the data?

3. Do teachers use the data?

4. Do students have access to the data?

5. Do students use the data?

Fall, 2011 Utah State Office of Education

15

16Fall, 2011 Utah State Office of Education

Fall, 2011 Utah State Office of Education

17

A “Good School”

“…a good school is not a collection of good teachers working independently, but a

team of skilled educators working together to implement a coherent instructional plan,

to identify the learning needs of every student, and to meet those needs” (Boudett, City, & Murnane, 2006).

Ask Questions“Data analysis supports a culture of

improvement by building the habit of inquiry in which you constantly ask questions and find answers not in your preconceived judgments of children, but in observable data. Therefore, it is critical to invest the time and effort needed to identify a meaningful problem that becomes the focus of the improvement process” (Boudett, City, & Murnane, 2006).

Fall, 2011 Utah State Office of Education

18

UTIPS Core Reports

Reports are only as good as the items that are used on the test:

• Do the items reflect the instruction that was presented?

• Are there enough questions asked for each objective to have confidence in the report?

• Are the items accurately aligned to the curriculum?

Fall, 2011 Utah State Office of Education

19

20

Student Feedback

Fall, 2011 Utah State Office of Education

21

UTIPS Reports

• Student Summary

• Score Distribution– % of students reaching performance targets

• Item Performance– # of students getting each question right

• Individual student mastery– By standard and/or objective

Fall, 2011 Utah State Office of Education

Report: Student Summary

Fall, 2011 Utah State Office of Education

22

23

Report: Score Distribution

Fall, 2011 Utah State Office of Education

24

Report: Item Performance

Fall, 2011 Utah State Office of Education

25

Report: Standards Mastery

Fall, 2011 Utah State Office of Education

26

Report: Objectives Mastery

Fall, 2011 Utah State Office of Education

Report: Common Core

Fall, 2011 Utah State Office of Education

27