1/36 CRESST/UCLA QSP Margaret Heritage CRESST/UCLA July 18, 2003 The Quality School Portfolio.

1/36CRESST/UCLA

QSPMargaret Heritage

CRESST/UCLA

July 18, 2003

The Quality School Portfolio

2/36CRESST/UCLA

Presentation Overview

• What is the Quality School Portfolio?

• Main Features of QSP

• Main Functions of QSP

• National Rollout of QSP

• Re-purposing QSP

3/36CRESST/UCLA

What is theQuality School Portfolio?

4/36CRESST/UCLA

A Decision Support System

• The Quality School Portfolio (QSP) is a free web-based decision support system currently used for schools and districts

• A powerful new tool to assist in collecting, organizing and making sense of data

• Developed from the desktop stand alone version of QSP

5/36CRESST/UCLA

• Multi-level password protection

• Embedded data backup system

• SSL Encryption Certificate (128-bit)

Maximum data security is a priority with The Portfolio, featuring:

A Secure System

6/36CRESST/UCLA

QSP Users

QSP can be used at many user levels within an organization or system

7/36CRESST/UCLA

Main Features of QSP

8/36CRESST/UCLA

Main Features of QSP

• Longitudinal

• Data are stored as Variables

• Groups from Variables for disaggregation

• Goals based on Group outcomes or background information

• Analysis based on any indicators

• 22 different Graphic Reporting options

• Digital archive of performance assessments

9/36CRESST/UCLA

Main Functions of QSP

10/36CRESST/UCLA

Groups Tab - for disaggregation

Reports Tab - for displaying information graphically

Goals Tab - for monitoring improvement targets

Gradebook Tab - for monitoring student progress

Students Tab - for examples of student work

Resource Kit – for assessment building

The Main Functions of QSP

11/36CRESST/UCLA

Groups Tab

12/36CRESST/UCLA

• Unit

• Training program

• Length of service

• Rank

• Job classification

Create Groups of trainees based on:

Groups Tab

13/36CRESST/UCLA

Reports Tab

14/36CRESST/UCLA

Bar Chart

Results from a school level

reading assessment

Results of a training

exercise

15/36CRESST/UCLA

Floating Bar Chart

Percentage of 9th graders

above or below proficiency

Percentage of Sailors

meeting a standard

16/36CRESST/UCLA

Multi-Level Floating Bar Chart

Performance of male vs female

students

Performance of male vs female

Sailors

17/36CRESST/UCLA

Slice Bar Chart

Performance of a student in

relation to his/her peers in the school

Performance of a Sailor in relation to

his/her peers in the unit

18/36CRESST/UCLA

Pie Chart

Ethnic distribution of

the low performers in

8th grade

Ethnic distribution of

low performers in a unit

19/36CRESST/UCLA

Relational Report

Students’ scores relative

to teachers’ professional

development and parental involvement

Trainees’ scores relative

to trainers’ experience and

unit commander’s length of service

20/36CRESST/UCLA

T-test

Question:Do female students

score higher on a test than male

students?

Question:Do female Sailors

score higher on an exercise than male

sailors?

21/36CRESST/UCLA

Cross-Sectional

Performance of all the

students at each testing

period

Performance of all the Sailors at each training

section

22/36CRESST/UCLA

Longitudinal

Performance of the same

students who took the same test four times

Performance of the same Sailors

who took the same training four

times

23/36CRESST/UCLA

Goals Tab

24/36CRESST/UCLA

Goals in QSP

25/36CRESST/UCLA

Monitoring Goals in QSP

Monitor each Target against the timeline

Goal:

100% of Marines will acquire expert rating in Marksmanship

Targets:

•Prone position 55 yds. slow fire- 100% accuracy

•BZO performance - 100% accuracy

26/36CRESST/UCLA

Goal Targets

See those trainees who

have either achieved or missed the

Target

27/36CRESST/UCLA

Gradebook

28/36CRESST/UCLA

Standards Gradebook

29/36CRESST/UCLA

Digital Portfolio

See student work, assessments and

exemplars

Examples: Video of a trainee’s performance

Scanned images of report writing

30/36CRESST/UCLA

National Rollout of QSP

31/36CRESST/UCLA

QSP Rollout States

QSP

QSP Web States

32/36CRESST/UCLA

Re-purposing QSP

33/36CRESST/UCLA

Modules

Unit of analysis: One training session

• Import trainees’ information

• Make a series of Goals to be achieved

• Build templates for easy data import and entry

• Create a series of Reports - individual and Group based

• Analyze information on educational and statistical bases

34/36CRESST/UCLA

Modules

Pre-define all procedures for a session

• Tests, exercises and physical standards

• Data entry process (trainer’s Gradebook, PDA)

• Standards for pass/fail

• Progress Reports - (trainee sets and monitors Goals)

• Graphical Report types

• Data format (for correct import and export)

35/36CRESST/UCLA

©2003 Regents of the University of California