Building Formative Assessments Using Quiz Builder · Building Formative Assessments Using Quiz Builder . Kerridan A. Kawecki, B.A. Margaret A. Johnson, ... Building Formative Assessments
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
“Galileo” and the Galileo logos are trademarks or registered trademarks of Assessment Technology, Incorporated. All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information
storage and retrieval system, without permission from the publisher. Printed in the U.S.A.
What is Quiz Builder? .................................................................................. 1 Community Assessment and Item Banking (CAIB) Initiative Test Items ............. 5
System Requirements ................................................................................. 5
Determine How to Use and Share Quizzes .................................................. 5 Class-level User .......................................................................................... 5 School-level User ........................................................................................ 5 District-level User ........................................................................................ 7
Quizzes via the Aggregate Multi-Test with Risk Levels Report .................. 52 Purpose ................................................................................................... 52 Access ..................................................................................................... 53 Report Interpretation ................................................................................. 53 Generate Report........................................................................................ 54
Schedule a Quiz for an Intervention Group ............................................... 62 Scheduling Impacts Reports ....................................................................... 62 Scanning Impacts Reports .......................................................................... 63 Bulk Scheduler .......................................................................................... 63 Schedule .................................................................................................. 63
View, Edit, and Delete a Scheduled Quiz ................................................... 68 View a Test Schedule ................................................................................. 69 Edit a Test Schedule .................................................................................. 71 Delete a Test Schedule .............................................................................. 72
View Scheduled Events for an Intervention Group .................................... 73
Students Take a Quiz ................................................................................ 75 Online Testing ........................................................................................... 75 Offline Testing .......................................................................................... 79
User-Defined Intervention Group .............................................................. 80 Access Intervention Groups Page ................................................................ 81 Create a Group ......................................................................................... 82 Create a Composite Set ............................................................................. 84 View an Intervention Group ........................................................................ 84 Edit an Intervention Group ......................................................................... 85 Delete an Intervention Group ...................................................................... 86
COMMUNITY ASSESSMENT AND ITEM BANKING (CAIB) INITIATIVE
TEST ITEMS ATI offers the Community Assessment and Item Banking (CAIB) Initiative allowing districts/charter schools to create valid, reliable, and fair items and assessments for use in evaluating student capabilities in areas not tested on the statewide
assessment. Participating districts/charter schools are provided access to a continually growing repository of shared, district-written, high-quality items, and
customized assessments in areas not currently addressed on statewide tests. To learn more about the initiative, please contact ATI’s Professional Development department ([email protected] or 800.367.4762).
SYSTEM REQUIREMENTS
Before you begin using Galileo’s Quiz Builder tool, you want to make sure that your
computer meets the system requirements. The system requirements can be found at http://www.ati-online.com/GalileoK12/K12TrainingSystem.html.
DETERMINE HOW TO USE AND SHARE QUIZZES
Before you begin using Quiz Builder you will want to determine how you wish to use the quiz. Galileo allows users to create content for themselves while also allowing a variety of sharing options.
CLASS-LEVEL USER “I am a Class-level user and intend to create a quiz for Intervention Groups
made up of students enrolled in my class(es) or for one of my classes.”
You are all set! Go ahead and start scheduling quizzes for Intervention Groups for your classes.
SCHOOL-LEVEL USER “I am a School-level user creating a quiz for one class/user.”
You are all set. Go ahead and start building your quiz in that class library. The Intervention Group is placed in the user’s Intervention Group library.
“I am a School-level user creating a quiz for many or all classes/users at my
school. Users may schedule and/or view the quiz questions.” You will need to create school libraries in which to save this quiz. The test library permission is Read-Only. You may need to create an Intervention
Group Library. Once this is done, you may build the quiz and all specified classes and users will have access to this quiz.
ATI does not recommend providing teachers with “Read-Only” or
“Write” permission to the Intervention Group Library, because teachers will then see data on other students.
The directions are explained in the Build a Library section, page 8.
“I am a School-level user creating a quiz for many or all classes/users at my school. The users will not be scheduling and/or viewing the quiz questions.” You will need to create school libraries in which to save this quiz. The Test
Library permission is Results Only. You may need to create an Intervention Group Library. Once this is done, you may build the quiz and all specified
classes and/or users will have restricted access to this quiz.
ATI recommends that you provide teachers “Read-Only”
permission to the Test Library so they can see reports. We do not recommend providing teachers with “Read-Only” or “Write”
permission to the Intervention Group Library, because teachers will then see data on other students.
The directions are explained in the Build a Library section, page 8.
“I am a School-level user creating a quiz for many or all classes/users at my
school. The users may add additional quizzes, schedule and/or view the quiz
questions.” You will need to create school libraries in which to save this quiz. The Test
Library permission is Read-Only. You may need to create an Intervention Group Library. Once this is done, you may build the quiz and all specified classes and/or users will have access to this quiz.
ATI recommends that you provide teachers “Read-Only”
permission to the Test Library so they can see reports. We do not recommend providing teachers with “Read-Only” or “Write” permission to the Intervention Group Library, because teachers
will then see data on other students.
The directions are explained in the Build a Library section, page 8.
DISTRICT-LEVEL USER “I am District-level user creating a quiz for one class/user.”
You are all set. Go ahead and start building your quiz in that class library.
The Intervention Group is placed in the user’s Intervention Group library.
“I am a District-level user creating a quiz for many or all schools, classes,
users in my district/charter school. Users may schedule and/or view the test questions.”
You will need to create district libraries in which to save this quiz. The Test Library permission is Read-Only. You may need to create an Intervention Group Library. Once this is done, you may build the quiz and all specified
schools, classes and/or users will have access to this quiz.
ATI recommends that you provide teachers “Read-Only” or “Write” permission to the Assignment/Test Library so they can see reports. We do not recommend providing teachers with “Read-Only” or
“Write” permission to the Intervention Group Library, because teachers will then see data on other students.
The directions are explained in the Build a Library section,
page 8.
“I am a District-level user creating a quiz for many or all schools, classes, users at my school. The users will not be scheduling and/or viewing the quiz questions.”
You will need to create district libraries in which to save this quiz. The Test Library permission is Results-Only. You may need to create an Intervention
Group Library. Once this is done, you may build the quiz and all specified schools, classes and/or users will have restricted access to this quiz.
ATI recommends that you provide teachers “Read-Only” permission to the Test Library so they can see reports. We do not recommend
providing teachers with “Read-Only” or “Write” permission to the Intervention Group Library, because teachers will then see data on other students.
The directions are explained in the Build a Library section, page 8.
For additional information on test library permissions, please refer to
ATI’s white paper “Developing District Test Security Protocols” found on the Galileo K-12 Online Publications’ page, http://www.ati-online.com/galileoK12/K12Research.html.
In addition to the Quiz Builder tools, educators can schedule assignments (e.g.,
Instructional Dialogs, KHAN Academy®, and LearnZillion) to their class or to an intervention group. Please refer to the Using Galileo’s Intervention Tools manual or
the online help files for further details about utilizing the Quiz Builder tool with Intervention Groups.
BUILD A LIBRARY
ABOUT LIBRARY BUILDER In Galileo Online, a library is best thought of as an electronic filing cabinet. This technology will allow you to replace the big, metal filing cabinets at the back of
your classroom or office. Once these items are created and stored in the libraries, they may be accessed, edited or printed anytime at the click of a mouse.
Libraries are automatically created for Class-level users. These libraries will be labeled with the first and last name of the user:
Sarah Bellum-Test
Sarah Bellum-Intervention Group
The:
Class-level user’s library allows that user to create and save intervention
groups and quizzes. They may also schedule quizzes for the intervention groups they have created.
District- and School-level users may create and save intervention groups, tests in Class-level user’s libraries.
District- and School-level users who would like to create intervention groups and or quizzes will first need to create a library. There a few things to keep in mind when
creating these:
You may provide other users with Read-Only and/or Write permission to your library if you wish others to be able to access this data.
Provide lower-level users Read-Only or Write permission to the Test library. They will be able to run reports on the tests and quizzes if any of their
students were in the intervention group.
Do not provide lower-level user Read-Only or Write permission to the
Intervention Group library. Doing so will allow them to see results not just of their students in the Intervention Group, but the results of all students in the group.
Tests Library with a Results Only permission provides all the specified
schools, classes and/or users restricted access to the test. Users will not be able to schedule and/or view the test questions and they are restricted on report details.
Refer to the Determine How to Use and Share Quizzes section, page 5, for additional information.
The Library Builder tool provides users with a variety of ways to share the content housed in libraries. Below are directions for setting up a basic library.
For more information on creating libraries with sharing capabilities, please visit the Galileo Forum, online help, or contact your ATI Field
1. If necessary, use the down arrow on the School drop-down menu to select the school in which the library will reside, be modified, or be deleted.
2. If necessary, use the down arrow on the Class drop-down menu to select the class in which the library will reside, be modified, or be deleted.
3. Use the down arrow on the Library Type drop-down menu to select your
library type.
Quiz Builder tools generally require users to select Test and/or Intervention Group as the type.
CREATE A LIBRARY 1. Access the Library Builder page. Refer to the Access Library Builder Page
section, page 9, for instructions.
2. Click the New library link.
3. You will be brought to a 3-tabbed set-up process. The books icon in the upper right-hand corner will bring you back to the Library Builder home page.
NAME AND YEAR TAB
4. Type in the name of your Library.
5. Determine if you would like this library available for All Years or just the
Current Year Only.
Most educators select the “All Years” option. This allows them to administer the same tests over multiple school years.
d. User: All the schools in your district/charter school will appear, with
the users therein beneath them. Click in the checkbox next to the school and that school's specific user(s) to whom you would like to
assign this library.
STEP 3 – PERMISSION LEVEL 10.Click the radio button for the desired Set Permission Level. Users with:
a. Read-Only permission will only be able to view the contents of the library and will need to make a copy of the contents to their own
libraries to edit them.
b. Write permission can edit the contents of the library and all other
users with permissions to that library will see and be affected by the changes.
c. Results Only prevents Class- and School-level users from seeing the test items and scheduling a test. Users cannot access details of certain
reports, generate a test booklet or print answer key pages. This permission is generally used with an Instructional Effectiveness (IE) test library. This permission is only available in the Test library.
11.If creating a District- or School-level access library, determine which Users you would like to have access to this library. Click in the desired radio
button. You may select:
a. Access Level Only to assign this library to those users who have the
same user level as the library access assignment you selected. For example, if the Access Level was School as selected in step #9 and
this Users’ radio button is selected, then all School-level users for the selected school(s) have permission to this library.
b. All Users to assign this library to all users at and below the selected level in the district/school. For example, if the Access Level was
School as selected in step #9 and this Users’ radio button is selected, then all Galileo users for the selected school(s) have permission to this library.
12.Click the Save and Next button. You will automatically be brought to the Summary tab.
SUMMARY TAB 13.The Summary tab displays the school years, schools, classes, and users this
library has been made available for. The creator of the library will always have Write permission to the library and is automatically listed under Users.
14.When you have finished creating the library, click the Library Builder home icon to return to the Library Builder page.
You may repeat the previous steps for new libraries, or to create different access permissions to the same library for different schools and classes. For example, you
may want to give Class-level users Read-Only permission to a library, but give other District-level users Write permission to the same library.
VIEW A LIBRARY 1. Access the Library Builder page. Refer to the Access Library Builder Page
section, page 9, for instructions.
2. Click the binoculars icon on the index list next to the desired library.
SETTINGS: LIBRARY TAB Galileo will assign users default libraries when they use Galileo. Once default libraries are set, a user will no longer see Library drop-down options when
scheduling an assignment (e.g., an Instructional Dialog).
Here are a few things to keep in mind about default libraries:
If you are a Class-level user and wish to save content and groups in the Galileo-created libraries you’re all set. The Galileo-created libraries are
already set as your defaults.
If you are a Class-level user and wish to save content and groups in user-
created libraries, you will need to follow the instructions in the Change Default Libraries section, page 18, to change your default libraries.
If you are a School- or District-level user, the first time you schedule Assignments/Dialogs for an Intervention Group, whichever libraries you
initially select will now be set as your default libraries. The next time you go to schedule an Assignment/Dialog it will be saved to these default libraries. If
you wish to change your default libraries you will need to follow the instructions in the Change Default Libraries section, page 18.
DEFAULT LIBRARIES Regardless of where you are in Galileo, you always have access to the Settings
On the Settings page is a series of tabs, including the Libraries tab.
CHANGE DEFAULT LIBRARIES The Libraries tab allows you to select to which libraries you would like Galileo to “default.” Once selected, these libraries will automatically be used during
scheduling.
1. Click the Settings icon.
2. Click the Libraries tab.
3. Select the Dialog, Test, and Intervention Group library from the drop-
down menu.
4. Click the Save Libraries button.
You can change them at any time simply by repeating these steps.
Galileo’s Quiz Builder tool may be accessed from the:
1. Quiz Builder menu. This page allows the user to create and schedule quizzes for an Intervention Group or for their class. (Refer to the Quiz Builder
Menu section, page 19.)
2. Intervention Alert report. This is an actionable report that allows the user to create and schedule quizzes for an Intervention Group or for the selected class or Intervention Group based on what standard(s) were not mastered.
(Refer to the Quizzes via the Intervention Alert Report section, page 27.)
3. Risk Levels reports:
a. Instruction Performance Tracker report. This is an actionable report
that allows the user to create and schedule quizzes for the selected class based on what risk category the students are identified as being
a part of for a particular performance objective, after benchmark testing. (Refer to the Quizzes via the Instruction Performance Tracker Report section, page 37.)
b. Group Benchmark Profile page. This is an actionable report that allows the user to create and schedule quizzes for an Intervention
Group or for the selected class based on what risk category the students are identified as being a part of after benchmark testing.
(Refer to the Quizzes via the Group Benchmark Profile Page section, page 44.)
c. Aggregate Multi-Test with Risk Levels report. This is an actionable report that allows the user to create and schedule quizzes for an
Intervention Group, or for the selected class(es) or school(s) based on what risk category the students are identified as being a part of after benchmark testing. (Refer to the Quizzes via the Aggregate Multi-Test
with Risk Levels Report section, page 52.)
QUIZ BUILDER MENU
PURPOSE The Quiz Builder menu allows you to create quizzes for a class or for an Intervention Group, rather than creating one when generating an Intervention Alert
or from one of the Risk Level reports. You select the performance objective and Galileo automatically generates up to a 5-item quiz for each of the chosen performance objectives. To do this, the Intervention Group is automatically created
by Galileo or the Intervention Group will already need to be created first.
2. (optional) Use the Library drop-down box to select the library that houses the intervention group for which you would like to create and schedule a quiz.
3. (optional) Use the Intervention Group drop-down box to select the
intervention group for which you would like to create and schedule a quiz.
The Intervention Group Library must have already been created. Refer to the Quizzes via the Intervention Alert Report section, page 27, Quizzes via the Risk Level
Reports section, page 33, or the User-Defined Intervention Group section, page 80, for directions.
4. Any quizzes that have been scheduled for the intervention group will appear. You can see the title, the schedule and the percentage of students who have
completed the quiz.
If a student take the quiz but skips a question, they will not be counted as having completed the quiz.
5. To generate a new quiz, click the Click here to create quiz(zes) link.
6. Select the Subject for which you wish to create a quiz.
7. Select the Knowledge Area for which you would like to build a quiz. All the
objectives linked to the selected Knowledge Area will appear.
8. Place a checkmark by the Performance Objective(s) you’d like to generate
quizzes.
9. Click the Select Objectives button. The selected objective(s) move to the Selected performance objective box on the right.
g. You are automatically brought to the Quizzes tab to continue on. Notice the objective now appears in the Performance Objective box
and is selected for quiz creation.
STEP 1: PICK A LOCATION 14.Use the down arrow on Library drop-down menu to select the quiz library.
If you are scheduling quizzes for a teacher and you would like the teacher to see the results, be sure to save the quiz in a library that the teacher has
Read-Only or Write permission to. More information on default libraries may be found in About Library Builder section, page 8.
STEP 2: PICK A SUBJECT 15.Use the down arrow on the Content Subject drop-down menu to select the
subject.
STEP 3: GENERATE QUIZZES
16.(optional) Place a checkmark in the Include technology enhanced items. Quiz(zes) will only be available online field if Technology Enhanced (TE)
test items are to be included in the quiz.
17.Select the date and times for which you would like to have students take
STEP 4: INTERVENTION GROUP/CLASS 28.Select the scheduling option, by clicking the radio button for:
a. Schedule for class to implement the selected quiz(zes) for the class and then select the Class from the drop-down menu.
b. Schedule for new intervention group to implement the selected quiz(zes) for the new, Galileo-created, intervention group.
i. Click the Intervention group builder page link.
ii. Proceed to the User-Defined Intervention Group section, page 80, for further directions.
c. Schedule for existing intervention group to select an already created Galileo intervention group or a user created intervention group. Select the Library and the Intervention Group from the
drop-down menus. Save this group in a library that the teacher has Read-Only or Write permission to, only if it is okay for the teachers to
access results for all students in the intervention group.
29.(optional) Place a checkmark in the Post student scores on field and enter
the date and time for posting in the K-12 Student-Parent Center.
31.The scheduled quiz now appears on the Teacher Dashboard and Class Calendar pages.2
Quizzes scheduled for intervention groups are noted on the calendar with a “people” icon.
Dashboard page Class Calendar page
ADMINISTER QUIZ Students are now ready to take the quiz. Remember, quizzes are taken online
through the K-12 Student-Parent Center. A quiz can be administered offline; the printed test booklet and answer sheets must be generated.
QUIZZES VIA THE INTERVENTION ALERT REPORT
PURPOSE The Intervention Alert report lists all of the performance objectives on a given assessment and displays the percentage of students who have demonstrated
mastery of the performance objectives. The performance objectives listed that do not have 75 percent of students mastering them, will be highlighted in red. An
educator may then drill down to see the mastery-level attained by each student for each standard tested. This allows the users to easily identify on what standards
2 District- and School-level users have access to the Class Calendar page.
interventions should focus. This is an actionable report that allows for the immediate scheduling of assignments (e.g., Instructional Dialogs, KHAN
Academy®, and/or LearnZillion) or quizzes for those students who have not demonstrated mastery of a standard. When creating and scheduling quizzes from
this report, you will end up with a unique intervention group for each standard.
Please keep in mind the following things:
This report creates intervention groups for students who have not mastered
the performance objectives.
This actionable report will result in an individual intervention group being
created for the selected performance objectives.
This actionable report will result in a quiz being created for each performance
objective.
You may run this report on benchmark assessments and formative assessments, including quizzes.
9. (optional) Click the question number link for the desired performance objective. You may have the option to view the test items associated with a
performance objective.
You must have “Write” or “Read-Only” permission level to the test library in order to view the test item. Users with “Results Only” permission level cannot view the test item; they may see
the test item’s performance objective. Refer to the Build a Library section, page 8, for details.
10.Select the performance objective(s) for which you’d like to generate a
quiz.
For District- and School-level users, you can drill down to the class-level information.
10.Click the Quiz Builder… button to automatically generate a quiz for each
selected performance objective. Additionally the quiz will be scheduled for students.
11.You are brought to the Quiz Builder page. Proceed to the Quiz Builder Menu’s Students section, page 22, for the next steps.
QUIZZES VIA THE RISK LEVEL REPORTS
PURPOSE Using the Risk Level reports allows users to find and schedule an assignment or
quiz from the results of benchmark assessments. Interventions via the risk level can accessed from Instruction Performance Tracker and the Aggregate Multi-Test with Risk Levels reports or from the Group Benchmark Profile page. Each of
these Risk Level reports are actionable and will create intervention groups of students based on their risk-level classification. A teacher may then use these risk-
level groups as a way to organize students into an intervention group.
The risk levels displayed is associated with the total number of benchmark
assessments administered. This table shows the risk level classifications based on the number of benchmark assessments on which the student scored below the cut
score for Proficient (the cut scores that correspond to the passing achievement levels on the state standardized assessment).
# of Benchmark Assessments Taken
# of benchmark scores below the cut score for
Proficient
One Test Two
Tests
Three
Tests
3 High
2 Moderate Moderate
1 Moderate Low Low
0 On Course On Course On Course
ACCESS The Risk Level report may be accessed from:
INSTRUCTION PERFORMANCE TRACKER REPORT The Instruction Performance Tracker report can be accessed from the Teacher and Admin Dashboard page. (Refer to the Quizzes via the Instruction Performance
Once you drill down onto the desired Risk Level, the Group Benchmark Profile
page opens. The Intervention Planning tab displays steps for planning (e.g., Move from Moderate Risk to Low Risk) and lists the standards assessed, from least likely to be mastered to most likely to be mastered. At each step in the Intervention Plan,
you have access to Quiz Builder.
AGGREGATE MULTI-TEST WITH RISK LEVELS REPORT
The Aggregate Multi-Test with Risk Levels report can be accessed from the Reports menu. (Refer to the Quizzes via the Aggregate Multi-Test with Risk Levels Report section, page 52, for directions on accessing this report.)
QUIZZES VIA THE INSTRUCTION PERFORMANCE TRACKER REPORT
PURPOSE The Instruction Performance Tracker report provides a way for educators to track students learning of the standards included on benchmark assessments and
displays the mastery probabilities by risk level for the standards. This report displays results for each standard along with the students’ risk level. The risk levels
displayed on this report is associated with the total number of benchmark assessments administered; refer to the risk level options table on page 33. A teacher may then use the standards and risk-level groups as a way to organize
students for tiered instruction and interventions.
This report is actionable allowing educators to quickly schedule an assignments or a
quiz for a performance objective’s risk group and/or class.
9. Prior to selecting the Quiz Builder button, you may:
a. Click the radio button for the desired Student Risk Level.
b. Uncheck the performance objective you want to exclude from the quiz.
10.Click the Quiz Builder… button to automatically generate a quiz for each performance objective selected. Additionally the quiz will be scheduled for
students for the selected Student Risk Level radio button.
11.You are brought to the Quiz Builder page. Proceed to the Quiz Builder Menu’s Students section, page 22, for the next steps.
PURPOSE The Group Benchmark Profile page provides an estimate of each student’s risk of
not meeting the standards on the next statewide assessment. The report displays groups students into different risk levels; the risk levels displayed on this page is associated with the total number of benchmark assessments administered; refer to
the risk level options table on page 33.
An educator may then use these risk-level groups as a way to organize students for
tiered instruction and interventions. This report automatically groups students for interventions based on what risk category they are identified as being a part of,
after benchmark testing and then can easily schedule follow-up assignments (e.g., Instructional Dialogs, KHAN Academy®, LearnZillion lessons and activities) and/or quizzes for the performance objectives based on standards mastery.
Please keep in mind the following things:
1. This actionable report will result in an intervention group being created for each risk-level group.
2. This actionable report will result in a quiz being created for each performance
objective.
3. You may only run this report on benchmark assessments.
ACCESS You can access the Group Benchmark Profile page report from the:
a. shows the students’ overall risk level for not meeting the standard as measured by the state test.
b. provides the students’ average Developmental Level Score on the benchmark assessment.
c. shows the “cut” score or the Developmental Level Score that corresponds to the score needed to “meet the standard” on the state standardized
assessment.
d. Lists the:
i. Mastery Probabilities - The probability that a student with the average
Developmental Level (DL) score of the selected risk group has mastered items that tested a standard. This is generated using Item
Response Theory (IRT). If the performance objective was on multiple tests, the mastery probability is averaged across the tests.
ii. Average Percent Correct – This is the earned points divided by the total number of test items for that standard.
e. Standards – The standards on the assessment(s). This list helps educators identify 1) the standard that, if learned, will most significantly reduce a
student’s risk designation and 2) where to target instruction.
Educators should take into account the blueprint for the state standardized assessment when selecting which
Intervention Planning step to begin their interventions. For example, if there is an extended period of time,
begin with “Step 1” and moving sequentially through the steps. If there is limited time before the state standardized assessment, select the standards to cover
based on the state standardized assessment blueprint.
FOUR COLUMN VIEW
a. shows the students’ overall risk level for not meeting the standards as
measured by the state test.
b. provides the students’ average Developmental Level Score on the
benchmark assessment.
c. shows the “cut” score or the Developmental Level Score that corresponds to the score needed to “meet the standard” on the state standardized assessment.
d. lists the:
i. Mastery Probabilities - the probability that a student with the average Developmental Level (DL) score of the selected risk group has mastered
the items that tested a performance objective. This is generated using Item Response Theory (IRT). If the performance objective was on
multiple tests, the mastery probability is averaged across the tests.
ii. Total questions - the number of test items on the assessment(s) that measure a standard.
iii. Average Earned Points – For the Group indicates the total number of points earned for that standard by students included in the risk group,
divided by the number of students in the risk group.
iv. Average Percent Correct - is the average percent correct attained by the
students in the group for the test items for that standard.
e. Lists and orders the standards on the assessment to help educators identify
1) the standards that, if learned, will most significantly reduce a student’s risk designation and 2) where to target instruction.
Educators should take into account the blueprint for the state standardized assessment when selecting which
Intervention Planning step to begin their interventions. For example, if there is an extended period of time,
begin with “Step 1” and moving sequentially through the steps. If there is limited time before the state standardized assessment, select the standards to cover
based on the state standardized assessment blueprint.
GENERATE 1. Click the Dashboard icon.
1. Click either: a. Reports>Test
Sets>Benchmark Results.
2. Hover over the Dashboard menu
option and select Teacher.
b. Assessment>Test Results>
Benchmark Results.
3. In the Dashboard Group
Filter widget select either the Class
or Intervention Group radio button. If selected the:
2. Proceed to step #6.
a. Class radio button filter mode: i. And you are a District- or
12.This tab contains links to the Class Development Profile Grid, Detailed Item Analysis, and Risk Level reports.
Refer to the “Reports and Using Data” manual or the online help files for information on the Class Development Profile Grid and Detailed Item Analysis reports.
RISK LEVEL
The Risk Level report helps teachers create intervention groups based on student’s
risk levels. Additionally, the report will identify performance objectives and specific students that teachers can target for instruction. Click the risk level number to access the Group Benchmark Profile page.
13.Click the Risk level link you want to drill down on.
The risk levels displayed on this page is associated with the total number of benchmark assessments administered.
Refer to the risk level options table on page 33.
14.A new browser window opens to the Group Benchmark Profile page.
15.Click the Quiz Builder… button to automatically generate a quiz for each performance objective selected. Additionally the quiz will be scheduled for
students.
16.You are brought to the Quiz Builder page. Proceed to the Quiz Builder
Menu’s Students section, page 22, for the next steps.
QUIZZES VIA THE AGGREGATE MULTI-TEST WITH RISK LEVELS REPORT
PURPOSE The Aggregate Multi-Test with Risk-Levels report shows progress reflected in
performance on a series of benchmark tests that have been placed on a common
scale. Since the tests have been placed on a common scale, the scores can be directly compared and an estimate can be generated related to each student’s risk
of not meeting the standards on the next state standardized assessment. This risk level is based on where his or her Development Level (DL) score falls relative to the
Proficient cut score on each benchmark assessment taken. The cut scores on the benchmark assessments are set to correspond to the cut scores on the state standardized test. The risk levels displayed on this report is associated with the
total number of benchmark assessments administered; refer to the risk level options table on page 33. An educator may then use these risk-level groups as a
way to organize students for tiered instruction and interventions.
Please keep in mind the following things:
1. This actionable report will result in an intervention group being created for
each risk-level group.
2. This actionable report will result in a quiz being created for each performance
objective.
3. You may only run this report on benchmark assessments.
ACCESS You can access the Aggregate Multi-Test with Risk Levels report from the Reports menu.
iii. have access to multiple classes, select the Class(es) for which you wish to generate a report.
b. Intervention Group mode, select the Intervention Group Library
and the Intervention Group.
4. Use the down arrow on the Library drop-down menu to select the library
which contains the test for which you wish to generate a report.
5. Double click the tests for which you wish to generate a report. Double click in the select test box to select the test(s) or use the single right arrow to move a single test or double right arrows to move all tests. The selected test
is moved to the Selected tests box.
You may select a maximum five tests.
6. (optional) If additional tests are in a different library, change the test Library and select those test(s).
7. If necessary, use the single up and/or down arrow to re-arrange the test order. Use the X to remove the selected test from the Selected tests box.
Arrange the tests in order – first administered to last administered.
8. The Test taken on or After and Test taken before dates default to your
district/charter school program year dates. If you want to have a more restrictive date range, use the drop-down menus to select the date for which
you wish to run a report.
This report cannot be generated across multiple school years.
9. Determine if you will include only students who have taken all selected tests by selecting (or deselecting) the Only include students who have taken
ALL tests.
10.(optional) Click the down arrow under Student Information Filters to
select the Form that contains the fields for which you would like to filter as you run this report.
From here, you may repeat the previous steps to see a list of individual students.
GROUP BENCHMARK PROFILE OR STUDENT BENCHMARK PROFILE 16.Once you have drilled-down to individual students by any of the methods
listed above you may access the Group Benchmark Profile report by clicking on the risk level above the students or access the Student Benchmark Profile report by clicking on the student’s name.
a. shows the students’ overall risk level for not meeting the standards as measured by the state test.
b. provides the students’ Developmental Level (DL) Score on the benchmark
assessment(s).
c. shows the “cut” score or the Developmental Level Score that corresponds to
the score needed to be proficient on the state standardized assessment.
d. lists the:
i. Mastery Probabilities - the probability that a student with this
Developmental Level (DL) score has mastered the items that tested a performance objective. This is generated using Item Response Theory (IRT). If the performance objective was on multiple tests, the mastery
probability is averaged across the tests.
ii. Total questions - the number of test items on the assessment(s) that measure a standard.
iii. Earned Points – indicates the total number of points the student earned for that standard.
iv. % of Total Points - is the earned points divided by the total number of test items for that standard.
e. Lists and orders the standards on the assessment to help educators identify 1) the standards that, if learned, will most significantly reduce a student’s
risk designation and 2) where to target instruction.
Educators should take into account the blueprint for the state standardized assessment when selecting which Intervention Planning step to begin their interventions.
For example, if there is an extended period of time, begin with “Step 1” and move sequentially through the
steps. If there is limited time before the state standardized assessment, select the standards to cover based on the state standardized assessment blueprint.
The Quiz Builder button is not available on the Student Benchmark Profile page.
a. shows the students’ overall risk level for not meeting the standards as
measured by the state test.
b. provides the students’ average Developmental Level Score on the
benchmark assessment.
c. shows the “cut” score or the Developmental Level Score that corresponds to the score needed to “meet the standard” on the state standardized assessment.
d. lists the:
i. Mastery Probabilities - the probability that a student with the average Developmental Level (DL) score of the selected risk group has mastered
the items that tested a performance objective. This is generated using Item Response Theory (IRT). If the performance objective was on
multiple tests, the mastery probability is averaged across the tests.
ii. Total questions - the number of test items on the assessment(s) that
measure a standard.
iii. Average Earned Points – For the Group indicates the total number of
points earned for that standard by students included in the risk group, divided by the number of students in the risk group.
iv. Average Percent Correct - is the average percent correct attained by the students in the group for the test items for that standard.
e. Lists and orders the standards on the assessment to help educators identify
1) the standards that, if learned, will most significantly reduce a student’s risk designation and 2) where to target instruction.
Educators should take into account the blueprint for the state standardized assessment when selecting which
Intervention Planning step to begin their interventions. For example, if there is an extended period of time, begin with “Step 1” and moving sequentially through the
steps. If there is limited time before the state standardized assessment, select the standards to cover
based on the state standardized assessment blueprint.
Then
17.Click the Quiz Builder… button to automatically generate a quiz for each
performance objective selected. Additionally the quiz will be scheduled for students.
18.You are brought to the Quiz Builder page. Proceed to the Quiz Builder Menu’s Students section, page 22, for the next steps.
SCHEDULE A QUIZ FOR AN INTERVENTION GROUP
Once the quiz is created using one of the methods described in this manual, you may schedule the quiz for an Intervention Group or class from the Teacher
Dashboard page. Generally a quiz is scheduled when it is created. To edit the schedule, please refer to the View, Edit, and Delete a Schedule section, page 68.
SCHEDULING IMPACTS REPORTS How assessments are scheduled will impact the report results. It is ideal to schedule assessments only for the class(es) or intervention group(s) in which
students will take the test. Limiting who is scheduled for a test will allow for more accurate measuring of participation.
SCANNING IMPACTS REPORTS It is important that assessments be scanned in the order they are administered: the pretest, test #1, test #2, then the posttest. Scanning should occur as close as
possible to the date of the test administration. This ensures that the growth expectations are accurately calculated.
To ensure accurate growth expectations, scan answer sheets as soon as possible after administration.
BULK SCHEDULER It is possible for an administrator to use the special Bulk Scheduler tool (available to District- and School-level users) to schedule grade-level tests across the
district/charter school, at selected schools and for selected classes as needed. The Bulk Scheduler tool may be used to schedule an online and offline administered
assessment.
Refer to the online help files for further information on the Bulk Scheduler tool.
SCHEDULE 1. Click the Dashboard icon.
2. Hover over the Dashboard menu option and select Teacher.
Passwords are linked to a class or intervention group. This means if you have multiple classes or intervention groups
taking the same test, you will need to set-up a password for each group taking the test.
Passwords cannot be reused for that class or intervention group during the same school year.
16.Click the Save button.
17.The scheduled test now appears on the Teacher Dashboard and Class Calendar pages.3
Assessments scheduled for intervention groups are noted on the calendar with a “people” icon.
Dashboard page Class Calendar page
VIEW, EDIT, AND DELETE A SCHEDULED QUIZ
If a quiz has not yet been taken by a student you may edit the date, time, posting
instructions, and/or password. If the quiz has been taken by students you will be notified at the top of the screen that you may only edit the posting of test scores.
3 District- and School-level users have access to the Class Calendar page.
7. To view the scheduling details, click the desired scheduled test link. If necessary, click the View/Edit Schedule button to view additional information.
8. (optional) Click the Preview link to view the scheduled test.
EDIT A TEST SCHEDULE In order to edit a test schedule, you must have Read-Only or Write permission to
the test library. Tests library with a Results Only permission provides all the specified schools, classes and/or users restricted access to the test; School- and Class-level users will not be able to schedule/reschedule and/or view the test items
If the quiz has not yet been taken by a student, you may edit the date, time, or password. If the quiz has been
taken by students you will be notified at the top of the screen that you may only edit the posting of the test
scores.
10.Click the Save button.
DELETE A TEST SCHEDULE If you need to delete a test schedule you may do so by following the steps listed on
the previous pages and then by following the directions listed below. You cannot delete a scheduled test:
Once the test has been taken by students. If another testing schedule is saved, the students who accessed a test may be transferred to the new
testing schedule.
If you did not schedule the test.
If bubble sheets have been generated for this scheduled test. A note appears
at the top of the page indicating such.
If you do not have access to the test library. You must have Read-Only or
Write permission to the test library. Tests library with a Results Only permission provides all the specified schools, classes and/or users restricted access to the test; users will not be able to modify (e.g. delete) the test
schedule and/or view the test items and they are restricted on report details.
a. If no students have accessed the test, you will receive a pop-up warning that says, "Delete Schedule? You will not be able to recover the deleted
schedule. Any answer sheets printed with this schedule will be unusable." If you're sure, click the OK button. If you made a mistake, or changed your mind, click the Cancel button.
b. If students have accessed the test, the student(s) must be moved to a
different schedule. However, if there is no other schedule available to transfer the student to, the test can’t be deleted.
c. Click the Apply button if the student(s) has been moved to a different
schedule.
VIEW SCHEDULED EVENTS FOR AN INTERVENTION GROUP
Educators may find it helpful to view a list of all events scheduled for an Intervention Group. School- and District-level users can view, edit, and delete
scheduled test for an intervention group from the Class Calendar page. All users can view, edit, and delete a test from the Teacher Dashboard page. It is recommended that Class-level view, edit, and delete a test using the Teacher
6. Analyze the results using the Teacher Dashboard page and/or the
Formative Results page.
OR
USER-DEFINED INTERVENTION GROUP
Galileo automatically creates an Intervention Group from a report. A Galileo user
may create an Intervention Group by selecting individual students or based on variables housed on student forms. To create an intervention group based on
student form variables a district/charter school will have needed to:
1. Request that ATI build a student form to house the desired information.
2. Recorded this information in their SIS (Student Information System).
CREATE A GROUP All Galileo users can create an Intervention Group by selecting individual students or based on form variables.
1. Access the Intervention Groups page. Refer to the Access Intervention Groups Page section, page 81, for instructions.
2. Click the Add an intervention group link.
NAME INTERVENTION GROUP 3. Type in the name of this intervention group.
You may select individual students (explained in the Select Students section) or use
the form filter (explained in the Select Student Form Information section).
SELECT STUDENTS
4. You must select the individual students. If you are a:
a. District-level user - determines if you would like to pull students from
individual schools or [All Schools]. [All Schools] will pull together all students enrolled the district/charter school, regardless of grade-level.
b. District- or School-level users - determine if you would like to pull students from individual classes or [All Classes]. [All Classes] will pull
together all students enrolled the school, regardless of grade-level.
c. Users with access to more than one class - select the Class you would like to pull students from. [All classes] will combine all students enrolled in all your classes.
CREATE A COMPOSITE SET Once intervention groups are created, they can be merged in a variety of ways by creating Composite Intervention Groups. The composite group tool allows you to
run reports on any combination of variables.
1. Access the Intervention Groups page. Refer to the Access Intervention
Groups Page section, page 81, for instructions.
2. Click the Add composite intervention group link.
3. Create a name for your composite set.
4. Select the Library that houses the set you would like to include in your
composite.
5. Double click the intervention group(s) to select the ones that will make up the composite set you are building.
6. Click the Save Intervention Group button.
VIEW AN INTERVENTION GROUP 1. Access the Intervention Groups page. Refer to the Access Intervention