Creating and Managing Assessments Erin Shelley
Creating and Managing Assessments
Erin Shelley
Today’s Workshop
• Overview of Assessments• Creating Questions• Creating Assessments and Adding
Questions• Managing the Questions Database• Editing Assessment Properties• Grading and Viewing Assessments with
Assessment Manager• Generating Assessment Reports
Learning Outcomes
After completing this workshop, you will be able to: • identify the differences between the available
assessment types.• create a variety of question types.• create assessments and add questions to them.• edit assessment settings.• add question sets and alternates.• manage questions in the Question Database.• grade assessments and view survey results.• generate assessment reports to evaluate student
performance and the effectiveness of assessments.
Overview of Assessments
Types of AssessmentsYou can create three unique types of assessments in WebCT.
– Quiz
– Self-test
– Survey
Overview of Assessments
Assessment ToolsAssessments Tool Functions by Tab
BuildFrom the Build tab, using the Assessments tool, you can:create and edit questions and assessments..manage the Question Database
Build
TeachFrom both the Build and Teach tabs, you can edit assessment properties.
Teach From the Teach tab, using the Assessment Manager tool, you can grade assessments and run reports.
Overview of Assessments
Assessment Creation ProcessTo create an assessment, you must complete the
following tasks: – create questions.– create the assessment and add the questions.– apply assessment settings.
Activity: Logging In
Log into Your Practice Course
The URL is http://build2.vista.nau.edu
Use your NAU ID and password to log in.
Creating Questions
• True-False Questions
• Multiple Choice Questions
• Creating Other Question Types
Activity: Creating True/False and
Multiple Choice Questions
• Create a true false question
• Create a simple multiple choice question with one correct answer.
• Create a multiple choice question with several correct answers.
Creating Assessments and Adding Questions
• Assigning Points to Questions
• Editing and Managing Questions within Assessments
Activity: Creating Assessments and Adding Questions
• Create a self test and add the questions. Edit the points assigned to each question so that the total points add up to 60.
• Create a quiz based on the self test.• Create a survey. Create and add a true
false and a multiple choice question while creating the survey.
Activity: Creating Other Question
Types
• Combination multiple choice question
• Fill in the blank question
• Jumbled sentence question
Activity: Creating Other Question
Types
• Matching question
• Paragraph question
• Short answer question
• Calculated question
Activity: Editing and Managing Questions within Assessments
• Divide your quiz into two parts and practice re-ordering questions within the parts.
• Add one of the new questions you created to your self test.
Activity: Editing and Managing Questions within Assessments
• Create a question set by adding two question alternates to the question.
• Ensure that WebCT will select two of the three questions from the set and assign points to the questions.
Editing Assessment Properties
Available Assessment Properties
SelfTest
Title Question titles Question delivery Dates Available
Survey • All of the settings above, plus: Duration Submission Settings Security Settings
Quiz • All of the settings above, plus: Attempts allowed Attempts separation Student score Student score release Results Settings
The Assessment Creation Process
• Quiz properties define how a quiz will be delivered to students and how results will be released to students. Properties are grouped into:
• Settings• Dates Available• Results Settings• Submission Settings• Security Settings.
Editing Assessment Properties
Quiz Properties• Quiz properties define how a quiz will be delivered
to students and how results will be released to students. Properties are grouped into:
• Settings• Dates Available• Results Settings• Submission Settings• Security Settings.
Activity: Specifying How
Questions are Delivered • Edit your self-test settings:
• Re-title the test.
• Make it available starting today and for an unlimited duration.
Activity: Specifying How
Questions are Delivered • Edit your survey settings:
• Email submissions to your external e-mail address.
• Require students to enter a password in order to access the survey.
Activity: Specifying How
Questions are Delivered • Enter a message for students to receive
when they submit their surveys.
• Edit your quiz settings:
• Do not display question titles to students.
Activity: Specifying How
Questions are Delivered • Deliver questions one at a time, without
allowing students to revisit them.
• Allow students to attempt the quiz three times and use the highest attempt score for students’ grades.
• Ensure that students will receive any feedback and grader’s comments when they view their graded quizzes.
Managing the Question Database
• Creating Categories
• Switching Between Category and Question View
• Default Columns in the Question Database
• Creating Custom Columns
Managing the Question Database
Creating Categories
Use categories to help browse the database.
For example, Create categories based on topics or themes that students are studying.
Managing the Question Database
Switching Between Category and Question View
Managing the Question Database
Default Columns in the Question Database
Column Description
Title The title entered for the question when it was created.
Type The type of question, e.g., Paragraph, Matching, Multiple choice, etc.
Used By The assessments in which the question appears.
Category
The name of the category in which the question is grouped.
Managing the Question Database
Creating Custom Columns
You can create custom columns to include additional information about your questions. Once created, custom columns appear as
fields in the question creation process.
Activity: Setting Up the Question
Database • Create a custom column that will allow
you to enter descriptive information for your questions.
• Create several categories you might use to organize the questions you plan to create.
Grading and Viewing the Assessments with Assessment Manager
• With Assessment Manager, you can: – Grade Assessments by Student– Grade Assessments by Question– Regrade Questions– Modify Quiz Grades– Run Reports
Grading and Viewing the Assessments with Assessment Manager
Grading Assessments Manually
You will need to grade an assessment manually if:
-the assessment includes a paragraph question-a student successfully defends an incorrect response on a question-a question was originally scored incorrectly.
You can grade manually grade questions in two ways:-grade by student -grade by question
Grading and Viewing the Assessments with Assessment Manager
Viewing Survey Submissions
Although you can view whether students have or have not submitted a survey, survey
submissions are anonymous.
Activity: Grading Quiz
Submissions • Grade the paragraph question in the
Workshop Intro Quiz. Note how paragraph questions can be graded by student or question.
• Add five points to your student’s total score for the Diagnostic Quiz.
• Adjust your student’s score on question six of the Workshop Intro Quiz; give five points for the response.
Generating Assessment Reports
• There are four reports for quizzes:
• Performance
• Item Statistics
• Summary Statistics
• Class Statistics
Activity: Generating Reports
• Select different reports to view for the two quizzes.
• Run a Performance Report for the Workshop Intro Quiz.
• Display the statistics for several questions.
Learning More
• Online Help
• www.webct.com
– Ask Dr. C (www.webct.com/askdrc)– Support (www.webct.com/support )
• Campus Resources– Resource One– Resource Two
Looking Ahead
• Additional F2F Workshops• Online Training Opportunities• Brown-bag Sessions
Questions and Answers
Workshop Evaluation and Feedback
Workshop Evaluation and Feedback