Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.

www.sakaiproject.org 1

Tests and Quizzes Tool(aka SAMigo)

Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford University Learning Activity Designer


Where did the design originate?• Formative Assessment (Homework)

– Stanford Assignment Tool for Human Biology– CourseWork CMS with Language Tools

(Andrew W. Mellon Foundation funded)

– OKI Tools Workshop to Specify Functionality(Andrew W. Mellon Foundation funded)

– OKI Formative Assessment Tool(Andrew W. Mellon Foundation funded)

• OnCourse Quiz Tool– Online testing


Where did the design originate?

• OKI Tools Workshop– Many schools met to define needs for a CMS– One group specified the needs for an

Assessment Tool– Several hundred functional requirements

identified



• Assignment and Assessment Manager – Supports teaching and learning in

large lecture science courses and in language instruction

– OKI Tool developed at Stanford– Andrew W. Mellon Foundation funded



• OnCourse CMS for Indiana University instructional support


What are its features:

• Assessment Authoring

• Assessment Publishing

• Assessment-taking Management

• Assessment Grading

• Question Pools Management

• Publishing Template Management


Organize & Publish Assessments

• Library of assessments for a course– Can be ex/imported in QTI XML format

• Published assessments with responses, grades– Can be published to sections, groups in course– Can have different release, due, retract dates



Question Types• Multiple Choice (single and multiple correct)• Multiple Choice Survey• True/False• Matching• Essay/Short Answer• Fill in the Blank• File Upload• Audio Recording** in future Sakai 2.x release



Multimedia Everywhere

• WYSIWYG editor

Fonts, style, layout, images, HTML, links

• In section headers, question texts, selections for responses, feedback, comments



Pedagogical Flexibility

• Online test

• Self-study questions

• Homework, problem-sets

• Essay, code, or project submission

• Language drills

• Quick knowledge probes

• Others???


Online Test• Unique tests for each student

– Randomized order of questions– Randomized draw from question pools

• Timed test-taking during access window– Auto-submit at end of timed period

• One submission only per student• Higher Security

– IP Addresses restricted– Secondary Password (proctored)

• No late submissions accepted• Scores transferred to gradebook



Self-Study Questions

• Immediate feedback

• Random access to Questions – Table of contents– Marked for review list

• No record of score in gradebook

• No due date; always available to student

• Unlimited submissions allowed



Homework/Problem Sets• Published with multiple release and due dates

for different sections• Multiple methods for handling late submissions• Students can save work during assignment

period.• Auto-grading with methods for diagnosing

learning problems • Quick-reviews of student aggregate performance

by instructors viewing histograms, statistics.• Pools for organizing questions for reuse


Essay and Project Submission

• Use file upload question type for submitting any type of document

• Grader can download assignment; upload marked-up file to return to student

• Grades are recorded in gradebook


Templates

• Create Assessment “Types” for different disciplines, different uses

• Select what which choices are available to the instructor.

• Hide complexity by making choices for the type (e.g., Self-study always has immediate feedback)




Question Pools

• Organize questions into multiple subpools

• Export and import questions in IMS QTI format.

• Author Questions from within Pool Mgr.

• Randomly draw from pools for an assessment


Demo

























2.0 Highlights

• Full integration into Sakai framework

• Assessment scores to Gradebook

• File upload question type

• Play with it:http://nightly2.sakaiproject.org/portal


T&Q 2.x Future

• Implementation of 2.0 framework – Release assessments to specific classes and

sections– Department template– Question Pool sharing

• Audio-recording question type


T&Q post 2.x Future

• Establish a T&Q sub-team (designers and developers)

• New features via Assessment DG (post Baltimore conference) and feature prioritization process

• New code via committer strategy that mirrors Sakai process

• See you in Austin! (Dec. SEPP conf.)


Questions?


ContactsMarc Brierley, Stanford University T&Q Project Manager and Lead Designer [email protected] Charles Kerns, Stanford University Learning Activity Designer [email protected]

Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.

Documents

assessment slide

gradebook slide

dates slide

comments slide

demo slide

reuse slide

immediate feedback slide

x release slide