Labrador: A Tool for Automated Grading Support in Multi-Section Courses Drexel University Programming Learning Experience (DUPLEX) http://duplex.mcs.drexel.edu Christopher D. Cera, Robert N. Lass, Bruce Char, Jeffrey L. Popyack, Nira Herrmann, Paul Zoski Drexel University Mathematics and Computer Science
46
Embed
Labrador: A Tool for Automated Grading Support in Multi-Section Courses Drexel University Programming Learning Experience (DUPLEX) .
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Labrador: A Tool for Automated Grading Support in Multi-Section Courses
Drexel University ProgrammingLearning Experience (DUPLEX)http://duplex.mcs.drexel.edu
Christopher D. Cera, Robert N. Lass, Bruce Char, Jeffrey L. Popyack, Nira Herrmann, Paul Zoski
Drexel UniversityMathematics and Computer Science
2
Roadmap
Introduction
Problems and Solution Goals
Labrador
Discussion
3
The Group
Bruce Char– Professor, Computer Science
Nira Herrmann– Professor and Head, Mathematics
Jeffrey L. Popyack– Associate Professor, Computer Science
Paul Zoski– Instructor, Math and Computer Science
Christopher D. Cera– Computer Science Graduate Student
Robert N. Lass– Computer Science Undergraduate Student
4
Who Am I
First TA in MCS to experiment with WebCT in December 2000
Courses I have TA’ed using WebCT– 3 x Introductory Programming I, II– 1 x Object Oriented Programming
Migrated course content to WebCT from previous course website– HTML assignments and labs into question database– Gradebook maintainer
Wrote demo’s and documentation to train other TAs
Developer of software supplements to WebCT to support course administration
5
The Course
Intro Programming I, II
Variety of Majors – Computer Science– Computer
Engineering– Information Systems– Mathematics– Digital Media
Adobe Portable Document Format can be viewed on all major platforms
With Adobe Acrobat, PDFs can be annotated by graders
Sony VAIO Slimtop PC (PCV-LX920)
Wacom Pen Tablet.
27
VAIO / Wacom
28
PDF Markup Example
29
Redistribution
How can we return annotated PDF’s back to students using WebCT?
WebCT Mail
WebCT Groups
Version 3.8 now addresses this issue
30
Heterogeneous Systems
Different systems want different formats
Plagiarism Detection Systems– Moss has been used most extensively– Began experimenting with JPlag more recently
Future work: Automatic program compiling and testing
31
Automated Plagiarism Detection
Digital formats make "borrowing" easy
– Browsing similar works needs a simple and quick user interface.
– Careful review by faculty to assess results and present to students
32
Moss
Processes C, C++, Java, ML, Lisp, Scheme, Pascal, and Ada programs.
Common code feature reduces false positives
33
Moss Interface
34
JPlag
Processes C, C++, Scheme, and Java programs
For plain text files, it matches a user specified number of words appearing in succession
Could be used for any course grading written (text) documents
35
Command Line Invocation
36
Interactive
37
Quiz Download with Config File
38
Roadmap
Introduction
Problems and Solution Goals
Labrador
Discussion
39
Recent WebCT Enhancements
Relevant to this talk:
– 3.7 Addressed bulk download issue for assignments
– 3.8 Attaching documents to an assignment
40
Future WebCT Enhancements
Power users will need functionality not yet supported
Every domain will also require additional functionality
Not feasible for all domain-specific functionality to run on the WebCT server
41
Wanted
API for non-administrators
Stateful protocol so clients can be built by 3rd parties
42
HTTP: Insufficient Protocol
Inconvenient content interchange Heavy client interaction
A HTTP based approach will be sensitive to the exact location of web pages, and format of text within them.
43
Labrador Availability
Contact Us
http://duplex.mcs.drexel.edu
44
Project Support
The Pew Learning and Technology Program at the Center for Academic Transformation
National Science Foundation, Division of Undergraduate Education, DUE-#0089009
The Ramsey-McCluskey Family Foundation, Margaret Ramsey, '84
Drexel University
45
References
[1] Alex Aiken. Moss: A system for detecting software plagiarism (unpublished), http://www.cs.berkeley.edu/~aiken/moss.html.
[2] Jeffrey L Popyack, Bruce Char, Paul Zoski, Nira Herrmann, and Christopher D. Cera. Managing course management systems. In Proceedings of the thirty-third SIGCSE technical symposium on Computer Science Education, Birds-of-a-Feather Sessions, page 423, 2002.
[3] L. Prechelt, G. Malpohl, and M. Philippsen. Jplag: Finding plagiarisms among a set of programs. Technical Report 2000-1, Fakultat fur Informatik, Universitat Karlsruhe, Germany, March 2000.
[4] Larry Wall, Tom Christiansen, and Jon Orwant. Programming with Perl. O’Reilly and Associates, 3rd edition, 2000.
[5] Michael J. Wise. Yap3: Improved detection of similarities in computer program and other texts. In Proceedings of the twenty-seventh SIGCSE technical symposium on Computer Science Education, pages 130–134. ACM Press, 1996.
46
Roadmap
Introduction
Problems and Solution Goals
Labrador
Discussion
Bonus Slides
47
Blooms Taxonomy
Knowledge– remembering of previously learned material; recall (facts or whole theories); bringing to mind.
Comprehension– grasping the meaning of material; interpreting (explaining or summarizing); predicting outcome and
effects (estimating future trends). Application
– ability to use learned material in a new situation; apply rules, laws, methods, theories. Analysis
– breaking down into parts; understanding organization, clarifying, concluding. Synthesis
– ability to put parts together to form a new whole; unique communication; set of abstract relations. Evaluation
– Ability to judge value for purpose; base on criteria; support judgment with reason. (No guessing).