Center for Excellence in Learning and Technology Student Evaluation of Teaching: Creating Reports with Class Climate Laura Bestler, Instructional Support Specialist 294-5357 • course- [email protected]eLearning: http://www.celt.iastate.edu/elearning/
30
Embed
Student Evaluation of Teaching: Creating Reports with Class Climate
This course is designed to provide the advanced knowledge, procedures, and hands-on experience required for the successful implementation and operation of online course evaluations with the Class Climate software. Topics for this workshop include: creating faculty and departmental reports. This course is recommended for personnel responsible for creating, managing and data collection for course evaluation surveys and already have basic skills with Class Climate.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Center for Excellence in Learning and Technology
Student Evaluation of Teaching: Creating Reports with Class
ClimateLaura Bestler, Instructional Support Specialist
Any Compilation (Combination) Last 2 options in pull-down
• Most Flexible• Combine Any
Surveys (except General Surveys)
• Choose multiple criteria from a standard choice box
• Allows Multiple Subunits / Periods / Types / Questionnaires
Report Creator: Profile Line• Create profile line emails (may be printed or saved)
• Compares scaled questions across selected surveys• 2-3 optimal (more becomes difficult to read)
Compare Instructor to their DEPT Peers
Up to 8 (eight)courses taught bysingle Instructor
Up to 8 (eight)Instructors whotaught same/similarCourse(s)
Line 1 Entire Faculty Course 1 Instructor A
Line 2 DEPT Averages Course 2 Instructor B
Line 3 Instructor/Course Averages
Course 3 Instructor C
Line 4 Total Average ofCourses 1,2,3
Total Average ofInstructor A,B,C
Report Creator: Profile Line
Mapping Questions Across Surveys• Used to Combine Surveys with Similar Questions
• Automatic• Use When:
• Questionnaires are Identical• Manual
• Use When:• Questionnaires are Somewhat Similar• Worded Differently, and Re-Sequenced
• You decide which questions are similar enough to average together
• Ability to define the number of character differences
Mapping Questions Across Surveys• Include Answers to Open Questions
• Not Extremely Useful when Combining Different Instructors / Courses
• Weighted Averages• Weighted is Default• Number of Responses will be used to Calculate the
Averages• Un-Weighted Averages
• Number of Surveys will be used to Calculate the Averages
• Not Eligible for Export to CSV nor SPSS• Raw Score Data is not Provided, only the Average• Not Widely Used
Weighted vs. Unweighted• By default, the reports are summarized
weighted, meaning that the calculation is effected according to the number of returns.
• Example: If you summarize a survey with 100 return questionnaires and one with 10, the survey with 100 questionnaires counts for more than the one with 10.
• Mathematically expressed: All individual results are summed for each question (each single value that was selected) and divided by the total number of returns (in this example: 110).
Weighted vs. Unweighted• You must explicitly select unweighted compilation
when creating a report. Unweighted calculation precludes the possibility to adequately undertake further processing in statistics programs.
• With unweighted compilations, each survey counts as 1, regardless of how many questionnaires have been processed for a given survey.
• Mathematically expressed: You add the respective total average of each question and divide by the number of the surveys that you are summarizing (in the example above: by 2).
• Individual response data is lost.
Evaluate Subgroup Data• Used with SINGLE-CHOICE questions
Example: If your survey asked: “Reason for taking this course” and the responses included: “Required” and “Elective”, you could produce a report which included ONLY the responses from those who attended as a required part of their major.
Evaluate Subgroup DataOpens a 2nd screen to allow multiple criteria
Name report as desired
Evaluate Subgroup: Multiple Criteria
Name report as desired
Merging Survey Data• Combine Reports Created by Evaluating a Subgroup
Example: Combine any reports, including those reports created using: Evaluate Subgroup
Single Profile Line Comparison• Combine any 2 Subgroup Reports
Example: Compare the responses from the 2 reports: “Required” and “Elective”, you could see which group evaluated the course higher / lower.
Report for Comparison on Questionnaire
Report for Comparison
Report for Comparison on Questionnaire
Report for Comparison on Questionnaire
The “Hook” Profile line into standard Report
Administrator Reports• Change your role to
[Administrator]• Note: You are unable to do
anything with surveys/questionnaires as a Report Creator
“Printing” Results• Click on [Batch Events] (Left Menu)
Creates PDFs to save on your local CPU or network
For surveys that have already been evaluated, the evaluations of a selection of courses can be requested. There are two possibilities:• The PDF reports of the selected
courses are created together in a common PDF file. This is advantageous for example, when the PDF reports for multiple courses are to be printed at the same time.
• The PDF reports requested are summarized as single PDF files in a ZIP file. This is advantageous for example, when the single PDF files are to be passed on in electronic format, deposited in a public folder or, when one wants to print them individually.
“Sending” Results
• Click on [Batch Events]
Send PDF ReportsYou can determine that an instructor receives all evaluations of his courses accumulated in one email. To do this, please activate the option “Reports of all courses of an instructor collected in one email”. Should this not be the case, the instructor will receive a separate email for each course. Please observe the defined maximum size for email attachments (“System Settings/Class Climate Settings/Network Settings/ Maximum document size”). In “System Settings/Text Templates” the relevant email text may be edited (“EMAIL: Results of a survey” and “E-MAIL: Results of a survey (Summary)”).
IMPORTANT: Discuss with your Department Chair how the reports should be sent to
Instructors
IMPORTANT: Discuss with your Department Chair how the reports should be sent to
Instructors
“Sending” Results
• Click on [Batch Events]
Sending PDF Reports as Instructor Profiles• You can send your instructor profile for surveys that
have already been evaluated as a batch email. By activating the option “Include courses with secondary instructors in instructor profiles”, courses with additional report recipients are also included.
• You can determine whether or not the answers to open questions are to be included in your instructor profile. To do this, please activate the option “Include answers to open questions”.
• If the respective instructor, in addition to his profile, is to receive a detailed report for each of his courses, simply activate the option “Also send single PDF reports”.
• Furthermore, you can determine whether profiles and PDF reports are sent solely to the respective instructor (“Send to instructors”) or only to a specified email address (“Send all to the following email address”).
CELT Training Adapted from:
• Oliver, M. (2011, October 25). Advanced topics in Class Climate: The Report Creator(s) Version 4 & 5 [Scantron webinar].
• Scantron Corporation. (2011). Class Climate Course Evaluation System User Guide v5.0. Eagan, MN: Scantron Corporation. http://classclimate.its.iastate.edu