Andrews University School of Education Assessment Report — 2012-2013
Feb 04, 2016
Andrews UniversitySchool of Education
Assessment Report
—2012-2013
Outline of Annual Report• Overview of SED Departments &
Programs• Assessment Report/Summary of
Data• Break for Dinner• Job Placements of Recent Grads• MTTC Score Trends• “Closing the Loop”—Plans for
Improvement
Programs in the SED
Teaching, Learning & Curriculum• BSELED (Bachelor of Science in
Elementary Education)• Elementary Certification• Secondary Certification• BS with Secondary Certification• MAT (Master of Arts in Teaching)• MA EdS, EdD, PhD in Education—
Curriculum and Instruction (C&I)
Programs (cont’d)
Graduate Psychology and Counseling• MS in Special Education—Learning
Disabilities• MA in School Counseling• MA in Community Counseling
Programs (cont’d)
Graduate Psychology and Counseling• MS in Special Education—Learning
Disabilities• MA in School Counseling• MA in Community Counseling• MA in Clinical Mental Health
Counseling• EdS in School Psychology• MA, EdD, PhD in Educational
Psychology• PhD in Counseling Psychology
Programs (cont’d)Leadership• Educational Leadership (K-12):
Graduate Certificate, MA, EdS, EdD, PhD
• Higher Education Administration: MA, EdS, EdD, PhD
• Leadership: Undergraduate Certificate, MA, EdS, EdD, PhD
2012-2013 Candidate Enrollments
Program Elementary Secondary
Biology . .
Chemistry . .
Communication . 1
English . 11ESL . 6
Education, Elementary 60 .
History . 1
Integrated Science . 2
Language Arts 2 .
2012-2013 Enrollments (cont’d)Program Elementary Secondary
French . .
Spanish . 8
Math/Math Education . 8
Music Education . 15
Physics . 1
Political Science . .
Religion . 3
Social Studies, Elementary 1 .
Social Studies, Secondary . 2
Visual Arts Education . 6
2012-2013 Enrollments (cont’d)
Program Certificates*, MA, MS, EdS, EdD, & PhD
Curriculum & Instruction 55Educational Leadership* 35Higher Education Administration 13Leadership* 113Special Education-Learning Disabilities 15School Counseling 11School Psychology 17Educational Psychology 27Community Counseling (phasing out) 1Clinical Mental Health Counseling 27Counseling Psychology 29
2012-2013 Enrollments (cont’d)
Total Enrollment = 470
Report of Assessment Data
• Student Outcomes• Program Quality• Faculty Assessment
Student Outcomes by Department
• Teaching, Learning & Curriculum (TLC)
• Graduate Psychology & Counseling (GPC)
• Leadership (LEAD)
Student Outcomes—TLC
Teacher Education Course Assessments• 20+ assessments (rubrics), lowest mean
rating 4.17/5.00• Over 90% of all ratings at least 3/5
• CAS course grades: • 14 disciplines, 300+ students• most ratings over 4.00 (mean)• 2 disciplines under 4.00 • biology (3.86) & math (3.87)
• In 7 disciplines, 100% of students rate at least 3/5
Student Outcomes—TLC
Teacher Education (MTTC Scores)• MTTC = Michigan Test of Teacher
Education • for Content Area Certification• Reported in 3-year blocks (2009-
2012)
MTTC Content Area, 2009-2012
Program A.U. N
A.U. % Pass
Mich. N
Mich.% Pass
Biology 3 504 85.1
Communication 2 26 53.8
English 11 81.8 2,042 88.1
ESL 7 516 91.7
History 3 1,631 87.2
Int Science, El 2 1,345 69.6
Int Science, Sec 3 298 88.3
Language Arts 11 90.9 2,765 78.0
MTTC Content Area, 2009-2012
Program A.U. N
A.U. % Pass
Mich. N
Mich.% Pass
Biology 3 504 85.1
Communication 2 26 53.8
English 11 81.8 2,042 88.1
ESL 7 516 91.7
History 3 1,631 87.2
Int Science, El 2 1,345 69.6
Int Science, Sec 3 298 88.3
Language Arts 11 90.9 2,765 78.0
MTTC Content Area, 2009-2012 (cont’d)
Program A.U.N
A.U. % Pass
Mich. N
Mich.% Pass
Math, Elem 5 1,610 86.7
Math, Sec 4 1,118 95.3
Music 7 415 98.6
Physics 2 196 89.8
Social Studies 6 2,677 73.5
Spanish 9 631 88.7
Elem Education 23 100.0 7,618 98.1
All Tests 108 89.8 34,556 88.5
MTTC Content Area, 2009-2012 (cont’d)
Program A.U.N
A.U. % Pass
Mich. N
Mich.% Pass
Math, Elem 5 1,610 86.7
Math, Sec 4 1,118 95.3
Music 7 415 98.6
Physics 2 196 89.8
Social Studies 6 2,677 73.5
Spanish 9 631 88.7
Elem Education 23 100.0 7,618 98.1
All Tests 108 89.8 34,556 88.5
MTTC Content Area, 2009-2012 (cont’d)
Program A.U.N
A.U. % Pass
Mich. N
Mich.% Pass
Math, Elem 5 1,610 86.7
Math, Sec 4 1,118 95.3
Music 7 415 98.6
Physics 2 196 89.8
Social Studies 6 2,677 73.5
Spanish 9 631 88.7
Elem Education 23 100.0 7,618 98.1
All Tests 108 89.8 34,556 88.5
Student Outcomes—TLC
Curriculum & Instruction• In 9 assessment rubrics, lowest mean
rating 4.77/5.00• 100% of all ratings at least 3/5
Student Outcomes—GPC
Assessment Data Across All GPC Programs• In 14 assessment rubrics, lowest mean
rating 3.54/5.00• For all assessments except 2, > 90% of
all ratings at least 3/5• In 6 assessments, 100% at least 3/5
Student Outcomes—LEAD
Educational Leadership• In 10 assessments, lowest mean rating
4.48/5.00• For all assessments, more than 90% of
all ratings at least 3/5
Student Outcomes—LEAD
Leadership (Portfolio Assessments)• Across 14 competencies, lowest mean
rating 3.14/5.00• >98% of all ratings at least 3/5
Program Quality
SED Overall• Alumni Survey (2010-2011)• N = 19• 4.05/5.00 (mean) on 16 questions
addressing program quality
Program Quality by Department
• Teaching, Learning & Curriculum• Graduate Psychology & Counseling• Leadership
Program Quality—TLCCourse Evaluations, Spring 2013
Question% at 4-5
Mean
This course helped me to express my ideas more clearly.
79.8 4.04
The learning objectives or goals for this course were clearly stated.
91.2 4.31
The grading system of this course was appropriate for the objectives of the course.
83.7 4.13
N = 158
Program Quality—TLCCourse Evaluations, Spring 2013 (cont’d)
Question% at 4-5
Mean
Methods of evaluation were fair and accurate measures of my learning.
82.4 4.14
This course helped me to critically evaluate different sources and/or points of view.
75.3 4.07
Independent of the instructor, my overall rating of this course is:
64.6 3.71
N = 158
Program Quality—TLCSenior Exit Survey, Teacher Education (2012-2013)
• Seniors (n = 14) rated program/faculty at least 3.75/5.00 (mean) on all indicators except one. • 3.50 (mean) for “There were adequate
specialized equipment (e.g. computers, instruments, lab supplies, etc.).”
• Similar to ratings across the University.
Program Quality—GPCCourse Evaluations, Spring 2013
Question% at 4-5
Mean
This course helped me to express my ideas more clearly.
80.4 4.05
The learning objectives or goals for this course were clearly stated.
90.7 4.31
The grading system of this course was appropriate for the objectives of the course.
86.2 4.26
N = 173
Program Quality—GPCCourse Evaluations, Spring 2013 (cont’d)
Question% at 4-5
Mean
Methods of evaluation were fair and accurate measures of my learning.
83.2 4.13
This course helped me to critically evaluate different sources and/or points of view.
86.7 4.28
Independent of the instructor, my overall rating of this course is:
63.7 3.83
N = 173
Program Quality—LEADCourse Evaluations, Spring 2013
Question% at 4-5
Mean
This course helped me to express my ideas more clearly.
93.5 4.59
The learning objectives or goals for this course were clearly stated.
90.0 4.45
The grading system of this course was appropriate for the objectives of the course.
90.2 4.46
N = 110
Program Quality—LEADCourse Evaluations, Spring 2013 (cont’d)
Question% at 4-5
Mean
Methods of evaluation were fair and accurate measures of my learning.
91.0 4.47
This course helped me to critically evaluate different sources and/or points of view.
99.1 4.72
Independent of the instructor, my overall rating of this course is:
85.7 4.35
N = 110
Faculty Assessment
• Course Evaluations• Advisor Evaluations• Senior Exit Survey
Faculty Assessment
Course Evaluations• N = 464 (all SED)• 4.33/5.00 = mean rating on 9
questions related to the instructor• Highest: “The instructor was
sensitive to and respectful of all people” (4.49)
• Lowest: “Timely, thoughtful, and helpful feedback was provided on tests and other work” (4.16)
Faculty AssessmentAdvisor Evaluations• Difficulty in collecting data• Revised process to begin March 2014• 2012-2013: Only Leadership data• N = 25• All LEAD advisors 4.50/5.00 (mean)
on 10 of 14 indicators• Lowest: “My advisor responds within
two business days to my e-mail and/or telephone messages” (4.15)
• Highest: “My advisor is courteous and respectful” (4.92)
Faculty Assessment
Senior Exit Survey• Teacher Education (undergrads only)• N = 14• 4.50 (mean) on6 of 7 faculty-related
indicators• Lowest: 4.00 for “Faculty used
technology effectively to enhance their teaching” • (cf. 4.10 across all Andrews seniors)• Not so bad!
Faculty Assessment
Senior Exit Survey (cont’d)• Lowest: 4.00 for “Faculty used technology
effectively to enhance their teaching” • (cf. 4.10 across all Andrews seniors)• Not so bad!
• Highest: 4.86 for 2 indicators• “Faculty members showed genuine
interest in each student”• “Faculty taught me how Christian
faith and ethics relate to my field”
Dinner Time
Teacher Education Graduates2011-2012
Roger Alva Integrated Science
Jefferson Christian Acad
Rachel Ballast Spanish Grand Rapids Adv Acad
Katherine Bass
Integrated Science
Anabel Dominguez
Math, Spanish
Justin Groff Elementary Ed
SDA School, California
Erin Hotelling English Spring Valley Acad
Jarrod Lutz English Spencerville Adv Acad
Katherine Miller
Integrated Science
New Zealand
Teacher Education Graduates (cont’d)
2011-2012 (cont’d)Cheri Notice Social Studies,
Sec
Leah Rodriguez
English, Spanish
Milwaukee SDA Acad
Debra Rosengren
Music Education Graduate School
Nolan Williams
Religion Highland Advent Acad
Teacher Education Graduates (cont’d)
Michelle Adame
English Holbrook SDA Ind Sch
Jessica Catron English
Meredith Chavez Social Studies
Korea, student miss tchr
Tanya Crumley Read, Soc St Springs Adventist Acad
Hannah DeLuca Language Arts
Hinsdale Adventist Acad
Geneva Fraser Language Arts
Columbus Advent Acad
Tom Gammon Language Arts
Columbus Advent Acad
Kimberly Geach Language Arts
Elizabeth Glover Social Studies
2012-2013
Teacher Education Graduates (cont’d)
2012-2013 (cont’d)Ben Hotelling Social Studies Kettering College
Alicia Hutchinson
Math Korea, student miss tchr
Erica Johnson Language Arts
Ray Kirk Music Education
Pat Leja English
Jeremy McIntyre Music Education
Elem School, Kalamazoo
Ashley Meyer English
Kalicia Morrison Language Arts Charlotte Adventist Sch
John Musselman Math Bridgman High School
Teacher Education Graduates (cont’d)
2012-2013 (cont’d)Brad Paquette
Political Science
Niles New Tech Entre-preneurial Academy
Jason Park Social Studies
Jessica Ramirez
Visual Arts Educ
Korea, student miss tchr
Nicholas Reichert
English, Spanish
Arizona Conference, asst to Youth Director
Michael Riess History, English
Warren Junior Academy
Styves Romain
Math, Physics
Tonya Mae Ross
Language Arts Central Penn Christian School, PA
Lauren Snell Language Arts
Maxine Umana
Religion, Sec
MTTC Score Trends
• Michigan Test of Teacher Certification for subject areas
• Reported in 3-year blocks• 2006-2009 is missing• 6-Year Trends by Subject/Program
MTTC Score Trends
All Tests (excluding Basic Skills)
Years N % Pass09-12 108 89.808-11 105 86.707-10 131 91.606-09 - -05-08 189 93.104-07 184 91.3
MTTC Score Trends
Elementary EducationYears N % Pass09-12 23 100.008-11 23 95.707-10 34 97.106-09 - -05-08 57 98.204-07 60 98.3
MTTC Score Trends
EnglishYears N % Pass09-12 11 81.808-11 7 *07-10 10 90.006-09 - -05-08 8 *04-07 4 *
MTTC Score Trends
English as a Second LanguageYears N % Pass09-12 7 *08-11 4 *07-10 1 *06-09 - -05-08 0 -04-07 0 -
MTTC Score Trends
Language ArtsYears N % Pass09-12 11 90.908-11 11 100.007-10 15 100.006-09 - -05-08 29 89.704-07 26 88.5
MTTC Score Trends
HistoryYears N % Pass09-12 3 *08-11 4 *07-10 8 *06-09 - -05-08 11 100.004-07 10 90.0
MTTC Score Trends
Political ScienceYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 1 *04-07 1 *
MTTC Score Trends
Social StudiesYears N % Pass09-12 6 *08-11 12 58.307-10 17 70.606-09 - -05-08 16 75.004-07 11 63.6
MTTC Score Trends
BiologyYears N % Pass09-12 3 *08-11 1 *07-10 0 -06-09 - -05-08 1 *04-07 2 *
MTTC Score Trends
ChemistryYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 3 *04-07 5 *
MTTC Score Trends
PhysicsYears N % Pass09-12 2 *08-11 1 *07-10 1 *06-09 - -05-08 2 *04-07 2 *
MTTC Score Trends
Integrated Science (Elementary)
Years N % Pass09-12 2 *08-11 2 *07-10 3 *06-09 - -05-08 2 *04-07 2 *
MTTC Score Trends
Integrated Science (Secondary)
Years N % Pass09-12 3 *08-11 2 *07-10 0 -06-09 - -05-08 1 *04-07 1 *
MTTC Score Trends
Math (Elementary)Years N % Pass09-12 5 *08-11 4 *07-10 7 *06-09 - -05-08 7 *04-07 6 *
MTTC Score Trends
Math (Secondary)Years N % Pass09-12 4 *08-11 4 *07-10 3 *06-09 - -05-08 4 *04-07 7 *
MTTC Score Trends
SpanishYears N % Pass09-12 9 *08-11 12 91.707-10 13 92.306-09 - -05-08 10 90.004-07 7 *
MTTC Score Trends
FrenchYears N % Pass09-12 0 -08-11 1 *07-10 2 *06-09 - -05-08 3 *04-07 2 *
MTTC Score Trends
Music EducationYears N % Pass09-12 1 *08-11 1 *07-10 1 *06-09 - -05-08 10 90.004-07 11 90.9
MTTC Score Trends
MusicYears N % Pass09-12 7 *08-11 9 *07-10 7 *06-09 - -05-08 3 *04-07 1 *
MTTC Score Trends
Visual Arts EducationYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 4 *04-07 4 *
MTTC Score Trends
Guidance CounselorYears N % Pass09-12 4 *08-11 3 *07-10 0 -06-09 - -05-08 1 *04-07 1 *
MTTC Score Trends
Learning DisabilitiesYears N % Pass09-12 2 *08-11 0 -07-10 0 -06-09 - -05-08 6 *04-07 7 *
Closing the LoopPlans for Improvement• Are we assessing what we value?• Developing a revised Assessment
Calendar• Renewed efforts to collect rubric
data—LiveText• Developed a new Advisor Evaluation
procedure (online in March)• Considering how to boost return on
Alumni and Employer Surveys
Closing the LoopQuestions we continue to grapple with:• Faith development• Research competency• Technology competency• Dissertation process
Closing the LoopNew Faculty Members• Jay Brand—Leadership • Subir Dass—Leadership• Tammy Overstreet—Teaching,
Learning, & Curriculum• Nadia Nosworthy—Graduate
Psychology & Counseling
Resources
Available soon at the School of Education web page, www.andrews.edu/sed/resources/:
• Complete SED Annual Assessment Report, 2012-2013
• This PowerPoint presentation
The End
Thank you!