General Education Assessment Trevecca Nazarene University 2011-12
Feb 14, 2016
General Education Assessment
Trevecca Nazarene University2011-12
Today’s Questions Why have a General Education curriculum?
How is General Education assessed?
What were the results of last year’s assessment?
TNU BA/BS Degree
42%
31%
19%
8%
GenEdMajorMinor/SupportElectives
Why? General Education Curriculum
◦ Develop skills for life-long learning
Why? General Education Curriculum
◦ Develop skills for life-long learning◦ Expand the learner’s worldview
Why? General Education Curriculum
◦ Develop skills for life-long learning◦ Expand the learner’s worldview◦ Locate the Major
within human knowledgeMajor/Minor
General Education
Body of Knowledge
Why? Institutional Educational Goals
General Education Outcomes
Institutional Educational Goals
1. Leadership, Service
2. Disciplined reflection
3. Factors shaping civilization
4. Appreciates global diversity
5. Write, speak, use technology
6. Think critically
7. Engenders wholeness
8. Productive influence
General Education Outcomes
1. speak, write
2. Holy Bible
3. Wesleyan-Holiness tradition
4. Systematic problem-solver
5. Global civilization
6. Modes of thinking
7. Christian faith and knowledge
8. Cultural diversity
9. Stewards of resources
How? Outcomes Assessment Cycle
Assessment Data Third-party standardized test
◦ Norm-referenced: 32 doctoral/research universities
◦ Criterion-referenced: skills, content
Multiple and varied approaches◦ Self-generated content questions◦ Self-generated survey questions◦ Samples of student work
2011-12 Assessment Results ETS-Proficiency Profile
◦ Measures 4 skills: Critical Thinking Reading Writing Mathematics
◦ In 3 contexts: Humanities Social Science Natural Science
Humanities
SocialScience
NaturalScience
Proficiency Profile Norm-referenced: all grades; 365 institutions of all types
◦ TNU Total Score: 66th percentile (n=148)
Proficiency Profile Norm-referenced: Seniors; 32 doctoral/research univ.
◦ TNU Total Score: 42nd percentile (n=148)
2011-12 Assessment Results
Met or exceeded the criterionfor 5 of 9 assessment measures
Complete report: http://gened.wiki.trevecca.edu
Assessment Results 3: …articulate parameters of the Wesleyan-
Holiness tradition, doctrinal and moral convictions of the Church of the Nazarene and the connection with intellectual, emotional, spiritual, and physical life individually and collectively.
◦ Goal: correctly answer 70% of 5 questions◦ Actual mean: 65%
Assessment Results 6: …demonstrate an understanding and
practice of various intellectual modes of thinking.
◦ Goal: on PP Critical Thinking, 50% will score “marginally proficient” or “proficient”
◦ Actual: 32% (9% proficient, 23% marginally proficient)
◦ Affinity group: 32% (11% proficient, 21% marginally proficient)
Assessment Results 7: …value the general education curriculum of
their degree program. Two questions were asked
◦ #12 Trevecca’s General Education program enriched my understanding of my academic major.
◦ #13 Trevecca’s Christian emphasis enriched my understanding of my academic major.
◦ Goal: 80% will agree/strongly agree to each question◦ Actual: #12, 54%;
#13, 58%
Assessment Results 7: …value the general education curriculum
of their degree program. One question was asked
◦ #14 Trevecca’s General Education program prepared me for Christian leadership and service in a global community.
◦ Goal: 80% will agree/strongly agree ◦ Actual: #14, 54%
2012-13 GenEd Outcomes
More on ETS PPCriterion measures
PP Skills Scores Norm-referenced: 32 doctoral/research universities
◦ Critical Thinking: 70th (95% c.i.: 44-84)
◦ Reading: 37th (95% c.i.: 28-58)
◦ Writing: 26th (95% c.i.: 16-42)
◦ Mathematics: 33rd (95% c.i.: 28-49)
PP Context Scores Norm-referenced: 32 doctoral/research universities
◦ Humanities: 44th (95% c.i.: 30-72)
◦ Social Sciences: 53rd (95% c.i.: 30-77)
◦ Natural Sciences: 44th (95% c.i.: 26-60)
Proficiency Classifications Criterion –referenced classifications Skill Classification
Proficient Marginal Not ProficientReading 1 74% 14% 12%Reading 2 48% 16% 36%Critical Thinking 9% 23% 68%Writing 1 65% 25% 10%Writing 2 28% 34% 38%Writing 3 13% 27% 60%Math 1 63% 22% 16%Math 2 32% 31% 37%Math 3 11% 15% 74%
Proficiency Classifications Criterion –referenced classifications Skill Classification
Proficient Marginal Not ProficientReading 1 74% 71% 14% 17% 12% 13%Reading 2 48% 43% 16% 18% 36% 38%Critical Thinking 9% 10% 23% 20% 68% 70%Writing 1 65% 67% 25% 24% 10% 10%Writing 2 28% 24% 34% 36% 38% 40%Writing 3 13% 10% 27% 28% 60% 61%Math 1 63% 61% 22% 21% 16% 19%Math 2 32% 36% 31% 24% 37% 40%Math 3 11% 12% 15% 19% 74% 68%
ETS PP Item Information
Composite ReportSeptember 2009 – February 2012Trevecca Nazarene University(n = 365)
Skill Area/Proficiency Level Institution mean – National mean
Reading I 3.98Reading II 1.14Critical Thinking 1.8Writing I 3.09Writing II 4.9Writing III 3.23Mathematics I 2.4Mathematics II 0.06Mathematics III 0.9 Composite 2.27
Item Analysis 2009-2012
Item = Institution mean – National
Discern facts from a passage 4.26Meaning in context 3.85
Reading I (+3.98)
Item = Institution mean – National
Discern main idea 1.35Discern primary purpose -0.43Discern purpose of a reference 2.95Recognize a valid inference 1.82Synthesize material -0.25
Reading II (+1.14)
Item = Institution mean – National
Determine relevance of information 1.6Evaluate an argument 4.0Evaluate data for consistency 6.4Evaluate explanations 10.5Evaluate hypotheses -4.5Extrapolate from known facts 2.9Recognize an assumption 2.82Recognize flaws in argument 3.95Recognize salient features -3.3
Critical Thinking (+1.8%)
Item = Institution mean – National
Incorrect word choice 7.5Order sentences 4.5Recognize agreement 1.8Recognize appropriate transitions 4.4Recognize incorrect punctuation -0.3
Writing I (+3.09)
Item = Institution mean – National
Combine simple clauses 2.0Incorporate new material in paragraph 7.7Recast an existing sentence 4.3Recognize agreement 6.45
Writing II (+4.9)
Item = Institution mean – National
Recognize correct construction 3.8Recognize incorrect construction -2.0Recognize most effective revision 4.6
Writing III (+3.23)
Item = Institution mean – National
Algebraic expression -3.0Arithmetic word problem 3.1Arithmetic word problem - profit -3.3Arithmetic word problem - rates 5.6Arithmetic word problem - work units 3.7Data interpretation - compare two charts 0.9Data interpretation - percents 2.2Data interpretation - range 3.3Geometric word problem - lengths 7.0
Mathematics I (+2.14%)
Item = Institution mean – Ntl
Arithmetic word problem - complex wording 2.8Arithmetic word problem - embedded ratios -6.3Arithmetic word problem - ratios, approximation 1.2Arithmetic word problem - weighted mean 4.9Draw conclusion from algebraic expression 3.0Measurement conversion -6.8Simplify algebraic expression 0.3Translation to algebraic expression -4.6Translation to algebraic expression 6.0
Mathematics II (+.06)
Item = Institution mean – National
Data interpretation - percent change -1.1Data interpretation - percent increase -1.5Data interpretation - rate of change -0.9Exponential growth 7.6Percent change - ratio and proportion -1.7Percent decrease 2.7Solution is algebraic expression -1.2Understanding of properties of integers 1.8Word problem - algebraic expression 2.4
Mathematics III (+0.9)
We don’t live in Lake Wobegon, MN where
◦ the women are strong,
◦ the men are good looking,
◦ and, ALL the children are above average.
Keep in Mind
General EducationDiscussion