General Education Assessment

General Education Assessment

Trevecca Nazarene University2011-12

Today’s Questions Why have a General Education curriculum?

How is General Education assessed?

What were the results of last year’s assessment?

TNU BA/BS Degree

42%

31%

19%

8%

GenEdMajorMinor/SupportElectives

Why? General Education Curriculum

◦ Develop skills for life-long learning

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview◦ Locate the Major

within human knowledgeMajor/Minor

General Education

Body of Knowledge

Why? Institutional Educational Goals

General Education Outcomes

Institutional Educational Goals

1. Leadership, Service

2. Disciplined reflection

3. Factors shaping civilization

4. Appreciates global diversity

5. Write, speak, use technology

6. Think critically

7. Engenders wholeness

8. Productive influence

General Education Outcomes

1. speak, write

2. Holy Bible

3. Wesleyan-Holiness tradition

4. Systematic problem-solver

5. Global civilization

6. Modes of thinking

7. Christian faith and knowledge

8. Cultural diversity

9. Stewards of resources

How? Outcomes Assessment Cycle

Assessment Data Third-party standardized test

◦ Norm-referenced: 32 doctoral/research universities

◦ Criterion-referenced: skills, content

Multiple and varied approaches◦ Self-generated content questions◦ Self-generated survey questions◦ Samples of student work

2011-12 Assessment Results ETS-Proficiency Profile

◦ Measures 4 skills: Critical Thinking Reading Writing Mathematics

◦ In 3 contexts: Humanities Social Science Natural Science

Humanities

SocialScience

NaturalScience

Proficiency Profile Norm-referenced: all grades; 365 institutions of all types

◦ TNU Total Score: 66th percentile (n=148)

Proficiency Profile Norm-referenced: Seniors; 32 doctoral/research univ.

◦ TNU Total Score: 42nd percentile (n=148)

2011-12 Assessment Results

Met or exceeded the criterionfor 5 of 9 assessment measures

Complete report: http://gened.wiki.trevecca.edu

Assessment Results 3: …articulate parameters of the Wesleyan-

Holiness tradition, doctrinal and moral convictions of the Church of the Nazarene and the connection with intellectual, emotional, spiritual, and physical life individually and collectively.

◦ Goal: correctly answer 70% of 5 questions◦ Actual mean: 65%

Assessment Results 6: …demonstrate an understanding and

practice of various intellectual modes of thinking.

◦ Goal: on PP Critical Thinking, 50% will score “marginally proficient” or “proficient”

◦ Actual: 32% (9% proficient, 23% marginally proficient)

◦ Affinity group: 32% (11% proficient, 21% marginally proficient)

Assessment Results 7: …value the general education curriculum of

their degree program. Two questions were asked

◦ #12 Trevecca’s General Education program enriched my understanding of my academic major.

◦ #13 Trevecca’s Christian emphasis enriched my understanding of my academic major.

◦ Goal: 80% will agree/strongly agree to each question◦ Actual: #12, 54%;

#13, 58%

Assessment Results 7: …value the general education curriculum

of their degree program. One question was asked

◦ #14 Trevecca’s General Education program prepared me for Christian leadership and service in a global community.

◦ Goal: 80% will agree/strongly agree ◦ Actual: #14, 54%

2012-13 GenEd Outcomes

More on ETS PPCriterion measures

PP Skills Scores Norm-referenced: 32 doctoral/research universities

◦ Critical Thinking: 70th (95% c.i.: 44-84)

◦ Reading: 37th (95% c.i.: 28-58)

◦ Writing: 26th (95% c.i.: 16-42)

◦ Mathematics: 33rd (95% c.i.: 28-49)

PP Context Scores Norm-referenced: 32 doctoral/research universities

◦ Humanities: 44th (95% c.i.: 30-72)

◦ Social Sciences: 53rd (95% c.i.: 30-77)

◦ Natural Sciences: 44th (95% c.i.: 26-60)

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not ProficientReading 1 74% 14% 12%Reading 2 48% 16% 36%Critical Thinking 9% 23% 68%Writing 1 65% 25% 10%Writing 2 28% 34% 38%Writing 3 13% 27% 60%Math 1 63% 22% 16%Math 2 32% 31% 37%Math 3 11% 15% 74%

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not ProficientReading 1 74% 71% 14% 17% 12% 13%Reading 2 48% 43% 16% 18% 36% 38%Critical Thinking 9% 10% 23% 20% 68% 70%Writing 1 65% 67% 25% 24% 10% 10%Writing 2 28% 24% 34% 36% 38% 40%Writing 3 13% 10% 27% 28% 60% 61%Math 1 63% 61% 22% 21% 16% 19%Math 2 32% 36% 31% 24% 37% 40%Math 3 11% 12% 15% 19% 74% 68%

ETS PP Item Information

Composite ReportSeptember 2009 – February 2012Trevecca Nazarene University(n = 365)

Skill Area/Proficiency Level Institution mean – National mean

Reading I 3.98Reading II 1.14Critical Thinking 1.8Writing I 3.09Writing II 4.9Writing III 3.23Mathematics I 2.4Mathematics II 0.06Mathematics III 0.9 Composite 2.27

Item Analysis 2009-2012

Item = Institution mean – National

Discern facts from a passage 4.26Meaning in context 3.85

Reading I (+3.98)

Item = Institution mean – National

Discern main idea 1.35Discern primary purpose -0.43Discern purpose of a reference 2.95Recognize a valid inference 1.82Synthesize material -0.25

Reading II (+1.14)

Item = Institution mean – National

Determine relevance of information 1.6Evaluate an argument 4.0Evaluate data for consistency 6.4Evaluate explanations 10.5Evaluate hypotheses -4.5Extrapolate from known facts 2.9Recognize an assumption 2.82Recognize flaws in argument 3.95Recognize salient features -3.3

Critical Thinking (+1.8%)

Item = Institution mean – National

Incorrect word choice 7.5Order sentences 4.5Recognize agreement 1.8Recognize appropriate transitions 4.4Recognize incorrect punctuation -0.3

Writing I (+3.09)

Item = Institution mean – National

Combine simple clauses 2.0Incorporate new material in paragraph 7.7Recast an existing sentence 4.3Recognize agreement 6.45

Writing II (+4.9)

Item = Institution mean – National

Recognize correct construction 3.8Recognize incorrect construction -2.0Recognize most effective revision 4.6

Writing III (+3.23)

Item = Institution mean – National

Algebraic expression -3.0Arithmetic word problem 3.1Arithmetic word problem - profit -3.3Arithmetic word problem - rates 5.6Arithmetic word problem - work units 3.7Data interpretation - compare two charts 0.9Data interpretation - percents 2.2Data interpretation - range 3.3Geometric word problem - lengths 7.0

Mathematics I (+2.14%)

Item = Institution mean – Ntl

Arithmetic word problem - complex wording 2.8Arithmetic word problem - embedded ratios -6.3Arithmetic word problem - ratios, approximation 1.2Arithmetic word problem - weighted mean 4.9Draw conclusion from algebraic expression 3.0Measurement conversion -6.8Simplify algebraic expression 0.3Translation to algebraic expression -4.6Translation to algebraic expression 6.0

Mathematics II (+.06)

Item = Institution mean – National

Data interpretation - percent change -1.1Data interpretation - percent increase -1.5Data interpretation - rate of change -0.9Exponential growth 7.6Percent change - ratio and proportion -1.7Percent decrease 2.7Solution is algebraic expression -1.2Understanding of properties of integers 1.8Word problem - algebraic expression 2.4

Mathematics III (+0.9)

We don’t live in Lake Wobegon, MN where

◦ the women are strong,

◦ the men are good looking,

◦ and, ALL the children are above average.

Keep in Mind

General EducationDiscussion