Trevecca Nazarene University 2011-12. Why have a General Education curriculum? How is General Education assessed? What were the results of last.

General Education Assessment

Trevecca Nazarene University2011-12

Today’s Questions Why have a General Education curriculum?

How is General Education assessed?

What were the results of last year’s assessment?

TNU BA/BS Degree

42%

31%

19%

8%

GenEdMajorMinor/SupportElectives

Why? General Education Curriculum

◦ Develop skills for life-long learning

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview◦ Locate the Major

within human knowledgeMajor/Minor

General Education

Body of Knowledge

Why? Institutional Educational Goals

General Education Outcomes

Institutional Educational Goals

1. Leadership, Service

2. Disciplined reflection

3. Factors shaping civilization

4. Appreciates global diversity

5. Write, speak, use technology

6. Think critically

7. Engenders wholeness

8. Productive influence

General Education Outcomes

1. speak, write

2. Holy Bible

3. Wesleyan-Holiness tradition

4. Systematic problem-solver

5. Global civilization

6. Modes of thinking

7. Christian faith and knowledge

8. Cultural diversity

9. Stewards of resources

How? Outcomes Assessment Cycle

Assessment Data Third-party standardized test

◦ Norm-referenced: 32 doctoral/research universities

◦ Criterion-referenced: skills, content

Multiple and varied approaches◦ Self-generated content questions◦ Self-generated survey questions◦ Samples of student work

2011-12 Assessment Results ETS-Proficiency Profile

◦ Measures 4 skills: Critical Thinking Reading Writing Mathematics

◦ In 3 contexts: Humanities Social Science Natural Science

Humanities

SocialScience

NaturalScience

Proficiency Profile Norm-referenced: all grades; 365 institutions of all types

◦ TNU Total Score: 66th percentile (n=148)

Proficiency Profile Norm-referenced: Seniors; 32 doctoral/research univ.

◦ TNU Total Score: 42nd percentile (n=148)

2011-12 Assessment Results

Met or exceeded the criterionfor 5 of 9 assessment measures

Complete report: http://gened.wiki.trevecca.edu

Assessment Results 3: …articulate parameters of the Wesleyan-

Holiness tradition, doctrinal and moral convictions of the Church of the Nazarene and the connection with intellectual, emotional, spiritual, and physical life individually and collectively.

◦ Goal: correctly answer 70% of 5 questions◦ Actual mean: 65%

Assessment Results 6: …demonstrate an understanding and

practice of various intellectual modes of thinking.

◦ Goal: on PP Critical Thinking, 50% will score “marginally proficient” or “proficient”

◦ Actual: 32% (9% proficient, 23% marginally proficient)

◦ Affinity group: 32% (11% proficient, 21% marginally proficient)

Assessment Results 7: …value the general education curriculum

of their degree program. Two questions were asked

◦ #12 Trevecca’s General Education program enriched my understanding of my academic major.

◦ #13 Trevecca’s Christian emphasis enriched my understanding of my academic major.

◦ Goal: 80% will agree/strongly agree to each question

◦ Actual: #12, 54%; #13, 58%

Assessment Results 7: …value the general education curriculum

of their degree program. One question was asked

◦ #14 Trevecca’s General Education program prepared me for Christian leadership and service in a global community.

◦ Goal: 80% will agree/strongly agree ◦ Actual: #14, 54%

2012-13 GenEd Outcomes

More on ETS PPCriterion measures

PP Skills Scores Norm-referenced: 32 doctoral/research universities

◦ Critical Thinking: 70th (95% c.i.: 44-84)

◦ Reading: 37th (95% c.i.: 28-58)

◦ Writing: 26th (95% c.i.: 16-42)

◦ Mathematics: 33rd (95% c.i.: 28-49)

PP Context Scores Norm-referenced: 32 doctoral/research universities

◦ Humanities: 44th (95% c.i.: 30-72)

◦ Social Sciences: 53rd (95% c.i.: 30-77)

◦ Natural Sciences: 44th (95% c.i.: 26-60)

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not Proficient

Reading 1 74% 14% 12%

Reading 2 48% 16% 36%

Critical Thinking 9% 23% 68%

Writing 1 65% 25% 10%

Writing 2 28% 34% 38%

Writing 3 13% 27% 60%

Math 1 63% 22% 16%

Math 2 32% 31% 37%

Math 3 11% 15% 74%

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not Proficient

Reading 1 74% 71% 14% 17% 12% 13%

Reading 2 48% 43% 16% 18% 36% 38%

Critical Thinking 9% 10% 23% 20% 68% 70%

Writing 1 65% 67% 25% 24% 10% 10%

Writing 2 28% 24% 34% 36% 38% 40%

Writing 3 13% 10% 27% 28% 60% 61%

Math 1 63% 61% 22% 21% 16% 19%

Math 2 32% 36% 31% 24% 37% 40%

Math 3 11% 12% 15% 19% 74% 68%

ETS PP Item Information

Composite ReportSeptember 2009 – February 2012Trevecca Nazarene University(n = 365)

Skill Area/Proficiency Level Institution mean – National mean

Reading I 3.98

Reading II 1.14

Critical Thinking 1.8

Writing I 3.09

Writing II 4.9

Writing III 3.23

Mathematics I 2.4

Mathematics II 0.06

Mathematics III 0.9

Composite 2.27

Item Analysis 2009-2012

Item = Institution mean – National

Discern facts from a passage 4.26

Meaning in context 3.85

Reading I (+3.98)

Item = Institution mean – National

Discern main idea 1.35

Discern primary purpose -0.43

Discern purpose of a reference 2.95

Recognize a valid inference 1.82

Synthesize material -0.25

Reading II (+1.14)

Item = Institution mean – National

Determine relevance of information 1.6

Evaluate an argument 4.0

Evaluate data for consistency 6.4

Evaluate explanations 10.5

Evaluate hypotheses -4.5

Extrapolate from known facts 2.9

Recognize an assumption 2.82

Recognize flaws in argument 3.95

Recognize salient features -3.3

Critical Thinking (+1.8%)

Item = Institution mean – National

Incorrect word choice 7.5

Order sentences 4.5

Recognize agreement 1.8

Recognize appropriate transitions 4.4

Recognize incorrect punctuation -0.3

Writing I (+3.09)

Item = Institution mean – National

Combine simple clauses 2.0

Incorporate new material in paragraph 7.7

Recast an existing sentence 4.3

Recognize agreement 6.45

Writing II (+4.9)

Item = Institution mean – National

Recognize correct construction 3.8

Recognize incorrect construction -2.0

Recognize most effective revision 4.6

Writing III (+3.23)

Item = Institution mean – National

Algebraic expression -3.0

Arithmetic word problem 3.1

Arithmetic word problem - profit -3.3

Arithmetic word problem - rates 5.6

Arithmetic word problem - work units 3.7Data interpretation - compare two charts 0.9

Data interpretation - percents 2.2

Data interpretation - range 3.3

Geometric word problem - lengths 7.0

Mathematics I (+2.14%)

Item = Institution mean – Ntl

Arithmetic word problem - complex wording 2.8

Arithmetic word problem - embedded ratios -6.3Arithmetic word problem - ratios, approximation 1.2

Arithmetic word problem - weighted mean 4.9

Draw conclusion from algebraic expression 3.0

Measurement conversion -6.8

Simplify algebraic expression 0.3

Translation to algebraic expression -4.6

Translation to algebraic expression 6.0

Mathematics II (+.06)

Item = Institution mean – National

Data interpretation - percent change -1.1

Data interpretation - percent increase -1.5

Data interpretation - rate of change -0.9

Exponential growth 7.6

Percent change - ratio and proportion -1.7

Percent decrease 2.7

Solution is algebraic expression -1.2

Understanding of properties of integers 1.8

Word problem - algebraic expression 2.4

Mathematics III (+0.9)

We don’t live in Lake Wobegon, MN where

◦ the women are strong,

◦ the men are good looking,

◦ and, ALL the children are above average.

Keep in Mind

General EducationDiscussion