Results of AUC’s First NSSE · Results of AUC’s First NSSE ... Did a practicum, internship, field experience, clinical assignment ... often than NSSE peers in CBL.

Results of AUC’s First NSSE Administration 2009-2010

Office of Institutional Research

November 6, 2010

What We’ll Talk About

• What is Student Engagement and Why Do We Measure It?

• NSSE Background

• Survey Administration

• Selected AUC Results

– Satisfaction

– What We Do Well

– What Needs Work

• Directions for Action

What is Student Engagement? • What students do -- time and energy devoted

to studies and other educationally purposeful activities

– Research shows this is the single best predictor of their learning and personal development.

• What institutions do -- using resources and effective educational practices to induce students to do the right things

• Educationally effective institutions channel student energy toward the right activities

NSSE Background

• Launched with grant from The Pew Charitable Trusts in 1999, supported by institutional participation fees since 2002.

• Designed to assess the extent to which students are engaged in effective educational practices and what they gain from their college experiences.

• Main content represents student behaviors highly correlated with many desirable learning and personal development outcomes of college.

NSSE Background • More than 2,395,000 students from over 1,400

colleges and universities have participated to date.

• Institution types, sizes, and locations represented in NSSE are largely representative of U.S. baccalaureate institutions.

NSSE 2010 Institutions by Carnegie Classification

4%

8%

6%

24%

13%

7%

20%

18%

6% 7%

5%

22%

12%

8%

18%

23%

0%

5%

10%

15%

20%

25%

30%

RU/VH RU/H DRU Master’s L Master’s M Master’s S Bac/A&S Bac/Diverse

NSSE Schools

All 4-year Schools

Survey Administration

• All first-year and senior students with working email addresses in the student information system.

• Administration in spring term

• Web-based

• Multiple follow-ups to increase response rates

NSSE 2010 Survey Population and Response

• More than 1.2 million students were invited to participate in NSSE 2010, with 393,630 responding

• At AUC, 2,180 First-Years and 552 Seniors were invited to participate.

NSSE 2010 Response Rates

• AUC’s response rate = 35%

– (FY = 34%, SR = 35%)

• Comparison Groups:

– Basic Carnegie Class = 31%

– Middle East/Asia = 30%

– All NSSE 2010 = 32%

Comparison Groups

• Basic Carnegie Class (MA, Large): 123

• Middle East/Asia: 7

– American University of Afghanistan

– American University of Sharjah

– Carnegie Mellon, Qatar Campus

– Georgetown University School of Foreign Service in Qatar

– Lebanese American University

– Texas A&M University at Qatar

– Virginia Commonwealth University in Qatar

• All NSSE 2010 Institutions: 595

SELECTED AUC RESULTS

Demographics of AUC Respondents

• % Full-time:

• Gender:

• % Residence On Campus:

• % International: 14% FY, 14% Seniors

91%

93%

First-Year

Seniors

55%

44%

45%

56%

First-Year

Seniors Male

Female

12%

11%

First-Year

Seniors

Satisfaction • 87% of first-years and 85% of seniors reported that

their entire educational experience at AUC was good or excellent. – No significant differences from Carnegie and NSSE peers.

1.5% 11.2%

51.9%

35.4%

1.7% 10.2%

48.8%

39.2%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

Poor Fair Good Excellent

How would you evaluate your entire educational experience at this institution?

AUC First-Years NSSE First-Years

1.2% 13.7%

50.6%

34.5%

2.0% 10.7%

45.9% 41.5%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

Poor Fair Good Excellent

How would you evaluate your entire educational experience at this institution?

AUC Seniors NSSE Seniors

Satisfaction • 83% of first-years and 81% of seniors would

go to AUC, if they could start over again. – First-years report slightly lower mean response than Carnegie peers. No other

significant differences from comparison group peers.

82.9% 84.6% 81.4% 82.9%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years NSSE First-Years AUC Seniors NSSE Seniors

Percent which would go to same institution again, if starting over

Benchmarks of Effective Educational Practice Comparison Groups

Class

AUC Basic Carnegie

Class Middle

East/Asia NSSE 2010

Level of Academic Challenge (LAC)

How challenging is your institution's intellectual and creative work?

First-Year 56 54*** 56 55**

Senior 58 57 61 58

Active and Collaborative Learning (ACL)

Are your students actively involved in their learning, individually and working with others?

First-Year 47 44*** 49 44***

Senior 56 52** 56 52***

Student-Faculty Interaction (SFI)

Do your students work with faculty members inside and outside the classroom?

First-Year 33 35*** 35 35**

Senior 41 42 43 43

Enriching Educational Experiences (EEE)

Do your students take advantage of complementary learning opportunities?

First-Year 25 27*** 27** 28***

Senior 44 39*** 40** 41

Supportive Campus Environment (SCE)

Do your students feel the institution is committed to their success?

First-Year 57 63*** 64*** 63***

Senior 55 60*** 59* 60***

•Level of significance (***p<.001, **p<.01, *p<.05) •Green = AUC compares favorably •Red = AUC compares unfavorably

What We Do Well… Highest Performing Benchmark Items Relative to Basic Carnegie Class Comparison Groups

Ques- tion

Bench- mark1 Percent of students who...

AUC Basic

Carnegie Class

Middle East/Asia

NSSE 2010

First-Year Students

3c. LAC Wrote at least one paper or report of 20 pages or more 41% 20% 42% 20%

3d. LAC Wrote more than 4 papers or reports between 5 and 19 pages 42% 32% 35% 34%

3e. LAC Wrote more than 10 papers or reports of fewer than 5 pages 45% 32% 35% 32%

1a. ACL Asked questions/contributed to class discussions2 74% 62% 71% 61%

1j. ACL Tutored or taught other students (paid or voluntary)2 26% 15% 31% 16%

Seniors 3c. LAC Wrote at least one paper or report of 20 pages or more 79% 49% 76% 51%

1j. ACL Tutored or taught other students (paid or voluntary)2 39% 20% 35% 22%

7a. EEE Did a practicum, internship, field experience, clinical assignment

75% 48% 63% 52%

7h. EEE Completed a culminating senior experience (capstone, thesis, comp. exam)

55% 32% 39% 34%

9d. EEE Spent more than 5 hours/week in co-curricular activities 42% 22% 22% 27%

What We Do Well…

• AUC first-years report higher mean response than NSSE peers to working hard to meet instructor’s standards or expectations.

* Level of significance

63.7% 59.5% 58.4%

62.3%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years**


Often worked harder than you thought you could to meet an instructor's standards or

expectations

What We Do Well… • More than 80% of first-year

and seniors report substantial emphasis on analysis.


82.5% 81.0% 88.5% 86.3%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years NSSE First-Years


Coursework substantially emphasizes: Analyzing the basic elements of an idea, experience, or

theory

What We Do Well… • AUC first-years and seniors

report more often making class presentations.


39.0% 34.1%

73.1%

62.1%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years NSSE First-Years**

AUC Seniors NSSE Seniors***

Often made a class presentation

What We Do Well… • AUC first-years and seniors

more often worked with classmates outside of class.

• Both first-years and seniors report more often discussing ideas with faculty after class.

49.0% 46.6%

72.9%

60.8%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years NSSE First-Years* AUC Seniors NSSE Seniors***

Often worked with classmates outside of class to prepare class assignments

What We Do Well… • 72% of first-years plan to

study abroad, compared to 44% in NSSE cohort.

• Seniors report more participation in co-curricular activities than NSSE peers • Almost 50% of seniors spend 1-10 hours a

week in co-curricular activities

76.3%

43.9%

25.4%

9.1%

1.8%

3.0%

19.7%

16.0%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

AUC First-Years

NSSE First-Years*


Study Abroad

Done

Plan to do

What Needs Work… Lowest Performing Benchmark Items Relative to Basic Carnegie Class Comparison Groups

Ques- tion

Bench- mark1 Percent of students who...

AUC Basic

Carnegie Class

Middle East/Asia

NSSE 2010

First-Year Students

1o. SFI Talked about career plans with a faculty member or advisor2 22% 34% 28% 32%

1u. EEE Had serious conversations w/ students of another race or ethnicity2 38% 50% 45% 52%

8c. SCE Positively rated their relationships with admin. personnel and offices3

48% 61% 65% 61%

10d. SCE Said the institution substantially helps students cope w/ non-acad. matters4

33% 42% 44% 40%

10e. SCE Said the institution provides substantial support for students' social needs4

43% 52% 53% 51%

Seniors

1q. SFI Received prompt written or oral feedback from faculty2 53% 68% 52% 67%

1l. EEE Used an electronic medium to discuss or complete an assignment2 51% 63% 62% 62%

1u. EEE Had serious conversations w/ students of another race or ethnicity2 42% 53% 52% 54%

7e. EEE Completed foreign language coursework 22% 35% 23% 42%

8c. SCE Positively rated their relationships with admin. personnel and offices3

38% 58% 54% 58%

• Both AUC first-years and seniors report less emphasis on applying theories than NSSE peers.


What Needs Work…

68.6% 76.1% 76.9%

82.6%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***

AUC Seniors NSSE Seniors*

Coursework emphasizes: Applying theories or concepts to practical problems or in new

situations Combined a bit and much

• First-years participated less often than NSSE peers in CBL.


What Needs Work…

11.8% 14.5% 13.8% 18.8%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***


Participated in a community-based project (e.g. service learning) as part of a regular course

• First-years report less often interacting with students of different beliefs, opinions or values than NSSE peers.


What Needs Work…

45.5%

55.3% 53.3% 56.1%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***


Often had serious conversations with students who are very different from you in terms of their religious beliefs, political opinions, or

personal values

• Fewer first years than NSSE peers report AUC’s environment encourages contact with different groups.


What Needs Work…

53.6% 59.4%

48.6% 51.7%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***


Encourages substantial contact among students from different economic, social, and

racial or ethnic backgrounds

• Fewer students than those in all three comparison groups report satisfaction with the quality of academic advising they’ve received.


What Needs Work…

69.1%

80.0%

55.4%

72.6%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years NSSE First-Years***

AUC Seniors NSSE Seniors***

Quality of academic advising you have received at your institution (Combined Good and Excellent)

• Relatively fewer students strongly agree that faculty members are available, helpful, sympathetic.


What Needs Work…

37.8%

49.3% 46.9%

58.1%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***

AUC Seniors NSSE Seniors**

Percent that agree that faculty members are available, helpful, sympathetic

• Relatively fewer first-years agree that AUC provides the support needed for academic success or to thrive socially.


What Needs Work…

43.0% 51.2%

37.9% 39.7%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***


Provides substantial support for social success

72.8% 79.6%

65.1% 74.2%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

AUC First-Years

NSSE First-Years***


Provides substantial support for academic success

Directions for Action • Examine, share, and use results to make improvements.

– What are areas of interest?

– Who needs to be involved?

• What are AUC’s priorities?

• In addition to comparison with peers, what should our absolute targets/benchmarks be?

• Tie results to:

– University outcomes

– MSCHE standards

– Standards of professional accrediting bodies

– AUC’s strategic goals

Directions for Action • First-Years:

– Increase opportunities for CBL

– Improve support provided in the first year to set the stage for academic and social success.

– Expand encounters with racial, religious, political, ethnic, etc. diversity in first-year courses

• Seniors

– Encourage faculty to integrate web 2.0 tools in coursework

Directions for Action • Both:

– Increase opportunities for applying theory in courses

– Increase opportunities for student-faculty interaction

– Stress to faculty the importance of prompt feedback on assignments

– Improve academic advising and increase faculty mentoring

– Increase opportunities for interaction with different, diverse groups

– Work with faculty and staff to stress the importance of availability and a service culture

• Compare with NSSE results next year

Examples of Using NSSE Data • University of Tennessee: Hired FT academic advisors to

provide more assistance to students, improved orientation to give students more one-one-one advising time.

• UNLV: Hired more academic advisors, required advising for freshman and transfers, created Academic Success Center to consolidate and enhance academic support services.

• Illinois State U: Uses NSSE data as input to solution-based programming.

• Univ. of Akron: Used NSSE results to create more exposure to diversity in FY and gen-ed courses; more professional development for faculty and admin. who work with FY students; better ways of communicating with FY students, etc.

• Detailed reports are available on OIR website: http://www.aucegypt.edu/RESEARCH/IR/ASSESS/Pages/NSSE.aspx

• Reports by major grouping are available with the Deans.

• Use results to make improvements; as support for accreditation.

• For more information or analysis, contact OIR.

http://www.aucegypt.edu/RESEARCH/IR/ASSESS/Pages/NSSE.aspx

http://www.aucegypt.edu/RESEARCH/IR/ASSESS/Pages/NSSE.aspx

Results of AUC’s First NSSE · Results of AUC’s First NSSE ... Did a practicum, internship, field experience, clinical assignment ... often than NSSE peers in CBL.

Documents