NSSE: NSSE: A Window into A Window into Student and Student and Institutional Institutional Performance Performance George Kuh George Kuh University of Maine Trustees University of Maine Trustees Farmington ME Farmington ME March 19, 2007 March 19, 2007
59
Embed
NSSE: A Window into Student and Institutional Performance George Kuh University of Maine Trustees
NSSE: A Window into Student and Institutional Performance George Kuh University of Maine Trustees Farmington ME March 19, 2007. Commission on Future of Higher Education. Improve student academic preparation and make more financial aid available - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
NSSE:NSSE:A Window into Student A Window into Student
and Institutional and Institutional PerformancePerformance
George KuhGeorge KuhUniversity of Maine TrusteesUniversity of Maine Trustees
Commission on Future of Higher EducationCommission on Future of Higher Education
1.1. Improve student academic preparation and Improve student academic preparation and make more financial aid availablemake more financial aid available
2.2. Simplify & restructure student financial aid Simplify & restructure student financial aid system using incentives to control costs system using incentives to control costs
3.3. Cultivate a "robust culture of Cultivate a "robust culture of accountability & transparency“: invent accountability & transparency“: invent new student learning measures, make new student learning measures, make comparable information public, focus comparable information public, focus accreditation on outcomesaccreditation on outcomes
4.4. Embrace continuous innovation and Embrace continuous innovation and quality improvement. quality improvement.
5.5. Target federal investments to critical areas such Target federal investments to critical areas such as math, science, and foreign languages. as math, science, and foreign languages.
6.6. Develop a national strategy for lifelong learningDevelop a national strategy for lifelong learning
Association of American Colleges and Universities
We value what we measureWe value what we measure
Wise decisions are Wise decisions are needed about needed about whatwhat to to measure in the context measure in the context of campus mission, of campus mission, values, and desired values, and desired outcomes. outcomes.
2.2. What we’ve learned from NSSEWhat we’ve learned from NSSE
3.3. Unsolicited advice for trusteesUnsolicited advice for trustees
4.4. ConversationConversation
Student Success in CollegeStudent Success in College
Academic achievement, Academic achievement, engagement in engagement in educationally purposeful educationally purposeful activities, satisfaction, activities, satisfaction, acquisition of desired acquisition of desired knowledge, skills and knowledge, skills and competencies, competencies, persistence, attainment persistence, attainment of educational of educational objectives, and post-objectives, and post-college performancecollege performance
Pre-college Characteristics Pre-college Characteristics Associated with Student SuccessAssociated with Student Success
Academic preparationAcademic preparationAbility and college-level skillsAbility and college-level skillsFamily education and supportFamily education and supportFinancial wherewithalFinancial wherewithal
32.N162FG12
Postsecondary Education OPPORTUNITY Association for Institutional Research – May 16, 2006 – Chicago, Illinois
Early College Indicators of Early College Indicators of Persistence and SuccessPersistence and Success
Goal realizationGoal realization Psycho-social fitPsycho-social fit Credit hours completedCredit hours completed Academic and social supportAcademic and social support Involvement in the “right” kinds Involvement in the “right” kinds
of activitiesof activities
Factors That Threaten Persistence and Factors That Threaten Persistence and Graduation from College Graduation from College
academically underprepared for academically underprepared for college-level workcollege-level work
first-generation college studentfirst-generation college student gap between high school and college gap between high school and college 30+ hours working per week30+ hours working per week part-time enrollmentpart-time enrollment single parentsingle parent financially independentfinancially independent children at homechildren at home
What Really Matters in College: Student Engagement
Because individual effort and involvement are the critical determinants of impact, institutions should focus on the ways they can shape their academic, interpersonal, and extracurricular offerings to encourage student engagement.
Pascarella & Terenzini, Pascarella & Terenzini, How College How College Affects StudentsAffects Students, 2005, p. 602, 2005, p. 602
Foundations of Student EngagementFoundations of Student Engagement
Time on task Time on task (Tyler, 1930s)(Tyler, 1930s)
Quality of effort Quality of effort (Pace, 1960-70s)(Pace, 1960-70s)
Student-faculty contactStudent-faculty contact Active learningActive learning Prompt feedbackPrompt feedback Time on taskTime on task High expectationsHigh expectations Experiences with diversityExperiences with diversity Cooperation among studentsCooperation among students
The Student Engagement TrinityThe Student Engagement Trinity
What students What students dodo -- time and energy -- time and energy devoted to educationally purposeful devoted to educationally purposeful activitiesactivities
What institutions What institutions dodo -- using -- using effective educational practices to effective educational practices to induce students to do the right induce students to do the right thingsthings
Educationally effective institutions Educationally effective institutions channel student energy toward the channel student energy toward the right activitiesright activities
NSSE’s Survey InstrumentThe College Student ReportThe College Student Report
Student Behaviors
Institutional Actions & Requirements
Reactions to College
Student BackgroundInformation
Student Learning &
Development
National Survey of National Survey of Student EngagementStudent Engagement(pronounced “nessie”)
Community College Community College Survey of Student Survey of Student EngagementEngagement(pronounced “cessie”)
College student surveys that assess the extent to which students engage in educational practices associated with high levels of learning and development
OverviewOverviewInstitutional dataInstitutional dataMeans and frequenciesMeans and frequencies1st year students and 1st year students and
seniorsseniorsComparisons by peers, Comparisons by peers,
Carnegie, nationalCarnegie, nationalNational benchmarks National benchmarks Data use tipsData use tipsCD with raw data, etc.CD with raw data, etc.And more!And more!
What have weWhat have welearned so far?learned so far?
Grades, persistence, Grades, persistence, student satisfaction, student satisfaction, and engagement go and engagement go hand in handhand in hand
Does institutional size matter to Does institutional size matter to engagement?engagement?
Yes, Yes, size matters.size matters.
Smaller Smaller isis generally generally betterbetter..
Benchmark Scores for All Students by Undergraduate Enrollment
Benchmark Scores for All Students by Undergraduate Enrollment Intervals
First-Year Seminars and Experiences First-Year Seminars and Experiences Common Intellectual ExperiencesCommon Intellectual Experiences Learning CommunitiesLearning Communities Writing-Intensive CoursesWriting-Intensive Courses Collaborative Assignments and ProjectsCollaborative Assignments and Projects “ “Science as Science Is Done”; Science as Science Is Done”;
Undergraduate Research Undergraduate Research Diversity/Global LearningDiversity/Global Learning Service Learning, Community-Based Service Learning, Community-Based
Learning Learning InternshipsInternships Capstone Courses and ProjectsCapstone Courses and Projects
Effects of Learning Communities on EngagementEffects of Learning Communities on Engagement
Faculty Time Devoted to Research and Faculty Time Devoted to Research and Probability of Students Doing ResearchProbability of Students Doing Research
0
0.13
0.25
0.38
0.50
Pro
bab
ilit
y o
f U
nd
erg
rad
uate
Researc
h
2.02 6.04 10.07 14.09 18.11
Faculty Research (hours)
Faculty View of Importance of Doing Research Faculty View of Importance of Doing Research with Students and Probability of Students Doing with Students and Probability of Students Doing
ResearchResearch
0.13
0.25
0.38
0.50
0
Pro
bab
ilit
y o
f U
nd
erg
rad
uate
Researc
h
1.87 2.25 2.62 2.99 3.37
Importance of Undergraduate Research
Faculty Priorities and Faculty Priorities and Student EngagementStudent Engagement
1.1. When faculty members When faculty members emphasize certain educational emphasize certain educational practices, students engage in practices, students engage in them to a greater extent than them to a greater extent than their peers elsewhere.their peers elsewhere.
2.2. Good things go togetherGood things go together
First-Year Seminars and Experiences First-Year Seminars and Experiences Common Intellectual ExperiencesCommon Intellectual Experiences Learning CommunitiesLearning Communities Writing-Intensive CoursesWriting-Intensive Courses Collaborative Assignments and ProjectsCollaborative Assignments and Projects “ “Science as Science Is Done”; Science as Science Is Done”;
Undergraduate Research Undergraduate Research Diversity/Global LearningDiversity/Global Learning Service Learning, Community-Based Service Learning, Community-Based
Learning Learning InternshipsInternships Capstone Courses and ProjectsCapstone Courses and Projects
Effective Educational Practices Increase Effective Educational Practices Increase Odds That Students Will:Odds That Students Will:
Invest time and effort Invest time and effort Interact with faculty and peers Interact with faculty and peers
about substantive mattersabout substantive matters Experience diversityExperience diversity Get more frequent feedbackGet more frequent feedback Discover relevance of their Discover relevance of their
learning through real-world learning through real-world applicationsapplications
Institutional ReflectionInstitutional Reflection
Areas of Areas of EffectiveEffective
EducationalEducationalPracticePractice
Areas of Areas of Question or Question or ImprovementImprovement
PossibilitiesPossibilities
Merge NSSE data Merge NSSE data with school recordswith school records
Identify engagement Identify engagement patterns by student patterns by student characteristicscharacteristics
Predict retention, Predict retention, degree attainment, degree attainment, grades, other grades, other outcomesoutcomes
Track student Track student engagement year to engagement year to yearyear
Compare vs. peer, Compare vs. peer, aspirational, same-aspirational, same-region schools region schools
Program evaluation Program evaluation Accreditation Accreditation Consortium and Consortium and
system data sharingsystem data sharing Student outcomes Student outcomes
researchresearch Public reportingPublic reporting A national reporting A national reporting
1.l. l. Used an electronic medium (list-serv, chat group, Internet, etc.) to discuss or complete an assignment
1.m. Used e-mail to communicate with an instructor
10.g. Using computers in academic work
11.g. Using computing and information technology
SACS Standard
3.4.14 The institution’s use of technology enhances student learning, is appropriate for meeting the objectives of its programs, and ensures that students have access to and training in the use of technology.
Questions Trustees Should AskQuestions Trustees Should Ask
• To what extent does the To what extent does the institutional mission—espoused institutional mission—espoused and enacted—unmistakably and enacted—unmistakably emphasize student success? emphasize student success?
• How does the institution’s How does the institution’s spending plan enhance student spending plan enhance student learning and success? learning and success?
• What resources are available to What resources are available to support trying out good ideas? support trying out good ideas?
Put money where it will make a Put money where it will make a difference in student engagementdifference in student engagement
“…“…in professional in professional baseball it still baseball it still matters less how matters less how much you have much you have than how well you than how well you spend it”spend it”
Endowments & Undergraduate Enrollments Endowments & Undergraduate Enrollments of Selected Public DEEP Institutionsof Selected Public DEEP Institutions
Evergreen
$2,395,656
4,171 students
Fayetteville State
$8,465,541
5,029 students
UMF
$9,391,000
2,452 students
George Mason
$40,812,720
18,091 students
Source: US News America’s Best Colleges 2007
• What institutional and student-What institutional and student-performance indicators are used performance indicators are used to inform board decisions? to inform board decisions?
• Who is responsible for Who is responsible for maintaining an institutional focus maintaining an institutional focus on student success and reporting on student success and reporting these key indicators to the these key indicators to the board? board?
• Does the institution participate in Does the institution participate in NSSE and how are the results NSSE and how are the results being used (Bok, 2006)? being used (Bok, 2006)?
• Where do students and their Where do students and their learning fall among the board’s learning fall among the board’s interests and priorities? interests and priorities?
• Is a standing committee dedicated Is a standing committee dedicated to student learning and campus to student learning and campus life?life?
• Does the culture of the board Does the culture of the board encourage encourage or or discouragediscourage open, open, productive dialogue about matters productive dialogue about matters related to student success?related to student success?
•
Why stay the course?Why stay the course?
The good-to-great-transformations The good-to-great-transformations never happened in one fell swoop. never happened in one fell swoop. There was no single defining There was no single defining action, no grand program, no one action, no grand program, no one killer innovation, no solitary lucky killer innovation, no solitary lucky break, no miracle moment. break, no miracle moment. Sustainable transformations Sustainable transformations follow a predictable pattern of follow a predictable pattern of buildup and breakthroughbuildup and breakthrough……
(Collins, 2001, p. 186)
Last WordLast Word
A college or university cannot change A college or university cannot change the lineage of its students. Campus the lineage of its students. Campus cultures do not change easily or cultures do not change easily or willingly. But we can do far more to willingly. But we can do far more to shape the way students approach shape the way students approach college and what they do after they college and what they do after they arrive. arrive.
Do we have the Do we have the willwill to use promising to use promising policies and educational practices to policies and educational practices to increase the odds that more students increase the odds that more students “get ready,” “get in,” and “get “get ready,” “get in,” and “get through?”through?”