UWSP STUDENT AFFAIRS DIVISION ASSESSMENT PRESENTATION CAREER SERVICES OFFICE OCTOBER 21, 2010 Presented by Angie Kellogg and Lorry Walters
UWSP STUDENT AFFAIRS DIVISION
ASSESSMENT PRESENTATION
CAREER SERVICES OFFICE
OCTOBER 21, 2010
Presented by Angie Kellogg and Lorry Walters
Who we are
Our staff roles
Angie Kellogg - Director
Lorry Walters - Associate Director
Mike Pagel - Career Specialist
Lauri Martin Keefe - Career Specialist
John Zach - Career Development Coordinator
Patti Tomlinson - Coordinator of Scholarships & the
Honors Intern Program
Teri Jenkins - Office Manager
Our mission
Provide comprehensive career/life
planning and job search services linking
education and the world of work for
UWSP students and alumni.
Our stakeholders & services
Students and alumni Career exploration/assessments
Job search preparation
Intern/relevant experience and
career employment resources
Graduate/professional studies
assistance
STAKEHOLDERS SUMMARY OF SERVICES
Stakeholders & services-continued
Faculty and staff Classroom presentations/
coverage
Student organization programs
Liaison to employers
Web links to legal/ethical issues,
internship resources, economic/
workforce information
STAKEHOLDER SUMMARY OF SERVICES
Stakeholders & services-continued
Employers Posting openings
Electronic access to resumes
On-campus recruiting
Job/career fairs
Liaison to faculty/staff and
student organizations
STAKEHOLDERS SUMMARY OF SERVICES
Our services-continued
In addition, our staff coordinate the university-wide
Honors Intern Program and institutional-level
scholarships, assist Admissions with recruiting,
coordinate the New Student Orientation program,
and teach HPW 107-career exploration (two sections
each year).
Service delivery
We provide our services through:
In-person appointments and walk-in hours
Telephone appointments and conversations
E-mail interactions
Group presentations and career events
Classroom instruction
Office website
Office resource room materials
Demographics 2009-10
PROFILE OF OFFICE USERS
INDIVIDUAL APPOINTMENTS
Women 713
Men 509
Freshmen 128
Sophomores 144
Juniors 206
Seniors 554
Grad Students 37
Alumni 118
Other 35
TOTALS 1222
WALK-IN APPOINTMENTS
Women 77
Men 77
Freshmen 13
Sophomores 14
Juniors 38
Seniors 82
Grad Students 1
Alumni 4
Other 2
TOTALS 154
REASONS FOR VISITING OFFICE
Resume/Cover Letter Writing 819
Career Exploration 346
Career Assessment 207
Campbell Interest & Skill Survey 193
Myers-Briggs Type Indicator 196
Job Search (how to find a job) 163
Academic Issues (choosing/changing a major or minor) 156
Internships 142
Seasonal Employment 126
Honors Internship Program 92
Skill Identification 91
Interviewing 76
Grad/Professional Studies (program id/application) 64
Employer Identification 55
Other 55
InterviewStream (practice interview system) 15
No Response 3
Demographics 2009-10 continued
CAREER SERVICES PROGRAMS/CLASS PRESENTATIONS
CAREER PROGRAMS
# of programs 91
# of attendees 1619
CLASS PRESENTATIONS
# of presentations 96
# of students 2759
Intended outcomes
OUTCOME 1 - Students will explore potential major and career options based on an awareness of their skills, interests and values, as well as occupational and educational information.
OUTCOME 2 - Students will prepare for finding suitable employment or further education by developing effective search strategies and candidate presentation skills.
OUTCOME 3 - We will connect students/alumni with employers for information on career-related competencies and employment opportunities.
OUTCOME 4 - At least 90% of students will be satisfied with their experiences in the Career Services Office.
Methods of assessment for presentation
User Counts (2009-10) Demographic data on office users, reasons for visiting office, programs and class presentations
Learning Outcomes Survey - pilot (Spring 2010) Students completed paper surveys after meeting with career counselors
(22 responses)
Class Evaluations/Reflection Papers (Fall 2009/Spring 2010) Students in Career Exploration class (HPW 107) completed a 21-question course evaluation
and wrote reflection papers
(Fall 2009 - 22 students/Spring 2010 - 24 students)
SAAC Focus Groups (April 2009) SAAC conducted focus groups with advisees regarding what influences and resources shaped
their decision in choosing a major
(12 students - 2 groups of 6 students each)
Employer Survey (August 2009) Survey distributed via Survey Monkey to employers to worked with our office
(34 employers)
Methods of assessment for presentation
Follow-Up Studies of UWSP Graduates (2009) Reports provide data on the employment/educational status of UWSP graduates; data
collected through e-mail, regular mailings, telephone surveys, social media postings, faculty
inquiries, and employer surveys
(Teaching - 94% contact rate/200 of 212 graduates; Non-Teaching - 85%/1,200 of 1,433
graduates)
Job Fair Surveys (Spring 2009/Spring 2010) Surveys are given to employers who participate in the Central Wisconsin Collegiate Job Fairs
(2010 - 72% / 2009 - 85% response rates)
CareerPoint Counts (2009-10) Employer utilization data and job posting counts
User Satisfaction Survey (Monthly) Students who visited our office completed monthly user satisfaction surveys via Survey Monkey:
2008-09 - 24.5% (253 responses/1029 sent); 2007-08 - 29.3% (261responses/892 sent);
2006-07 - 26% (246 responses/946 sent); 2005-06 - 19.8% (223 responses/1128 sent);
2004-05 - 14.6% (245 responses/1669 sent)
Other methods of assessment
Program Evaluations
Students complete written evaluations after career workshops and presentations
NACE Benchmarking
We participate in an annual benchmarking survey through the National Association of Colleges and Employers (NACE)
Honors Intern/Supervisor’s Survey
Surveys are given to Honors Interns and their supervisors to track the level of certain marketable skills and employer-valued attributes
Job Fair Surveys
Surveys are given to students attending the Central Wisconsin Collegiate Job Fair
User Counts
We track usage of our services and resources (e.g. InterviewStream)
Faculty/Staff Survey
We distributed a survey to faculty/staff asking for feedback on services we offer supporting their instructional role
Outcome 1
Students will explore potential major and
career options based on an awareness of
their skills, interests, and values, as well as
occupational and educational information.
Learning Outcomes Survey – pilot
Class Evaluations/Reflection Papers
SAAC Focus Groups
Results
LEARNING OUTCOMES SURVEY Agree Disagree
CLASS EVALUATIONS
OUTCOMES - Career assessment follow-up 4 3 2 1 N/A
I know that my values, interests and skills are interrelated with my choice of
major/career4 2 0 0 0
I know where to locate info/resources to further investigate major and career options 5 1 0 0 0
I value the importance of reflection and self-discovery in my academic/career decision
making process6 0 0 0 0
I learned how my personality affects the way I gather information and make decisions 5 1 0 0 0
I understand that career development is a lifelong process 6 0 0 0 0
OUTCOMES - Selected items Spring 2010 Fall 2009
This course provided me information, activities, and resources helpful in my career
development and planning.4.67 4.36
The WISCareers Internet program was helpful in providing information and career options. 4.46 4.0
The WISCareer budget program was helpful in understanding the need to think about future
budget goals and the future salary expectations and requirements3.5 3.55
The MBTI and CISS career assessments were helpful in thinking about myself and my future. 3.67 3.77
I would recommend this course to friends of mine. 4.38 4.18
Overall, I would rate this as an excellent course. 4.38 4.45
Responses were on a 5-point Likert Scale: 5-Strongly agree; 4-Agree; 3-Neutral; 2-Disagree; 1-Strong Disagree
Results-continued
CLASS REFLECTION PAPERS
“It was also a relief to know that I definitely wasn‟t the only person lost in the ocean.”
“The portfolios were extremely helpful in determining what kind of things I want in a job, where I would like to live, what good questions to ask in an interview, and what skills I possess and can use in a work place.”
“I have a much better idea of the direction I am headed and, more importantly, how to get there.”
SAAC FOCUS GROUPS
Helpful Influences: Career counselors; career assessments; CS library
“The first weekend that we move in, I think it would be kind of cool that before you have any classes, . . . there could be some kind of career fair where anyone can get information on careers or anything.”
“Maybe a list, every major would have to do this, but various jobs that people got after they graduated with that major.”
Implications
Career Services provided training for SAAC advisors to help
facilitate follow-up after students complete the assessments.
Career Services and SAAC are collaborating to develop a
new 8-week class focused on major/career exploration and
student success.
Career Services sponsored a “Career Party” workshop during
the time between move-in and the start of classes.
We made valuable exploration resources such as the Career
Portal and WISCareers accessible directly from the homepage
of our website.
Outcome 2
Students will prepare for finding suitable
employment or further education by
developing effective search strategies
and candidate presentation skills.
Learning Outcomes Survey – pilot
Employer Survey
Follow-up Studies of UWSP Graduates
Results
LEARNING OUTCOMES SURVEY
OUTCOMES – Resume/cover letter follow-up 4 3 2 1 N/A
I received useful feedback on my draft document(s) 13 0 0 0 0
I know the components/key elements of a resume and/or cover letter 12 1 0 0 0
I am able to describe my greatest strengths when marketing myself to employers 7 6 0 0 0
I have resources to use for further development of my document(s) 12 1 0 0 0
My questions were answered 13 0 0 0 0
OUTCOMES – Job search resources follow-up 4 3 2 1 N/A
I am familiar with CareerPoint, the online system used by Career Services 9 4 0 0 0
I understand the importance of networking in the job search process 12 1 0 0 0
I know helpful Internet sites to use for my job search 8 3 2 0 0
My questions were answered 9 2 2 0 0
Responses were on a 4-point Likert scale: 4-Agree to 1-Disagree
Results-continued
EMPLOYER SURVEY
How do UWSP students/grads compare to students/grads from other schools?
“We see very solid students coming from UW-Stevens Point that compare very positively with students from other schools.”
“Overall they compare pretty well, but in some cases lacking professionalism in dress.”
What can students do to be better prepared for the work environment?
“Job shadow as early as possible in their college career.”
“Work thru college, gain experience thru internships and summer jobs.”
What can students do to improve their success in the application process?
“Have someone else review their resume, interview early and often to gain experience and be confident by the time they are a senior and looking for a career.”
“Be prepared and professional. Practice speaking, answering questions and double check work.”
Results-continued
FOLLOW-UP STUDIES OF UWSP GRADUATES
NON-
TEACHINGTotal # grads Total # seeking Employed in field Employed out of field Further schooling Total Placed
2009 1433 1204 552 (46%) 178 (15%) 230 (19%) 960 (80%)
2008 1365 1238 675 (54%) 171 (14%) 243 (20%) 1089 (88%)
2007 1327 1219 729 (60%) 156 (13%) 215 (17%) 1100 (90%)
2006 1312 1227 667 (54%) 219 (18%) 227 (19%) 1113 (91%)
2005 1311 1209 673 (56%) 228 (19%) 209 (17%) 1110 (92%)
TEACHING Total # grads Total # seeking Employed in field Employed out of field Further schooling Total Placed
2009 212 197 150 (76%) 18 (9%) 1 (1%) 169 (86%)
2008 215 209 172 (82%) 11 (5%) 10 (5%) 193 (92%)
2007 249 247 213 (86%) 16 (7%) 5 (2%) 234 (95%)
2006 220 213 175 (82%) 18 (9%) 2 (1%) 195 (92%)
2005 228 222 171 (77%) 24 (11%) 11 (5%) 206 (93%)
Percentages were calculated based on the total number of graduates seeking employment, not the total number of graduates
Implications
We learned a new distribution/collection system is needed for our learning
outcomes survey, to improve response rate. We will also be re-evaluating our
survey instrument as numerous people misunderstood our instructions and
responded incorrectly.
We added two new workshops due to students indicating lower confidence in
describing their strengths and knowing how to use job search resources.
We added resources to our new website to help students explore options to
obtain relevant experiences prior to graduation.
We added web-based resources (e.g. CareerSpots videos, InterviewStream) to
provide students more ways to access information and prepare to present
themselves professionally to employers.
Our Follow-up Studies of UWSP Graduates are now accessible from the
Career Services homepage for ease of reference by all constituents.
Outcome 3
The Career Service Office will connect
students/alumni with employers for
information on career-related
competencies and employment
opportunities.
Job Fair Surveys
Employer Survey
CareerPoint Counts
Results
JOB FAIR SURVEYS2010 2009
Fields rated 5-4 3 2-1 5-4 3 2-1
Attire 38% 52% 1% 64% 27% 9%
Grooming 43% 57% 0% 67% 27% 6%
Handshake 38% 48% 14% 58% 30% 12%
Introduction/Verbal Communication 57% 28% 14% 61% 33% 6%
Resume quality 83% 5% 11% 68% 32% 0%
Questions asked 44% 44% 11% 53% 37% 10%
Responses were on a 5-point Likert scale: 5-Outstanding to 1-Poor. Percentages may not total 100 due to rounding.
Sample comments from employers in 2010:“Most students looked great and were articulate and engaging. Students were definitely well
coached on their intros.”
“Prep – Attire/Grooming – many didn‟t seem to follow your tips. Do they realize they are „selling‟
themselves?”
Advice to students from employers in 2010:“Know in advance what you bring to the table and how that applies to the company you are talking
to. It‟s important to realize each interaction is like a mini interview.”
“Dress professionally. Research company. Have questions. Be confident.”
Results-continued
Services w/highest utilization & rating
Career Services website 63.4%
Job/internship postings in CareerPoint 61.3%
On-campus recruiting 56.7%
Central WI Collegiate Job Fair 56.7%
Programs/services employers want
Attending job fairs 79.3%
Posting jobs/internships 75.9%
Accessing resumes online 69.0%
Recruiting on-campus 58.6%
EMPLOYER SURVEY
Top 10 skills/qualities sought in candidates
Skills/qualitiesVery
ImportantImportant
Initiative 84.6% 15.4%
Strong work ethic 80.8% 19.2%
Teamwork/collaborative skills 73.1% 26.9%
Ethics/professionalism 73.1% 26.9%
Oral /written communication skills 61.5% 34.6%
Flexibility/adaptability 56.0% 44.0%
Interpersonal skills 61.5% 30.8%
Problem-solving 57.7% 38.5%
Organizational skills 57.7% 38.5%
Self-confidence 50.0% 46.2%
Results-continued
CareerPoint utilization by employers
# Employer/organization records 3569 Cumulative 2005-2010
# Employer/individual contacts 4634 Cumulative 2005-2010
# Active job postings 422 For the week ending October 2, 2010
# New job postings 67 For the week ending October 2, 2010
Average # new job postings each week in 2009-10 71
# Employer contacts given access to CareerPoint in 2009-10 32
# Employer contacts with current access to CareerPoint 236 Cumulative
CAREERPOINT
1638
17151748 174914
9
1451
1550
1600
1650
1700
1750
1800
1850
2006-07 2007-08 2008-09 2009-10
Ave Alumni
Ave Students
CareerPoint utilization by students/alumni
Results-continued
AVERAGE # OF ACTIVE JOB POSTINGS IN CAREERPOINT
0
100
200
300
400
500
600
700
2005-06 2006-07 2007-08 2008-09 2009-10
Sept-Dec
Jan-April
May-Aug
Implications
We added more outreach to UWSP students for job fair preparation (e.g. promotional table in the DUC Concourse, resource table at the fair), and web resources for easy access.
Employers showed little interest in our mentoring database and high interest in other web-based services, so we created a robust employer section on our new website and will be exploring use of LinkedIn to connect employers with our students/alumni.
CareerPoint job postings were affected by the economy, which is outside of our control. However, we do not charge employers to use any services and waived the fee to our alumni for CareerPoint access.
Outcome 4
At least 90% of students will be satisfied
with their experiences in the Career
Services Office.
User Satisfaction Survey
Results
USER SATISFACTION SURVEY
5-year Comparison of “Very Helpful/Very Useful” and “Helpful/Useful” Combined Responses
Survey Questions 2008-09 2007-08 2006-07 2005-06 2004-05
1. Helpfulness of reception staff 99.2% 97.3% 96.2% 95.7% 92.1%
2. Usefulness of CareerPoint online system 85.5% 79.4% 85.3% 84.4% 78.7%
3. Usefulness of Career Services website 92.0% 87.8% 91.3% 89.4% 80.1%
4. Usefulness of skill/interest and personality
assessments95.7% 86.0% 86.3% 76.8% 65.8%
5. Helpfulness of staff-interpreting assessments 97.2% 88.9% 94.1% 83.7% 80.7%
6. Usefulness of career counseling/career option
information92.8% 93.0% 95.7% 85.% 79.3%
7. Helpfulness of staff-career counseling/career option
interactions91.9% 92.3% 94.9% 89.9% 86.5%
8. Helpfulness of staff-job search preparation 90.7% 92.5% 92.7% 88.2% 79.2%
9. Usefulness of graduate/professional school materials 100% 81.3% 94.7% 90.0% 75.4%
10. Helpfulness of staff-graduate/professional school
interactions92.8% 85.7% 94.7% 84.2% 71.7%
Results-continued
What services/resources would you like us to offer that we don’t currently?
“Updating internship and career level opportunities on website”
“It would be useful to have actual people run mock interviews”
“Learning how to budget for yourself and practical application for a successful transition”
Additional comments
“I wish I would have known about your services when I was a freshman. I would suggest having presentations in freshman orientation or lower level classes.”
“You guys are awesome!!!!!! Keep up the good work because there are dumb kids like me that are in desperate need of your help. So thank you so much for your time and energy!”
Implications
We redesigned our office website, updating links and making information easily accessible (launched September 2010).
We are discussing offering mock interviews with the assistance of a Hall Director who volunteers in our office.
We introduced a new workshop entitled “Your Financial Future is Now” to provide information on managing finances as students move from college to their professional careers.
We stopped using the Satisfaction Survey to focus efforts on the development of an outcome-related measure. We will decide in the next survey cycle whether to re-institute and/or revise the satisfaction survey for future use.
Involving our stakeholders
Career Services Staff
Have assessment binders in each person’s office
Discuss assessment at staff meetings and retreats
Participate in development of outcomes survey
Connect staff with employers interested in serving as resource people
Other
Post comments from Job Fair Surveys on event website to help students prepare for future job fairs
Share job fair survey results with co-sponsoring schools
Share results of Follow-Up Studies on website and with faculty/administrators as appropriate
Followed up with employers expressing interest in becoming involved with Career Services programming/services
Reached out to faculty/staff interested in our services through personal contacts, hosting an Open House and providing office brochures and information
Future assessment
Streamline user counts to collect only the data we use.
Explore alternate ways to collect user data (card swipe).
Re-evaluate the content/use of our current assessment tools (e.g. program evaluations, learning outcome survey).
Engage staff in discussions regarding if and how we might realistically assess the increasing assistance provided via e-mail and telephone appointments.
Incorporate Google Analytics to track usage of our website.
Consider the use of qualitative methods to gather information (e.g. focus group with employers).
Discuss new ways to share results with stakeholders.
Questions?
Thanks for attending!