Assessing Customer Satisfaction with Vocational Rehabilitation Programs Florida State University Survey Research Laboratory College of Social Sciences www.fsu.edu/~survey Dr. Mary Stutzman, Director FSU Survey Research Laboratory Presentation at the Quarterly Meeting West Palm Beach , September 14 – 16 2009
38
Embed
Assessing Customer Satisfaction with Vocational ...rehabworks.org/rehab/FRC_survey09.pdf · Assessing Customer Satisfaction with Vocational Rehabilitation Programs ... • can handle
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Assessing CustomerSatisfaction with
Vocational Rehabilitation Programs
Florida State University Survey Research LaboratoryCollege of Social Sciences
www.fsu.edu/~survey
Dr. Mary Stutzman, DirectorFSU Survey Research Laboratory
Presentation at the Quarterly Meeting
West Palm Beach , September 14 – 16 2009
2
Why Should the FRC Survey Customers?Provides an “outside” look of customer service.
Customers are sometimes uncomfortable to give feedback directly to the agency giving them services.
Gives customers an opportunity to “speak” to someone outside the Department.
Open-ended comments800 number calls and referrals to FRC
Provides longitudinal data base to assess trends.
Data can be “packaged” for to address specific concerns.
3
Evolution of the Survey Effort
Survey of Customers with Cases ClosedLaunched 2001Questions developed by FRC Evaluation Committee and DVR staffDesigned survey instrument one-page legal front and backSample Design—all cases closed previous month
Customers in Program after 6 monthsLaunched 2002 Questions mirrored Closed Cases SurveySample Design—random sample of 700 per monthCustomers in program after 6 months
4
Customer Surveys OverviewGather information from customers:
ACTIVE CASES—Surveyed Customers in Program after 6 months
Random sample of 700 per month; 800 beginning July 2008
5
Survey ApproachClosed Cases—Survey all cases closed at the end of month
LetterInstrument• 12 Closed items• 2 Open-ended
Active Cases—Survey sample of 800 cases still active (opened 6 months earlier)
LetterInstrument• 12 Closed items• 2 Open-ended
6
Staffing the Survey Effort
FSU Survey Research LaboratoryAll staff paidStaffed with trained interviewers 7 days a week• can handle PR issues on 800 line and conduct call-
in interviewsMail within 1-week of sample receiptData and open-ended responses entered Analysis of dataProvide reports and presentations on a quarterly and ad hoc basis
7
Design BenefitsSampling Strategy
Power of numbers to analyze by various segments (Areas, Disabilities, etc).Monthly—helps eliminate “seasonal” bias
Response CategoriesAllow “ordinary language” responses for respondentsHelps make reports understandable
OperationsMode choice—mail , Internet, phone800 number and open comments—public relations for Council
ReportingSufficient numbers for Quarterly TrendsSufficient numbers Annual Trends and sub-analyses
8
Respondents are King/Queen
Make convenient2-pages legalKeep short—12 Questions
Accommodate Respondent PreferencesWeb access800 number for phone responseTTY line
9
Privacy Issues: Called ”Project”
10
Closed Cases: Survey Instrument
11
Closed Cass: Survey Instrument
12
Survey Areas
Program OutcomesProgram Choice
ServicesStaff
13
Program Outcomes
Closed Cases
Active Cases
Program OutcomesOverall Satisfaction with Services X XServices Made Life Better X XWould Recommend to A Friend X XEmployment Outcomes and Satisfaction X
14
Program ChoiceProgram Choice Closed
CasesActive Cases
Informed of Alternative Service Providers and Vocational Goals X
Able to Choose Service Providers and Vocational Goals X
Informed of Alternative Service Providers XAble to Choose Service Providers XInformed of Alternative Vocational Goals XAble to Choose Alternative Vocational Goals X
15
Program ServicesProgram Services Closed
CasesActive Cases
Accessibility to VR Offices X XAppropriateness of Services Considering Rehabilitation Goals X
Promptness of Services Provided X XNeed Other Services but Did Not Receive X
Open-Ended Closed Cases
Active Cases
Especially helpful VR associates or services X XWhat VR can do to improve services X XWhy did not get a job X
16
Program Staff
Program Staff Closed Cases
Active Cases
Understand Needs and Feelings X X
Treated with Courtesy and Respect X X
Explained Responsibilities as Client X
Do What Say X
17
CLOSED CASES: APPROACH AND RESPONSE RATE
CUSTOMERS WITH CASES CLOSED: 2007-08 Surveys mailed monthlySurveys mailed to all customers whose cases were closed in the prior month October 2007 to September 2008 mailings18,100 surveys mailedTwo Mailings Analysis based on 5,176 returns
Response Rate = 29%
18
CURRENT CASES: APPROACH AND RESPONSE RATE
CUSTOMERS WITH CASES ACTIVE CASES: 2007-08Surveys mailed monthlySurveys mailed to random sample of 700-800 customers whose case is active 6 months after plan8,700 surveys mailedTwo Mailings Analysis based on 2,441 returnsResponse Rate = 28%
19
Adaptation and Change
Refined and revisited over timeInstrument—”already have a job”Letters—explanation of council and repeated surveysReports—content and format