10/11/2016 1 Advanced Topics in Web Surveys SOWMYA ANAND SURVEY RESEARCH LABORATORY Notes Please hold your questions until the end Slides available at http://www.srl.uic.edu/SEMINARS/semnotes.htm Please raise your hand so that I can see that you are able to hear me
37
Embed
Advanced Topics in Web Surveys Fall 2016 - UIC | … Topics in Web... · Advanced Topics in Web Surveys SOWMYA ANAND ... Motivate respondents to complete the questionnaire in the
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
10/11/2016
1
Advanced Topics in Web SurveysSOWMYA ANAND
SURVEY RESEARCH LABORATORY
Notes
Please hold your questions until the end
Slides available at http://www.srl.uic.edu/SEMINARS/semnotes.htm
Please raise your hand so that I can see that you are able to hear me
10/11/2016
2
Trends in Survey Data Collection, by Mode, of U.S. Academic Centers
3
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
1995 1997 1999 2001 2003 2005 2007 2009
Survey Mode, by Year: Regression Lines
Web
Phone
In Person
Mail
Survey Software
Numerous web survey software packages now available
Most recent count upwards of 250 ◦ http://www.capterra.com/survey-software/
University services◦ https://answers.uillinois.edu/illinois/page.php?id=51271
◦ http://accc.uic.edu/service/surveys
SRL uses◦ Surveygizmo
◦ Qualtrics
10/11/2016
3
Devices on which surveys can be taken
This webinar…
Focuses on interactive surveys that respondents access using the Internet
Does not cover◦ Question Wording
◦ Sampling issues
◦ Response rates
◦ Programming
Focuses on visual and other design aspects◦ Data quality
◦ Shorter is not necessarily better (Kaplowitz, Lupi, Couper, & Thorp, 2012; Klofstad, Boulianne, & Basson, 2008)
◦ Placement of survey link
◦ Earlier is not necessarily better (Kaplowitz et al., 2012)
10/11/2016
6
Email invitations: Other aspects
Effects depend on various factors◦ Source of survey
◦ Relationship with respondents
◦ Motivation of respondents
Email invitations: Examples
10/11/2016
7
Scrolling versus Paging
10/11/2016
8
10/11/2016
9
Scrolling versus Paging
Break offs◦ No difference (Lozar Manfreda, Batagelj, & Vehovar, 2002)
Item non-response◦ More in scrolling design (Lozar Manfreda et al., 2002)
Response time◦ Less with scrolling design (Couper, Traugott, & Lamias, 2001; Lozar et al., 2002; Toepel, Das, & Van Soest, 2009)
Skips or branching◦ Better with paging design
Saving responses◦ Available mainly with paging
10/11/2016
10
Progress Indicators
10/11/2016
11
Progress Indicators
Motivate respondents to complete the questionnaire in the absence of an interviewer
Indicates how long the questionnaire is
◦ Does not necessarily work well in questionnaire with branching or skips
Transition sentences are an alternative
Many options for positioning and format
10/11/2016
12
Progress Indicators
Empirical evidence regarding effectiveness not clear• Respondents notice when it is not provided (Lozar Manfreda et al., 2002)
• More completed surveys with progress indicator (89.9%) than without (86.4%) (Couper et al.,
2001)
• No reduction in breakoff
• If anything, slight increase (Villar, Callegaro, & Yang, 2013)
Best used for• Short surveys
• With minimal branching or skips
• That move at a fairly consistent pace
Open ended questions
10/11/2016
13
10/11/2016
14
10/11/2016
15
Open ended questions
Elicits longer, richer information than other types of self-administered surveys (Barrios, Villarroya, Borrego, & Olle, 2011)
Size of text boxes can indicate the amount of information expected◦ Larger boxes increase length of responses provided (Dennis et al., 2000; Smyth, Dillman, Christian, & McBride,
2009)
But also increases perceived burden (Zuell, Menold, & Korber, 2015)
10/11/2016
16
Single item questions
10/11/2016
17
10/11/2016
18
Single item questions
Radio button requires one to have a degree of motor control (Lumsden, 2007)
10/11/2016
19
Single item questions
Horizontal or vertical orientation does not appear to matter (Toepoel et al., 2009)
Ability to uncheck selected response
10/11/2016
20
Single item questions
Long lists require consideration◦ Branching/Drill down
10/11/2016
21
10/11/2016
22
Single item questions
Long lists require consideration◦ Dropdown menu
10/11/2016
23
Single item questions
Dropdown menus do affect data quality◦ Options not visible upfront