Page 1
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 1/28
F R O M Q
U E S T
I O N T O
A C T I O
N :
C R E A T
I N G I N
- H O U
S E S U R
V E Y S
A S A
P A R T
O F D A
T A D R I V
E N I N F O
R M E D
D E C I S
I O N M
A K I N G
D A V I
D C
O N
S I G
L I O
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 2
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 2/28
SURVEY DESIGN PROCESS
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
IVITY #1
K: You have been told to u!ve" "ou! o$$un%t" ab &ual%t" o' la !oo$ u((o!t e!v% e ) Outl%ne the *( to+a!d a h%ev%n, th% ,oal)
E: . $%nute
PECTATIONS: You a!e NOT e0(e ted to have a o$(lve" at the end o' the . $%nute )
Page 3
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 3/28
SURVEY DESIGN PROCESS
• Sta,e 1: -% %on tate$ent• Sta,e : Plann%n,•
Sta,e 2: In t!u$ent develo($ent3Re !u%t%n, (lan• Sta,e 4: Data olle t%on• Sta,e .: Data anal" % and !e(o!t%n,
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
S T A G E S
Page 4
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 4/28
SURVEY DESIGN PROCESS: STAGE 1
M I S S I O N S T A T E M E N T
• 5h" do the !e ea! h6• 5hat a!e the ,oal 6• 5hat a t%on $a" !e ult '!o$ %t6• 5!%te a $% %on tate$ent and !e'e!
to %t th!ou,hout the (!o e
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 5
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 5/28
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 6
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 6/28
SURVEY DESIGN PROCESS: STAGE
P L A N N I N G : M E A S U R E M E N T
• De*ne the (!%$a!" on t!u t• On e (!%$a!" on t!u t a!e de*ned3
dete!$%ne the ele$ent that
o$(o e the on t!u t• Con %de! !elated ele$ent o' %nte!e t
7e),)3 de$o,!a(h% 8• Develo( a data anal" % (lan
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 7
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 7/28
SURVEY DESIGN PROCESS: STAGE
P L A N N I N G : R E P R E S E N T A T I O N
• De*ne the %ntended (o(ulat%on 9 be(e %*
• Develo( a a$(le '!a$e a (lan 'o!dete!$%n%n, ho+ to !ea h the (o(ulat%on
• Develo( a a$(l%n, (lan• Dete!$%ne the $ode 'o! data olle t%on
7%)e)3 5eb3 (a(e!3 %n (e! on %nte!v%e+ 3tele(hone8
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 8
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 8/28
Page 9
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 9/28
SURVEY DESIGN PROCESS: STAGE 2
I N S T R U M E N T D E V E L O P M E N T : C O N S U LT W I T H E P E R T S
• E0(e!t o' u!ve" de %,n anda$(l%n,
• To(% e0(e!t : e!v% e (!ov%de!• To(% e0(e!t : e!v% e on u$e!• <oo= to e0% t%n, and +ell te ted
u!ve" %n t!u$ent
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 10
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 10/28
SURVEY DESIGN PROCESS: STAGE 2
I N S T R U M E N T D E V E L O P M E N T: D R A F T Q U E S T I O N S
• Rev%e+ to dete t o$$on >a+
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 11
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 11/28
SURVEY DESIGN PROCESS: STAGE 2
I N S T R U M E N T D E V E L O P M E N T: D R A F T Q U E S T I O N S
• Rev%e+ to dete t o$$on >a+
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 12
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 12/28
SURVEY DESIGN PROCESS
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
TIVITY #
SK: Ident%'" the o$$on >a+ %n the u!ve" &ue t%o the handout)
E: . $%nute
T: The!e a!e a $%n%$u$ o' t+o >a+ (e! &ue t%on)
Page 13
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 13/28
SURVEY DESIGN PROCESS: STAGE 2
I N S T R U M E N T D E V E L O P M E N T : F O C U S G R O U P T E S T I N G
• @%ve to t+elve %nd%v%dual 'o! ea h $a o!(o(ulat%on to be u!ve"ed
• T+o taB $e$be! : one to 'a %l%tate'o u ,!ou(3 one to ta=e note
• Pa!t% %(ant hould o$(lete the u!ve"• A = ho+ the" %nte!(!eted ea h &ue t%on
and ea h %te$ %nd%v%duall"• A = %' the" +e!e able to an +e! ea h
&ue t%on
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 14
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 14/28
SURVEY DESIGN PROCESS: STAGE 2
I N S T R U M E N T D E V E L O P M E N T : R E W R I T E Q U E S T I O N N A I R E
• Ta=e %nto a ount 'eedba = '!o$'o u ,!ou( te t%n,
•
Re te t %' ne e a!"• ;u%ld %n all u!ve" $e han% 7e),)
=%( lo,% 8• De*ne all value and va!%able na$e
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 15
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 15/28
SURVEY DESIGN PROCESS: STAGE 2
R E C R U I T I N G P L A N : M E S S A G I N G
• ?o+ $an" $e a,e +%ll be ent•
5ho +%ll be the ende! o' the$e a,e
• 5hen +%ll $e a,e be ent• D!a't $e a,e ontent
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 16
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 16/28
T I P S @ O R
- A /
I - I C I
N G
R E S P
O N S E R
A T E S
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 17
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 17/28
Page 18
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 18/28
-A/I-I ING RESPONSE RATES: SURVEYCONSTRUCTION
• -a=e u!ve" a ho!t a (o %ble +h%le t%llolle t%n, the data "ou need)
• I' the u!ve" % lon,3 b!ea= %t u( a !o $an"(a,e )
• -a=e u!ve" ea " to ta=e)U!" #$%&'( )*"!%'+ ! -." !"/"&$ )*"!%'+ ! .$/" %." !$#" ! $ "
K""3 )*"!%'+ -+&4' !'#3 "B" ' !*&/"6 -'%. %." #+!% " "&$ $ 4 "$!6 )*"!%'+ ! %+ $ !-"&S$/" 4"#+ &$3.' )*"!%'+ ! 7+& %." " 4 +7 %." !*&/"6M$8" %." 9!%+&6 +7 %." !*&/"6 "$!6 %+ 7+ +-
• Kee( the o(en u!ve" (e!%od !elat%vel" ho!t3 %n
$o t a e t+o +ee= % $o!e than enou,ht%$e)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 19
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 19/28
SURVEY DESIGN PROCESS
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
TIVITY #2
K: Ident%'" the a (e t o' the %nv%tat%on $e a,e th=e %t %neBe t%ve)
E: . $%nute
A/ G S O S A S
Page 20
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 20/28
-A/I-I ING RESPONSE RATES:-ESSAGINGP R E L I M I N A R Y N O T I F I C AT I O N
• Send (!el%$%na!" not%* at%on'!o$ a t!u ted autho!%t")
• Do not %n lude l%n= to the u!ve")• Announ e the u!ve" % o$%n,
and tate +h" %t % %$(o!tant tothe %n t%tut%on)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
A/I I ING RESPONSE RATES
Page 21
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 21/28
-A/I-I ING RESPONSE RATES:-ESSAGING
I N I T I A L I N V I T AT I O N
• 5!%te the $e a,e a %' %t % a (e! onal o$$un% at%on'!o$ one (e! on to one (e! on)
• Send the $e a,e '!o$ one %nd%v%dual u %n, the e$a%ladd!e o' an %nd%v%dual)
•
Pe! onal% e the %nv%tat%on : e),)3 Dea! Fohn3 o! ?% Fohn3• U e %n,ula! (e! onal (!onoun : 5!%te I %n tead o'
5e +heneve! (o %ble)• Tell the$ +h" u!ve" % %$(o!tant to the$3 not +h" %t %
%$(o!tant to "ou o! the %n t%tut%on)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
A/I I ING RESPONSE RATES
Page 22
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 22/28
-A/I-I ING RESPONSE RATES:-ESSAGING
I N I T I A L I N V I T AT I O N
• Tell the$ +h" the%! (a!t% %(at%on % %$(o!tant)• U e a$(le '!o$ (o(ulat%on %' (o(ulat%on a!e
la!,e enou,h3 then %n'o!$ the ele ted %nd%v%dualthat the" a!e a$on, a ele ted ,!ou( o' %nd%v%dual )
•
-a=e %nv%tat%on ho!t)• Save IR; lan,ua,e 'o! the u!ve" %t el'3 %'
(e!$% %ble b" "ou! IR;)• U e lan,ua,e that % a %n'o!$al a (e!$%tted 'o!
the (o(ulat%on)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
A/I I ING RESPONSE RATES
Page 23
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 23/28
-A/I-I ING RESPONSE RATES:-ESSAGING
I N I T I A L I N V I T AT I O N
• Neve! %n lude the +o!d u!ve" %n the ub e tl%ne o' the $e a,e )
• Do not !eveal the lo e date o' the u!ve" unt%lthe *nal !e$%nde! not% e)
• Choo e ub e t l%ne that a!e ,ene!% ound%n,but %nte!e t%n, to (otent%al !e (ondent )
• -e a,e hould onta%n no othe! l%n= then theone that ta=e the$ to the u!ve")
• Do not be ove!l" on e!ned +%th ,!a$$a!)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
A/I I ING RESPONSE RATES
Page 24
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 24/28
-A/I-I ING RESPONSE RATES:MESSAGING
R E M I N D E R N O T I C E S
• @ollo+ all the !ule o' the In%t%al Inv%tat%on)• U e eve!al !e$%nde! not%* at%on heduled
evenl" th!ou,hout the o(en u!ve" (e!%od)• Re$%nde! not% e an be le 'o!$al and
hould !e'e! to the (!ev%ou $e a,e )• U e the ub e t head%n, 'o! the In%t%al
Inv%tat%on +%th the add%t%on o' Re: %n '!onto' %t)
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
A/I I ING RESPONSE RATES
Page 25
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 25/28
-A/I-I ING RESPONSE RATES:INCENTIVES
-%n%$all" eBe t%ve:C.$ " %+ -' '7% "&%'; $%" +& +##+ '%"# <" ,'P+4=
EBe t%ve:C.$ " %+ -' !+#"%.' .' . 6 4"!'&$> " $ 44'? * % %+ +>%$' <" , !%*4" % "%! ;&!% .+' " 7+&!" " %' .+*!' =
Ve!" eBe t%ve:P$6#" %, "/" $% !#$ $#+* %!, %+ $ 3$&%' '3$ %!
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 26
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 26/28
SURVEY DESIGN PROCESS: STAGE 4
D A T A C O L L E C T I O N : D R E S S R E H E A R S A L
• Che = that all $e a,e lea! (a$*lte!
• -e a,e 'o!$att%n, % o!!e t• <%n= +o!= (!o(e!l"• @%nal !ev%e+ o' the u!ve"
%n t!u$ent
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 27
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 27/28
SURVEY DESIGN PROCESS: STAGE 4
D A T A C O L L E C T I O N : S U R V E Y L A U N C H
• Che = that data % be%n, olle ted(!o(e!l"
• Re (ond &u% =l" to an" !e(o!t o'(!oble$ +%th the u!ve"
• Send !e$%nde! not% e a heduled• Clo e u!ve" a heduled
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5
Page 28
8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)
http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 28/28
SURVEY DESIGN PROCESS: STAGE
D A T A A N A LY S I S A N D R E P O R T I N G
• Clean data• Anal" e data a ,u%ded b" anal" %
(lan• Re(o!t !e ult
E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5