© 2015 Upwork Inc. Proprietary and confidential. Do not distribute. What’s In It For Me? Get users to take action through A/B testing & agile design Eileen Chang | Sr. Product Marketer | Upwork
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
What’s In It For Me?Get users to take action through A/B testing & agile design
Eileen Chang | Sr. Product Marketer | Upwork
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
Upwork (formerly Elance-oDesk)
● Global platform for businesses to hire, work with, and pay freelance professionals○ 4M registered clients○ 9M registered freelancers representing 2800 skills○ $1B worth of work on our platform annually
3
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
In 2014, our homepage looked like this:
5
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
We tried a new approach
● 1 week ● 1 marketer● 2 designers● 1 writer● Result: 2 testable concepts
6
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
We tested two concepts with users
7
A B
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
We further tested and refined Concept “A”
9
Test v1 prototype
Get feedback
Adjust
Test v2 prototype
Get feedback
Adjust
Test v3 prototype
Get feedback
Adjust
Day 1 Day 2 Day 3
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
Over 3 days, user feedback vastly improved
10
Day 1 Day 2 Day 3
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
Live tested new design with real users
11
Existing New
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
New design drove 7.7% increase in signup rate
12
Existing New
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
#1:Identify where users stumble
14
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
Use tools to help uncover user needs
15
Purpose Example Tools
Site Analytics
User Feedback
● Customer support● Sales reps● Community forums● User surveys and interviews
Prototyping & Testing
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
#2:Do small experiments to validate hypotheses
16
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
#3:Get feedback early and often
17
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
#4:There’s always room for (more) improvement
18
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
What follow-on experiments can you try?
19
Show example tasks Show freelancer types
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
What follow-on experiments can you try?
20
Merchandise tasks Merchandise freelancers
+69% click-through rate+1.1% signup rate
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
What follow-on experiments can you try?
21
Search results Category pages
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.
What follow-on experiments can you try?
22
Search results Category pages +1.3% signup rate