Top Banner
introduction learnings best practices conclusion contextual user testing assumption is the mother of all f#ck-ups. Vincent van Scherpenseel
33

The Importance of Contextual User Testing

Nov 01, 2014

Download

Technology

dotBlue

Slides from Vincent van Scherpenseel's talk at WebExpo 2013 in Prague.

Learnings obtained while conducting contextual user testing for SalesChamp. Includes best practices to apply and common pitfalls to avoid while performing contextual user testing.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The Importance of Contextual User Testing

introduction learnings best practices conclusion

contextualuser testing

assumption is the mother of all f#ck-ups.

Vincent van Scherpenseel

Page 2: The Importance of Contextual User Testing

introduction Contextual User Testing

Testing within the context of the user.

Page 3: The Importance of Contextual User Testing

introduction SalesChamp

Tablet application for sales professionals.

Track sales meetings

Collect information

Schedule appointments

Sign contracts

Page 4: The Importance of Contextual User Testing

introduction SalesChamp - 2013 redesign

Page 5: The Importance of Contextual User Testing

learnings

learnings

Page 6: The Importance of Contextual User Testing

learnings Attention for the app

our assumptionThe user is focused on the app.

Page 7: The Importance of Contextual User Testing

learnings Attention for the app

our assumptionThe user is focused on the app.

Page 8: The Importance of Contextual User Testing

learnings Attention for the app

our findingThe app is merely an assistant.

Page 9: The Importance of Contextual User Testing

learnings Attention for the app

our findingThe app is merely an assistant.

Page 10: The Importance of Contextual User Testing

learnings Element visibility

our assumptionThis button that appears,

they surely can’t miss that.

Page 11: The Importance of Contextual User Testing

learnings Element visibility

our assumptionThis button that appears,

they surely can’t miss that.

Page 12: The Importance of Contextual User Testing

learnings Element visibility

our findingSome users didn’t see it

after 16 hours of use!

Page 13: The Importance of Contextual User Testing

learnings Element visibility

our findingSome users didn’t see it

after 16 hours of use!

Page 14: The Importance of Contextual User Testing

learnings Network coverage

our assumptionYou either have coverage or you don’t.

Page 15: The Importance of Contextual User Testing

learnings Network coverage

our assumptionYou either have coverage or you don’t.

Page 16: The Importance of Contextual User Testing

learnings Network coverage

our findingCoverage is flaky.

Page 17: The Importance of Contextual User Testing

learnings Network coverage

our findingCoverage is flaky.

Page 18: The Importance of Contextual User Testing

learnings Perception of action duration

our assumptionMaking the app lightning fast will be enough.

Page 19: The Importance of Contextual User Testing

learnings Perception of action duration

our assumptionMaking the app lightning fast will be enough.

Page 20: The Importance of Contextual User Testing

learnings Perception of action duration

our findingIt’s not just about how long an action takes.

It’s about saying it.

Page 21: The Importance of Contextual User Testing

learnings Perception of action duration

our findingIt’s not just about how long an action takes.

It’s about saying it.

Page 22: The Importance of Contextual User Testing

learnings Feature inspiration

our assumptionUser testing would only validate features.

our findingEvery time the product evolved and we tested

new features new ideas emerged.

Page 23: The Importance of Contextual User Testing

best practices

best practices

Page 24: The Importance of Contextual User Testing

best practices Define your objectives

Define your objectivesand align your test sample.

Page 25: The Importance of Contextual User Testing

best practices Be unobtrusive

Never interfere.

Page 26: The Importance of Contextual User Testing

best practices Include team members

Don’t just share anecdotes.

Take your developers, designers andother team members with you.

Page 27: The Importance of Contextual User Testing

best practices Don’t just trust what a user says

“No one on the team uses that feature.”

vs.

“I wouldn’t be able to live without that feature.”

Page 28: The Importance of Contextual User Testing

best practices Add (quantitative) validation

Never make changes to your productwithout validation in multiple tests.

Page 29: The Importance of Contextual User Testing

best practices Take notes, photos and videos

Pin them on a wall.

Make it easy for everyone to rememberwhat the context is like.

Page 30: The Importance of Contextual User Testing

conclusion Just do it

Bust your assumptions using Contextual User Testing to create better experiences.

Page 31: The Importance of Contextual User Testing

conclusion Just do it

Break paradigms, build bridgesand improve experiences.

Page 32: The Importance of Contextual User Testing

conclusion Just do it

It’s fun to do!

Page 33: The Importance of Contextual User Testing

thank youfor your attention

vincent van [email protected]

www.dotblue.net(we are hiring!)