Top Banner
Users play cards We keep score Magic results! Carol Barnum and Laura Palmer The Usability Center @ Southern Polytechnic www.usability.spsu.edu
26

Users Play Cards, We Keep Score, Magic Results!

Dec 05, 2014

Download

Design

UX Firm

These are the slides from our STC2011 presentation on using Microsoft's product reaction cards in our usability testing sessions. We are making a shorter version of this talk at UPA in June.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Users Play Cards, We Keep Score, Magic Results!

Users play cards We keep score Magic results!

Carol Barnum and Laura Palmer 

The Usability Center @ Southern Polytechnic

www.usability.spsu.edu

Page 2: Users Play Cards, We Keep Score, Magic Results!

• Microsoft introduces the cards in 2002– varies their use in 2004

• A few others report in

• We get on board in 2006

• We've been crazy about them ever since

• We share what we have learned

• We give you the tools to do it yourself

Microsoft plays their hand

2usability.spsu.edu                                     STC Summit 2011

Page 3: Users Play Cards, We Keep Score, Magic Results!

Your presenters

Carol Barnum Laura Palmer

3usability.spsu.edu                                     STC Summit 2011

Page 4: Users Play Cards, We Keep Score, Magic Results!

ISO defines the key elements in usability

U testing gives great results for 2 out of 3

We’re here to talk about desirability

4usability.spsu.edu                                     STC Summit 2011

Page 5: Users Play Cards, We Keep Score, Magic Results!

Can’t get no…

But, we’ve tried….and we’ve tried…. 

SATISFACTION

5usability.spsu.edu                                     STC Summit 2011

Page 6: Users Play Cards, We Keep Score, Magic Results!

Microsoft tackles the problem

1. Faces Questionnaire

2. Product Reaction Cards

118 Cards

6 Faces

6usability.spsu.edu                                     STC Summit 2011

Page 7: Users Play Cards, We Keep Score, Magic Results!

After Microsoft?

A small oasis of reports shows variations on the theme

7usability.spsu.edu                                     STC Summit 2011

Page 8: Users Play Cards, We Keep Score, Magic Results!

We decided to give the cards a try

8usability.spsu.edu                                     STC Summit 2011

Page 9: Users Play Cards, We Keep Score, Magic Results!

How we deal

Slide 9usability.spsu.edu                                     STC Summit 2011

Page 10: Users Play Cards, We Keep Score, Magic Results!

Putting the “meta” in analysis

2006…..ongoing

Studies from a variety of industries and interfaces

10usability.spsu.edu                                     STC Summit 2011

Page 11: Users Play Cards, We Keep Score, Magic Results!

Teaching the teachers

18 cards…..17 positive, 1 negative

11usability.spsu.edu                                     STC Summit 2011

Page 12: Users Play Cards, We Keep Score, Magic Results!

Got reservations?

PRC = 93% positive + 7% negativeSUS = 82

Themes: ease‐of‐use, comprehensibility, familiarity, speed

12usability.spsu.edu                                     STC Summit 2011

Page 13: Users Play Cards, We Keep Score, Magic Results!

Calling the cable company

January41% +21% 38%‐

Neutral’s good in our industry!

Negative Neutral PositiveAnnoyingBoringDifficultDistractingFrustratingImpersonalInconsistentNot valuablePoor QualityToo technicalUncontrollable

ExpectedFamiliarSterile

AccessibleBusiness‐likeComprehensiveConvenientDesirableEasy‐to‐useHelpfulStraight‐forward

Repeated PositivesPredictable = 3Friendly = 2Usable = 2

13usability.spsu.edu                                     STC Summit 2011

IVR

Page 14: Users Play Cards, We Keep Score, Magic Results!

Six weeks later: the cable company

85% +11%4% ‐

IVR  APOSITIVE                   NEUTRAL                    NEGATIVE

48% +12%40% ‐

14usability.spsu.edu                                     STC Summit 2011

IVR  BPOSITIVE                    NEUTRAL                      NEGATIVE

Page 15: Users Play Cards, We Keep Score, Magic Results!

Changing planes

IVR

SUS = 8779%+ PRC

15usability.spsu.edu                                     STC Summit 2011

Page 16: Users Play Cards, We Keep Score, Magic Results!

Clear for takeoff

21% - PRC

16usability.spsu.edu                                     STC Summit 2011

Page 17: Users Play Cards, We Keep Score, Magic Results!

It’s not easy being green

International “green” initiative

March 2010 = SUS = 5242% PRC positive

October 2010 = ☺SUS = 7382% PRC positive

17usability.spsu.edu                                     STC Summit 2011

March 2011 = ☺☺SUS = 96100% PRC positive

Page 18: Users Play Cards, We Keep Score, Magic Results!

Movin’ on up

Positives: 24 50 43

18usability.spsu.edu                                     STC Summit 2011

1.0 2.0 2.1

Page 19: Users Play Cards, We Keep Score, Magic Results!

Negative choices decline to zero

Negatives: 33 11 0

19usability.spsu.edu                                     STC Summit 2011

2.0 2.1 01.0

Page 20: Users Play Cards, We Keep Score, Magic Results!

Weather or not

3 TV weather sites

0

10

20

30

40

Positive Negative PositiveNegative

PositiveNegativeStation A

Station BStation C

26/13 39/5 24/17

20usability.spsu.edu                                     STC Summit 2011

Page 21: Users Play Cards, We Keep Score, Magic Results!

“B”cause we like you

Repeats within and between

Blanks are just as telling as choices

21usability.spsu.edu                                     STC Summit 2011

Page 22: Users Play Cards, We Keep Score, Magic Results!

“C” you later

What Station B isn’t!

22usability.spsu.edu                                     STC Summit 2011

Page 23: Users Play Cards, We Keep Score, Magic Results!

C’mon…give it a try

Slide 23usability.spsu.edu                                     STC Summit 2011

Page 24: Users Play Cards, We Keep Score, Magic Results!

Our concluding thoughts

24usability.spsu.edu                                     STC Summit 2011

Page 25: Users Play Cards, We Keep Score, Magic Results!

Compare, Contrast and Combine

Slide 25usability.spsu.edu                                     STC Summit 2011

Page 26: Users Play Cards, We Keep Score, Magic Results!

Questions? Now or later?

Carol Barnum Laura Palmer

26usability.spsu.edu                                     STC Summit 2011

[email protected] [email protected]