I'm Sorry. I Can't. Don't Hate Me. The Post-it Breakup

@KyleSoucy | UsableInterface.com | #ias17

I’m Sorry. I Can’t. Don’t Hate Me.

the post-it breakup

“There is a good way to break up with someone, and it doesn’t involve a post-it!” - Carrie Bradshaw

observe

Kyle Soucy

I don’t have an issue with the method.

I have an

issue with when

it’s used._____

Affinity Diagraming

1. Put ideas/observations on post-its

2. Put post-its on the wall

3. Group similar items

4. Name each group

5. Vote on most important groups

UXRESEARCH

incomplete data

Rashomon effect: Contradictory interpretations of the same event by different people.

observer debrief Goals

1. Share observations2. Understand themes3. Prioritize issues

We all agree this doesn’t work...

So... can you believe that last person couldn’t find the ‘submit’ link.

Informal Discussion

understanding the problem

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

“You should average about one

observation per minute...”

- David Travis

Source: http://www.userfocus.co.uk/articles/datalogging.html

60

Let’s assume half as manyfor this scenario...

x 6

(observers)

(per interview)

x 7 (interviews)

= 1,260 (Total notes!)

= 180 notes 30

Which can look like...

Source: http://www.dia2.org/images/2_data%20analysis_large.JPG

Source: https://i.ytimg.com/vi/UynxDyr0lAo/maxresdefault.jpg

drawbacks

Source: https://pbs.twimg.com/media/BMGV8zECMAI23AC.jpg

It’s an overwhelming task

Source: http://www.vibe-ing.com/affinity-diagram-merged-from-different-sources-and-conceptual-design/

talking is not allowed

SILENCE! I Kill YOU!SILENCE! I Kill YOU!

Source: http://www.vibe-ing.com/affinity-diagram-merged-from-different-sources-and-conceptual-design/

fatigue

Have you seen me?

missing data...

illegible notes

Source: https://static1.squarespace.com/static/50c01780e4b0d4272576e000/t/570c838ff8baf32904ee3368/1460437908289/

Miscategorized notes

wrongly discarded notes

vague notes

Lost notes

Transcribing

Source: https://www.google.com/imgres?imgurl=http%3A%2F%2Fwww.clifschaller.com%2Fassets%2Fpivit_3.jpg&imgrefurl=http%3A%2F%2Fwww.clifschaller.com%2F&docid=dJACv0T5wTDy5M&tbnid=0rAeMCTTYNaJhM%3A&vet=10ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD..i&w=694&h=462&bih=635&biw=1268&q=large%20affinity%20diagram%20mess&ved=0ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD&iact=mrc&uact=8#h=462&imgrc=0rAeMCTTYNaJhM:&vet=10ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD..i&w=694

requires A dedicated room

wasteful

AlternativeWays to Take Notes

Everyone sho

uld

use the same tool

&/or method.

"Usability testing is like getting a drink from a fire hydrant…" - Carolyn Snyder

Notes Grid Using Excel

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Participant name

P1 P2 P3User Group P1 P2 P3Date/Time

P1 P2 P3Questions

Task 1...

Task 2...

Task 3...

Task 4...

Task 5...

Task 6..

Why? Because this doesn’t work...

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Notes Grid Using Trello

Theme Analysis grid

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

Or, rainbow spreadsheet

Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/

Need help keeping observers engaged?

give assignments

AlternativeWays to debrief

Themes can be te

ased

out without a diagram.

when to debrief?

After every 3-6 sessions.Don’t wait ‘til the end.

Prepare Consolidate your own notes first!

round-robin

or lead + additions Source: https://upload.wikimedia.org/wikipedia/commons/0/03/Staff_meeting.jpg

It’s not just about the findings...

implications matter

Wish for, how to, what if

H2 make these box entry areas clearer; H2 make it obvious they’re exclusive; Wif we only allowed one way to search for repair info?

Observation: The user didn’t realize they were notlogged in and couldn’t access documents they wanted.

Implications:

- “W4 a way the user can access documents without logging in.”

- “H2 make the log in link more visible.”

- “Wif we didn’t force the user to log in?”

Example

Blue sky thinking

Other Tools

Takeaways...

Ditch the post-its! (for note-taking)

Use affinity diagramming when you have a focus question.

Not to analyz

e

research no

tes!

Always question your methods.

www.UsableInterface.com

@kylesoucy

/usableinterface