Chisnell Pew Ballot Testing 120908.Key

1

What is a usability test?

2

Sit next to someone. Watch. Listen.

Dana Chisnell

3

Complement to best practice

When something changes

Take constraints into account

Reveal remedies

4

What to look for

Hesitating

Comments

Questions

Body language

Behaviors

5

Ballot testing.

Dana Chisnell

6

The

ques

tion

7

How successfully do voters vote?

The

ques

tion

8

The

plan

9

1 day

Dana Chisnell

10

a ballot and instructions

Nancy Frishberg

11

voter participants

Dana Chisnell

12

observers

Dana Chisnell

13

results due: today

14

15

16

How we got value

Used the ballots and instructions at hand

Focused on one thing at a time

Had participants generate and collect data

Drafted observers and debriefed

17

Follow these steps:

1. Plan, minimally

2. Get the team on board

3. Use the LEO Kit

4. Recruit participants

5. Conduct sessions

6. Debrief and decide

18

Conduct sessions Rehearse (P1)

Checklist of tasks

Short, focused sessions

Adjust what you’re doing, if you need to

Dana Chisnell

19

Session outline

Greet the participant

Explain the test, your role, and their role

Watch the voter vote

Ask follow-up questions

Debrief with participant

Debrief with observers

20

Moderating, not training

Impartial, unbiased observing

No teaching!

Listen and watch

Ask open-ended questions: Why? How? What?

21

Debrief and decide

What could cause a recount?

What could make it difficult to tell intent?

What could draw unwanted attention?

What could cost money if it is not fixed?

21

Dana Chisnell

22

Resources

• Usability Professionals’ Association: www.usabilityprofessionals.org/

• LEO Usability Testing Kit:www.usabilityprofessionals.org/ civiclife/voting/leo_testing.html

• Ballot Usability and Accessibility Blog: ballotusability.blogspot.com/