Ballot Design And Usability Testing Caceo

Ballot Design and Usability

1

CACEODana ChisnellDecember 2008 - Sacramento

Typical, costly mistakes in ballot design

Before-and-afters

What can be done

2

Typical, costly mistakes

3

Better Ballots

13 important design features

Brennan Center for Justice

Key pointsPoor ballot design frustrates voters, undermines confidence, and contributes to related Election Day problems

5

Dana Chisnell

Key pointsThousands of votes are lost or miscast

All voters are affected

The risk is greater for some groups of voters

All voting technologies are affected

Usability testing is the best way to make sure that voters are successful

6

Dana Chisnell

Certain design problems cause errors

• Splitting contests into different columns

• Placing different contests on same screen

• Inconsistency in format and style

• Not using shading to help voters differentiate between contests

Better Ballots: Re-designed Ballot, Kewaunee County

Keep contests in same column

Better Ballots: Sarasota County, FL (2006)One Contest Per Screen for DREs

Better Ballots: Sarasota Ballot Compared to Charlotte Ballot

Better Ballots: Los Angeles County

Format consistently

Before and after

12

Cedar County: May 2006 for ES&S optical scanners

Cedar County: November 2006 for ES&S optical scanners

King County: November 2004 for Premier optical scanners

King County: November 2008 for Premier optical scanners

Shawnee County: November 2004 for Premier optical scanners

Shawnee County: November 2008 for Premier optical scanners

TEST BALLOTGENERAL ELECTIONNOVEMBER 4, 2008

MARIN COUNTY, CALIFORNIAINSTRUCTIONS TO VOTERS:• Use only the marking pen provided, or a ball-point pen with black ink.• To vote for a candidate, completely blacken the oval next to your choice, like this . Do not vote for more than the

number of candidates to be elected.• When there are two (2) or more candidates to be elected for the same office, blacken the ovals next to each of your choices.• To vote on a measure, blacken the oval next to the word YES or next to the word NO.• Write-in candidates: To vote for a qualified write-in candidate, blacken the oval next to the blank line for the office and write

the name of the person on the line. Do not vote for both a write-in candidate and a candidate whose name is on the ballot for the same office.

• All distingushing marks on the ballot are forbidden and void the ballot.• If you make a mistake, tear your ballot, or want to change your vote, return it to the election official and obtain another.

VOTE ON BOTH SIDES OF BALLOT

FEDERAL

BOB BARR WAYNE A. ROOT

Libertarian

JOHN MCCAIN SARAH PALIN

Republican

CYNTHIA MCKINNEY ROSA CLEMENTE

Green

ALAN KEYES WILEY S. DRAKE, SR.

American Independent

RALPH NADER MATT GONZALEZ

Peace And Freedom

BARACK OBAMA JOE BIDEN

Democratic

PRESIDENT AND VICE PRESIDENTVote for One Party (1)

JOEL R. SMOLEN Registered Investment Advisor

Libertarian

MIKE HALLIWELL College Professor

Republican

LYNN WOOLSEY U.S. Representative

Democratic

UNITED STATES REPRESENTATIVE, 6TH DISTRICT

Vote for One (1)

STATE

MARK LENO California State Legislator

Democratic

SASHI MCENTEE Small Business Consultant

Republican

STATE SENATOR, 3RD DISTRICTVote for One (1)

PAUL LAVERY Businessman/Father

Republican

JARED HUFFMAN Incumbent

Democratic

TIMOTHY J. HANNAN Attorney/Mediator/Arbitrator

Libertarian

MEMBER OF THE STATE ASSEMBLY,6TH DISTRICT

Vote for One (1)

DISTRICT

ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman

MARIN HEALTHCARE DISTRICT, DIRECTOR

Vote for no more than Two (2)

MEASURES SUBMITTEDTO THE VOTERS

STATE

YES NO

PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply. Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.

YES NO

PROPOSITION 1A: SAFE, RELIABLE HIGH-SPEED PASSENGER TRAIN. To provide Californians a safe, convenient, affordable, and reliable alternative to driving and high gas prices; to provide good-paying jobs and improve California’s economy while reducing air pollution, global warming greenhouse gases, and our dependence on foreign oil, shall $9.95 billion in bonds be issued to establish a clean, efficient high-speed train service linking southern California, the Sacramento/San Joaquin Valley, and the San Francisco Bay Area, with at least 90 percent of bond funds subject to independent audits? Fiscal Impact: State costs of $19.4 billion, assuming 30 years to pay both principal and interest costs of the bonds. Payments would average about $647 million per year. When constructed, unknown operation and maintenance costs, probably over $1 billion annually; at least partially, and potentially fully, offset by passenger fares.

YES NO

PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals. Fiscal Impact: State cost of about $2 billion over 30 years to pay off both the principal ($980 million) and interest ($933 million) costs of the bonds. Payments of about $64 million per year.

YES NO

PROPOSITION 4: WAITING PERIOD AND PARENTAL NOTIFICATION BEFORE TERMINATION OF MINOR’S PREGNANCY. INITIATIVE CONSTITUTIONAL AMENDMENT. Changes California Constitution, prohibiting abortion for unemancipated minor until 48 hours after physician notifies minor’s parent, legal guardian, or, in limited cases, substitute adult relative. Provides an exception for medical emergency or parental waiver. Fiscal Impact: Potential unknown net state costs of several million dollars annually for health and social services programs, court administration, and state health agency administration combined.

YES NO

PROPOSITION 5: NONVIOLENT DRUG OFFENSES. SENTENCING, PAROLE AND REHABILITATION. INITIATIVE STATUTE. Allocates $460,000,000 annually to improve and expand treatment programs. Limits court authority to incarcerate offenders who commit certain drug crimes, break drug treatment rules or violate parole. Fiscal Impact: Increased state costs potentially exceeding $1 billion annually primarily for expansion of offender treatment programs. State savings potentially exceeding $1 billion annually on corrections operations. Net one-time state prison capital outlay savings potentially exceeding $2.5 billion.

FRONT Card 1 RptPct 1001-1100 "0001100" FOR PROOF ONLY 08/29/08 12:41:52

19

NOVEMBER 4, 2008MARIN COUNTY, CALIFORNIA

INSTRUCTIONS TO VOTERS:• Use only the marking pen provided or a ball point pen with black ink.

• To vote for a candidate, completely blacken the oval to the left of the name, like this . Where two or more candidates for the same office are to be elected, blacken the oval to the left of each of your choices.

• To vote on a measure, completely blacken the oval next to YES or NO.

• To vote for a qualified write-in candidate, completely blacken the oval next to the blank line for that office and write the name of the person on the line.

• If you make a mistake, damage your ballot, or you want to change a vote, take your ballot to an election worker and get another. All distinguishing marks are forbidden and void the ballot.

FEDERAL

BOB BARR WAYNE A. ROOT

Libertarian

JOHN MCCAIN SARAH PALIN

Republican

CYNTHIA MCKINNEY ROSA CLEMENTE

Green

ALAN KEYES WILEY S. DRAKE, SR.

American Independent

RALPH NADER MATT GONZALEZ

Peace And Freedom

BARACK OBAMA JOE BIDEN

Democratic

PRESIDENT AND VICE PRESIDENTVote for One Party (1)

JOEL R. SMOLEN Registered Investment Advisor

Libertarian

MIKE HALLIWELL College Professor

Republican

UNITED STATES REPRESENTATIVE, 6TH DISTRICT

Vote for One (1)

DISTRICT

ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman

MARIN HEALTHCARE DISTRICT, DIRECTOR

Vote for no more than Two (2)

MEASURES SUBMITTEDTO THE VOTERS

STATEPROPOSITION 1A: SAFE, RELIABLE HIGH-

PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals.

YES NO

PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply.Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.

20

What can be done

21

HistoryExpense MachinesState law

Better Ballots: Limitations

Better Ballots: What Can Be Done?

• Use a ballot design checklist

• Review old ballots/work with experts

• Conduct usability testing of ballots

• Public education/publicize sample ballots

Ballot design checklist

Ballot instructions should be brief, simple, and clear

Don’t split contests

Make sure ballot design is consistent

Make ballots easy to understand visually

Give voters maximum flexibility

24

Dana Chisnell

Usability testing steps

25

1. Plan, minimally

2. Get the team on board

3. Use the LEO Testing Kit

4. Recruit participants

5. Conduct sessions

6. Debrief and decide

Better Ballots: Sarasota County

Better Ballots: Kewaunee County

Gradual levels of improvement: Elections officials do not have to implement every design suggestion to improve the usability of their ballots.

Best practices

Guidelines

Usability testing

28

✤ AIGA: Design for Democracy for EAC

✤ Brennan Center: Better Ballots

✤ UPA: ongoing testing, LEO Usability Test Kit

Resources

Usability Professionals’ Association: www.usabilityprofessionals.org/

LEO Usability Testing Kit:http://www.usabilityprofessionals.org/civiclife/voting/leo_testing.html

Ballot Usability and Accessibility Blog: http://ballotusability.blogspot.com/

29

Dana Chisnell

Resources

Brennan Center for Justice at NYU: Better Ballotshttp://www.brennancenter.org/content/resource/better_ballots/

AIGA - Design for Democracy: Effective Design for Federal Elections http://www.aiga.org/content.cfm/design-for-democracy-eac-reports

30

Dana Chisnell