Top Banner
Employee Password Usability Survey Yee-Yin Choong Visualization and Usability Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology September 10, 2015
30

Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Mar 17, 2018

Download

Documents

vukhuong
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Employee Password Usability Survey

Yee-Yin Choong Visualization and Usability Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology

September 10, 2015

Page 2: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Online Survey

Anonymous

Questions on password management and computer security

Demographics

US Government Workers

4,573 Department of Commerce (DOC) employees

Employee Password Management

1

Page 3: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Demographics

Gender

Education

3.3%

39.2%

57.5%

0% 20% 40% 60% 80% 100%

na

Female

Male

1.4%

2.7%

15.6%

31.7%

34.4%

5.3%

7.0%

0% 20% 40% 60% 80% 100%

na

Prof degree

PhD

MS

BS

Asso

HS

2

Page 4: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Demographics

Age (years)

Service Length (years)

2.0%

2.4%

18.6%

29.8%

23.1%

20.5%

3.5%

0% 20% 40% 60% 80% 100%

na

> 65

56–65

46–55

36–45

26–35

<=25

0.5%

35.1%

11.5%

11.3%

15.1%

7.7%

13.4%

5.5%

0% 20% 40% 60% 80% 100%

na

> 20

15–20

11–14

6–10

4–5

1–3

< 1

3

Page 5: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Demographics

Job Level

Computer Experience

0.6%

1.9%

9.6%

11.5%

13.8%

62.6%

0% 20% 40% 60% 80% 100%

na

Executive

Manager

Team lead

Supervisor

Non-supervisor

0.3%

19.5%

50.6%

29.0%

0.5%

0% 20% 40% 60% 80% 100%

na

Expert

Advanced

Average

Novice

4

Page 6: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Password Usage

Attitudes toward Password Policy

Password Management Lifecycle

Generation

Maintenance

Authentication

Findings – Outline

5

Page 7: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

6

Average 9 work-related passwords

5 frequently used

4 occasionally used

Time spent on creating passwords

Password Usage

Password Types Estimated Longest

Time Total1 (Mean)

Worst Scenario - time spent annually2 (with longest time)

Hours/employee/year If on a 90-day cycle

Hours/employee/year If on a 60-day cycle

Frequent passwords 98.5 min 6.6 h 9.9 h

Occasional passwords 86.6 min 5.8 h 8.7 h

Total 12.4 h 18.6 h 1 Estimated Longest Time Total = (number of password counts) x (estimated longest time for a password) 2 The calculation is based on the password changing cycle of 90 days (i.e. 4 times a year), and 60 days (i.e. 6 times a year).

Page 8: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

7

Password creation takes long, why?

The program kept rejecting my password because it was not within the guildlines

[sic] even though I thought I was following them.

That 25 minutes was actual time trying to get a system to accept a password. I

was so desparate [sic] I actually started asking colleagues for suggestions! .

Longer if I manage to lock myself out in doing so, or can't remember what I just

changed it to and have to get it reset all over.

sometimes it's taken me 20min to change a password to one that meets the

requirements and isn't too far off from my other ones (so I can remember it!)

Longest time is 2 days. The password expired and a default password was set. I

could not change away from the default due to a lock out feature requiring that

the password not be changed more than once in two days.

There have been several times where it took so long to create a complex enough

password that I forgot the password when logging in the next time and had to

have it reset.

Page 9: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

8

Attitudes toward Password Policy

Too long

Too complex

Changed too often

not at the same time!

Too short 0.9%

Too long 57.2%

About right 36.2%

Neutral 5.7%

Attitudes – Password Length

Too simple 0.6%

Too complex

51.0%

About right 44.4%

Neutral 4.0%

Attitudes – Password Complexity

> 180 days 35.2%

121 - 180 days 17.4%

91 - 120 days 18.3%

61 - 90 days 18.8%

31 - 60 days 5.8%

<= 30 days 1.3%

Neutral 3.2%

Attitudes – Password Expiration

Page 10: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

9

What did they say? The combination of length/complexity, number of different passwords, plus

frequent changes makes passwords insecure, because they must be written down. How do you think people remember extremely complex passwords which also

require to be changed every 3 months ? #Wr1T31Td0wN .. yes that's 12 chars :) I understand that for ““security” ” reasons it is good to change a password - but

seriously are we all expected to magically remember 12 different passwords, most of which are 10 charecters [sic] long, and can't look like a word (I agree with the reason for the complexity - it just hard on the user).

I make a list of the password requirements for all accounts and make one that fits all of them.

Security has become so complex, it's interfering with being able to do a job efficiently.

It is hard enough to come up with a 12 or so string of unique characters every three months, let alone remember 10 individual ones.

Security has become so complex, it's interfering with being able to do a job efficiently.

Page 11: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

10

Organizational Password Policy

Protect data integrity and system security

Control employees’ access

Dictate employees’ password management

Password composition requirements

Password expiration

Reuse and history

Storage requirements

Page 12: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

11

Attitudes (Fishbein & Ajzen, 1975)

“Learned, relatively enduring dispositions to respond in consistently favorable or unfavorable ways to certain people, groups, ideas, or situations.”

Positive employee attitudes

combat negative reactions to organization-wide changes or policy viewed as unfavorable

Employee Attitudes

Page 13: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Employee Password Management Lifecycle 12

Burdensome

Too short 0.9%

Too long 57.2%

About right

36.2%

Neutral 5.7%

Attitudes – Password Length

Too simple 0.6%

Too complex

51.0%

About right

44.4%

Neutral 4.0%

Attitudes – Password Complexity

About Right

Divergent Views

Page 14: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

13

Page 15: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Password Generation Considerations

75.4%

67.3%

44.0%

86.0%

51.8%

22.5%

75.9%

68.5%

43.5%

87.0%

48.5%

19.8%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Easy to remember Compliant Strong

% “

Ver

y Im

po

rtan

t”

Length – About right Length – Burdensome

Complexity – About right Complexity – Burdensome

14 * All comparisons are statistically significant (p < 0.05).

Page 16: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Password Generation Strategies

61.1%

36.2%

29.7%

68.3%

45.8% 41.7%

58.8%

35.2%

30.1%

71.5%

48.2%

42.9%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Minor change Existing pwd Recyle old pwd

% o

f u

sin

g th

e st

rate

gy

Top 3 Strategies

Length – About right Length – Burdensome

Complexity – About right Complexity – Burdensome

15 * All comparisons are statistically significant (p < 0.05).

Page 17: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Password Maintenance

16 * All comparisons are statistically significant (p < 0.05).

69.7%

56.0%

26.8%

64.0% 65.6%

30.9%

70.4%

56.8%

25.5%

62.7% 66.2%

32.5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Memorize Paper File

% o

f u

sin

g th

e tr

acki

ng

met

ho

d

Primary password tracking methods

Length – About right Length – Burdensome

Complexity – About right Complexity – Burdensome

Page 18: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Password Tracking – paper in plain view

17

15.9% 16.3%

29.1% 31.1%

0%

10%

20%

30%

40%

50%

Length Requirement Complexity Requirement

% p

aper

in p

lain

vie

w

Attitudes toward Password Policy

About right Burdensome

Page 19: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Authentication Experience

18 * All comparisons are statistically significant (p < 0.05).

18.4% 15.9% 16.1%

33.0% 29.5% 29.6%

18.8%

13.7% 13.2%

34.4% 33.6% 34.4%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Mistyping password Forgetting password Error message - changingpassword

% “

A L

ot"

Fru

stra

tio

n

Top 3 Login Problems

Length – About right Length – Burdensome

Complexity – About right Complexity – Burdensome

Page 20: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Thoughts on Compromised Passwords

19

13.6%

34.3%

9.3%

22.6% 24.5%

11.1%

48.3%

9.9%

15.5% 17.8%

13.7%

33.3%

10.0%

22.3% 24.1%

10.9%

50.7%

9.3%

14.5% 17.5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Don't know None Minor Major Depending on accounts

Perceived Severity of Consequeces on Compromised Passwords

% o

f re

spo

nd

ents

Length – About right Length – Burdensome

Complexity – About right Complexity – Burdensome

* Comparisons (None, Major, Accounts dependent) are statistically significant (p < 0.05).

Page 21: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

What Did 4,500+ People Tell Us?

Staff overwhelmed – pushing human cognition limits different password requirements (length, complexity, expiration) multiple passwords – frustration level significantly related to

number of passwords

Statistically significant relationships Attitudes toward organizational security policies

Security behaviors and experiences

Positive attitudes Compliant and strong passwords more important

Write-down passwords less often

Less frustration with login problems

Better understanding of password security 20

Page 22: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

21

Smart Cards for identification and authentication

Security, multi-factors

Something you have – a Smart card

Something you know – a PIN

Usability

Single sign-on

PINs easier to remember and to enter

Promising Solution?

Page 23: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

22

CAC Standard identification for Department of Defense

(DoD) personnel

Physical access

Logical access

Online Survey Anonymous

Questions on CAC usage and password management

The case of CAC (Common Access Card)

Page 24: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

23

Single Sign-on Coverage

11.8%

21.6% 20.3% 20.5% 25.7%

2.9%

9.3% 12.9%

21.8%

53.2%

0%

20%

40%

60%

80%

100%

All - 100% About 75% About 50% About 25% None - 0%

DOD DOC

Page 25: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

24

Attitudes toward Password Policy

0.6%

4.0%

51.0%

44.4%

0.9%

5.7%

57.3%

36.2%

0.5%

4.2%

32.5%

62.8%

0.7%

6.0%

41.4%

51.8%

0% 20% 40% 60% 80% 100%

Too simple

Neutral

Too complex

About right

Too short

Neutral

Too long

About right

Co

mp

lext

iyLe

ngt

h

DOD

DOC

Page 26: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

25

Authentication Problems – Forgetting

0.6%

11.3%

89.5%

3.3%

51.1%

39.5%

Very Large + Large amount Moderate + Small amount None

Frustration with Forgetting – DOD

CAC – Forget PIN PWD – Forget Password

Statistical significance (p < 0.05)

More frustration with Forgetting Password

Page 27: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

26

User Satisfaction with CAC

Satisfied 90.2%

Dissatisfied 1.9%

Neutral 7.9%

Page 28: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

27

Fewer passwords to maintain, less forgetting

Better attitudes

Less frustration with authentication problems

Time-saving

High Satisfaction

CAC benefits >> Passwords

Page 29: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Moving Forward

Smartcards (e.g., PIVs, CACs) for authentication

More research on

Direction of causality: Attitudes & Behaviors

Promote positive attitudes

Work and personal password management

Better organizational security policies

28

Page 30: Employee Password Usability Survey - NIST Password Usability Survey ... Hours/employee/year If on a 60-day cycle ... High Satisfaction

Q & A

Yee-Yin Choong

National Institute of Standards and Technology Gaithersburg, MD, USA

[email protected]

Choong, Y. Y., Theofanos, M., & Liu, H.-K. (2014). United States Federal Employees' Password Management Behaviors – A Department of Commerce Case Study, NISTIR 7991 Choong, Y. Y. (2014). A cognitive-behavioral framework of user password management lifecycle. In Human Aspects of Information Security, Privacy, and Trust (pp. 127-137). Springer International Publishing. Choong, Y. Y., & Theofanos, M. (2015). What 4,500+ people can tell you–employees’ attitudes toward organizational password policy do matter. In Human Aspects of Information Security, Privacy, and Trust (pp. 299-310). Springer International Publishing.