Top Banner
AccelPrint: Imperfections of Accelerometers Make Smartphones Trackable Sanorita Dey , Nirupam Roy, Wenyuan Xu, Romit Roy Choudhury, Srihari Nelakuditi
47

AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

May 06, 2018

Download

Documents

trinhdan
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

AccelPrint: Imperfections of Accelerometers Make Smartphones

Trackable

Sanorita Dey, Nirupam Roy,

Wenyuan Xu, Romit Roy Choudhury, Srihari Nelakuditi

Page 2: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

People use hundreds of apps

Page 3: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Some apps are sneaky

• Exchanging IDs without consent is rampant

– IMEI (device id), IMSI (subscriber id), or ICC-ID (SIM card serial number) help track users

• One possible Solution: TaintDroid

– Realtime filtering of exchange of device IDs

Page 4: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Law: Get user’s consent

• While installing a cookie • While sharing location

Page 5: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

People use hundreds of apps

Page 6: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Our findings

Accelerometers have fingerprint

Other sensors can also potentially

track the users

Page 7: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

What if accelerometers have fingerprints?

Page 8: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

What if accelerometers have fingerprints?

Page 9: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

What if accelerometers have fingerprints?

Page 10: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Evidence of fingerprint

Page 11: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Toy Experimental Setup

Controlled, Identical Impetus

Page 12: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Toy Experimental Setup

Page 13: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Toy Experimental Setup

• Six stand-alone accelerometer chips

• Stimulation with an external vibration motor

• Arduino to control vibration and collect accelerometer readings

Page 14: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Accelerometers are distinguishable

Accelerometer chips of Samsung Galaxy S3

Accelerometer chips of Nexus S

Accelerometer chips of Samsung Galaxy Nexus

Page 15: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Accelerometers are distinguishable

Samsung S3

Samsung S3 Galaxy Nexus

Galaxy Nexus

Nexus S

Nexus S

Page 16: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Accelerometers are distinguishable

Nexus s_1 Nexus s_2

Page 17: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Why are accelerometers distinct?

Page 18: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Accelerometers are based on MEMS

Page 19: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Internal structure of an accelerometer

Page 20: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Reasons for difference in accelerometers

• Manufacturing imperfections

• Idiosyncrasies due to QFN and LGA Packaging

• Subtle imperfections do not alter the rated functionality

• Small imperfections can potentially introduce idiosyncrasies in data

Page 21: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Evaluation and External Impact Analysis

Page 22: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Larger Scale Exploration

107 stand-alone chips, smartphones and tablets in total

+ 36 time domain and frequency domain features

80 stand-alone accelerometer chips 27 smartphones and tablets

Bagged Decision Trees for ensemble learning (with accelerometer traces)

+

Page 23: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Feature Selection

Time domain features Frequency domain features

Extract 8 time and 10 frequency domain features from S(i) and I(i)

Page 24: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Overall classification performance

Page 25: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Overall classification performance

MPU 6050

ADXL 345

MMA 8452q

Nexus One

Samsung S3

MPU 6050

Page 26: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

worst case precision & recall > 76%

average precision & recall > 99%

Precision and Recall

Page 27: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Questions

• Is the external vibration mandatory for fingerprinting the accelerometers?

• What is the impact of smartphone CPU load on fingerprints?

• Does the fingerprint manifest only at faster sampling rates?

• Does the system need to be aware of the surface on which device is placed?

Page 28: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Precision and Recall Without Vibration

worst case precision & recall > 66%

average precision & recall > 88%

Page 29: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Natural Questions

• Is the external vibration mandatory for fingerprinting the accelerometers?

• What is the impact of smartphone CPU load on fingerprints?

• Does the fingerprint manifest only at faster sampling rates?

• Does the system need to be aware of the surface on which device is placed?

Page 30: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Is the system sensitive to CPU load?

• CPU load matters. But up to 20% difference, high classification precision

Page 31: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Natural Questions

• Is the external vibration mandatory for fingerprinting the accelerometers?

• What is the impact of smartphone CPU load on fingerprints?

• Does the fingerprint manifest only at faster sampling rates?

• Does the system need to be aware of the surface on which device is placed?

Page 32: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Does the fingerprint manifest only at faster sampling rates?

• Even at slower sampling rates, devices exhibit discriminating features • Likelihood of distinguishing devices improves with faster sampling rates

Page 33: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Natural Questions

• Is the external vibration mandatory for fingerprinting the accelerometers?

• What is the impact of smartphone CPU load on fingerprints?

• Does the fingerprint manifest only at faster sampling rates?

• Does the system need to be aware of the surface on which device is placed?

Page 34: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Does the system need to be aware of the surface on which device is placed?

• Training on different surfaces helps but the system is surface-agnostic

Page 35: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Conclusion and Future Work

• Accelerometers possess fingerprints

• Next step is commercial-grade evaluation

• How to scrub fingerprint from sensor data?

Page 36: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Two objects may be indistinguishable …

Page 37: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

… but no two objects are identical

Page 38: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Thank You http://web.engr.illinois.edu/~sdey4/

Page 39: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Can we distinguish between an alien phone from a registered phone?

Page 40: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

How unique are accelerometer fingerprints?

Even with increasing number of known or alien devices, precision/recall is still high

known devices alien devices

Page 41: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Can we mask a device’s fingerprint with a case?

• Accelerometer readings with and without case are different • Training with and without case still helps classify a device

Page 42: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

When to extract a fingerprint in practice?

• Opportunistically under similar conditions

– e.g. when vibration motor on, CPU load moderate

Page 43: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

AccelPrint Design

Data collection

Feature Extraction

Fingerprint Creation

Database Population

Random Sample Collection

Fingerprint Matching

Fin

gerp

rin

t ge

ne

rati

on

an

d s

tori

ng

ph

ase

Fin

gerprin

t match

ing p

hase

Page 44: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Accelerometer data collection

• Vibrate phone/chip for a certain duration (say 2 sec)

– Smartphones stimulated with internal vibration motor

• Trace: Accelerometer values during vibration period

– {sx(i), sy(i), sz(i)} be the ith acceleration at time T(i)

• Root sum square

– Samples are not at regular intervals

• Sampling rate depends on the mode

• Sampling interval

S(i) = sx2(i)+ sy

2(i)+ sz2(i)

I(i) =T(i+1)-T(i)

Page 45: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Fingerprint matching

• When a phone is registered

– AccelPrint is trained with features extracted from multiple (say 10 to 15) traces from that phone

– Bagged Decision Trees for ensemble learning

• When a phone is tested

– Extracts features from a single trace

– Classifier outputs a matching registered phone

• or “alien” based on classification score

Page 46: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Can we fingerprint a device without vibration?

Rotational setup controlled by Arduino

Page 47: AccelPrint: Imperfections of Accelerometers Make ...wp.internetsociety.org/ndss/wp-content/uploads/sites/25/2017/09/03... · –IMEI (device id), IMSI (subscriber id), or ICC-ID ...

Can we fingerprint a device without vibration

Even with rotational motion for stimulation, average precision/recall > 97%