Top Banner
MoLe: Motion Leaks through Smartwatch Sensors Presented by Michael Mahler
20

MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Jul 13, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

MoLe: Motion Leaks through Smartwatch Sensors

Presented by Michael Mahler

Page 2: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 3: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Background

● Modern smartwatches have full suite of motion sensing chips

● Great for counting steps, monitoring sleep, etc

● Opens up a potential side-channel attack

● NOT the goal of MoLe: prove that leaks are possible

● Goal of MoLe: determine to what extent the leaks are possible

Page 4: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 5: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Related Work

● Using the accelerometer and gyroscope, is it possible to infer keystrokes?

● Related work suggests it’s doable

● (sp)iPhone

● TouchLogger

Page 6: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Why It’s Hard

● Data from right hand is absent

● Not everyone uses the same fingers for the same keys

● People type at different speeds (faster and fainter is obviously harder)● Motion data is dependent on the last key pressed - so incorrectly classifying

one key could throw off all subsequent keypresses

Page 7: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Data Exploration

Page 8: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Data Exploration

Page 9: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Overview

Page 10: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Design - Keystroke Detector

Page 11: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Design - Cloud Fitting

Page 12: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation

● How well can MoLe guess each word?

● What affects its effectiveness?

● Should humans be used in this system?

● Threat prevention

Page 13: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Overall Effectiveness

● 30% chance that MoLe would narrow down a typed word to only 5 possibilities

● 50% chance to only 24 possibilities

Fairly brute-forceable now

Page 14: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Impacts of Variables

● Word Length - longer words are generally easier to classify

● Number of Left-hand Chars in a Word

● Sampling Rate

Page 15: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Human Intervention

● Given a list of possible words in a sentence, how hard would it be for a human to guess the phrase?

● Is this really feasible?

Page 16: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Threat Prevention

● Detect typing events and throttle the accelerometer to ~ 30Hz● Only let the OS handle the raw data. Apps can only see analytics about the

data (i.e. “steps taken today” or “activity level in the past hour”)

● Could apply some sort of differential privacy algorithm

Page 17: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Some Good Things

● Authors very up-front about the limitations of MoLe

● Authors used real people to test MoLe

● A lot of good evaluation-based questions were answered

Page 18: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Criticisms

● Sampling at 200Hz - Data size/throughput/storage isn’t talked about

● No other ML techniques used or considered

● Authors too hard on themselves- MoLe could easily be deployed IRL

Page 19: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 20: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Discussion