Osaka University Advanced T elecommunications R esearch Institute International Osaka University Advanced T elecommunications R esearch Institute International *Quan Kong(Osaka University) Takuya Maekawa(Osaka University) Taiki Miyanishi(ATR) Takayuki Suyama(ATR) Selecting Home Appliances with Smart Glass based on Contextual Information Ubicomp 2016
16
Embed
Selecting Home Appliances with Smart Glass based on ...
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Osaka UniversityAdvanced Telecommunications Research
Institute InternationalOsaka UniversityAdvanced Telecommunications Research
Osaka UniversityAdvanced Telecommunications Research
Institute International
Device for data collection Google Glass, Nexus 5 (in pocket) Sampling rate : 30HzSemi-naturalistic collection
protocol Activities follow the instruction 3 users X 10 sessions activities
prepare meals
eat meals
wash dishes
watch TV
…
sleep
Random
Activities
floor plan and appliances
toilet faucet
bedroom air conditioner
bedroom lighting
lounge lighting
TV
lounge air conditioner
kitchen faucet
kitchen curtain lounge curtain
kitchen lighting
drawer
front door
fan
Evaluation – Data set
Osaka UniversityAdvanced Telecommunications Research
Institute International
Evaluation Result - Leave-one-session out cross validation
Proposed: activity + position + camera
Proposed w/o pos:activity+ camera
Proposed w/o act: position + camera
Proposed w/ cam: only camera
SVM w/ cam: only camera
SVM all: activity + position + camera
Effect of context
F-measureRecallPrecision
10%
0.845
0.813
0.857
0.928
0.894
0.955
0.844
0.812
0.862
0.897
0.878
0.936
0.844
0.812
0.859
0.912
0.886
0.945
SVM all
SVM w/ cam
Proposed w/ cam
Proposed w/o act
Proposed w/o pos
Proposed
Osaka UniversityAdvanced Telecommunications Research
Institute International
Evaluation Result – Confusion MatrixVisual confusion matrix of Proposed w/ cam Visual confusion matrix of Proposed
• air conditioner and lighting were relatively poor • can’t distinguish between kitchen lighting and
bedroom lighting • drawer performed not well
• air conditioner and lighting were increased about 14% on average of F-measure
• F-measure improved by about 10% on total average
Osaka UniversityAdvanced Telecommunications Research
Institute International
0.4
0.5
0.6
0.7
0.8
0.9
1
0 2 4 6 8 10 12
Proposed
Proposed (reuse)
Proposed (imgaenet)
Evaluation Result – Transition of Average F-measures
sessions
F-m
easu
re
Reusing other users’ data
Appliance Image Sensor Data
Position
Activity
+
Appliance Image Sensor Data
Position
Activity
+
Appliance Image Sensor Data
Position
Activity
+
User1User2
User3
-collect online images for each category
-find top-k similar images for each appliance
Utilizing online image database
32% 28%
Osaka UniversityAdvanced Telecommunications Research
Institute International
Conclusion
We proposed a new method of appliance selection with a smart glass based on position and activity contextual information
The effectiveness of contextual information in an appliance selection task has been confirmed in a real experiment environment.
Context based method can also be used to enhance the performance of such other appliance selection approaches as speech, gaze direction, and beacon- based approaches