GESTURE PHONES Authors Krishna Kumar. S & Sai Venkata Vinay. C 1 Dept of Electronics & Communication Engg SONA COLLEGE OF TECHNOLOGY, SALEM
GESTURE PHONESAuthors
Krishna Kumar. S & Sai Venkata Vinay. C
1Dept of Electronics & Communication Engg
SONA COLLEGE OF TECHNOLOGY, SALEM
2
What is a Gesture Phone? Different tracking methods
◦ Optical tracking Stereoscopic vision technology Triangulation
◦ Inertial tracking Cases of gesture recognition technology Future innovations
TABLE OF CONTENTS
Dept of Electronics & Communication Engg
3
Phones which recognize our gestures and movements either using touch or touch free technology
WHAT IS A GESTURE PHONE?
http://www.pointgrab.com/276/gesture-mobile/http://www.fastcompany.com/1570274/how-use-androids-gesture-search-and-leave-your-phones-keyboard-behind
Dept of Electronics & Communication Engg
4
Optical tracking Inertial tracking
DIFFERENT TRACKING METHODS
www.ti.com/lit/wp/spry199/spry199.pdf
Dept of Electronics & Communication Engg
5
Optical tracking:◦ Two different cameras ◦ Triangulation method
Inertial tracking :◦ Single camera◦ Rolling shutters
DIFFERENT TRACKING METHODS
http://www.ti.com/lit/wp/spry199/spry199.pdf
Dept of Electronics & Communication Engg
Source :Real-time Motion Tracking on a Cellphone using Inertial Sensing and a Rolling-Shutter Camera.
The common technologies used are◦ Stereoscopic vision◦ Structured light pattern◦ Time of flight(TOF)
Optical tracking
Dept of Electronics & Communication Engg6
Source:www2.maths.lth.se
Two images shot Image processed using triangulation Calculates the depth of the image
STEREOSCOPIC VISION TECHNOLOGY
http://www.ti.com/lit/wp/spry199/spry199.pdf
Dept of Electronics & Communication Engg7
TRIANGULATION
Dept of Electronics & Communication Engg8
Source:www2.maths.lth.se
Independent of external structure Pixels are captured row by row
INERTIAL TRACKING
Dept of Electronics & Communication Engg9
Source :Real-time Motion Tracking on a Cell phone using Inertial Sensing and a Rolling-Shutter Camera.
Dept of Electronics & Communication Engg10
Source: Real-time Motion Tracking on a Cell phone using Inertial Sensing and a Rolling-Shutter Camera.
11
Answer call Operate other devices Browse web pages and scroll e-books Switch off mobile
CASES OF GESTURE RECOGNITION TECHNOLOGY
Dept of Electronics & Communication Engg
www.thorntech.com Source: EFY June 2013
Point grab’s solution Air swiper Hovering controls Blow to unlock
ANDROIDS AND WINDOWS PHONES
12
Source: androios-tveaks.blogspot.com
Source: androios-tveaks.blogspot.com
Flexible programming environment User friendly Multitasking Easy optimizing and paralyzing data portable
BENEFITS OF GESTURE TECHNOLOGY
13Dept of Electronics & Communication Engg
Depends on compiler’s performance Power consumption High clock cycle High standard processor required Requires lighting Gorilla arm
CHALLENGES
14Dept of Electronics & Communication Engg
Ultrasonic on phone for industries Infrared waves can be used for smaller application Burglar alarm Background smudging Pausing of signal transmission
INNOVATIONS
15Dept of Electronics & Communication Engg
16
1. BongWhan Choe, Jun-Ki Min, and Sung-Bae Cho; Online Gesture Recognition for User Interface.
2. Mingyang Li, Byung Hyung Kim and Anastasios I. Mourikis; Real-time Motion Tracking on a Cellphone using Inertial Sensing and a Rolling-Shutter Camera.
3. Mingyu Chen, Ghassan AlRegib, Senior Member, IEEE, and Biing-Hwang Juang, Fellow, IEEE; Feature Processing and Modeling for 6D Motion Gesture Recognition.
4. Dong-ik ko, Lead engineer, gesture recognition and depth –sensing gaurav agarwal, Manager, Gesture recognition and depth-sensing; Gesture recognition: Enabling natural interactions with electronics.
REFERENCES
Dept of Electronics & Communication Engg