Sixth Sense Technology

1

“SIXTH SENSE TECHNOLOGY”

Presented by: JAI RABINDRA UPADHYAY 1MJ08EE020

Under the guidance of: PURNIMA DEVI.G (ME) Asst.Professor

2

CONTENTS

INTRODUCTION

SIXTH SENSE PROTOTYPE

COMPONENTS

HOW IT WORKS

APPLICATIONS

ADVANCEMENT

CONCLUSION

Sixth Sense is a wearable gestural interface that augments the physical world around us with digital information.

Technology that plays with Human gestures to make the world more interactive and workflow much easier.

Pranav Mistry , of Indian origin, a PhD student in the Fluid Interfaces Group at the MIT Media Lab is the mastermind behind the sixth sense technology

INTRODUCTION

3

Pranav Mistry

4

WHAT IS SIXTH SENSE TECHNOLOGY

'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

It augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

5

PHYSICAL WORLD

Objects ~ Gestures Gestures ~ Interaction

6

WHAT DOES IT DO? “Sixth Sense brings intangible, digital information into the

tangible world, and allows us to interact with this information via natural hand gestures.

6thfrees information from its confines, seamlessly integrating it with reality, thus making the entire world your computer.”

7

SIXTH SENSE OVERVIEW

Developed by Pranav MistryResearch assistant/PhD candidate MIT

Portable device that is worn around neck Consists of:

CameraColored MarkersProjectorA smart phone

8

SIXTH SENSE PROTOTYPE

A Pocket Projector Projects visual

information to interfaces like wall, physical objects.

A Camera Tracks user hand gestures.

Colored Markers Movements of fiducials are interpreted into gestures.

MirrorMobile phone

9

COLOR MARKERS

It is at the tip of the user’s fingers .

Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures

The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces

10

SMART PHONE

A Web-enabled smart phone in the user’s pocket processes the video data

Other software searches the Web and interprets the hand gestures

11

MIRROR

The usage of the mirror is significant as the projector dangles pointing downwards from the neck.

MIRROR

12

PROJECTOR

The projector projects visual information enabling surfaces and physical objects to be used as interfaces

The projector itself contains a battery inside, with 3 hours of battery life.

A tiny LED projector displays data sent from the smart phone on any surface in view–object, wall, or person.

13

HOW IT WORKS ?

BLOCK DIAGRAM

captureSend for processing

Reflect on desired surface

Project image

Send Info

• Images • Pictures • Gesture

Info on surface

14

The hardware that makes Sixth Sense work is a pendant like mobile wearable interface

It has a camera, a mirror and a projector and is connected wirelessly to a Bluetooth smart phone that can slip comfortably into one’s pocket

The camera recognizes individuals, images, pictures, gestures one makes with their hands

Information is sent to the Smartphone for processing The downward-facing projector projects the output image

on to the mirror Mirror reflects image on to the desired surface Thus, digital information is freed from its confines and

placed in the physical world.

DESCRIPTION

15

WASHING MACHINES WITH 6TH SENSE TECHNOLOGY

Whirlpool's 6th Sense technology uses sensors built in to the washing machine to continually monitor and control your washing cycle to give you perfect results in the most efficient way possible.

6th Sense adjusts water, temperature and time levels to save energy and natural resources

Whirlpool’s 2009 range of washing machines AWOE 8758 comes integrated with enhanced 6th sense technology that gives more optimisation of resources and also increased saving in terms of energy, water and time.

16

WORKING

All Whirlpool appliances with intelligent 6th Sense technology work on three key principles; Sense, Adaption and Control, to ensure that they achieve optimal performance In Whirlpool washing machines the intelligent sixth sense technology sensors firstly measure the load size. Secondly, they will adjust the water, the temperature and the time in order to save energy and natural resources.

Adapts: It will then fill the washing machine with just the right amount of water to get the job done - no more, no less.

Senses: sensors measure the load size - the amount of washing you have put in your washing machine before starting the cycle.

This step by step rise in temperature optimises the working power of each individual active agent within the stain solver, giving you the best results on stain removal in a highly energy-efficient manner.

17

REFRIGERATORS

18

WORKING Once set, the unique Sixth Sense system memorises, monitors and

maintains your cooling levels automatically. When you open the door, Sixth Sense detects a rise in temperature and the

sensitive system automatically boosts cooling to recover the optimum storage conditions fast.

Humidity settings lets you control the whole climate at the touch of a button.

On holiday’ mode: The Whirlpool holiday or vacation mode controls your fridge freezer while you’re away. Controlled from the digital panel it ensures that the freezer temperature is maintained while the fridge operates at a minimal energy setting. Saving you money when you’re not at home

Also in the sixth sense cooling products you have the benefit of the multi flow ventilation system. This is a "total no frost" system which circulates chilled air around the freezer's storage areas, reducing humidity and preventing the formation of ice. This system blows chilled air around the interior of the fridge to ensure perfect conditions throughout.

AUTOMOBILES APPLICATION

Preventing accidents by warning drivers about potential danger from other vehicles was a major goal during the development of the new General Motors V2V (vehicle-to-vehicle) communication systems. Vehicles equipped with this technology can communicate with each other and exchange information such as location and speed. Drivers can then be warned in advance if another car is travelling in their blind spot, stopped in an area that is difficult or impossible to see, or about to enter the same intersection as they are. 19

20

ADVANCEMENTS

MAKE A Call-You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a all

CALL UP A MAP- With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map

CHECK THE Time-draw a circle on your wrist to get a virtual watch that gives you the correct time

21

WATCH Videos : Sixth Sense can be programmed to project related videos onto newspaper articles you are reading

22

ADVANTAGES

Connectedness between world and information. Data access directly from machine in real time. Mind map the data anywhere. Portable. Inexpensive Microsoft Surface does currently exist (which is similar in

theory). But Microsoft’s product is not portable like Sixth SenseIn addition to that Microsoft is developing a controlling environment whore the user doesn’t even have to touch the controller device named ‘Project Natal’. This will be a significant market competitor to the SixthSense technology since it still required some hardware involvement with the user.

OPEN SOURCE

23

CONCLUSION

Sixth Sense recognizes the objects around us, displaying information automatically and letting us to access it in any way we need

The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system

Allowing us to interact with this information via natural hand gestures

The potential of becoming the ultimate "transparent" user interface for accessing information about everything around us

24

PROJECT NATAL

• Recent introduction of the natal in gaming world has changed the whole dimension of the gaming world

25

REFERENCE http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html http://www.pranavmistry.com P. Mistry, P. Maes. Sixth Sense – A Wearable Gestural Interface. To be appeared

in SIGGRAPH Asia 2009, Emerging Technologies. Yokohama, Japan. 2009 P. Mistry. The thrilling potential of Sixth Sense technology TED India 2009.

Mysore, India http://ieeexplore.ieee.org Rao, S.S.;

Electron. & Commun. Eng., Anna Univ. of Technol., Coimbatore, India This paper appears in: Communication and Computational Intelligence (INCOCCI), 2010 International Conference on Issue Date: 27-29 Dec. 2010 On page(s): 336 - 339 Location: Erode E-ISBN: 978-81-8371-369-6 References Cited: 11 INSPEC Accession Number: 11887446 Date of Current Version: 24 March 2011

26