Sixth sense

CONTENTSINTRODUCTIONREQUIREMENTSWORKINGAPPLICATIONSADVANTAGES & LIMITATIONSCONCLUSION

INTRODUCTION•This technology was developed by Pranav Mistry.

•An extrasensory perception.

•Sixth sense is a wearable gestural interface device.

•It is named sixth sense as it recognizes objects around us and give information about them.

REQUIREMENTS• Mirror• Wearable Camera• Pocket Projector• Internet enabled Smart phone• Colored markers

Wearable camera•It captures an object in view and tracks the user’s hand gestures.

•It acts like a digital eye, connecting you to the world of digital information.

Pocket projector•It Projects visual information & enables surfaces, walls and physical objects to be used as interfaces.•It displays data sent from smart phone on any surface in view.

Smart phone• As the smart phone is open sourced.

• The software searches the web and interprets the hand gestures.

Color markers• They help the camera to recognize the hand gestures.• The movements and arrangements of these markers are interpreted and they act as instructions for the projected application interfaces.

WorkingImages

Gestures

Vision

Capture

To process the video sequence

Send info

Project image Info on surface

Vision based gesture recognitionInvolves hand shape, position, and movement.Software's used in processing are Java,.net,SYMBIAN.It is done through following steps:

Image capturingFinger tip detectionFeature extractiontracking

Fingertip detection

Threshold image Detecting finger tips

Feature extraction

1)Circles and ellipses extracted from an image of a hand.

2) Selected image features corresponding to the palm, the fingers and the finger tips of a hand.

3) The selected image features capture the essential structure of a hand.

Tracking hand

rotationsSize variations State change

Interaction based direct manipulation and symbolic gestures

Tracking result

Gesture mode

selector

Operating mode selector

Application controller for direct

manipulation

Application controller for

symbolic gesture

Symbolic gesture recognizer

Application

Operating mode

No of fingers

location

Size & location of the gesture

trajectory

Kind of gesture

APPLICATIONS

•Getting information •Product enquiry

•Call making

•Take pictures

•Enhanced news reading

•Travel

•Maps

•Zooming features

• Art

•As watch

AdvantagesPortable.Multi touch and multi user interaction.Time conserving.connects the real world and digital world.Mind map the idea anywhere.Data access from machine directly in real time.

LimitationsImage noise.High cost of individual components.

Future developmentsGaming with out controllers.

Invisible mouse.

3d interfaces.

ConclusionUsing this technology:

“Finally one gets a taste of the world of Harry Potter.”Interaction via natural hand gestures.Recognizes objects around us and displays information.Transparent user interface.This prototype shows several applications that proves

usefulness and flexibility of the system.