FUTURE DETACHABLE ORGAN
SIXTH SENSE PLUS TECHNOLOGYNAME OF AUTHORS:GAURESH D.
VANJAREHARSHIL A. SHETHNAME OF INSTITUTE: VIVEKANAND EDUCATION
SOCIETY POLYTECHNIC.CONTACT DETAILS- 1. GAURESH D.VANJARE.EMAIL:
[email protected] Contact number-9987140449 2. HARSHIL A. SHETH.
EMAIL: [email protected] Contact number- 9773326721COURSE :
ELECTRONICS AND COMMUNICATION.YEAR : THIRD YEAR DIPLOMA
1.0ABSTRACT-Starting from 6TH SENSE TECHNOLOGY (SST) is a
wearable gestural interface that augments the physical world around
us with digital information and lets us use natural hand gestures
to interact with that information. By using a camera and a tiny
projector mounted in a pendant like wearable device, ' SST ' sees
what you see and visually augments any surfaces or objects we are
interacting with. It projects information onto surfaces, walls, and
physical objects around us, and lets us interact with the projected
information through natural hand gestures, arm movements, or our
interaction with the object itself. 'SST' attempts to free
information from its confines by seamlessly integrating it with
reality, and thus making the entire world your computer.1.1
INTRODUCTION-When we encounter something, someone or some place, we
use our five natural senses which include eye, ear, nose, tongue
mind and body to perceive information about it; that information
helps us make decisions and chose the right actions to take. But
arguably the most useful information that can help us make the
right decision is not naturally perceivable with our five senses,
namely the data, information and knowledge that mankind has
accumulated about everything and which is increasingly all
available online. Although the miniaturization of computing devices
allows us to carry computers in our pockets, keeping us continually
connected to the digital world, there is no link between our
Digital devices and our interactions with the physical world.
Information is confined traditionally on paper or digitally on a
screen. fig1.2.11.3 WHAT IS SIXTH SENSE TECHNOLOGY?SST in
scientific terms is defined as Extra Sensory Perception or in short
ESP. It involves the reception of information not gained through
any of the five senses. Nor is it taken from any experiences from
the past or known. Sixth Sense aims to more seamlessly integrate
online information and tech into everyday life.
1.4 COMPONENTS-
Fig1.4.1 fig1.4.21 Camera
Fig1.4.3
The camera captures and recognises an object in view and tracks
the users hand gestures using computer-vision based techniques. 2
Projector
Fig1.4.4A projector opens up interaction and sharing. The
projector projects visual information enabling surfaces, walls and
physical objects around us to be used as interfaces.3 MirrorThe
usage of the mirror is significant as the projector dangles
pointing downwards from the neck.4 Peripheral Connectors And
Wireless MediumMicro USB is used as main connector to connect this
technology to pc. This port is also used for charging the device.
Also micro HDMI is provided to view FULL HD recorded video on the
big TV. Also a 3.5mm jack to connect your earphones is provided.On
the contrary ,with the wireless medium go, we can integrate WIFI
DIRECT with blazing fast speed for sharing of files, also Bluetooth
3.0 providing faster file transfer and connectivity ,and WIFI to
connect to internet and browse the internet at faster speed , also
there is DLNA SHARING and NFC sharing.5 Memory Unit, Sim Slot And
Processor.It is packed with 1GB RAM, 16GB user memory .It also
accepts any sim card for its networks, and processor used here can
be Intels atom or cortex processor.6 Colour Markers
Fig1.4.5It is at the tip of the users fingers. Marking the users
fingers with red, yellow, green, and blue tape helps the camera
recognize gestures. 1.5 HOW DOES IT WORK?
Fig1.5.11. The hardware that makes SST work is a pendant like
mobile wearableInterface.2. It has a camera, a mirror and a
projector and is connected wirelessly to a Bluetooth or 3G or wifi
smart phone that can slip comfortably into ones pocket.3. The
camera recognizes individuals, images, pictures, gestures one makes
with their hands.4. Information is sent for processing.5. The
downward-facing projector projects the output image on to the
mirror.6. Mirror reflects image on to the desired surface.7. Thus,
digital information is freed from its confines and placed in the
physical world.The idea is that SST tries to determine not only
what someone is interacting with, but also how he or she is
interacting with it. The software searches the internet for
information that is potentially relevant to that situation, and
then the projector takes over.
1.6 GESTURES"The system is constantly trying to figure out
what's around you, and what you're trying to do. It has to
recognize the images you see, track your gestures, and then relate
it all to relevant information at the same time."The software
recognizes 3 kinds of gestures:- Multitouch gestures, make the map
move by pinching and dragging.- Freehand gestures, like when you
take a picture. -Iconic gestures, drawing an icon in the air. You
might want to use other gestures that you use in everyday life.
This system is very customizable.-Pantomimic gestures:It means
mimicking the actions of doing something.
Fig1.6 GesturesTo give our device an Indian touch we have
programmed the gesture of NAMASTE to turn on the device.1.7
OPERATING SYSTEMWe can integrate Linux, android, windows OS
etc.
1.8 THE PLUS TECHNOLOGYThe 6th sense plus technology comes with
a bionic lens which completely changes the vision for 6th sense. It
can do all things that SST can but in much integrated manner.1.8.1
Construction of bionic lens. Fig1.9.1 fig1.9.2 A contact lens
display comprising a multipixel light emitting diode (LED) chip (1)
power-harvesting/control circuitry (2), antenna (3), and
interconnects (4). These subsystems are encapsulated in a
transparent polymer (5), creating a system to project virtual
images (6) perceivable by the eye of the wearer. (b) LED chip with
100 pixels. LED active layers can be grown a top a transparent
substrate. Emitted light travels through the substrate and is
reimaged using planar Fresnel lenses. (c) Magnified view with one
pixel activated, showing Fresnel lenses opposite each LED
pixel.1.8.2 How does it work
Fig1.8.1Here mobile phone can be replaced by 6th sense
hardware.1.8.3 A new vision from plus technologyAugmented
realitySixth sense technology which uses Augmented Reality concept
to super imposes digital information on the physical world. With
the help of advanced AR technology (e.g. adding computer vision and
object recognition) the information about the surrounding real
world of the user becomes interactive and digitally usable.
Artificial information about the environment and the objects in it
can be stored and retrieved as an information layer on top of the
real world viewSee the world like never before. Fig 1.8.3a
Fig 1.8.3c 1.9 GENERAL APPLICATIONS OF 6TH SENSE TECHNOLOGY.1.
Viewing Map: With the help of a map application the user can call
upon any map of his/her choice and navigate through them by
projecting the map on to any surface.
Fig1.9.12 Taking Pictures: Another application of sixth sense
devices is the implementation of a gestural camera. This camera
takes the photo of the location user is looking at by detecting the
framing gesture. Fig1.9.2 3. Drawing Application: The drawing
application allows the user you to draw on any surface by tracking
the fingertip movements of the users index finger.
Fig1.9.34.Making Calls: We can make calls with help of sixth
sense device .The sixth sense device is used to project the keypad
onto your palm and then using that virtual keypad we can make call
anyone.
Fig1.9.45. Check the time: Draw a circle on your wrist to get a
watch that gives you the correct time
Fig1.9.56. Create multimedia reading experiences Sixth Sense can
be programmed to project related videos onto the latest newspaper
articles you are reading. This ensures that we are connected with
the world all the time.
Fig1.9.67. Get product and book information: Sixth Sense uses
image recognition or marker technology to recognize products we
pick up, and then gives us information on those products.
Fig1.9.78. Feed information on people: The system will project
relevant information about a person such as what they do, where
they work etc.
Fig1.9.89. Wireless sharingWith wifi direct file sharing of
about 400mb/min wirelessly can be made possible. This is one of the
fastest technologies that have changed the world.And Bluetooth can
be used to connect another supported peripheral to it. Also NFC tap
sharing and tap to pay technology is integrated to it.10. Voice
based technologyLike siri in Iphone 4s we can just speak to do any
activity using a voice module.
1.10 SPECIFIC APPLICATIONS1. Sixth sense technology ensures 100
% security from hackers and thefts, as only the one wearing the
lens can decode the information.2. This technology can work as a
fifth sense for the physically challenged people. Using earphones
this device can instruct the blind to move forward or avoid an
obstacle.3. Sixth sense technology ensures that all special moments
of your life are captured in your camera. Like if your baby takes
its first step you can fail to click it using an ordinary camera
but just a little gesture and the picture is taken using our
device.4. This technology can be used in the medical field such
that patients heartbeat and other parameters can be displayed as
soon as the camera detects the patient.5. This technology can be
used in industries to monitor the performances of machines and send
reports of the state of site wirelessly to the control room.6. Can
be used by students to submit their assignments, make presentations
etc.7. This plus technology can be used by soldier to track the
movement of enemy.And many more... 1.11 WHAT CAN PLUS TECHNOLOGY
DO?Check mails can be used in office Fig1.11.1 fig1.11.2To check
the automation process in security Fig1.11.3 fig1.11.4For
navigation for calling a person
Fig1.11.5 fig1.11.6Reading news paper with Augmented reality
Getting plant information Fig1.11.7 fig1.11.8And many more with
plus technology.1.12 ADVANTAGES-SST is a user friendly interface
which integrates digital information into the physical world and
its objects, making the entire world your computer.- SST does not
change human habits but causes computer and other machines to adapt
to human needs.- It uses hand gestures to interact with digital
information.- Supports multi-touch and multi-user interaction- Data
access directly from machine in real time- It is an open source and
cost effective and we can mind map the idea anywhere 1.13 FUTURE
ENHANCEMENT-To get rid of colour markers-To incorporate camera and
projector inside mobile computing device.- Whenever we place
pendant- style wearable device on table, it should allow us to use
the table as multi touch user interface.- To have 3D gesture
tracking.-To display images holographically.
Fig1.13-To add new toolkit facility for upgradation.1.14 A NEW
CONCEPT FOR BLIND TO LET THEM SEE THE WORLD :Let there be light: A
microchip packed with 1,500 sensors is implanted in the back of the
eye. This then stimulates nerves in the retina which pass signals
down the optic nerve to the brain to create an image
Fig1.14.1Sixth Sense Washing MachineThe New Generation 6th Sense
appliances from Whirlpool are helping to protect theEnvironment and
to reduce your energy bills1.13 CONCLUSIONSixth Sense recognizes
the objects around us, displaying information automatically and
letting us access it in the way we need. This prototype implements
several applications that demonstrate the usefulness, viability and
flexibility of the system, allowing us to interact with this
information via natural hand gestures. This became the ultimate
transparent user interface for accessing information about
everything around us. This technology is surely the next big thing
in the techno world1.14 REFERENCES1.
www.blendernation.com/sixth-sense-technology/2.
http://boingboing.net/2009/11/12/sixth-sense-technolo.html3..http://lucasrichter.wordpress.com/2009/03/13/pattie-maes-sixth-sensetechnology-whats-stopping-this/
10.