Blue Eyes Technology

BLUE EYES TECHNOLOGY

PRESENTED BY

PRIYANKA MEENA

ROLL NO 12469

ECE

CONTENTS INTRODUCTION. WHAT IS BLUE EYES TECHNOLOGY? WHY BLUE EYES TECHOLOGY? SYSTEM OVERVIEW DATA ACQUSITION UNIT JAZZ MULTISENSOR CENTRAL SYSTEM UNIT DATA ANALYSIS MODEL DATA LOGGER MODEL VISUALISATION MODEL TECHNIQUE USED APPLICATION CONCLUSION

INTRODUCTION

BLUE EYES TECHNOLOGY started at IBM’s Almaden Research Centre in USA

The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings.

It verifies your identity, feels your presents, and starts interacting with you .

Human cognition depends primarily on the ability to perceive, interpret, and integrate audio-visuals and sensoring information.

Monitors and records operator’s conscious brain and involvement

WHAT IS BLUE EYES ??

BLUE- Bluetooth EYES –eye moment enable to obtain lot of

information Key feature are :

• Visual attention monitoring.

• Physiological condition monitoring.

• Operator’s position detection.

• Wireless data acquisition.

• Real time user defined alarm triggering

SYSTEM OVERVIEW

Blue eyes system monitors the status of the operator’s visual attention through measurement of saccadic activity.

The system checks parameters like heart beat rate and blood oxygenation against abnormal and triggers user defined alarms.

The major parts in the Blue eye system: 1. Data Acquisition Unit and 2. Central System Unit.

System overview

Data Acquisition Unit

DATA ACQUISITION UNIT:

1. Data Acquisition Unit is a mobile part of the Blue eye system.

2. Its main task is to fetch the physiological data from the sensor and to send it to the central system to be processed.

3. Personal ID cards and PIN codes provide operator's authorization.

4. Atmel 89C52 microcontroller - system core.

4. Bluetooth module (based on ROK101008)6. HD44780 - small LCD display7. MC145483 – 13bit codec8. Jazz Multisensory interface9. Beeper and LED indicators, 6 AA batteries and voltage level monitor. 10. 24C16 - I2C EEPROM (on a removable ID card)

Data Acquisition Unit

JAZZ MULTISENSOR

JAZZ MULTISENSOR Supplies raw physical data regarding eye

position, level of blood oxygenation . Eye position measuring –direct infrared

oculography Oxy and deoxyheamoglobin measurement. Two axial accelerometer Ambient light sensor

CENTRAL SYSTEM UNIT

Maintain bluetooth connections. Buffer incoming sensor data. Perform on line data analysis . Record the conclusion for further

exploration. Provide visualisation interface. PCM codec for voice data transmission . Module is interfaced to a PC using a

parallel, serial and USB cable.

Central System Unit

There are four main CSU modules.

1. Connection Manager, 2. Data Analysis, 3. Data Logger 4. Visualization.

CONNECTION MANAGER

manages wireless communication between DAU and central

system. Connection manager handles:

• Communication with CSU hardware

• Searching for new devices in covered range

• Establishing Bluetooth connections

• Connection authentication

• Incoming data buffering

• Sending alerts

DATA ANALYSIS MODULE

Analysis of raw sensor data. Supervises working operator’s. Large number of smaller analysers extracting information . The most important analyser are :

• Saccade detector –monitors eye movements in order to determine the level of operator’s visual attention

• Pulse rate analyser-uses blood oxygenation signal to compute operators pulse rate.

• Custom analyser-recognize other behaviours than those which are built in the system.

DATA LOGGER MODULE

The raw or processed physiological data, alerts and operator’s voice are stored.

A voice data acquisition module delivers the voice data

VISUALISATION MODULE

Provide a user interface for the supervisors. Enables to watch each of the working operators

physiological condition. Incoming alarm messages are instantly signalled. Can be set in an offline mode, where all data is fetched from

database. Reconstruct course of selected operator’s duty.

TECHNOLOGIES USED

Emotion mouse Manual and gaze input cascaded (MAGIC). Artificial intelligent speech recognition. Simple user interest tracker(SUITOR).

EMOTION MOUSE

Non intensive method for gaining user information through touch .

Measure heart rate ,temperature ,galvanic skin response and minute bodily movements.

Matches with six emotional states :happiness, surprise, anger, fear ,sadness, and disgust.

Includes different sensors including pressure sensor heart beat sensor ,temperature sensor .

EMOTION MOUSE

MANUAL AND GAZE INPUT CASCADING (MAGIC)

Pointing appears to user to be a manual task

Used for fine manipulation and selection.

Webcam is used to determine glints and pupils of user.

wrap curser to every new object cursor looks at.

This combines Manual Pointing and Eye Gaze pointing

Manual pointing appears to the user to be a manual task, used for fine manipulation and selection.

Eye Gaze warps the cursor to the eye gaze area, which encompasses the target.

There are 2 approaches for MAGIC:

1. Liberal Pointing

2. Conservative pointing

SPEECH RECOGNITION

1. User speaks to computer through a microphone .

2. Switched capacitor digital filter are used.

3. ADC samples filter outputs.

4. Each sample represents different amplitude of signal .

5. Converted to binary number proportional to amplitude of sample.

6. Binary representation of words become standards/templates and stored in memory .

7. Input words are scanned and matched .

8. When best match occurs word is identified and displayed on screen

SIMPLE USER INTEREST TRACKER

Fetches more information at desktop . Notice where users eyes focus on the

screen . Precise in determining user’s topic of

interest . Deliver relevant information to a

handheld device. Eg – if reading headline ,pops up story

in browser window.

LIMITATION OF BLUE EYES TECHNOLOGY

1. Target not selected if not looked at for a set threshold.

2. Target selected if stared at without user intention

APPLICATIONS

IN POD CAR The first blue eye enabled mass production device was POD the car manufactured by TOYOTA.

It could keep driver alert and active.

It could tell the driver to go slow if he is driving too fast .

Also it could hear the driver some sort of interesting music when he is getting bored

Another application would be in the automobile industry. By simply touching a computer input device such as a mouse, the computer system is designed to be able to determine a person's emotional state. for cars, it could be useful to help with critical decisions like:

"I know you want to get into the fast lane, but I'm afraid I can't do that.You are too upset right now" and therefore assist in driving safely.

major application of speech processing is in military operations. Voice control of weapons is an example

In retailing record and interpret customer movements.

Power station . Flight control centres . Operating theatres

eg - A blue eyes enabled TV set would become active when we look in its directions. Voice commands could then tune your favourite channel and adjust the volume.

CONCLUSION

In future it is possible to create a computer which can interact with us as we interact each other with the use of blue eye technology. It seems to be a fiction, but it will be the life lead by “BLUE EYES” in the very near future. Ordinary household devices -- such as televisions, refrigerators, and ovens -- may be able to do their jobs when we look at them and speak to them.