52085275-blue-eyes

BLUE EYES TECHNOLOGY

Abstract— Human error is still one of the most frequent causes of catastrophes and ecological disasters. The main reason is that the monitoring systems concern on the state of the processes whereas human contribution to the overall performance of the system is left unsupervised. Since the control instruments are automated to a large extent, a human – operator becomes a passive observer of the supervised system, which results in weariness and vigilance drop. This, he may not notice important changes of indications causing financial or ecological consequences and a threat to human life. It therefore is crucial to assure that the operator’s Conscious brain is involved in an active system supervising over the whole work time period. It is possible to measure indirectly the level of the operator’s conscious brain involvement using eye motility analysis .Although there are capable sensors available on the market, a complex solution enabling transformation, analysis and reasoning based on measured signals still does not exist. In large control rooms, wiring the operator to the central system is a serious limitation of his mobility and disables his operation. Utilization of wireless technology becomes essential.

Keywords— Blue eyes, software, hardware, CSU (central system unit), mouse.

I. INTRODUCTION

The Blue eyes system provides technical means for monitoring and recording the Operator’s basic physiological parameters. The most important parameter is saccadic activity, which enables the system to monitor the status of the operator’s visual attention along with head acceleration, which accompanies large displacement of the visual axis .Complex industrial environment can create a danger of exposing the operator to toxic substances, which can affect his cardiac, circulatory and pulmonary systems..The The Blue eyes system checks above parameters against abnormal values and triggers user-defined alarms when necessary. Quite often in an emergency situation operators speak to themselves expressing their surprise or stating verbally the problem.. This helps to reconstruct the course of operators’ work and provides data for long-term analysis. Blue Eyes consists of a mobile measuring device and a central analytical system.

The mobile device is integrated with Bluetooth module providing wireless interface between sensors worn by the operator and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side Provide necessary data personalization so different people can use a single mobile device. The tasks of the mobile Data

Acquisition Unit are to maintain Bluetooth connections, to get information from the sensor and sending it over the wireless connection, to deliver the alarm messages sent from the Central System Unit to the operator and handle personalized ID cards. Central System Unit maintains the other side of the Bluetooth connection, buffers incoming sensor data, performs on-line data analysis, records the conclusions for further exploration and provides visualization interface.

II. PERFORMANCE REQUIREMENTS

The portable nature of the mobile unit results in a number of performance requirements. As the device is intended to run on batteries, low power consumption is the most important constraint. Moreover, it is necessary to assure proper timing while receiving and transmitting sensor signals.. Finally the use of standard and inexpensive IC does will keep the price of the device at relatively low level. The priority of the central unit is to provide real-time buffering and incoming sensor signals and semi-real-time processing of the data, which requires speed-optimizes filtering and reasoning algorithms.

III. SYSTEM OVERVIEWS

Blue eyes system monitors the status of the operator’s visual attention through measurement of saccadic activity. These system checks parameters like heart bitrates and blood oxygenation against abnormal and triggers user defined alarms.So the system consists of

Mobile measuring device (DAU) Central System Unit (CSU)

Figure2. System overview

IV. THE HARDWARE

4.1. DATA ACQUISITION UNIT:-Data Acquisition Unit is a mobile part of the Blue eyes system. Its main task is to fetch the physiological data from the sensor and to send it to the central system to be processed. The Data Acquisition Unit comprises several hardware modules:1. Atmel 89C52 microcontroller system core2. Bluetooth module (based on ROK101008) 3 .HD44780 - small LCD display 4.24C16 - I2C EEPROM 5 .MC145483 – 13bit PCM codec6. Jazz Multi sensor interface7. Beeper and LED indicators

Hardware specification

Microcontrollers (e.g. Atmel 8952 microcontroller) can be used as the core of the Data Acquisition Unit since it is a well-established industrial standard and provides necessary functionalities) at a low price. The Bluetooth module supports synchronous voice data transmission .The codec reduces the microcontroller’s tasks and lessens the amount of data being sent over the UART. The Bluetooth module performs voice data compression, which results in smaller bandwidth utilization and better sound quality. Communication between the Bluetooth module and the microcontroller is carried on using standard UART interface. The speed of the UART is set to115200 bps in order to assure that the entire sensor data is delivered in time to the central system. The alphanumeric LCD display gives more information of incoming events and helps the operator enter PIN code. The LED indicators show the result of built-in-self-test, power level and the state of wireless connection the simple keyboard is used to react to incoming events and to enter PIN code while performing authorization procedure. The ID card interface helps connect the operator’s personal identification card to the DAU. After inserting the card authorization procedure starts. The operator’s unique identifier enables the supervising system to distinguish different operators

4.2. CENTRAL SYSTEM UNIT

Central System Unit hardware is the second peer of the wireless connection. The box contains a Bluetooth module and a PCM codec for voice data transmission. The module is interfaced to a PC using a parallel, serial and USB cable. The audio data is accessible through standard mini-jack sockets to program operator's personal ID cards we developed a simple programming device.

V. THE SOFTWARE

Blue Eyes software's main task is to look after working operators' physiological condition. To assure instant reaction on the operators' condition change the software performs real time buffering of the incoming data, real-time physiological data analysis and alarm triggering.The Blue Eyes software comprises several functional modules System core facilitates the transfers flow between other system modules.The System Core fundamental are single-producer-multi- consumer thread safe queues.

Parts:

Connection Manager is responsible for managing the wireless communication between the mobile Data Acquisition Units and the central system. Data Analysis module performs the analysis of the raw sensor data in order to obtain information about the operator’s physiological condition.Visualization module provides a user interface for the supervisors. It enables them to watch each of the working operator’s physiological condition along with a preview of selected video source and related sound stream.

VI. IMPLEMENTATION OF BLUE EYES Functional designDuring the functional design phase we used UML standard use case notation, which shows the functions the system offers to particular users. Blue Eyes has three groups of users: operators, supervisors and system administrators. Operator is a person whose physiological parameters are supervised. The operator wears the DAU. The only functions offered to that user are authorization in the system and receiving alarm alerts. Such limited functionality assures the device does not disturb the work of the operator

Authorization – the function is used when the operator’s duty starts. After inserting his personal ID card into the mobile device and entering proper PIN code the device will start listening for incoming Bluetooth connections. Once the connection has been established and authorization process has succeeded central system starts monitoring the operator’s physiological parameters. The authorization process shall be repeated after reinserting the ID card. It is not, however, required on reestablishing Bluetooth connection. Receiving alerts – the function supplies the operator with the information about the most important alerts regarding his or his co-workers’ condition and mobile device state. Alarms are signaled by using a beeper, earphone providing central system sound feedback and a small alphanumeric LCD display, which shows more detailed information. Supervisor is a person responsible for analyzing operators’ condition and performance.

During the on-line browsing it is possible to watch a list of currently working operators and the status of their mobile devices. Selecting one of the operators enables the supervisor to check the operator’s current physiological condition (e.g. a pie chart showing active brain involvement) and a history of alarms regarding the operator. All new incoming alerts are displayed immediately so that the supervisor is able to react fast. However, the presence of the human supervisor is not necessary since the system is equipped with reasoning algorithms and can trigger user-defined actions. During off-line browsing it is possible to reconstruct the course of the operator’s duty with all the physiological parameters, audio and video data. A comprehensive data analysis can be performed enabling the supervisor to draw conclusions on operator’s overall performance and competency System administrator is a user that maintains the system. The administrator delivers tools for adding new operators to the database, defining alarm conditions, configuring logging tools and creating new analyzer modules.

While registering new operators the administrator enters appropriate data to the system database and programs his personal ID card.Defining alarm conditions – the function enables setting up user-defined alarm conditions by writing condition-action rules Designing new analyzer modules-based on earlier recorded data the administrator can create new analyzer module that can recognize other behaviors than those which are built-in the system. The new modules are created using decision tree induction algorithm. The administrator names the new behavior to be recognized and points the data associated with it. The results received from the new modules can be used in alarm conditions. Monitoring setup enables the

administrator to choose the parameters to monitor as well as the algorithms of the desired accuracy to compute parameter values. Logger setup provides tools for selecting the parameters to be recorded. For audio data sampling frequency can be chosen. As regards the video signal, a delay between storing consecutive frames can be set.Database maintenance – here the administrator can remove old or “uninteresting” data from the database. The uninteresting data is suggested by the built-in reasoning system.

VII. EMOTION COMPUTING

There are two aspects of affective computing: giving the computer the ability to detect emotions and giving the computer the ability to express emotions. An adaptive, smart computer system has been driving our efforts to detect a person’s emotional state.An important element of incorporating emotion into computing is for productivity for a computer user.

VIII. TYPES OF MOTIONAL SENSORS:For Hand:

Emotion Mouse Sentic Mouse

For Eyes:1.ExpressionGlasses2.MagicPointing3.Eye TrackingFor Voice:

Artificial Intelligence Speech Recognition

IX. EMOTION MOUSE

One proposed, non invasive method for gaining user information through touch is via a computer input device, the mouse. This then allows the user to relate the cardiac rhythm, the body temperature, electrical conductivity of the skin and other physiological attributes with the mood. This has led to the creation of the “Emotion Mouse”.

The device can measure heart rate temperature galvanic skin response and minute bodily movements and matches them with six emotional states: happiness, surprise, anger, fear, sadness and disgust. The mouse includes a set of sensors including infrared detectors and temperature-sensitive chips.

Figure: Emotion mouse

X. SENTIC MOUSE

It is a modified computer mouse that includes a directional pressure sensor for aiding in recognition of emotional valence

Figure7. Senetic mouse

XI. EXPRESSION GLASSES

A wearable device which allows any viewer to visualize the confusion and interest levels of the wearer. Other recent developments in relatedtechnology is the attempt to learn the needs of the user just by following the interaction between the user and the computer in order to know what he/she is interested in at any given moment.

XII. MAGIC POINTING

This work explores a new direction in utilizing eye gaze for computer input. Gaze tracking has long been considered as an alternative or potentially superior pointing method for computer input. We believe that many fundamental limitations exist with traditional gaze pointing. In particular, it is unnatural to overload a perceptual channel such as vision with a motor control task. We therefore propose an Alternative approach, dubbed MAGIC (Manual and Gaze Input Cascaded) pointing. With such an approach, pointing appears to the user to be a manual task used for fine manipulation and selection. However, a large portion of the cursor movement is eliminated by warping the cursor to the eye gaze area, which encompasses the target. Two specific MAGIC pointing techniques, one conservative and one liberal, were designed, analyzed, and implemented with an eye tracker we developed. They were then tested in a pilot study. Pointing and possibly faster speed than manual pointing. In our view, there are two fundamental shortcomings to the existing gaze pointing techniques, regardless of the maturity of eye tracking technology.

XIII. EYE TRACKING

Since the goal of this work is to explore MAGIC pointing as a user interface technique, we started out by purchasing a commercial eye tracker after a market survey. In comparison to the system reported in early studies this system is much more compact and reliable. However, we felt that it was still not robust enough for a variety of people with different eye characteristics, such as pupil brightness and correction glasses. We hence chose to develop and use our own eye tracking system.

XIV. ARTIFICIAL INTELLIGENT

Artificial intelligence (AI) involves two basic ideas. First, it involves studying the thought processes of human beings. Second, it deals with representing those processes via machines (like computers, robots, etc). AI is behavior of a machine, which, if performed by a human being, would be called intelligent. It makes machines smarter and more useful, and is less expensive than natural intelligence. Natural language processing (NLP) refers to artificial intelligence methods of communicating with a computer in a natural language like English. The main objective of a NLP program is to understand input and initiate action stores all the digital values in a buffer area. This digital information, representing the spoken word, is now accessed by the CPU to process it further. The normal speech has a frequency range of 200 Hz to 7 kHz. Recognizing a telephone call is more difficult as it has bandwidth limitation of300 Hz to3.3 kHz.

XV.SPEECH RECOGNITION

The user speaks to the computer through a microphone, which, in used; a simple system may contain a minimum of three filters. The more the number of filters used, the higher the probability of accurate recognition. Presently, switched capacitor digital filters are used because these can be custom-built in integrated circuit form. These are smaller and cheaper than active filters using operational amplifiers.

The filter output is then fed to the ADC to translate the analogue signal into digital word. The ADC samples the filter outputs many times a second. Each sample represents different amplitude of the signal .Evenly spaced vertical lines represent the amplitude of the audio filter output at the instant of sampling. Each value is then converted to a binary number proportional to the amplitude of the sample. A central processor unit (CPU) controls the input circuits that are fed by the ADCS. A large RAM (random access memory) stores all the digital values in a buffer area. This digital information, representing the spoken word, is now accessed by the CPU to process it further. The normal speech has a frequency range of 200 Hz to 7 kHz. Recognizing a telephone call is more difficult as it has bandwidth limitation of 300 Hz to3.3 kHz. The binary representation of each of these words becomes a template or standard, against which the future words are compared. These templates are stored in the memory. Once the storing process is completed, the system can go into its active mode and is capable of identifying spoken words. As each word is spoken, it is converted into binary equivalent and stored in RAM. The computer then starts searching and compares the binary input pattern with the templates. T is to be noted that even if the same speaker talks the same text, there are always slight variations in amplitude or loudness of the signal, pitch, frequency difference, time gap, etc. Due to this reason, there is never a perfect match between the template and binary input word. The pattern matching process therefore uses statistical techniques and is designed to look for the best fit. The values of binary input words are subtracted from the corresponding values in the templates. If both the values are same, the difference is zero and there is perfect match. If not, the subtraction produces some difference or error. The smaller the error, the better the match. When the best match occurs, the word is identified and displayed on the screen or used in some other manner. The search process takes a considerable amount of time, as the CPU has to make many comparisons before recognition occurs. This necessitates use of very high-speed processors. A large RAM is also required as even though a spoken word may last only a few hundred milliseconds, but the same is translated into many thousands of digital words. It is important to note that alignment of words and templates are to be matched correctly in time, before computing the similarity score. This process, termed as dynamic time warping, recognizes that different speakers pronounce the same words at different speeds as well as elongate different parts of the same word. This is important for the speaker-independent recognizers

XVI.TOOLS USED TO DEVELOP BLUE EYES:

In creating the hardware part of the DAU a development board was built, which enabled to mount, connect and test various peripheral devices cooperating with the microcontroller. During the implementation of the DAU there

was a need for a piece of software to establish and test Bluetooth connections. Hence created a tool called Blue Dentist. The tool provides support for controlling the currently connected Bluetooth device. Its functions are: Local device management and connection management).

To test the possibilities and performance of the remaining parts of the Project Kit. Blue Capture was created. The tool supports capturing video data from various sources and storing the data in the MS SQL Server database. Additionally, the application performs sound recording. After filtering and removing insignificant fragments the audio data is stored in the database. Finally, the program plays the recorded audiovisual stream. They used the software to measure database system performance and to optimize some of the SQL queries

Also a simple tool for recording Jazz Multisensory measurements was introduced. The program reads the data using a parallel port and writes it to a file. To program the operator’s personal ID card we use a standard parallel port, as the EEPROMs and the port are both TTL-compliant. A simple dialog-based application helps to accomplish the task.

XVII. THE SIMPLE USER INTERST TRACKER

Computers would have been much more powerful, had they gained perceptual and sensory abilities of the living beings on the earth. What needs to be developed is an intimate relationship between the computer and the humans. And the Simple User Interest Tracker (SUITOR) is a revolutionary approach in this direction.By observing the Webpage at bedizen is browsing, the SUITOR can help by fetching more information at his desktop. By simply noticing where the user’s eyes focus on the computer screen, the SUITOR can be more precise in determining topic of interest. It can even deliver relevant information to a handheld device. The success lies in how much the suitor can be intimate to the user. Flicker and his colleagues have created some new techniques for tracking a person's eyes and have incorporated this gaze-tracking technology into two prototypes. One, called SUITOR (Simple User Interest Tracker), fills a scrolling ticker on a computer screen with information related to the user's current task. SUITOR knows where you are looking, what applications you are running, and what Web pages you may be browsing.

SUMMARY

The Blue Eyes system is developed because of the need for a real-time monitoring system for a human operator. The approach is innovative since it helps supervise the operator not the process, as it is in presently available solutions. We hope the system in its commercial release will help avoid potential threats resulting from human errors, such as weariness, oversight, tiredness or temporal indisposition. However, the prototype developed is a good estimation of the possibilities of the final product. The use of a miniature CMOS camera integrated into the eye movement sensor will enable the system to calculate the point of gaze and observe what the operator is actually looking at. Introducing voice recognition algorithm will facilitate the communication between the operator and the central system and simplify authorization process. Despite considering in the report only the operators working in control rooms, our solution may well be applied to everyday life situations. Assuming the operator is a driver and the supervised process is car driving it is possible to build a simpler embedded on-line system, which will only monitor conscious brain involvement and warn when necessary. As in this case the logging module is redundant, and the Bluetooth technology is becoming more and more popular, the commercial implementation of such a system would be relatively inexpensive. The final thing is to explain the name of our system. Blue Eyes emphasizes the foundations of the project – Bluetooth technology and the movements of the eyes. Bluetooth provides reliable wireless communication whereas the eye movements enable us to obtain a lot of interesting and important information

XV. APPLICATION OF BLUE- EYE TECHNOLOGY

Blue Eyes is developing ways for computers to anticipate users' wants by gathering video data on eye movement and facial expression. The first practical use for the research turns out to be snooping on shoppers.

Another application would be in the automobile industry. By simply touching a computer input device such as a mouse, the computer system is designed to be able to determine a person's emotional state. For cars, it could be useful to help with critical decisions like: "I know you want to get into the fast lane, but I'm afraid I can't do that. Your too upset right now" and therefore assist in driving safely.

Current interfaces between computers and humans can present information vividly, but have no sense of whether that information is ever viewed or understood.

Using stereo-vision techniques, we are able to detect, track, and identify users robustly and in real time. This information can make spoken language interface more bust, by selecting the acoustic information from a visually-localized source.

XVI. CONCLUSIONS

The nineties witnessed quantum leaps interface designing for improved man machine interactions. The BLUE EYES technology ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Instead of using cumbersome modules to gather information about the user, it will be better to use smaller and less intrusive units. Ordinary household devices such as televisions, refrigerators, and ovens may be able to do their jobs when we look at them and speak to them. It is only a technological forecast.

XVII.DISADVANTAGES

1. Does not predict nor interfere with operators thoughts

2. Cannot force directly the operator to work

REFERENCES[1] Joseph j.carr & john m.brown,”introduction to blue eyestechnology”,published in IEEE spectrum magazine.

[2] A.jajszczyk,”automatically switched blue eyes networks:Benefits and Requirement,”IEEE blue toooth.feb 2005,vol 3,no1,pp.

[3] A .Banerjee, ”Generalized multi protocol label switching: an over view of computer enhancements and recovery techniques,”IEEE” commun. Magvol39.[4] J.jones, L.ong, and m.lazer,”creating and intelligent technology network /worldwide nteroperability demonstration.”IEEEcomm un .mag.,vol 42.

[5] Blue Eyes Technology, Computer Edge,Oct.2002,pages 23-27.