8/13/2019 blue eyes.ppt
1/31
BlueEyesHumanOperatorMonitoringSystem
BlueEyesHuman-Operator Monitoring System
Presented by -
Saste Ashwini S.
8/13/2019 blue eyes.ppt
2/31
BlueEyesHumanOperatorMonitoringSystem Agenda
What is Blue Eyes (and what is not) ?
Emotional mouse.
Magic
Artificial intelligent speech recognition
Suitor
Conclusion
Agenda
Introduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
3/31
BlueEyesHumanOperatorMonitoringSystem
BLUE EYES technology enables the computer to
gather information about person and interact with the
person through special techniques like facial
recognition, speech recognition etc.
It verifies persons identity ,feels his presence &
starts interacting with him.
Human cognition depends primarily on the ability toperceive , interpret & integrate audio-visuals &
sensing information.
Introduction
Agenda
Introduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
4/31
BlueEyesHumanOperatorMonitoringSystem What Is Blue Eyes?
The Blue Eyes technology aims at creating
computational machines that have perceptual and
sensory ability like those of human beings.
What Is Blue EyesNot?
Doesnt predict nor interfere with operatorsthoughts
Cannot force directly the operator to work
Agenda
Introduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
5/31
BlueEyesHumanOperatorMonitoringSystem
One goal of Human Computer Interaction
(HCI) is to make an adaptive, smart
computer system. In order to start creating smart
computers, the computer must start
gaining information about the user.
Emotional Mouse
Agenda
Introduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
6/31
BlueEyesHumanOperatorMonitoringSystem
Rosalind Picard (1997) describes two aspects of
affective computing:
1) Giving the computer the ability to detect emotions
&2) Giving the computer the ability to express
emotions.
We can gain the information from user via
(1) Touch
(2) Video
(3) Speech
Emotion And Computing
Agenda
Introduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
7/31
BlueEyesHumanOperatorMonitoringSystem
It Contains The Four Technologies As:
a) Paul EkmansFacial Expression.
b) Magic Pointing.
c) Artificial Intelligent Speech Recognition.
d) Suitor.
Theories & Technologies
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
8/31
BlueEyesHumanOperatorMonitoringSystem
Based on Paul Ekmansfacial expression work, we
see a correlation between a persons emotional
state and a persons physiological measurements.
He defined the six basic emotions as anger, fear,
sadness, disgust, joy and surprise.
Six participants were trained to exhibit the facial
expressions of the six basic emotions
The measures taken were GSR, heart rate, skin
temperature and general somatic activity (GSA).
Paul Ekmans Facial Expression
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
9/31
BlueEyesHumanOperatorMonitoringSystem Emotion Sensing Mouse
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
10/31
8/13/2019 blue eyes.ppt
11/31
BlueEyesHumanOperatorMonitoringSystem Manual And Gaze Input Cascaded
(MAGIC) Pointing
Gaze tracking has long been considered as an
alternative or potentially superior pointing method
for computer input.
Many fundamental limitations exist with traditional
gaze pointing. We therefore propose an alternative
approach, MAGIC pointing.
Two specific MAGIC pointing techniques are as:
1) Conservative &
2) Liberal.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
12/31
BlueEyesHumanOperatorMonitoringSystem
Liberal MAGIC Pointing Technique Of Cursor
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
13/31
BlueEyesHumanOperatorMonitoringSystem
Conservative MAGIC pointing technique of cursor
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
14/31
BlueEyesHumanOperatorMonitoringSystem Advantages
Reduction of manual stress and fatigue.
Practical accuracy level.
A more natural mental model for the user.
Speed
Improved subjective speed and ease-of-use.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
15/31
BlueEyesHumanOperatorMonitoringSystem Disadvantages
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
With the more liberal MAGlC pointing technique, the
cursor warping can be overactive at times
It is possible to introduce additional constraint
according to the contexta strategy may prolong the target acquisition time
Motor action may start as soon as the user's gaze
settles on a target.
With MAGlC pointing techniques, the motor action
computation (decision) cannot startuntil the cursor
appears.
8/13/2019 blue eyes.ppt
16/31
BlueEyesHumanOperatorMonitoringSystem IBM Almaden Eye Tracker
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
17/31
BlueEyesHumanOperatorMonitoringSystem Implementation Of Magic Pointing
The MAGIC pointing program takes data from both
the manual input device and the eye tracking system.
Raw data from an eye tracker can not be directlyused for gaze-based interaction, due to noise from
image processing. To eliminate noise we have used
Filters.
The goal of filter design is to make the best
compromise between preserving signal bandwidth &
eliminating unwanted noise.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
18/31
BlueEyesHumanOperatorMonitoringSystem Implementing MAGIC pointing
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
19/31
BlueEyesHumanOperatorMonitoringSystem Experimental Results
SESSION SESSION
Mean Completion Time (Sec) Vs. Experimental Session
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
No_Gaze -1.4sec ,Gaze-1.52 sec ,Gaze 2 -1.33 sec
8/13/2019 blue eyes.ppt
20/31
BlueEyesHumanOperatorMonitoringSystem Experimental Results
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
0 20 40 60 80
NO GAZE
GAZE 1
GAZE 2
SMALL LARGE
W
Mean Completion Time (Sec) Vs. Target Size (Pixels)
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
21/31
BlueEyesHumanOperatorMonitoringSystem Experimental Results
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
0 500 1000
NO_GAZE
GAZE 1
GAZE 2
Mean Completion Time (Sec) Vs. Pointing Amplitude(pixels)
200AShort Mid Long
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
22/31
BlueEyesHumanOperatorMonitoringSystem Experimental Results
Mean Completion Time (Sec) Vs. Target Angle(Degree)
200AShort Mid Long
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
No_Gaze-8.2% , Gaze 1-7% , Gaze 2-7.5%
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
Horizontal Diagonal Vertical
No_Gaze
Gaze 1
Gaze 2
8/13/2019 blue eyes.ppt
23/31
BlueEyesHumanOperatorMonitoringSystem
MAGIC Pointing Is More
Significant
(1) Reduced physical effort and fatigue
(2) Greater accuracy and naturalness
(3) Higher speed
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
24/31
BlueEyesHumanOperatorMonitoringSystem Artificial Intelligence Speech
Recognition
It is important to consider the environment in which
speech recognition system has to work.
Example : an automatic call-handling system is used
without employing any telephone operator.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
25/31
BlueEyesHumanOperatorMonitoringSystem
Technology
(AI) involves two basic ideas as:
1. It involves studying the thought processes of human
beings.
2. It deals with representing those processes via
machines (like computers, robots, etc).
It makes machines smarter and more useful.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
26/31
BlueEyesHumanOperatorMonitoringSystem Speech Recognition
The user speaks to the computer through amicrophone, which may use minimum three filters.
As the number of filters used increases, the
probability of accurate recognition increases.
The filter output is then fed to the ADC to translate
the analogue signal into digital word.
The binary representation of each of these words
becomes template or standard, against which the
future words are compared.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
27/31
BlueEyesHumanOperatorMonitoringSystem
Simple User Interest Tracker(Suitor)
We have to develop an intimate relationship between the
computer and the humans.
By simply noticing where the users eyes focus on the
computer screen, the SUITOR can be more precise indetermining users topic of interest.
Two prototypes of gaze-tracking technology are as:
(1)SUITOR (Simple User Interest Tracker)
(2)Filling a scrolling ticker on a computer screen with
information related to the user's current task.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
28/31
BlueEyesHumanOperatorMonitoringSystem Applications
Blue Eyes can be implemented in surveillance systems
that record and interpret customer movements.
Blue Eyes can be applied in the automobile industry.
We could see its use in video games.
Current interface between computers and human users
becomes more natural and intuitive.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
29/31
BlueEyesHumanOperatorMonitoringSystem CONCLUSION
The BLUE EYES technology ensures a convenient
way of simplifying the life by providing more delicate
and user friendly facilities in computing devices.
AgendaIntroduction
What Is BlueEyes
EmotionalMouse
MAGIC
ArtificialIntelligentSpeechRecognition
Suitor
Conclusion
8/13/2019 blue eyes.ppt
30/31
BlueEyesHumanOperatorMonitoringSystem BIBLIOGRAPHY:
www.newtech.com
www.blue-eyestech.com
www.wikipedia.com
www.google.com
www.eetimes.com
8/13/2019 blue eyes.ppt
31/31
BlueEyesHumanOperatorMonitoringSystem hank you for your attention
BlueEyesHuman-Operator Monitoring System