Top Banner

of 31

blue eyes.ppt

Jun 04, 2018

Download

Documents

Pratik Bhoir
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
  • 8/13/2019 blue eyes.ppt

    1/31

    BlueEyesHumanOperatorMonitoringSystem

    BlueEyesHuman-Operator Monitoring System

    Presented by -

    Saste Ashwini S.

  • 8/13/2019 blue eyes.ppt

    2/31

    BlueEyesHumanOperatorMonitoringSystem Agenda

    What is Blue Eyes (and what is not) ?

    Emotional mouse.

    Magic

    Artificial intelligent speech recognition

    Suitor

    Conclusion

    Agenda

    Introduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    3/31

    BlueEyesHumanOperatorMonitoringSystem

    BLUE EYES technology enables the computer to

    gather information about person and interact with the

    person through special techniques like facial

    recognition, speech recognition etc.

    It verifies persons identity ,feels his presence &

    starts interacting with him.

    Human cognition depends primarily on the ability toperceive , interpret & integrate audio-visuals &

    sensing information.

    Introduction

    Agenda

    Introduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    4/31

    BlueEyesHumanOperatorMonitoringSystem What Is Blue Eyes?

    The Blue Eyes technology aims at creating

    computational machines that have perceptual and

    sensory ability like those of human beings.

    What Is Blue EyesNot?

    Doesnt predict nor interfere with operatorsthoughts

    Cannot force directly the operator to work

    Agenda

    Introduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    5/31

    BlueEyesHumanOperatorMonitoringSystem

    One goal of Human Computer Interaction

    (HCI) is to make an adaptive, smart

    computer system. In order to start creating smart

    computers, the computer must start

    gaining information about the user.

    Emotional Mouse

    Agenda

    Introduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    6/31

    BlueEyesHumanOperatorMonitoringSystem

    Rosalind Picard (1997) describes two aspects of

    affective computing:

    1) Giving the computer the ability to detect emotions

    &2) Giving the computer the ability to express

    emotions.

    We can gain the information from user via

    (1) Touch

    (2) Video

    (3) Speech

    Emotion And Computing

    Agenda

    Introduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    7/31

    BlueEyesHumanOperatorMonitoringSystem

    It Contains The Four Technologies As:

    a) Paul EkmansFacial Expression.

    b) Magic Pointing.

    c) Artificial Intelligent Speech Recognition.

    d) Suitor.

    Theories & Technologies

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    8/31

    BlueEyesHumanOperatorMonitoringSystem

    Based on Paul Ekmansfacial expression work, we

    see a correlation between a persons emotional

    state and a persons physiological measurements.

    He defined the six basic emotions as anger, fear,

    sadness, disgust, joy and surprise.

    Six participants were trained to exhibit the facial

    expressions of the six basic emotions

    The measures taken were GSR, heart rate, skin

    temperature and general somatic activity (GSA).

    Paul Ekmans Facial Expression

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    9/31

    BlueEyesHumanOperatorMonitoringSystem Emotion Sensing Mouse

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    10/31

  • 8/13/2019 blue eyes.ppt

    11/31

    BlueEyesHumanOperatorMonitoringSystem Manual And Gaze Input Cascaded

    (MAGIC) Pointing

    Gaze tracking has long been considered as an

    alternative or potentially superior pointing method

    for computer input.

    Many fundamental limitations exist with traditional

    gaze pointing. We therefore propose an alternative

    approach, MAGIC pointing.

    Two specific MAGIC pointing techniques are as:

    1) Conservative &

    2) Liberal.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    12/31

    BlueEyesHumanOperatorMonitoringSystem

    Liberal MAGIC Pointing Technique Of Cursor

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    13/31

    BlueEyesHumanOperatorMonitoringSystem

    Conservative MAGIC pointing technique of cursor

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    14/31

    BlueEyesHumanOperatorMonitoringSystem Advantages

    Reduction of manual stress and fatigue.

    Practical accuracy level.

    A more natural mental model for the user.

    Speed

    Improved subjective speed and ease-of-use.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    15/31

    BlueEyesHumanOperatorMonitoringSystem Disadvantages

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

    With the more liberal MAGlC pointing technique, the

    cursor warping can be overactive at times

    It is possible to introduce additional constraint

    according to the contexta strategy may prolong the target acquisition time

    Motor action may start as soon as the user's gaze

    settles on a target.

    With MAGlC pointing techniques, the motor action

    computation (decision) cannot startuntil the cursor

    appears.

  • 8/13/2019 blue eyes.ppt

    16/31

    BlueEyesHumanOperatorMonitoringSystem IBM Almaden Eye Tracker

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    17/31

    BlueEyesHumanOperatorMonitoringSystem Implementation Of Magic Pointing

    The MAGIC pointing program takes data from both

    the manual input device and the eye tracking system.

    Raw data from an eye tracker can not be directlyused for gaze-based interaction, due to noise from

    image processing. To eliminate noise we have used

    Filters.

    The goal of filter design is to make the best

    compromise between preserving signal bandwidth &

    eliminating unwanted noise.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    18/31

    BlueEyesHumanOperatorMonitoringSystem Implementing MAGIC pointing

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    19/31

    BlueEyesHumanOperatorMonitoringSystem Experimental Results

    SESSION SESSION

    Mean Completion Time (Sec) Vs. Experimental Session

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

    No_Gaze -1.4sec ,Gaze-1.52 sec ,Gaze 2 -1.33 sec

  • 8/13/2019 blue eyes.ppt

    20/31

    BlueEyesHumanOperatorMonitoringSystem Experimental Results

    0

    0.2

    0.4

    0.6

    0.8

    1

    1.2

    1.4

    1.6

    1.8

    0 20 40 60 80

    NO GAZE

    GAZE 1

    GAZE 2

    SMALL LARGE

    W

    Mean Completion Time (Sec) Vs. Target Size (Pixels)

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    21/31

    BlueEyesHumanOperatorMonitoringSystem Experimental Results

    0

    0.2

    0.4

    0.6

    0.8

    1

    1.2

    1.4

    1.6

    1.8

    0 500 1000

    NO_GAZE

    GAZE 1

    GAZE 2

    Mean Completion Time (Sec) Vs. Pointing Amplitude(pixels)

    200AShort Mid Long

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    22/31

    BlueEyesHumanOperatorMonitoringSystem Experimental Results

    Mean Completion Time (Sec) Vs. Target Angle(Degree)

    200AShort Mid Long

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

    No_Gaze-8.2% , Gaze 1-7% , Gaze 2-7.5%

    0

    0.2

    0.4

    0.6

    0.8

    1

    1.2

    1.4

    1.6

    1.8

    Horizontal Diagonal Vertical

    No_Gaze

    Gaze 1

    Gaze 2

  • 8/13/2019 blue eyes.ppt

    23/31

    BlueEyesHumanOperatorMonitoringSystem

    MAGIC Pointing Is More

    Significant

    (1) Reduced physical effort and fatigue

    (2) Greater accuracy and naturalness

    (3) Higher speed

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    24/31

    BlueEyesHumanOperatorMonitoringSystem Artificial Intelligence Speech

    Recognition

    It is important to consider the environment in which

    speech recognition system has to work.

    Example : an automatic call-handling system is used

    without employing any telephone operator.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    25/31

    BlueEyesHumanOperatorMonitoringSystem

    Technology

    (AI) involves two basic ideas as:

    1. It involves studying the thought processes of human

    beings.

    2. It deals with representing those processes via

    machines (like computers, robots, etc).

    It makes machines smarter and more useful.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    26/31

    BlueEyesHumanOperatorMonitoringSystem Speech Recognition

    The user speaks to the computer through amicrophone, which may use minimum three filters.

    As the number of filters used increases, the

    probability of accurate recognition increases.

    The filter output is then fed to the ADC to translate

    the analogue signal into digital word.

    The binary representation of each of these words

    becomes template or standard, against which the

    future words are compared.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    27/31

    BlueEyesHumanOperatorMonitoringSystem

    Simple User Interest Tracker(Suitor)

    We have to develop an intimate relationship between the

    computer and the humans.

    By simply noticing where the users eyes focus on the

    computer screen, the SUITOR can be more precise indetermining users topic of interest.

    Two prototypes of gaze-tracking technology are as:

    (1)SUITOR (Simple User Interest Tracker)

    (2)Filling a scrolling ticker on a computer screen with

    information related to the user's current task.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    28/31

    BlueEyesHumanOperatorMonitoringSystem Applications

    Blue Eyes can be implemented in surveillance systems

    that record and interpret customer movements.

    Blue Eyes can be applied in the automobile industry.

    We could see its use in video games.

    Current interface between computers and human users

    becomes more natural and intuitive.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    29/31

    BlueEyesHumanOperatorMonitoringSystem CONCLUSION

    The BLUE EYES technology ensures a convenient

    way of simplifying the life by providing more delicate

    and user friendly facilities in computing devices.

    AgendaIntroduction

    What Is BlueEyes

    EmotionalMouse

    MAGIC

    ArtificialIntelligentSpeechRecognition

    Suitor

    Conclusion

  • 8/13/2019 blue eyes.ppt

    30/31

    BlueEyesHumanOperatorMonitoringSystem BIBLIOGRAPHY:

    www.newtech.com

    www.blue-eyestech.com

    www.wikipedia.com

    www.google.com

    www.eetimes.com

  • 8/13/2019 blue eyes.ppt

    31/31

    BlueEyesHumanOperatorMonitoringSystem hank you for your attention

    BlueEyesHuman-Operator Monitoring System