Final Presentation

TELEMATICS : ARTIFICIAL PASSENGER

AND BEYOND …

• Introduction to Telematics.

• History of Telematics.

• Transport Telematics.

• Telematics Technology: Artificial Passenger.

• Artificial Passenger :Introduction.

• Why such Systems?

• What does it do?

• Background of Invention.

CONTENTS

Devices used in Artificial Passenger.Architecture of Artificial Passenger.Working of Artificial Passenger.Advantages of Artificial Passenger.Applications of Artificial Passenger.Future Applications.Conclusion.

Continued…

• Shift in the interpretation of term telematics towards applications based on wireless communication.

Telematics

ComputersTelecommunicati

on

INTRODUCTION TO TELEMATICS.

Economic and social organization of the society would be well transformed.

Subsequently resulted in smaller and cheaper computers.

Computation time was a challenge previously, neither could they be connected to each other.

HISTORY OF TELEMATICS.

With development of smaller PC’s in 70’s widespread computation came into effect.

Computers became geographically distributed, need for data exchange aroused.

Thus using telecommunication technologies were used to connect computers.◦THIS WAS BIRTH OF “TELEMATICS”

Continued…

Also known as Intelligent Transportation System(ITS) and Transport Information and Control System(TCS).

Example : Navigation System.

History

First Stolen Car.

TRANSPORT TELEMATICS.

The AP is an artificial intelligence–based companion .

The heart of the system is a conversation planner .◦Microphone.◦Camera.◦Voice Analyzer.

Slow responses and a lack of intonation are signs of fatigue.

TELEMATICS TECHNOLOGY: ARTIFICIAL PASSENGER.

We can make predictions about various aspects of driver performance.

The natural dialog car system analyzes a driver’s answer.

Detects if a driver is affected by alcohol or drugs.

Continued…

“The AP is an artificial intelligence–based companion that will be resident in software and chips embedded in the automobile dashboard”.

◦ It is a Natural Language E-companion.

◦ It is a Sleep preventive device in cars to overcome drowsiness.

◦ It is a Life safety system.

WHAT IS ARTIFICIAL PASSENGER ?

Why such systems?National survey in UK and USA

observed driver fatigue annually causes :

Cause :Eye-closure of one-half second to as long as 2 to 3 seconds.

It is said that the normal human eye blinks lasts 0.2 to 0.3 second.

What does it do?

Natural language E-companion.

Sleep preventive device in cars to overcome drowsiness.

Life safety system.

Detects alarm conditions through sensors.

Broadcasts pre-stored voice messages over the speakers.

Captures images of the driver.

Background Of Invention…During the night times the driver

could get sleepier which may be porn to accidents.

Precautions:◦Use of simulation drinks (e.g.: coffee

and tea)◦Some tablets to prevent sleeping.◦Miniature system installed in driver’s

hat.

Continued…

These methods are some times inefficient.

IBM introduces a new sleep prevention technology device called as “ARTIFICIAL PASSENGER” developed by Dimitry Kanevsky and Wlodek Zadrozny.

• This software holds the conversation with driver to determine whether the driver can respond alertly enough.

Devices Used Is Artificial PassengerThe main devices that are used

in this artificial passenger are:-◦Eye tracker or Camera.◦Voice recognizer or speech

recognizer.◦Touch sensors.

Devices Used Is Artificial PassengerHow does eye tracking work?

◦Eye-tracking hardware is either mounted on a user's head or mounted remotely.

◦Both systems measure the corneal reflection of an infrared light emitting diode (LED).

◦This action causes the pupil to appear as a bright disk in contrast to the surrounding iris and creates a small glint (shine) underneath the pupil.

Continued…

◦It is this glint that head-mounted and remote systems use for tracking.

Architecture of Artificial Passenger

Architecture

Picks up words and separates them by use of some software.

Architecture

Tracks lip movement and improve the accuracy of speech recognition .

Architecture

Sensor alarms when the door is not locked

Architecture

Sensor will periodically sprinkles the sweet air inside the vehicle.

Architecture

Used for the entertainment purpose.

Architecture

Linked to the dialog system by wireless network system Coupled with

Architecture•Car media, driver profile, conversational planner.•Driver analyzer module

•It controls interruption of a dialog between the driver and the car dashboard (for example, interrupting a conversation to deliver an urgent message about traffic conditions on an expected driver route).

Working of Artificial Passenger.

Components Supporting Working…Automatic Speech Recognizer

(ASR)Natural Language Processor

(NLP)Driver analyzerConversational planner (CP)AlarmExternal service providerMicrophoneCamera

Continued…Microphone:

◦It picks up the words and separate it using speech recognition software.

Camera:◦A camera built into the dashboard

used to track the lip movement of the driver to improve the accuracy of the speech recognition.

Continued…Automatic Speech

Recognition (ASR):◦There are two types of ASR:

First ASR decodes the drivers voice and decoded data is an input to NLP.

Second ASR decodes voice of car media, decodes tapes, audio books, telephone mails.

Continued…Natural Language Processor

(NLP):◦Identifies semantic and syntactic

content of the decoded message, produces variants of responses and outputs this data to a text input of the driver analyzer.

Digital Analyzer :◦Receives the textual data and voice

data from NLP and measures the time of response using a clock.

Continued…Conversational planner:

◦It instructs the language generator to produce the response.

Alarm:◦ If driver is about to fall asleep then

it activates an alarm system.

Continued…External Service Provider:

◦Linked to the dialog system by wireless network system as it is coupled with

Car media, driver profile, conversational planner

Driver analyzer module.

Advantages of Artificial Passenger

Prevent accident.

Used for entertainment.

Establishes interface with other drivers very easily.

Open/Close the window of a car automatically and also answer a call for you.

Continued…

If the driver gets a heart attack or he is drunk it will send signals to vehicles nearby about this so driver there become alert.

Provide a natural dialog car system that understands content of tapes, books and radio programs.

Applications

• Security guard.• Operators at nuclear plants.• Cabins in airplanes.• Watercraft such as boats.• Trains and subways.

Future Back –office data aggregation is a

key enabler of telematics growth. Analyzing data and turning information to knowledge would be a push point to growth.

Designing “Specifically Targeted Actionable Data”.

ConclusionAllow use of various services in

car like reading e-mails, navigation, downloading music files, voice games without compromising a driver safety.

Primary objective of the invention is to provide a system for monitoring driver alertness.

THANK YOU !!!