COGNITIVE NAVIGATION AND OBJECT DETECTION SYSTEM FOR BLIND PEOPLE Larisa Dunai Guillermo Peris-Fajarnes Teresa Magal-Royo Beatriz Defez AEGIS 2 nd International Conference 2011
Jun 28, 2015
COGNITIVE NAVIGATION AND
OBJECT DETECTION SYSTEM
FOR BLIND PEOPLE
Larisa Dunai
Guillermo Peris-Fajarnes
Teresa Magal-Royo
Beatriz Defez
AEGIS 2nd International
Conference 2011
Motivation AEGIS International
Conference 2011
Introduction
Communication localization
AEGIS International
Conference 2011
Introduction
¿From
where?
AEGIS International
Conference 2011
Objective
Design an Electronic Travel Aid system
(ETA) for object detection and navigation for
blind people
inform the blind user about near and far static
and dynamic objects through acoustical
signals
Stereovision
AEGIS International
Conference 2011
Objective AEGIS International
Conference 2011
State of the art
Detectores de obstáculos Sensores del entorno Navegación
Ultrasonidos Láser y ultrasonidos Identificador de posición
-Lindsay Russell Pathsounder
-Mowat sensor
-Light Probes
-Nottinham Obstacle Detector
-Sonic Torch
-Sonic guide
-KASPA
-Bat K Sonar
-Miniguide
-Trisensor
-Ultracane
-Talking Signs
-Taling Lights
-Sonic Orientation Navigation Aid
-Marco
-Verbal Landmark
-Easy Walker
-Pilot Light
Láser Localización del usuario
-Laser Cane
-Ultracane
-Sonic Pathfinder
-Polaron
-Walk Mate
Video
- SWAN
-The vOICe
-Navigation Assistance for Visually Impaired
-Tyflos device
-EPEL
-System for wearable Audio Navigation
GPS
- Trekker
-Geotact
-Tormes
-GPS Braylle Note
-Personal Guidance System
-Talk & Wayfinder
AEGIS International
Conference 2011
System design
INPUTS OUTPUT
environment
AEGIS International
Conference 2011
Real-Time Assistance Prototype AEGIS International
Conference 2011
Real-Time Assistance Prototype
Fig.2. Real-Time Assistance Prototype block diagram
Processing Unit
PPM
images
Acoustic
sounds
Stereo
cameras
Headphones
Object detection and Free
space detection
Segmentation algorithm
Depth Map Estimation
Bounding Box Algorithm
Acoustical Module
Object distance
Object speed
Object direction
Object height
Free Space coordinates
Stereo Camera calibration
AEGIS International
Conference 2011
Acoustical system
Object
Distance
Direction
Height
Speed
complexity
AEGIS International
Conference 2011
Object segmentation using depth
maps, sparse dots and bounding box
AEGIS International
Conference 2011
Experimental scenario 15 m
10 m
5 m
12 m
AEGIS International
Conference 2011
Experimental trial
video
AEGIS International
Conference 2011