Sensors for Machine Intelligence

Sensors for Machine IntelligenceTaiyi Cheng

Nov.13, 2019

Haptic&

Gesture

Visual

Auditory

Machine Intelligence - Sensing like Humans

Interactive

integration of all

types of sensing

Sensors for All Walks of Life

Technology

Mic

Speaker

Fingerprint

Touch

Heart Rate

Gesture

Distance

CIS

LiDAR

Proximity

ToF

Blood Pressure

Haptic

mm Wave

Basic Form

Photo-acoustic

Visible

Laser

Infrared

Capacity

RF

Audio

Products

Enhancement

• Sense a vehicle and its surroundings with accuracy

• Enable sensitivity beyond human capability

• Offer active safety and ADAS with continually

improving performance

• Behavioral analysis to provide greater comfort to

driver/passengers

• Intuitive operation

Ubiquitous Applications on Smart Mobility

• Ability to ‘see’ and predict possible issues

Comfort and Wellness for a Smart Life On Board

A Comfortable Interior

• Personalized Comfort

• Multi-dimensional

interactions

Active Wellness for all

• Active safety and

hazard avoidance

• Vitality and health

monitoring

• Relevant information

provided to passengers

Biometric Signatures -> Personalization -> Intuitive Operation

• Personalized care

The Starting Point - Identification

• Fingerprint recognition on the remote, door, ignition

and steel wheel

• Facial recognition on the back mirror

• Remote authorized driving

Driver

Passenger

• Fingerprint recognition on the remote, door and seats

• Facial recognition on the back mirror

• Voiceprint for family members

Fingerprint \ 3D Face Recognition \ Voiceprint Recognition

Comfortable Interior

Connected as you go

Easy napping

• A cozy, homelike space

• Advanced facilities and human machine interface

• Sync information Seamlessly

• Location-based information and service

• Multi-dimensional interaction

• Display Stabilization

• Explore all the possibilities while on the road

• Entertainment and Gaming

• Catching up on Business

• Rest with comfort

• The list can go on…

Temperature / Humidity / Pressure /Smart Mic Array / Camera / Vibration / Gesture / NLP

Adjustable comfort

Accessible chatting

A Reliable Sidekick

Safety and hazard monitoring

Child and senior monitoring/assistance

Health, wellness, and biometric monitoring

AI/ML used with sensor data to better learn

and facilitate passengers

Microphone / Infrared Camera / MM Wave / ToF / Remote Heartbeat /Blood Pressure/ Breathing

Sensing Inside and Out

Fingerprint identification

Smart Mic Array：Voice communication

Touch panel：Touch control

IR camera & ToF: Face \ gesture\ object recognition

Ultra-sonic ToF：Personnel Presence Detection

Projector & Haptic: Work and game

Co-pilot position: Main angle of view-share

Backseat Projector & Haptic feedback:

Gesture controlling interaction

MM Wave：Remote Heartbeat / Breathing

Temperature sensor hygrometerUltra-sonic: Haptic feedback \ Proximity

Pressure & Vibration

Provided by GigaDevice

Sensing and Thinking

Fusion Decision Feedback Sensor Signal Estimation

Fusion

Analysis

Synthesized

Information

Sensor Processing Data

Sensor Processing Data

Sensor Processing Data

Decision Feedback

Fusion Decision Feedback for Iterative Signal Estimation / Comprehensive Decision

With GigaDevice

High speed, low power &

smallest package for code

and data application

Capacitive

Ultrasonic

Optical

MM wave

MCU and Embedded Computing

About GigaDevice

• Established in 2005, 800+ employees globally;

• Successfully listed in the Shanghai Stock Exchange

in 2016 (SSE 603986);

• A semiconductor technology leader in China

focusing on flash memory, microcontroller and

sensor design.

• Top 1 fabless NOR Flash memory supplier worldwide

• Top 3 SPI NOR Flash supplier worldwide

• China’s No.1 32-bit Arm® general-purpose MCU

supplier

• China’s No.2 fingerprint sensor supplier

• 1132 patents filed, 510 granted

• ISO9001 and ISO14001 certified

Thank You