Shangkai Gao 2012. 10. 4 Dept. of Biomedical Engineering Tsinghua University, Beijing, China Grand Challenges in EEG based Brain-Computer Interface
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Shangkai Gao
2012. 10. 4
Dept. of Biomedical Engineering Tsinghua University, Beijing, China
Grand Challenges in
EEG based Brain-Computer Interface
Jonathan R.Wolpaw et al., 2000
A brain-computer interface is a communication and control system that uses signals generated in the Central Nervous System (CNS) and does not depend on peripheral nerves or muscles.
feedback
BCI
Brain-Computer Interface, BCI
Turning THOUGHTS into ACTIONS Leigh R. Hochberg, 1999
EEG
Brain Signals for BCI
high low low
high
NIRS
Temporal resolution
Spat
ial r
esol
utio
n
MEG
fMRI
Spikes
BCI Applications
high low low
high
Temporal resolution
Spat
ial r
esol
utio
n
Leigh Hochberg et al., 2012
Bin He et al., 2010
EEG based BCI EEG based BCI
IEEE Engineering in Medicine and Biology
Society
IEEE Trans. on NSRE (2003,2006)
IEEE Trans. on BME (2004)
IEEE Journal of Emerging and Selected Topics in Circuits and Systems (2011)
IEEE Circuits and Systems Society
IEEE Signal Processing Magazine (2008)
IEEE Signal Processing Society
IEEE Computational Intelligence Society
IEEE Computational Intelligence
Magazine (2009)
IEEE publications of special issues on BCI/BMI
Grand challenges in EEG based BCI
Brain-Computer Interface
Clinical population
Wireless commu.
Healthy population
Brain signals
Electrodes & amplifiers
Signal processing
Feature extraction
Pattern classification
device control
System Feedback
Sensory inputs
3. Applications
Clinical population
Healthy population
2. Engineering
Electrodes & amplifiers
Wireless commu.
Signal processing
Feature extraction
Pattern classification
device control
System Feedback
1. Neuroscience
Brain signals
Sensory inputs
Grand Challenge (1)
( Neuroscience )
+
Attention
Mental task
Visual
Auditory
Tactile External stimulus Sensation
Perception
Cognition
t /ms
100 300 500 700 900
Tempral spacial patterns
Brain Signals
Grand challenges (1) - Neuroscience
feedback
intent
Brain signal generation
control
Variability of brain status
Skill learning
Brain Adaptation
Grand challenges (1) - Neuroscience
Grand Challenge (2)
( Engineering )
BCI System Signal processing
Pre- processing
Feature extraction Classification
Data acquisition
Command output
Feedback
Software
Hardware
Grand challenges (2) - Engineering
Portability & wearability Signal Acquisition (Hardware)
Neurosky
1
ATCOMAART
2 Wireless communication
Electric Geodesics, Inc. IMEC-NL
Grand challenges (2) - Engineering
3 Dry electrode
Liao
g.tec Matthews
Cristian
4 Multiple subjects
Tsinghua University
Randy Montoya, 2012
Conductive gel
Signal Acquisition (Hardware) Grand challenges (2)
- Engineering
Obstacles:
• Low signal to noise ratio
• Low spatial resolution
• Strong artifacts (e.g. eye movements, line noise, cable movements…) millions of neurons
EEG
Grand challenges (2) - Engineering
Signal Processing (Software)
EEG Signals
COMPLEX intelligence system
Signal Processing (Software)
external device
intent
Grand challenges (2) - Engineering
System Co-adaptation
Human brain
BCI controller
Biological intelligence
system
Artificial intelligence
system
Grand Challenge (3)
( Applications )
BCI Applications for Clinical Population
• Communication • Control • Rehabilitation
Grand challenges (3) - Application
Kathryn Levy Feldman, 2009
Scott Mackler
Amyotrophic Lateral Sclerosis (ALS) - “locked -in”
30,000 Americans have ALS. ~5,600 people are diagnosed each year. ~15 new cases per day.
Grand challenges (3) - Application
Stephen Hawking: communicating via brain waves!
Grand challenges (3) - Application
http://bigthink.com/think-tank/hacking-hawkings-brain
BCI based Neural Rehabilitation
Brain-Computer Interface + Functional Electric Stimulus
Tsinghua University & Hong Kong Polytechnic University
Grand challenges (3) - Application
BCI Applications for Healthy Population
• Mental state monitoring • Consumer neuroscience • User authentication • Entertainment
Grand challenges (3) - Application
Stefan Haufe et al., 2011
Mental State Monitoring
Grand challenges (3) - Application
Mind reading for faster reactions in emergency situations
Consumer Neuroscience
Recording Brain Waves at the Supermarket
Sands and Sands, 2012
BCI Applications
Measuring Emotion in Advertising Research
Silberstein and Nield, 2012
Grand challenges (3) - Application
Julie Thorpe，P.C. van Oorschot，Anil Somayaji
Pass-thoughts: Authenticating with minds
from Pass-word to Pass-thoughts User Authentication
Grand challenges (3) - Application
…
E. C. Lalor, 2005
Games
Brent J. Lance, 2012
Uncle Milton Inc.
Grand challenges (3) - Application
Brent J. Lance, 2012
Extensions of BCI
Original
BCI
Effectively fuse brain activities of a group of people
BCI
Colla- borative
Readout of cognitive state without requiring voluntary control
BCI Passive
Combine with physiological signals or other Devices
BCI Hybrid
BCI
Aug- mented
Support the uses by individuals in everyday life
Grand challenges (3) - Application
Neuroscience Engineering
App
licat
ions
Summary
BCIs impact many aspects of modern life.
Mental status
monitoring
Mind control games
Human computer
interaction
Fundamental neuroscience
research
Paralyzed patients
Neural rehabilitation
Consumer neuroscience
Cognitive state
assessment
User authentication
BCI
BCI technology is still in its infancy. The grand challenges are in front of us.
The breakthrough of BCI technologies needs the collaborative efforts of multidisciplinary scientists.
feedback
BCI
Summary
Neuroscience
Engineering
Applications
( Future perspectives )
Acknowledgements
Grant support: National Nature Science Foundation of China Ministry of Science and Technology of China
Colleagues: Xiaorong Gao Bo Hong Former Graduate Students: Yijun Wang Guangyu Bin Dan Zhang Honglai Xu Wei Wu Graduate Students: Tianyi Qian Yun Li Xiaoshan Huang Peng Yuan
Related Documents
