Department of Aerospace Vehicles Design and Control ROY, RAPHAËLLE N. Associate Professor (tenure track) EEG-BASED MENTAL STATE MONITORING: INTRODUCTION TO NEUROERGONOMICS Workshop Neurophénoménologie, Imagerie Motrice et Performance Sportive, CLLE, 04/11/19 [email protected]
29
Embed
EEG-BASED MENTAL STATE MONITORING: INTRODUCTION TO ...
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Department of Aerospace Vehicles Design and Control
ROY, RAPHAËLLE N.
Associate Professor (tenure track)
EEG-BASED MENTAL STATE MONITORING: INTRODUCTION TO NEUROERGONOMICS
Supervised Dictionary Learning Power in 5 frequency bands (δ, θ, α, β and γ)
Inter-subject classification 67% in average
ISAE-SUPAERO 2019 23
Closing the loop
How to close the loop by injecting this assessment into a control loop with a decisional system unit in order to enhance the human-system interaction?
Mental states: cognitive & affective
Estimation
Feedback
Decision
ISAE-SUPAERO 2019 24
Necessary ingredients:
• Machine learning • Planification tools Direct and online measurements of subtle incapacitations Passive Brain-Computer Interfaces / neuroadaptive technology / biocybernetical loop [Fairclough2009; Zander2010]
Caroline Chanel & Nicolas Drougard
Decisional system
System - Human(s) - Artifical agent(s) x Performance
Goal Decision
policy
Closing the loop
Sensors (EEG,
fNIRS, etc)
Feature extraction
Classification
ISAE-SUPAERO 2019 25
The policy can adapt:
• The human/artificial agent interaction e.g. autonomy level of the artificial agent • The interface (dealt with by an artificial agent) e.g. task difficulty
Closing the loop
Gateau, Chanel, Le & Dehais. (2016) IROS.
Online UAVs behavior adaptation depending on operator’s availability (eye-tracking)
MOMDP model to drive the
adaptive behavior of the entire
artificial agents and system
ISAE-SUPAERO 2019 26
Closing the loop
Performance increase on the secondary task with online gaze monitoring-based adaptation!
Gateau, Chanel, Le & Dehais. (2016) IROS.
ISAE-SUPAERO 2019 27
Using physiological data one can perform:
Conclusion
MS characterization
Offline use Closed systems
that adapt to the operator’s state
Online use
Challenges/Studies in progress / Outlook
• Robustness of both markers & pipelines (inter-subject variability, sessions, tasks, and ecological settings)
• Ethics, acceptability, …
28
THANKS
SAVE THE DATE: 19th of December at ISAE-SUPAERO
10:30am: seminars by Pr S. Fairclough, Dr A.-M. Brouwer and Dr F. Lotte