Top Banner
40

NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Jul 29, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 2: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 3: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

3

NeuroInformatics.GRoup‘’Coping with Brain Complexity’’

Page 4: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

4

Single-Trial analysisof cognitive ERP Responses

Data Learning

Information Mining

Signal Analysis

Dynamical systems

Page 5: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

5

The Clinical problem (simplified ):

There are complaints about decline in cognitive performance

Can we distinguish between normal ageing effects and

mild cognitive impairment (MCI) / prodromal AD pathology?

A Clinical Approach (just one possibility)

ERPs - auditory oddball paradigm

Page 6: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

6

Single-trials

A waveform-biomarker

reflecting the ‘average’ performance in a simple cognitive task

alternatively …

Page 7: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

7

Preliminaries – Our Motivation

Discriminative VQ - descriptor

Cross Frequency Coupling - Biomarker

Future directions

Page 8: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Preliminaries – Our Motivation

8

the synopsis of response dynamics and its variability

by means of

Semantic Maps

and Brainwaves Dictionary

[Laskaris et al., 2001-2009]

Page 9: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

9

In a nutshell,

directed queries are formed in the Single-Trial signals,

which are then summarized

using a very limited vocabulary of information granules (prototypes)

that are easily understood, accompanied by well-defined semantics

and help expressing the inherent data structure.

The information abstraction is accomplished

via unsupervised data-manifold learning techniques

and followed by a suitable visualization scheme

that can readily spot interesting events & trends in the experimental data

Semantic Maps : is a cartography of single-trials that results in a topographical representation of response variation

and enables the virtual navigation in the encephalographic database.

Page 10: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

10

A Short Intro

Page 11: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

11

Step_the spatiotemporal dynamics are decomposed

By designing a spatial filter that is used to extract

temporal patterns conveying

the regional response dynamics

Page 12: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

12

Feature selection

Embedding in high-D

feature space

Manifold learning

Neural-Gas Codebook

design

Vector Quantization

&

Ordering

Dimensionality Reduction

MAP

with semantics attached

Response re-parameterization

Signal Understanding

&

Machine learning

Step_Pattern & Graph-theoretic Analysisof the extracted ST-patterns

Page 13: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

13

Page 14: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

14

Page 15: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

16

Can single-trial response dynamics

(i.e. the recorded brainwaves)

be described/characterized

in ways that would help revealing

the cognitive impairment

better than the averaged response ?

Page 16: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Exploiting BrainWaves in aMCI-detection Part-I. Discriminative VQ - descriptor

auditory oddball paradigm with 20% target tones

Signals were recorded at Cz and Pz sites with fs=1024 ,

~ 30 responses to target stimulus per subject

25 amnestic MCI patients & 25 non-impaired subjects

from GAADRD

Page 17: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The concept

Semantic Map

Single-Trial response dynamics

BrainWaves

descriptors

CodeBook design

Feature

selection

Initial representation of STs

1. Design the Codebook

discriminatively

2. Derive semantic map

based on CodeWaves

3. Embed ST-responses as

trajectories on the map.

4. Compute distributions

over the Codebook

5. Compare ‘histograms’

Page 18: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Training stage

Page 19: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The temporal patterning in δ-rhythm showed the most prominent

differences between NI and aMCI single-trial cognitive responses.

Two distinct temporal segments (LOIs) were identified,

associated with the N200 and P300 (averaged) response

Page 20: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Using randomization,

Page 21: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Based on the detected LOIs

Page 22: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Classification stage

Page 23: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The semantic map of the overall CodeBook (a)

with single-trial response trajectories sketched within (b & c).

Page 24: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Single-subject (top) and group-averaged (bottom) DVQ-profiles

Page 25: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

MDS-based scatterplot for the DVQ-profiles (left)

and the Signal-Averaging representation (right)

Comparing with Signal Averaging

Page 26: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

By means of 5-fold cross-validation for CodeBook design

& leave-one-out cross-validation (LOOCV) for the knn-classifier

1NN 3NN

DVQ-profile Averaged

Signal

DVQ-profile Averaged

Signal

ACC 0.90 0.80 0.93 0.83

Sensitivity 0.87 0.73 0.93 0.80

Specificity 0.93 0.87 0.93 0.87

Descriptors’ validation

Page 27: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 28: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Can the study of

interactions among distinct brain rhythms

(i.e. brainwaves of different prominent frequency jointly analyzed)

offer alternative / additional ways

for detecting cognitive impairment ?

Page 29: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

δ(2-4)Hz

θ(4-8) Hz

α1(8-10)

α2(10-13)

β1(13-20)

β2(20-30)

γ1(40-45)

Exploiting BrainWaves in aMCI-detection Part-II. Cross Frequency Coupling - Biomarker

CFC is a key mechanism for the integration of distinct processes

mediated by the distinct brain rhythms, and there is rapidly

accumulating experimental evidence about its role in cognition

Page 30: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

1

• a PAC-estimator is employed across trials• for each pair of brain rhythms a time-varying profile

of interaction is estimated by means of PLV(low, high)

2distinct CFC events

associated with the ERP components are detected

3

rhythm-pairs and latencies of high discriminative power are detected and wrapped in a multifaceted-biomarker

Method’s outline

Page 31: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

time-resolved PAC estimation

θ β1

Using Band-Pass filtering and Hilbert transform

𝒙 𝒕 ՜𝟏𝑯𝑭𝒇𝒊𝒍𝒕𝒆𝒓 𝒙 𝒕

𝟐:𝑯𝒊𝒍𝒃𝒆𝒓𝒕𝒆𝒏𝒗𝒆𝒍𝒐𝒑𝒆՜

𝟑𝑳𝑭𝒇𝒊𝒍𝒕𝒆𝒓(𝒆𝒏𝒗𝒆𝒍𝒐𝒑𝒆)

𝟒: 𝑯𝒊𝒍𝒃𝒆𝒓𝒕inst. phase

𝒙 𝒕 ՜𝟓𝑳𝑭𝒇𝒊𝒍𝒕𝒆𝒓 𝒙 𝒕

𝟔: 𝑯𝒊𝒍𝒃𝒆𝒓𝒕inst. phase

Page 32: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

by integrating across trials and within a temporal window

Page 33: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

δ

θ

α1

α2β1

β2

γ1

δθ δα1 δα2 δβ1 δβ2 δγ1

θα1 θα2 θβ1 θβ2 θγ1

α1α2 α1β1 α1β2 α1γ1

α2β1 α2β2 α2γ1

β1β2 β1γ1

β2γ121 pairs

LF HF

the corresponding 3D/2D array encapsulated the temporal evolution of

CFC associated with the response generation.

instantaneous PLV measurements can be tabulated in a [7x7] Matrix

or more compactly in a 21-tuple vector

PLV

δθ

δα1

θα1

δα2

β2γ1

PAC dynamics representation

Page 34: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

studying the PAC evolution - I

Single-subject (NI) example

Averaging

across pairs

Picking the maximal

interaction

Page 35: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Group-averaged results for healthy participants :

contrasting CFC from responses to Target and Nontarget stimuli

studying the PAC evolution - II

Page 36: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Group-averaged results

aMCI vs. NI subjects

studying the PAC evolution - III

Page 37: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Class-Separability Analysis

The dynamic PAC profiles from aMCI and NI subjects

are statistically compared

Page 38: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Biomarker - validation

Page 39: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

40

ERPs

• Multichannel signal

• Functional connectivity

Resting State

• BrainWaves VQ-characterization

• CFC

Interventions

• Restoring brainwaves distribution

• Restoring CFC

Page 40: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

41

M.Tsolaki, I.Tarnanas

& coworkers

S.Dimitriadis, M.Bitzidou

& coworkers

http://neuroinformatics.gr/