Top Banner
Source Analysis and Multimodal Neuroimaging Bin He Department of Biomedical Engineering Institute for Engineering in Medicine University of Minnesota
46

Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Sep 09, 2018

Download

Documents

doanthu
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Source Analysis and

Multimodal Neuroimaging

Bin He Department of Biomedical Engineering Institute for Engineering in Medicine

University of Minnesota

Page 2: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Brain Activity is Spatio-temporal Process

•  Brain activity is distributed in 3-dimensional space and evolves in time.

•  High spatial resolution imaging modalities needed.

•  High temporal resolution imaging modalities needed.

•  Noninvasive imaging modalities needed for human brain imaging. 100 ms

Page 3: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Spatial & Temporal Resolution of Neuroimaging Modalities

He & Liu, IEEE Rev BME, 2008

Page 4: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Strategies

 Increase temporal resolution of fMRI

 Enhance spatial resolution of EEG/MEG  Multimodal imaging combining fMRI

and electromagnetic imaging

Page 5: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Problem Formulation

Brain Electric Source

Volume Conductor E/MEG

Equivalent Brain Source

Volume Conductor

Model E/MEG

Inverse Problem/ Source Analysis

Forward Problem

Page 6: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Why Source Analysis?

  The head volume conductor smears the EEG/MEG distribution over the scalp, thus it is difficult to relate scalp EEG/MEG to intra-cranial sources by only inspecting scalp EEG/MEG.

Page 7: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Electrophysiological Neuroimaging •  Neuroimaging aimed at improving substantially

the spatial resolution of conventional EEG/MEG through deconvolution, and use of anatomic information on the brain and head as obtained from magnetic resonance imaging.

•  We shall abbreviate it as EEGI below.

Page 8: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

From Sensor to Source Space

Michel & He, Niedermeyer's Electroencephalography, 2011

Page 9: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Issues in EEGI

•  Scalp Mapping •  Equivalent Source Modeling •  Volume Conductor Modeling •  Inverse Source Solutions •  Validation and Biomedical Applications

Page 10: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Electrophysiological Mapping of Binocular Rivalry

Zhang, Jamison, Engel, He, He, Neuron, 2012

Page 11: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Low density / high density array

32 electrodes 64 electrodes 128/256 electrodes

Page 12: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Effect of electrode numbers - Patient data

Mean and standard deviation of localization errors in clinical data analysis

Lu et al., Clin. Neurophysiol., 2012

Page 13: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Issues in EEGI

•  Scalp Mapping •  Equivalent Source Modeling •  Volume Conductor Modeling •  Inverse Source Solutions •  Validation and Biomedical Applications

Page 14: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Electric Source Modeling

He et al, IEEE Trans BME, 2011

Page 15: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Equivalent Source Modeling

•  Point Source Models - Moving Dipole - Fixed Dipole - Multipole •  Distributed Source Models

- 2D Cortical Potential - 2D Cortical Dipole Layer - 3D Dipole Distribution - 3D Current Distribution

Page 16: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

3D Source Models

Dipole Source Model

Distributed Source Model

•  Amplitude, location, orientation

•  Nonlinear problem

•  Modeling focal and compact source

•  Amplitude

•  Linear problem

•  Modeling distributed source network

Page 17: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Issues in EEGI

•  Scalp Mapping •  Equivalent Source Modeling •  Volume Conductor Modeling •  Inverse Source Solutions •  Validation and Biomedical Applications

Page 18: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Head Conductor Modeling

•  Homogeneous Sphere Model •  Inhomogeneous 3-concentric-spheres Model •  Inhomogeneous 4-concentric-spheres Model •  Homogeneous Realistic Geometry (RG) Model •  Piece-wise Homogeneous RG Model (BEM) •  Inhomogeneous RG Model (FEM)

Page 19: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

RG-Head based EEG Inverse Solution

He et al., IEEE Trans on BME, 1987

Page 20: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Brain-Head Modeling

He et al., NeuroImage, 2002

Page 21: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Issues in EEGI

•  Scalp Mapping •  Equivalent Source Modeling •  Volume Conductor Modeling •  Inverse Source Solutions •  Validation and Biomedical Applications

Page 22: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Forward and Inverse Problems

Forward Problem

Inverse Problem

Source Model

-  current dipoles

-  discrete and distributed source models

Volume Conductor Model

-  sphere head model

-  boundary element model

-  finite element model Source Imaging

-  discrete source imaging

-  distributed source imaging

Solving inverse problem

ill-posedness

regularization

Page 23: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Moving Dipole Localization

Dipole Source Model

Comparator

Volume Model

Parameter Modifier

Initial Parameters

Inverse Solution

Subject Mapping

System

EEG/MEG

Page 24: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Linear Inverse Problem

s

x

x - Scalp EEG/MEG

s - Unknown Source Vector

A - Transfer Matrix

b - Noise

Page 25: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

•  Tikhonov regularization:

k : truncation parameter

s(λ) = (AtA+λR)−1Atx

where

Regularization Approach

•  Truncated singular value decomposition:

s(k) = A#x =VΣk−1Utx

Page 26: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

L-Curve Approach

sFA φ−

F large k

small λ

small k large λ

Hansen 1992

Page 27: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Issues in EEGI

•  Scalp Mapping •  Equivalent Source Modeling •  Volume Conductor Modeling •  Inverse Source Solutions •  Validation and Biomedical Applications

Page 28: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Electrophysiological

Source Imaging

MRI

Source Imaging

EEG

Page 29: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Cortical Imaging from EEG

Bai, He, et al., Brain Topography, 2011

Page 30: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Cortical Imaging of Epileptic Activity

Lai, He, et al., NeuroImage, 2011

Page 31: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Sparse Source Imaging from EEG

Ding & He, Human Brain Mapping, 2008

Page 32: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Spatio-temporal Seizure Imaging

Yang, He, et al., NeuroImage, 2011

Page 33: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

EEG Imaging of Seizure Sources

Yang, He, et al., NeuroImage, 2011

Page 34: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Beyond EEGI

 Increase temporal resolution of fMRI

 Enhance spatial resolution of EEG/MEG  Multimodal imaging combining fMRI

and electromagnetic imaging

Page 35: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Multimodal Neuroimaging

  Electrophysiological and hemodynamic measurements represent complementaty responses of brain activation.

  fMRI has high spatial resolution.   EEG has high temporal resolution.   Integration of fMRI with EEG represents a natural

approach to further improving spatio-temporal resolution, but a new challenge due to the very different time scales of these measurements.

Page 36: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

EEG/fMRI & Brain Activity EEG

BOLD-fMRI activations Scalp potential maps

Neural activation

Neurovascular coupling

Page 37: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

fMRI and EEG

He et al., IEEE TBME, 2011

Page 38: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Origin of BOLD

Logothetis et al., Nature, 2001

Page 39: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Simultaneous EEG-fMRI Recordings

Im, He et al., J Neurosci. Meth., 2006

Page 40: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Spatiotemporal Neuroimaging by fMRI-EEG Integration

EEG fMRI

fMRI-constrained cortical source imaging

Statistical Parametric Mapping

Page 41: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Cross-modal Relationship

Liu and He, NeuroImage, 2008

Page 42: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

fMRI/EEG Multimodal Imaging

(Grill-Spector and Malach, Annu. Rev Neurosci, 2004)

Liu & He, NeuroImage, 2008

Page 43: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

BOLD vs VEP Power

Liu, He, et al, NeuroImage, 2010

Page 44: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Functional Connectivity Imaging in Source Space

Babiloni, He, et al, NeuroImage, 2005

Page 45: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

eConnectome

  MATLAB-based, GUI   Temporal Analysis   Scalp Topographical Analysis   Spectral Analysis   Cortical Current Density Imaging   Functional Connectivity Mapping   EEG, V1.0, 2010   ECoG, V1.0, 2010   MEG V1.0, 2011   Open-source, GPL

Electrophysiological Connectome

http://econnectome.umn.edu

He et al., J Neurosci. Methods, 2011; Dai et al., Brain Topography, 2012

Page 46: Source Analysis and Multimodal Neuroimaging · Source Analysis and Multimodal Neuroimaging ... • Brain activity is distributed in 3- ... fMRI has high spatial resolution.

Thank you