Top Banner
1 Medical Imaging using Computational Conformal/Quasi-conformal Geometry Prof. Tony F. Chan Hong Kong University of Science and Technology (HKUST) Jointly work with: Prof. David Gu, CS, Stony Brook Prof. Ronald Lok Ming Lui, Math, CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong, Math, UCI Prof. Shing-Tung Yau, MATH, Harvard, CUHK Part I of the sequel of 2 talks. More applications of QC theory will be presented by Ronald Lui
43

Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

Jun 08, 2018

Download

Documents

lyngoc
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

1

Medical Imaging using Computational

Conformal/Quasi-conformal Geometry

Prof. Tony F. ChanHong Kong University of Science and Technology (HKUST)

Jointly work with:Prof. David Gu, CS, Stony Brook

Prof. Ronald Lok Ming Lui, Math, CUHK

Prof. Yalin Wang, CS, ASU

Dr. Alvin Wong, Math, UCI

Prof. Shing-Tung Yau, MATH, Harvard, CUHK

Part I of the sequel of 2 talks.

More applications of QC theory will be presented by Ronald Lui

Page 2: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

2

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Part II: Quasi-conformal Geometry &

Applications

Conclusion

Page 3: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

3

What is Medical Morphometry?

Medical Morphometry: Tracking of shape changes/abnormality; analysis of medical images.

Main goal: Generate diagnostic images for visualization of

structural changes.

Thompson et.al Growth patterns in the developing brain detected by using continuum mechanical tensor maps, Nature, 2000.

How Conformal/Quasi-conformal theory help?

Page 4: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

4

Brain Mapping Tasks

Spatial

normalization

in Canonical

Space

Shape

representation

Automatic identification and localization of structures and function

PDEs, ...Statistical shape analysis

Page 5: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

5

Brain Shape Analysis: Examples

-Hippocampus : long-term memory & spatial navigation;-Shape analysis for Alzheimer's disease

- Lateral ventricles : fluid-filled

structures deep in the brain;

- Enlarged in disease;

- Shape analysis for measures of

disease progression.

Page 6: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

6

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Part II: Quasi-conformal Geometry & Applications

Conclusion

Page 7: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

7

What is Conformal map?

Conformal map = preserves inner product up to a

scaling factor (the conformal factor ).

Mathematically, where

NMf :

2

21

2 ),()(* MN dsxxdsf

2

1,

2

ji

ji

ijM dxdxgds

conformal factor

Page 8: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

8

Why Conformal for Brain Mapping?

• Metric preserved up to scaling Local geometry preserved!

• Angle-preserving inherits a natural orthogonal grid on the

surface.

• Simple (gij) Matrix simple differential operator expression on

the parameter domain and simple projected equations.

Φ

M2M1

Page 9: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

9

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Part II: Quasi-conformal Geometry & Applications

Conclusion

Page 10: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

10

Computation of Conformal Maps

Genus zero surface conformal parameterization

Minimize:

Conformal

Theorem: (Genus 0)

(Genus 0)

Discrete version of Harmonic energy:

(Discrete Laplacian)

(Harmonic Energy)

Page 11: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

11

Genus-0 Conformal Maps: Examples

Two brain surfaces are of

the same subject at

different time.

Conformal mapping :

Good parameter

domain

Page 12: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

12

Computation of Conformal Maps

Curvature flow method

Basic idea: conformally deform Riemannian metric to another Riemannian

metric to achieve prescribed curvature.

Conformal

Page 13: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

13

Examples: Curvature Flow Method

(5 landmarks)

(7 landmarks)

Page 14: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

14

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Part II: Quasi-conformal Geometry & Applications

Conclusion

Page 15: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

15

Application: Brain Registration

Brain Conformal Parameterization:

A canonical domain for brain surface analysis!

Genus 0

Open surface(disk is removed at the back)

Page 16: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

16

Application: Brain Registration

Conformal Slit Map: (using curvature flow method)

Sulcal landmarks are mapped to circular slits or horizontal slit

Another brain

Circular Slit map

Horizontal Slit map

Page 17: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

17

Solving PDEs on surfaces: Conformal Approach

Goal: Solve equations on the surface by mapping it onto the 2D conformal parameter domain.

Differential operators are computed on 2D domain with simple formula.

Example:

Conformal factorProjected PDE on conformal

domain take simple expression!

Page 18: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

18

Applications: Imaging on surfaces

Page 19: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

19

Application: Automatic Sulcal Landmark Tracking

mean curvature

Page 20: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

20

Application: Shape Analysis w/ Conformal Structure

AIDS

Healthy(21 yrs old)

Page 21: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

21

Application: Shape Analysis w/ Conformal Structure

AIDS

Healthy(21 yrs old)

Aspect ratio tells the conformal similarity

Page 22: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

22

Application: Shape Analysis w/ Conformal Structure

HEALTHY Patient (William Syndrome)

Fixing two circles to the center to remove the Mobius ambiguity

Conformal dissimilarity is measured by the locations and radii of circles

Page 23: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

23

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Part II: Quasi-conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Conclusion

Page 24: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

24

What is Quasi-conformal map?

Generalization of conformal maps (angle-preserving);

Orientation preserving homeomorphism between Riemann

surfaces;

Bounded conformality distortion;

Intuitively, map infinitesimal circle to ellipse;

Mathematically, it satisfies:

Beltrami coefficient:

Measure conformality distortion;

Invariant under conformal

z

fz

z

f

)(

Beltrami

coefficient

)(2

1

);(2

1

y

fi

x

f

z

f

y

fi

x

f

z

f

Conformal 0 0

z

f

Page 25: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

25

Example: Quasi-conformal

Conformal Quasi-conformal

Page 26: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

26

Why Quasi-conformal?

2. Quasi-conformal Geometry studies the

deformation pattern between shapes. It effectively

measures the conformality distortion under the

deformation.

1. Natural deformations are unlikely to be rigid, or

isometric, or even conformal. The search space for

the mapping should include all diffeomorphisms.

Page 27: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

27

Goal: Look for a simple representation of surface diffeomorphisms, called Beltrami representation. (Lui & Wong et al. 2009)

Surface Diffeomorphism v.s Beltrami Coefficient

Theorem:

Coordinates functions representation

Beltramirepresentation

1-1correspondence

),,( 321 ffff

Constraints:-1-1;-Onto;-Jacobian >0-No linear structure

1||

No other constraints

Page 28: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

28

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Part II: Quasi-conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Conclusion

Page 29: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

29

Computation of Quasi-conformal map

Given a Beltrami coefficient, how to get the quasi-conformal map?

Theorem: (Beltrami Holomorphic Flow method )

Answer: 1. Beltrami Holomorphic Flow method;2. Curvature flow method to convert QC into C

(will be presented by Ronald Lui)

Page 30: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

30

QC parameterization

example of simply –

connected domain

QC parameterization

example of multiply –

connected domain

Page 31: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

31

Outline Of The Talk

Motivation

Part I: Conformal Geometry & Applications

Part II: Quasi-conformal Geometry & Applications

Basic Mathematical Background

Computational Algorithms

Applications

Conclusion

Page 32: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

32

Quasi-conformal for Registration

Example: Hippocampal registration with geometric matching

Hippocampus = limbic system;

important role for long-term memory and spatial navigation

No well-defined landmarks.

Meaningful surface registration =

DIFFICULT!

Optimizing a compounded energy :

Curvatures mismatch

GaussianMean

Page 33: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

33

Quasi-conformal for Registration

Example: Hippocampal registration with geometric matching

Basic Idea: Find a registration f that minimizes the following energy functional:

Optimization: Minimize with respect to the the Beltrami coefficientEasily control the diffeomorphic property!

Simplified optimization problem:

Compute the direction of descent and adjust f through adjusting BC.

Advantage: 1. BC doesn’t need to be 1-1, onto. Only constraint is norm < 1.2. The constraint can be easily controlled

(starting from conformal map with BC = 0 everywhere)

Page 34: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

34

Quasiconformal for Registration

Energy:

Euler-Lagrange Equation:

Variation obtained from BHF

Iterative Scheme:

Page 35: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

35

Quasi-conformal for Registration

Example: Hippocampal registration with geometric matching

Page 36: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

36

Quasi-conformal for Shape Analysis

Main Goal: Detect abnormal deformation on biological organs

Applications: detecting brain tumor, tracing deformation (medicine evaluation)

Difficulties:

1. Biological organs are geometrically complicated (Example: Brain);

2. Examining abnormalities by the human eye is inefficient & inaccurate .Goal:Develop automatic methods to detect & track abnormalities over time.

Tool:BC: Detecting abnormalities as non-conformal deformation = 1. serious abnormal change; 2. invariant to normal growth [local geometry preserving]P. Thompson et al.: Growth patterns in the developing brain detected by using continuum-mechanical tensor maps. Nature, 404-6774(2000), 190-193.

Page 37: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

37

Quasiconformal for Shape Analysis

Basic idea: (Lui & Wong et al. 2009)

- Compute quasiconformal map (registration) between original and

deformed surfaces;

- Compute its Beltrami coefficients:

BC preserved under

conformal map:

F

F~

o d

Page 38: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

38

Quasiconformal for Shape Analysis

(Isometric index)

Page 39: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

39

BC effectively shows the region of gyrification!

Brain (Patient)

Brain after gyrification(abnormal

deformation)

(Zoom-in)

BC on conformal domain

White = high BC = abnormal!

Quasiconformal for Shape Analysis

Page 40: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

40

Tracking the degree of gyrification over time using Beltrami Index!

Quasiconformal for Shape Analysis

Quantitative measurement of gyri thickening!

Page 41: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

41

BC + Curvatures = complete shape index!

Temporal shape changes of healthy and AD HPs:

Quasiconformal for Shape Analysis

(100 normal & 100 AD)

Page 42: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

42

Left = healthy;Right = Unhealthy

Beltrami coefficient is not a good shape index for hippocampal shape analysis

Beltrami coefficient + Curvatures is a better shape index

BC + Curvatures = complete shape index!

Quasiconformal for Shape Analysis

Page 43: Medical Imaging using Computational Conformal/Quasi ... · Medical Imaging using Computational Conformal/Quasi-conformal Geometry ... CUHK Prof. Yalin Wang, CS, ASU Dr. Alvin Wong,

48

Conclusion

Computational Conformal/Quasi-conformal

Geometry can be used for medical imaging

More applications on Quasi-conformal geometry in

Medical Imaging and computer graphics will be

presented by Ronald Lui.

THANK YOU!