MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 15: Medical Image Registration I (Introduction) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL 32814. [email protected]or [email protected]1 SPRING 2017
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
MEDICAL IMAGE COMPUTING (CAP 5937)
LECTURE 15: Medical Image Registration I (Introduction)
Dr. Ulas BagciHEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL [email protected] or [email protected]
1 SPRING 2017
Outline
• Motivation– Image registration is an alignment problem
• Registration basics• Rigid registration• Non-rigid registration• Example Applications
2
Image Registration Taxonomy• Dimensionality
– 2D-2D, 3D-3D, 2D-3D
• Nature of registration basis– Image based
• Extrinsic, Intrinsic– Non-image based
• Nature of the transformation– Rigid, Affine, Projective, Curved
• Modalities involved– Mono-modal, Multi-modal, Modality to model
3
• Subject: Intra-subject Inter-subject Atlas
• Domain of transformation
• Local, global
• Optimization procedure
• Gradient Descent, SGD, …
• Object
• Whole body, organ, …
Open Source Implementation• ITK• ANTS (advanced normalization tools) (PICSL of Upenn)• CAVASS (MIPG of Upenn)• Nifty Reg (UCL)• Elastix (www.elastix.isi.uu.nl)• FAIR (Modersitzki 2009), mostly matlab.• 3D Slicer• FSL• …
4
Modalities in Medical Imaging• Mono-modality:
5
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
6
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
ü Images may be acquired weeks or months apart; taken from different viewpoints.
7
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
ü Images may be acquired weeks or months apart; taken from different viewpoints.
ü Aligning images in order to detect subtle changes in intensity or shape
8
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
ü Images may be acquired weeks or months apart; taken from different viewpoints.
ü Aligning images in order to detect subtle changes in intensity or shape
• Multi-modality:
9
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
ü Images may be acquired weeks or months apart; taken from different viewpoints.
ü Aligning images in order to detect subtle changes in intensity or shape
• Multi-modality:ü Complementary anatomic and functional information from multiple
modalities can be obtained for the precise diagnosis and treatment.
10
Modalities in Medical Imaging• Mono-modality:
ü A series of same modality images (CT/CT, MR/MR, Mammogram pairs,…).
ü Images may be acquired weeks or months apart; taken from different viewpoints.
ü Aligning images in order to detect subtle changes in intensity or shape
• Multi-modality:ü Complementary anatomic and functional information from multiple
modalities can be obtained for the precise diagnosis and treatment.
ü Examples: PET and SPECT (low resolution, functional information) need MR or CT (high resolution, anatomical information) to get structure information.
11
BEFORE
AFTER
PET/CT EXAMPLE
In other words,…• Combining modalities (inter
modality) gives extra information.
• Repeated imaging over time same modality, e.g. MRI, (intra modality) equally important.
• Have to spatially register the images.
12
13 Before Registration
14 After Registration
15
16
17
18
19
20
21
22
Summary of Mostly Used Applications• Diagnosis
– Combining information from multiple imaging modalities• Studying disease progression
– Monitoring changes in size, shape, position or image intensity over time
• Image guided surgery or radiotherapy– Relating pre-operative images and surgical plans to the physical reality
of the patient• Patient comparison or atlas construction
– Relating one individual’s anatomy to a standardized atlas
23
Then, What is Image Registration (formally)?
24
Image Registration is a• Spatial transform that maps points from one image to
corresponding points in another image
25
matching two images so that corresponding coordinate points in the two images correspond to the same physical region of the scene being imaged also referred to as image fusion, superimposition, matching or merge
MR SPECT registered
Image Registration is a• Spatial transform that maps points from one image to
Slide Credits and References• Credits to: Jayaram K. Udupa of Univ. of Penn., MIPG• Sir M. Brady’s Lecture Notes (Oxford University)• Darko Zikic’s MICCAI 2010 Tutorial• Bagci’s CV Course 2015 Fall.• K.D. Toennies, Guide to Medical Image Analysis,• Handbook of Medical Imaging, Vol. 2. SPIE Press.• Handbook of Biomedical Imaging, Paragios, Duncan, Ayache.• Seutens,P., Medical Imaging, Cambridge Press.• Aiming Liu, Tutorial Presentation.• Jen Mercer, Tutorial Presentation.