YOU ARE DOWNLOADING DOCUMENT

Please tick the box to continue:

Transcript
Page 1: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Basic medical image processing concepts and

continued course introduction

Einar Heiberg, [email protected]

Course homepage http://www.maths.lth.se/course/medim/2015/

Page 2: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Who am I?

• Master of Science in computer engineering • PhD medical image analysis and modelling • Worked in hospital environment for 15 years • Part of Lund Cardiac MR Group • Founder of Medviso AB • CTO for Imacor

Page 3: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Dept Clinical Physiology

Page 4: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Purpose of the lecture

• Revisit basic image processing concepts in medical imaging context

• Hope to provoke you to start thinking about images and imaging in new directions

• Application examples

Page 5: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

General notation of hand-outs

• Red texts are basic take home messages after discussions in the lecture.

Page 6: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

What is an image?

• Generally speaking we agreed that it is a mapping from one space (typically R2) to another space (typicall R2)

• Other spaces such R3 or higher are possible

Page 7: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Dimensionality (outer)

• 1D

• 2D

• 2D+T

• 3D

• 3D+T • 3D+T+T

Time are often cyclic in medical images (cardiac motion).

Page 8: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Dimensionality (inner) – Scalar

– Vector

V

We might even have a chemical spectrums in each point.

Page 9: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Dimensionality – Scalar

– Vector

– Tensor λ1

λ3

λ2

V

Strain, strain-rate, stress, ….

Velocity, spectrum, …

Pixel intensity, attenuation, temperature, radiation count, energy, …

Page 10: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

What is image contrast?

• Generally we agreed that it is defined on the basis of difference in image intensity

Page 11: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

What is contrast in medical images?

• Generally we agreed that is it defined as difference in intensity in objects we are interested in and objects we are not interested in (background)

Page 12: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Contrast

Orginal “Contrast enhanced”

Here I have just saturated the brightest parts and the darkest parts to enhance the border between the blood in the left ventricle compared to the heart muscle.

Page 13: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Transfer curve

Orginal Result

Input intensity

Contrast mappings may be expressed in terms of transfer curves.

Page 14: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Transfer curve

Orginal Result

Input intensity

Bizarre mappings cause bizarre side effects. See artificially introduced edge. On the other hand it really enhances the perception of the border.

Page 15: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Contrast agentsn (used in medical imaging)

• Iron particles (MRI) • Gadolinium (MRI) • Radio nuclides (SPECT, PET) • Bubbles (ultrasound) • Staining (histology)

Page 16: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Resolution (what is it?) Image shows and ultrasound image. Here the image are formed by sending out focused rays of sound and listen to echo that comes back. What is then the resolution?

Page 17: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Resolution (what is it?) • Generally resolution of medical images are

defined in terms of the pixel size (in the real physical world in mm).

• Only then we can defined distances and volumes in the medical images.

• Frequently it is not easy to get information about the true resolution. That could be determined on what is the highest frequency that we can depict in the images.

Page 18: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Signal to Noise Ratio (SNR)

• Common definitions below:

• SNR = Psignal / Pnoise (P=power)

• SNR = μ / σ

Page 19: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

What is noise?

HMG, Lund 0.5 x 0.5 x 0.5 mm

The tricky part with noise in medical images are how you estimate the noise. Estimating the signal is usually easier.

Page 20: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Accelerated imaging (and noise)

Noise may in some cases not be constant over the image!

Page 21: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Colour vs greyscale

• We can perceive about 100 shades of grey

• We can perceive > 100 000 colours

Page 22: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Why does not an MR image look like this?

• Harder to objectively understand the differences in scale (we perceive colors less linear compared to gray scale) • Traditions. Medical doctors may not be used looking at colors for the particular image type. Color monitors may not have been common when the technique was invented. • Colors are good when we can have an objective color legend.

Page 23: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Why do a SPECT image look like this?

It has always looked this way for SPECT images!

Page 24: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Example of medical image processing projects from

Lund University

Page 25: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Automatic segmentation of infarct size in MR images

Page 26: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Automated segmentation of myocardium at risk

= MaR = Total occlusion

= Myocardial infarction (MI)

Page 27: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are
Page 28: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

So what? We can use about 50% fewer patients when we use this (infarct size over myocardium at risk) as an efficacy measure of the treatement.

The graph shows the number of patients in a clinical trial to reach a certain statistical power

Page 29: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Regional myocardial analysis

Using MR velocity encoded images, we can calculate deformation and strain in the heart muscle. Heiberg et al, JCMR, 2013.

Page 30: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Regional myocardial analysis

Strain

Using MR velocity encoded images, we can calculate deformation and strain in the heart muscle. Heiberg et al, JCMR, 2013.

Page 31: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Blood flow in the human heart

Using MR velocity encoded images in 3D. We can visualize how the blood flows. This is also one form of image processing.

Page 32: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Detection and Diagnosis of Kidney Lesions Scandinavian Conference on Image Analysis, 2011

LDA QDA ANN Area under ROC curve (AUC)

0.964 0.935 0.960

Sensitivity (%) 96.5 96.5 96.5 Specificity (%) 84.8 61.2 83.4 Positive Predictive value (%) 35.0 17.4 32.9 Negative Predictive value (%) 99.7 99.5 99.6

Mis-classification rate (%) 14.2 36.0 15.6

Page 33: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are
Page 34: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Diagnosis of Pulmonary Embolism

European Journal of Nuclear Medicine, 2000

Page 35: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Segmentation – shape variation methods Understanding both appearance and shape

Page 36: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Exini Diagnostics

Page 37: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

MR – knee injuries

Page 38: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

SPECT – brain (dementia)

Page 39: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Gated SCINT - heart

CAFU

QGS

EDV ESV EDV ESV

185 ml 46 ml 21 ml 71 ml

45 ml 21 ml 201 ml 122 ml

TRUE 57 ml 22 ml 186 ml 72 ml

Page 40: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Automated Pharmacokinetic Analysis Scandinavian Conference on Image Analysis, 2011

Page 41: Basic medical image processing concepts and continued ... · processing concepts and continued course introduction Einar Heiberg, einar@heiberg.se. ... • 3D+T • 3D+T+T Time are

Questionaire

http://voto.se/poll/FMNA30


Related Documents