Top Banner
Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability NVIDIA AI CONFERENCE SINGAPORE 23-24 OCTOBER 2017
29

Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Nov 02, 2018

Download

Documents

dangliem
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Glaucoma Diagnosis

Alexandre THIERYDepartment of Statistics

& Applied Probability

NVIDIA AI CONFERENCESINGAPORE 23-24 OCTOBER 2017

Page 2: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability
Page 3: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability
Page 4: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability
Page 5: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Normal eye GlaucomaDamaged Optic Nerve

● Intraocular pressure (IOP) is the major risk factor for glaucoma● … but glaucoma can also occur at normal levels of IOP (normal tension glaucoma)

Page 6: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Current Glaucoma Diagnosis:● Lengthy process● Expensive● Not automated + Subjective● Not scalable

Page 7: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Fundus images are easy and cheap to collect

Damaged Optic Nerve

Page 8: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

● Vertical Cup/Disk Ratio: straightforward automated diagnosis● Very low diagnosis power for glaucoma

Opticcup Optic

disk

Vertical Cup/Disk Ratio (VCDR)

Page 9: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Deep Learning for Fundus Images Analysis

● Deep-Learning approaches: better than Vertical Cup/Disk Ratio● … but fundus images are intrinsically of limited use: low diagnosis power● … a robust glaucoma diagnosis needs to exploit 3D imaging modalities

Page 10: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Optical Coherence Tomography (OCT)

Imaging of the Optic Nerve Head

Few seconds scan

Page 11: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Optical Coherence Tomography (OCT)

● Exponential growth of OCT market● Democratization of the use of OCT

Page 12: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

2D Fundus image

3D OCT volume

Page 13: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Full 3D volume Diagonal Scans(view from above)

1 slice

Page 14: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

● Retinal Fiber Neural Layer (RNFL) Thickness: current gold standard● Very limited information exploited● Low predictive power

Page 15: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Low Visibility of Deep Tissues

Standard OCT Technology

Page 16: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Compensation Technology

● Signal Restoration● Based on physics of light propagation (no DL)

Page 17: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Deep Learning

Page 18: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Data Collection and Collaborators

Page 19: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

GlaucomaPrediction

● Only a few thousands training examples available● Complex structure (more than MNIST!)● CNN trained from scratch: very poor generalization abilities

Standard Convolutional Network

Page 20: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Rotation Translation Zoom Deformation Pixel IntensityChange

Standard Data-Augmentation

● Very low dimensional group of transformations available● Limited gain in predictive power

Page 21: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

GlaucomaPrediction

● Leverage networks trained on millions of images (eg. Imagenet)● Very low level filters (e.g. edge detectors) are somehow useful● ... but non-medical images are ultimately not very relevant for glaucoma diagnosis

Pretrained Networks

Page 22: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

GlaucomaPrediction

Incorporate Human Expert

KnowledgeIn the network

Leveraging Prior ExpertKnowledge is crucial

● Bayesian Regularization● Helps mitigate overfitting● Data efficiency: crucial in data-scarce settings

Page 23: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

● How would you teach a 4th grader about art?● Would you show him a few thousands

paintings and let him figure it all out?

Page 24: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Deep Residual Unet (DRUnet)

Page 25: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Recurrent DRUnet

Page 26: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Teach the network how to locate landmark points

Page 27: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Dimension Reduction: Variational Autoencoder

Page 28: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

● Deep-Learning in data-scarce (eg. medical) settings:○ Many challenges and a few solutions○ Incorporating prior expert knowledge is crucial○ Intrinsic dimensionality is often not very high○ Finding good representations is (as always) crucial

● What about Glaucoma diagnosis:○ Current automated diagnosis have low predictive power○ Deep Learning is a potential game-changer

Conclusion:

Page 29: Glaucoma Diagnosis - Nvidiaimages.nvidia.com/.../Deep-Learning-for-Early-Glaucoma-Detection.pdf · Glaucoma Diagnosis Alexandre THIERY Department of Statistics & Applied Probability

Thanks!

Any [email protected]