Top Banner
1 Lead. researcher, Dr.sc.ing. Dmitrijs Bļizņuks 13th International Young Scientist conference “Developments in Optics and Communications” 6 April 2017 Riga Technical University Faculty of Computer Science and Information Technology Towards the Scalable Cloud Platform for Non-Invasive Skin Cancer Diagnostics
33

Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

Sep 21, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

1

Lead. researcher, Dr.sc.ing. Dmitrijs Bļizņuks

13th International Young Scientist conference “Developments in Optics and Communications”

6 April 2017

Riga Technical University

Faculty of Computer Science and Information Technology

Towards the Scalable Cloud Platform for Non-Invasive Skin Cancer Diagnostics

Page 2: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

2

Outlines

▪ Background

▪ Skin cancer

▪ Existing devices and approaches

▪ Proposed architecture

▪ Challenges and future plans

Page 3: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

3

3 / 33

▪ PhD in Engineering, thesis “Applying Sensor Networks Technologies

in Time Critical Applications”

▪ Research interests in wireless networks, embedded systems and

industrial automation

▪ Cooperation with Biophotonics laboratory (Latvian Univertsity) from

2013 in the field of skin cancer diagnostics

▪ Ongoing project with Biophotonics laboratory “Portable Device for

Noncontact Early Stage Skin Cancer Diagnostics”

Background

Background Skin cancer Existing Proposal Challenges

Page 4: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

4

4 / 33 Background Skin cancer Existing Proposal Challenges

Age-adjusted death rates for selected leading causes of death: United States, 1958–2014

Page 5: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

5

5 / 33 Background Skin cancer Existing Proposal Challenges

Changes in the risk of dying from cancer, 2010 relative to 2000

Page 6: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

6

6 / 33

1.2

1.5

1.5 1

.6

2

1.9

2.3

2.1

1.9

2.1

2.9

2.3

3.4

3.2

2.2

3.3

2.7

2.7

3

3.3

3.5

3.3

4.3

1988 1991 1994 1997 2000 2003 2006 2009

Death

s p

er

100 0

00

Melanoma mortality rate

K. Azarjana, A. Ozola, D. Ruklisa, I. Cema, A. Rivosh, A. Azaryan, and D. Pjanova, "Melanoma epidemiology, prognosis and trends in Latvia,"

J. Eur. Acad. Dermatol. Venereol. 27(11), pp. 1352-1359, November 2013

Background Skin cancer Existing Proposal Challenges

Page 7: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

7

7 / 33 Background Skin cancer Existing Proposal Challenges

Page 8: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

8

8 / 33

”Almost 100% will survive their cancer

for 5 years or more after they are

diagnosed at Stage #1”

vs

“Almost 10% men and 25% women will

survive their cancer for 5 years or more

after they are diagnosed at Stage #4”

Background Skin cancer Existing Proposal Challenges

*Statistical Information Team at Cancer Research UK

Page 9: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

9

9 / 33

How to detect melanoma?

Background Skin cancer Existing Proposal Challenges

Biopsy – 100%

Easy ?

Page 10: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

10

10 / 33

No!

Background Skin cancer Existing Proposal Challenges

Page 11: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

11

11 / 33 Background Skin cancer Existing Proposal Challenges

Dermatologist or self screening

Page 12: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

12

12 / 33

▪ Regular full body analysis

▪ According to SCREEN project in the German state of Schleswig-

Holstein, state achieved reduction for 48% in deaths due to skin

cancer

▪ Same results were not achieved on the national level

▪ Possible reason — lack of dermatologists

Availability of diagnostics

Background Skin cancer Existing Proposal Challenges

Page 13: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

13

13 / 33

Wavelengths’ penetration depth

Background Skin cancer Existing Proposal Challenges

Page 14: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

14

14 / 33

Optical Density spectra of skin lesions

Background Skin cancer Existing Proposal Challenges

D.Jakovels et al. Application of principal component analysis to multispectral imaging data for evaluation of pigmented skin

lesions, Proc. SPIE 9032, Biophotonics—Riga 2013, 903204 (November 18, 2013)

Page 15: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

15

15 / 33

▪ Natural (RGB) images are visually similar

▪ Multispectral analysis allows noticeable differentiation in healthy and

skin with pathology

Example of analysis

Background Skin cancer Existing Proposal Challenges

Page 16: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

16

16 / 33

What kind of equipment is available

for diagnostics?

Background Skin cancer Existing Proposal Challenges

KaWe Med ©

DermDOC ©MoleMAX ©

DermLite © Schuco ©

Page 17: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

17

17 / 33

Imaging equipment

— High price,

— Not portable,

— Proprietary hardware and softwareMoleMax ©

DermDOC ©

Background Skin cancer Existing Proposal Challenges

Page 18: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

18

18 / 33

Low cost portable equipment

Portable, affordable Hard to update and support

J.Spigulis et al. SkImager: a concept device for in-vivo skin assessment by multimodal imaging, Proceedings of

the Estonian Academy of Sciences, 2014, 63, 301–308

Background Skin cancer Existing Proposal Challenges

Page 19: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

19

19 / 33

Further steps

Background Skin cancer Existing Proposal Challenges

PC as visualization

and processing unit

Page 20: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

20

20 / 33

▪ Smartphone as image source

▪ Images analyzed by dermatologists

▪ Image quality and illumination

features are limited by smartphone

Further steps

Background Skin cancer Existing Proposal Challenges

Page 21: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

21

21 / 33

Supercomputer power

Background Skin cancer Existing Proposal Challenges

Page 22: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

22

22 / 33

Smartphone with

additional module for

illumination

Further steps

Background Skin cancer Existing Proposal Challenges

Page 23: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

23

23 / 33 Background Skin cancer Existing Proposal Challenges

SkImager

• Illumination

• Imaging

• Processing

• Displaying

«+»• All in one

• No extras

«-»• Limited CPU

power

• Special

processing

techniques

• Hard to change

hardware

Proposal

• Illumination

• Imaging

• Processing

• Displaying

• Transmittion

«+»• Quick module

changing

• Flexible

displaying

«-»• Need for some

displaying

device

Page 24: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

24

24 / 33

▪ Portable

▪ Easy to use

▪ Quick prototype transition from lab to user

▪ Easy exchange of modules

▪ Fast implementation of processing algorithms

▪ No limitation on processing power

Proposals

Background Skin cancer Existing Proposal Challenges

Page 25: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

25

25 / 33

Proposed system

Background Skin cancer Existing Proposal Challenges

D.Bļizņuks, D.Jakovels, I.Saknite, J.Spigulis “Mobile platform for online processing of multimodal skin

optical images”

Focusing spacer

Camer with lens

LEDs ring

Control unit Battery

Control unit

Page 26: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

26

26 / 33

Proposed system

Background Skin cancer Existing Proposal Challenges

*Dr.phys. I.Kuzmina

Page 27: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

27

27 / 33

Proposed system

Background Skin cancer Existing Proposal Challenges

D.Bļizņuks, D.Jakovels, I.Saknite, J.Spigulis “Mobile platform for online processing of multimodal skin optical images”

1 LED fluorescence –

405nm

3 LEDs diffuse reflection

535 / 640 / 950 nm

IDS camera

1 – 5 MPix

Control unit

(Raspberry Pi)

WiFi module

(Access Point)

Battery (>8 hours of

service) IDS camera driver

forms video stream

WEB server

forms real time

video stream

Remote Matlab

servers

Page 28: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

28

28 / 33 Background Skin cancer Existing Proposal Challenges

Cloud processing

1. Local test server

2. Amazon S3 cloud

3. Private cloud (eg.

RTU HPC)

*Dr.sc.ing. P.Osipovs

Page 29: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

29

29 / 33

Image examples

Background Skin cancer Existing Proposal Challenges

RGB

405

nm

535

nm

660

nm940

nm

Page 30: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

30

30 / 33

Photobleaching (405nm)

Background Skin cancer Existing Proposal Challenges

I.Ferulova,A.Rieba,J.Lesins,A.Berzina,A.Lihachev,J.Spigulis Portable device for skin autofluorescence photobleaching measurements

Page 31: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

31

31 / 33

Nonuniform illumination

Background Skin cancer Existing Proposal Challenges

405nm

*Dr.phys. I.Kuzmina

Page 32: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

32

32 / 33

Intensity drift due to temperature

Background Skin cancer Existing Proposal Challenges

*Dr.phys. I.Kuzmina

Page 33: Towards the Scalable Cloud Platform for Non-Invasive Skin ...€¦ · 27 27 / 33 Proposed system Background Skin cancer Existing Proposal Challenges D.Bļizņuks, D.Jakovels, I.Saknite,

33

33 / 33

Research funded by ERAF project 1.1.1.1/16/A/197

Projekts Nr: 1.1.1.1/16/A/197

„Portatīva ierīce ādas vēža agrīnai bezkontakta diagnostikai”