Top Banner
Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven Belgium Philips Eindhoven April 11 2008
51

Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

Jul 19, 2018

Download

Documents

TrươngTuyến
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

Realizing real time monitoring and controlling bio-signals

Daniel BerckmansM3 – BIORES

Katholieke Universiteit LeuvenBelgium

Philips EindhovenApril 11 2008

Page 2: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN2

Ing. KAREL DE BODT

2

Head: Prof. Daniel Berckmans

K.U.Leuven DIVISION M3-BIORESMeasure, Model and Manage Bioresponses

Ir. VO TAN THANH

Ir. NILA ALBAN

Dr. TADIWOS ZERIHUN DESTA

Ir. SEZIN EREN OZCAN

Ir. SARA FERRARI

Ir. JAN DEKOCK

Ir. TOON LEROY

Ir. JORIS LEFEVER

Ir. GUIDO DE BRUYNE

Ir. KRISTIEN VAN LOON

Prof. JEAN-MARIE AERTS

Prof. ERIK VRANKEN

Ir. OZLEM CANGAR

Ir. SONG XIANGYU

Ir. X

Ir. X

Dr. Claudia Bahr

Technical assistance

PRIVATE COMPANIES

LUDO HAPPAERTS

Ing. JEAN-LOUIS LEMAIRE

Imperfectly mixed fluids Bioresponses 1 Process output & environment

SecretaryANN VAN

GINDERACHTER

Ir. DRAGANA MILJKOVIC

Ir. PIETER SCHIEPERS

Dr. STIJN QUANTEN

CoordinatorsBioresponses 2

Ir. SEBASTIAN DE BOODT

BioRICS NV, Belgium

Ir. X

BioRICS NVIr. KIM BATSELIER

Ir. FREDERIK JANSEN

Ing. MIHAJLO MILUTINOVIC

Ir. X

Ir. X

Ir. X

Ir. X

Dr. VASILEIOS EXADAKTYLOS

Ir. MITCHELL SILVA

Sound analysis and bioresponses

Ir. X

Page 3: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3

BioRICS n.v.

- 2006:

- K.U. Leuven, LRD (o1972): 56 spin-offse.g. LMS, Ubizin, Thromb-X, ....

Page 4: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN4

Problem• Livestock farming in the past …

Farmer had the time to use audio-visual scoring

Page 5: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN5

•Today however…

Low price of product

High number of animals

More welfare problemsLess available time per animal

Page 6: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN6

Market numbers

258 million ton meat/year

7 billion pigs

40 billion chicken

Page 7: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN77

A living organism:Complex

Page 8: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN88

Complex Individual

Hea

rtbe

at (b

pm)

Time (s)

A living organism:

Page 9: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN9

Identical Individually different

Page 10: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1010

Complex Individual Time-Varying

A living organism:

TIME (HOURS)

0 1 2 3 4 5

HEA

T PR

OD

UC

TIO

N (W

/KG

)

11

12

13

14

15

16

17

MEASUREDMODELLED (1ST ORDER)MODELLED (2ND ORDER)

5 days old

TIME (HOURS)

0 1 2 3 4 5

HEA

T PR

OD

UC

TIO

N (W

/KG

)7

8

9

10

11

12

13

MEASUREDMODELLED (1ST ORDER)

30 days oldExample: Heat production of broiler chickens

Different model order

Page 11: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1111

Complex Individual Time-Varying Dynamic

A living organism:

Measure

Model

Manage

In an on-line way

Living organism = CITD - system

Complex Individual Time-Varying Dynamic

M3-BIORES

Page 12: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1212

What happens today in other process control

Page 13: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1313

Desired direction

General methodology: Conditions for process control

1FEEDBACK

2PREDICTION

MODEL-BASED CONTROLLER

3

ProcessPosition Steering

wheel Direction

MEASUREMEASURE

Page 14: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN14

Control of “Biological Responses”

MODEL BASED CONTROLLER

DESIRED BIORESPONSE

DYNAMICBIORESPONSE

MICRO-ENVIRONMENT

Process

1FEEDBACK

PREDICTION

2

3

Page 15: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1515

Examples

Page 16: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN16

Control of the crawl trajectory of larvae of Calliphora vicina

Page 17: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1717

Light intensity crawl trajectory

Control of the crawl trajectory of larvae of Calliphora vicina

Page 18: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1818

t t

y(t)u(t)

Response of crawl direction to variations in ligth

Light intensity crawl trajectory

MEASURE MEASURE

Page 19: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN1919

-45.00

0.00

45.00

90.00

135.00

180.00

225.00

270.00

315.00

360.00

0 3 6 9 12 15 18 21 24 27 30 33 36

Time

Cra

wl d

irect

ion

(°)

270.00 180.00 12.55

315.00 270.00 9.72

45.00 90.00 13.59

90.00 180.00 15.77

225.00 90.00 12.77

135.00 270.00 9.60

0.00 0.00 15.60

180.00 0.00 15.61

Responses of crawl direction to steps in light direction

Page 20: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN2020

PREDICTION

Light intensity crawl trajectory

FEEDBACK

MODEL-BASED CONTROLLER

Active control of crawl direction of larvae

MEASURE MEASURE

Page 21: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN2121

Active control of crawl direction of 6 larvae

Page 22: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN22

Control of the growth trajectory of chickens

Page 23: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN23

Day 1

Day 42

Weight

40 g

> 2000 g

Problems!

Leg disordersAscitesSudden death syndrome…

Active on-line growth trajectory control• Chickens

Page 24: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN24

Possible solution:Growth restriction + compensatory growth

= growth control

Day 1 Day 42

Weight

Growth restrictionCompensatory growth

Page 25: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN25

Control diagram

TemperatureLight scheduleFeed quantityFeed quality

Weight trajectory

t

Prediction

Model

Model based controller

Feedback

Page 26: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN26

EXP2001-3 - afdeling2

Tijd (dagen)0 10 20 30 40

Gew

icht

(gra

m)

0

500

1000

1500

2000

2500

Gestuurd groeitrajectReferentie groeitrajectGroeitraject controle groep

Time (days)

Wei

ght (

gram

s)

Controlled growth trajectoryReference growth trajectoryGrowth trajectory of control group

PLF control results in reduction of mortality (12 exp, 2900 animals each) of 4%

∆ = 3.7% - 6.0%

Page 27: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN27

Optimisation of physicaltraining of race horses

Page 28: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN28

v

Heart rate

Lactate conc.

VO2

Running speed Heart rate

Optimisation of physical training of race horses

Page 29: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN29

Polar equine HR monitor

Sensors

Garmin forerunner GPS

Page 30: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN30

Velocity and Heart rate - Kyrielle (Bert) 01-01

0

5

10

15

20

25

30

0:00:00 0:05:00 0:10:00 0:15:00 0:20:00 0:25:00

time (u:mm:ss)

velo

city

(km

/u)

0

20

40

60

80

100

120

140

hear

t rat

e (b

pm)

VelocityHeart rate

Optimisation of physical training of race horses

Page 31: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN31

40

50

60

70

80

90

100

110

120

0:00:00 0:10:00 0:20:00 0:30:00 0:40:00 0:50:00 1:00:00

time(h:mm:ss)

hear

t rat

e (b

pm

Controlled heart rateTarget heart rate

Optimisation of physical training of race horses

Page 32: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN32

Time-constant of HR over time

0

10

20

30

40

50

60

70

Week 0 Week 1 Week 2 Week 3 Week 4Time (date)

TC (s

ec)

TC

Optimisation of physical training of race horses

Page 33: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3333

Model based monitoring of physical & mental performance

(AC Milan)

Page 34: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3434

Physical trainingPhysical

performance

Perf

orm

ance

Total performance = a. Mental performance + b. Physical performance

Mental performance

Mental training

Process

CITD

CITD

Page 35: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3535

Training exercises Performance

Body

Process

MEASURE(Inmotio)

MEASURE(Inmotio + Hosand)

Page 36: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3636

Heart Rate

Physical Activity

Reference mental status

???

Time

On-line mental monitor

Mental algorithm

Mental monitoring

Page 37: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3737

MINDROOM

Reference mental status

Page 38: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3838

Demo: mental monitoring

Page 39: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN3939

Mindroom data (1133 and 1156)

-1.5

-1

-0.5

0

0.5

1

1.5

27/0

3/20

06

31/0

3/20

06

3/4/

2006

7/4/

2006

13/4

/200

6

19/4

/200

6

24/4

/200

6

27/4

/200

6

1/5/

2006

2/5/

2006

3/5/

2006

4/5/

2006

10/5

/200

6

27/0

3/20

06

31/0

3/20

06

7/4/

2006

11/4

/200

6

Date (ddmmyy)

Men

tal s

tatu

s [

pos,

neg

or n

eutr

al]

MINDROOM

11561133

Mindroom vs. Mental algorithm

Page 40: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN4040

Mindroom vs. Mental algorithmMental algo vs Mindroom

-1.5

-1

-0.5

0

0.5

1

1.5

27/0

3/20

06

31/0

3/20

06

3/4/

2006

7/4/

2006

13/4

/200

6

19/4

/200

6

24/4

/200

6

27/4

/200

6

1/5/

2006

2/5/

2006

3/5/

2006

4/5/

2006

10/5

/200

6

27/0

3/20

06

31/0

3/20

06

7/4/

2006

11/4

/200

6

Date (ddmmyy)

Men

tal s

tatu

s [

pos,

neg

or n

eutr

al]

MINDROOM

MENTAL ALGO

11561133

Page 41: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN4141

Physical trainingPhysical

performance

Perf

orm

ance

Total performance = a. Mental performance + b. Physical performance

Mental performance

Mental training

Real-time process control

CITD

BioRICS

BioRICSCITD

Page 42: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN4242

Application Examples

Page 43: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN43

Stressmonitoring

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

Page 44: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN44

Monitoring and control of physical performance

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

Page 45: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN45

Weight Control

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

Page 46: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN46

Driver Sleepiness

Temperature sensorECG

BioRICS serverUSB

transceiver

Pedal + steer input

Page 47: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN47

Bidirectional Wireless link 2

Bidirectional Wireless link 1

Sensor Modules Central ModuleECG module

Accelerometer module1

Accelerometer module 3

…PDA

orMobile w

ww

.bio

rics.

com

Temp. module

Central Module :

• Transceiver connected to PDA or mobile (mini-USB)

• Responsible for synchronization of the signals from the different sensor modules

General hardware scheme

2m

Page 48: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN48

ECG sensor module : sampling freq : 300 Hz

Temperature module : sampling freq : 1/60Hz (1 sample/minute)

Accelerometer modules : sampling freq : 200 Hz

g – range : 6g ; 10g ; 25g

└ Strongly dependent on application field

Bidirectional Wireless link 1 : wireless range : 2m

low power (e.g. recharging after 1 week)

Central Module : USB transceiver

Synchronization of the different signals form the sensor modules

Data transmission via mobile network to BioRICS server

Specifications

Page 49: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN49

Complex Algorithms (high level language, e.g. Matlab)

Low level language (C)

Translation

Compiler

Page 50: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN5050

10 Products

11 Patents

applications

Bicycle helmets

Race horses

Chickens

Mussels

Professional Cyclists

Intensive Care

ESA

Daphnia

Tubifex

Page 51: Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

M3-BIORES, K.U.LEUVEN5151

Thank you for your attention…

• For more information you can always check our website:

• http://www.m3-biores.be• http://www.biorics.com