Top Banner
Energy expenditure estimation with wearable accelerometers Mitja Luštrek, Božidara Cvetković and Simon Kozina Jožef Stefan Institute Department of Intelligent Systems Slovenia
39

Energy expenditure estimation with wearable accelerometers

Feb 25, 2016

Download

Documents

Angelo Ferrillo

Energy expenditure estimation with wearable accelerometers. Mitja Luštrek, Božidara Cvetković and Simon Kozina Jožef Stefan Institute Department of Intelligent Systems Slovenia. Introduction. Motivation: Chiron project – monitoring of congestive heart failure patients - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Energy  expenditure estimation with wearable accelerometers

Energy expenditure estimation with wearable accelerometers

Mitja Luštrek,Božidara Cvetković and Simon Kozina

Jožef Stefan InstituteDepartment of Intelligent Systems

Slovenia

Page 2: Energy  expenditure estimation with wearable accelerometers

Introduction

• Motivation:– Chiron project – monitoring of

congestive heart failure patients– The patient’s energy expenditure (= intensity of

movement) provides context for heart activity

Page 3: Energy  expenditure estimation with wearable accelerometers

Introduction

• Motivation:– Chiron project – monitoring of

congestive heart failure patients– The patient’s energy expenditure (= intensity of

movement) provides context for heart activity• Method:– Two wearable accelerometers → acceleration– Acceleration → activity– Acceleration + activity → energy expenditure

Machine

learning

Page 4: Energy  expenditure estimation with wearable accelerometers

Measuring human energy expenditure

• Direct calorimetry– Heat output of the patient– Most reliable, laboratory conditions

Page 5: Energy  expenditure estimation with wearable accelerometers

Measuring human energy expenditure

• Direct calorimetry– Heat output of the patient– Most reliable, laboratory conditions

• Indirect calorimetry– Inhaled and exhaled oxygen and CO2

– Quite reliable, field conditions, mask needed

Page 6: Energy  expenditure estimation with wearable accelerometers

Measuring human energy expenditure

• Direct calorimetry– Heat output of the patient– Most reliable, laboratory conditions

• Indirect calorimetry– Inhaled and exhaled oxygen and CO2

– Quite reliable, field conditions, mask needed• Diary– Simple, Unreliable, patient-dependant

Page 7: Energy  expenditure estimation with wearable accelerometers

Measuring human energy expenditure

• Direct calorimetry– Heat output of the patient– Most reliable, laboratory conditions

• Indirect calorimetry– Inhaled and exhaled oxygen and CO2

– Quite reliable, field conditions, mask needed• Diary– Simple, Unreliable, patient-dependant

Wearable accelerometers

Page 8: Energy  expenditure estimation with wearable accelerometers

Hardware

Co-located with ECG

One placement to be selected

Page 9: Energy  expenditure estimation with wearable accelerometers

Hardware

Co-located with ECG

One placement to be selected

Shimmer sensor nodes• 3-axial accelerometer @ 50 Hz• Bluetooth and 802.15.4 radio• Microcontroller• Custom firmware

Page 10: Energy  expenditure estimation with wearable accelerometers

Hardware

Co-located with ECG

One placement to be selected

Shimmer sensor nodes• 3-axial accelerometer @ 50 Hz• Bluetooth and 802.15.4 radio• Microcontroller• Custom firmware

Android smartphone

Bluetooth

Page 11: Energy  expenditure estimation with wearable accelerometers

Training/test dataActivityLyingSittingStandingWalkingRunningCyclingScrubbing the floorSweeping...

Page 12: Energy  expenditure estimation with wearable accelerometers

Training/test dataActivity Energy expenditureLying 1.0 METSitting 1.0 METStanding 1.2 METWalking 3.3 METRunning 11.0 METCycling 8.0 METScrubbing the floor 3.0 METSweeping 4.0 MET...

1 MET = energyexpendedat rest

Recordedby fivevolunteers

Page 13: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

Sliding window (2 s)

Page 14: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

Sliding window (2 s)

f1 f2 f3 ... Activity

Training

Machine learning

AR Classifier

Page 15: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

f1 f2 f3 ...

Use/testingActivity

Sliding window (2 s)

AR Classifier

Page 16: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

ActivityAR Classifier

Page 17: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

Sliding window (10 s)

ActivityAR Classifier

Page 18: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

Sliding window (10 s)

f’1 f’2 f’3 ... Activity EE

Training

Machine learning (regression)

EEE Classifier

ActivityAR Classifier

Page 19: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

Sliding window (10 s)

f’1 f’2 f’3 ... Activity

Use/testing

EEE Classifier

ActivityAR Classifier

EE

Page 20: Energy  expenditure estimation with wearable accelerometers

Machine learning procedureat at+1 at+2 ... Acceleration data

EEEnergy expenditure

Page 21: Energy  expenditure estimation with wearable accelerometers

Features for activity recognition

• Average acceleration• Variance in acceleration• Minimum and maximum acceleration• Speed of change between min. and max.• Accelerometer orientation• Frequency domain features (FFT)• Correlations between accelerometer axes

Page 22: Energy  expenditure estimation with wearable accelerometers

Features for energy expenditure est.

• Activity• Average length of the acceleration vector• Number of peaks and bottoms of the signal

Page 23: Energy  expenditure estimation with wearable accelerometers

Features for energy expenditure est.

• Activity• Average length of the acceleration vector• Number of peaks and bottoms of the signal• Area under acceleration• Area under gravity-subtracted acceleration

Page 24: Energy  expenditure estimation with wearable accelerometers

Features for energy expenditure est.

• Activity• Average length of the acceleration vector• Number of peaks and bottoms of the signal• Area under acceleration• Area under gravity-subtracted acceleration• Change in velocity• Change in kinetic energy

Page 25: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 26: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 27: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 28: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 29: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 30: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Page 31: Energy  expenditure estimation with wearable accelerometers

Sensor placement and algorithm

Linear regression

Support vector regression

Regression tree

Model tree

Neural network

Chest + ankle 5.09 3.29 1.41 2.18 1.65

Chest + thigh 6.75 3.68 1.58 2.38 1.66

Chest + wrist 6.75 3.94 1.30 4.95 1.39

Mean absolute error in MET

Lowest error, poor extrapolation, interpolation

Second lowest error, better

flexibility

Page 32: Energy  expenditure estimation with wearable accelerometers

Estimated vs. true energyAverageerror:1.39 MET

Page 33: Energy  expenditure estimation with wearable accelerometers

Estimated vs. true energy

Low intensity

Moderateintensity

Running, cycling

Averageerror:1.39 MET

Page 34: Energy  expenditure estimation with wearable accelerometers

Estimated vs. true energy

Low intensity

Moderateintensity

Running, cycling

Averageerror:1.39 MET

Page 35: Energy  expenditure estimation with wearable accelerometers

Multiple classifiers

Activity

AR Classifier

Page 36: Energy  expenditure estimation with wearable accelerometers

Multiple classifiers

Activity

AR Classifier

GeneralEEE Classifier

EECyclingEEE Classifier

RunningEEE Classifier

Activity = cycling

Activity = running

Activity = other

Page 37: Energy  expenditure estimation with wearable accelerometers

Estimated vs. true energy, multiple cl.

Low intensity

Moderateintensity

Running, cycling

Averageerror:0.91 MET

Page 38: Energy  expenditure estimation with wearable accelerometers

Conclusion

• Energy expenditure estimation with wearable accelerometers using machine learning

• Study of sensor placements and algorithms• Multiple classifiers: error 1.39 → 0.91 MET

Page 39: Energy  expenditure estimation with wearable accelerometers

Conclusion

• Energy expenditure estimation with wearable accelerometers using machine learning

• Study of sensor placements and algorithms• Multiple classifiers: error 1.39 → 0.91 MET

• Cardiologists judged suitable to monitor congestive heart failure patients

• Other medical and sports applications possible