Top Banner
MEDICAL MIRROR FOR NON CONTACT HEALTH MONITORING A Seminar Presentation By: Soumyashree M S (1VI08TE050)
20

Medical Mirror for Non Contact Health Monitoring 1 - Copy

Oct 24, 2014

Download

Documents

soumyashreems15
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Medical Mirror for Non Contact Health Monitoring 1 - Copy

MEDICAL MIRROR FOR NON CONTACT HEALTH MONITORING

A Seminar Presentation By: Soumyashree M S

(1VI08TE050)

Page 2: Medical Mirror for Non Contact Health Monitoring 1 - Copy

CONTENTS

• Introduction• Design• Study description and experimental setup• Measurement methodology• Advantages• Conclusion and future scope• Reference

Page 3: Medical Mirror for Non Contact Health Monitoring 1 - Copy

INTRODUCTION1. Digital medical devices promise to transform the detailed individual physiological

data.

2. Access and control over their own physiological data, they can play a more active role in the management of their health.

3. This revolution must take place in our everyday lives, not just in the Doctor’s office or research lab.

4. However, current techniques for physiological monitoring typically require users to strap on bulky sensors, straps etc.. This discourages regular use because the sensors can be uncomfortable.

5. In this work, a new mirror interface for real-time, Contact-free measurements of heart rate without the need for External sensors have been proposed.

6. Users can have the experience of remote health Monitoring by simply looking into

the medical mirror(cardio cam).

Page 4: Medical Mirror for Non Contact Health Monitoring 1 - Copy

PhD students of MIT Inventors of the medical mirror

Daniel J. McDuffRosalind W. PicardMing-Zher Poh

Mirrors are part of our another daily life, but with the combination of technology , mirrors too can be taken to level, so we intelligent mirror that can analyze your heart rate.

Page 5: Medical Mirror for Non Contact Health Monitoring 1 - Copy

EXPERIMENTAL SETUP

Built-in Webcam

Laptop

Finger BVP Sensor

Subject

BVP sensor

Page 6: Medical Mirror for Non Contact Health Monitoring 1 - Copy

• Uses a basic webcam embedded in a laptop to record the video for analysis.

• All videos are recorded in color(24-bit RGB with 3channels * 8bits /channel) at 15 frames per second(fps) with pixel resolution of 640*480and saved in AVI format on laptop.

• 12 participants b/w the ages of 18-31 yrs were enrolled for this study that was approved by MIT.

• For all experiments, FDA approved and commercially available BVP sensor was used to measure participants BVP signal via a finger probe at 256 Hz for validation.

• Participants were seated at a distance of approx. 0.5m from webcam. Two videos each lasting 1 min for measuring heart rate at rest and at motion respectively.

• Also recorded a video with multiple participants at a time.

Study description and experimental setup

Page 7: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Schematic of a Medical Mirror•To encourage people to keep track of their vital signs on a daily basis, They designed the Medical Mirror to provide a natural user interface. They also utilized an LCD monitor with a built-in webcam to provide an interactive display.

•A two-way mirror was fitted onto the frame to present a reflective surface for the users in normal lighting conditions.

•This design means the LCD monitor and webcam are not visible to the user.

•However, the user is visible to the webcam and the LCD monitor can be used to project information onto the reflective surface of the mirror.

•The monitor and webcam are connected to a laptop running the analysis software in real-time.

Page 8: Medical Mirror for Non Contact Health Monitoring 1 - Copy
Page 9: Medical Mirror for Non Contact Health Monitoring 1 - Copy

(a)The ROI is automatically detected using a face tracker. (b) the ROI is decomposed into RGB channels and spatially averaged to obtain (c) The raw RGB traces. ICA is applied on normal RGB traces to recover (d) three independent source signals .

Measurement Methodology

Page 10: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Recovery of cardiac pulse from a webcam video recording of a participant at rest

(a) 30 s raw RGB traces and (b) their respective power spectra. (c) The independent components recovered using ICA along with the reference finger BVP signal (d) Their respective power spectra. (e) (Media 1) A single-frame excerpt from the webcam video recording with localized ROI (white

box). (f) Evolution of the localized ROI over 1 min.

Page 11: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Bland-Altman plots demonstrating the agreement between 30s epoch heart rate measurements obtained from participants sitting at rest using finger BVP and(a) The raw green channel trace (black circles), (b) The proposed ICA method (red circles) The lines represent the mean and 95% limits of agreement

Page 12: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Recovery of the cardiac pulse from a webcam video recording of a moving participant.(a) 30 s raw RGB traces and (b) their respective power spectra. (c) The independent components recovered using ICA along with the reference finger BVP

signal and (d) Their respective power spectra. (e) (Media 1) A single-frame excerpt from the webcam video

recording with localized ROI (white box). (f) Evolution of the localized ROI over 1 min.

Page 13: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Bland-Altman plots demonstrating the agreement between 30s epoch heart rate measurements obtained from participants sitting at rest using finger BVP and(a) The raw green channel trace (black circles), (b) The proposed ICA method (red circles) The lines represent the mean and 95% limits of agreement

Page 14: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Simultaneous heart rate measurement of multiple participants

(a) (Media 3) A single-frame excerpt from the webcam video recording with the ROI for each participant highlighted (white boxes).

(b) Comparison between heart rate measurements obtained using the proposed methodology (colored lines) and a reference BVP sensor (black lines).

Page 15: Medical Mirror for Non Contact Health Monitoring 1 - Copy

ADVANTAGES• Low cost compares to other equipments.

• The Medical Mirror fits seamlessly into the ambient home environment, blending the data collection process into the course of daily routines when they use the mirror for shaving, brushing teeth, etc..

• This is beneficial for babies or for people with sensitive skin or burn wounds.

• The mirror approach is great because the technology is hidden and you don't even have to think about checking yourself; it just does it in the background.

• And if we advance the technology to get even more vital signs, the potential for tele-medicine is huge.

Page 16: Medical Mirror for Non Contact Health Monitoring 1 - Copy
Page 17: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Conclusion And Future Scope

• This concept describes a novel methodology for recovering the cardiac pulse rate from video recordings of the human face and implementation using a simple webcam with ambient daylight providing illumination.

• This is the first demonstration of a low-cost method for non-contact heart rate measurements that is automated and motion-tolerant.

• Moreover, this approach is easily scalable for simultaneous assessment of multiple people in front of a camera.

• Given the low cost and widespread availability of webcams, this technology is promising for extending and improving access to medical care.

Page 18: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Conclusion And Future Scope

• Although this concept only addressed the recovery of the cardiac

pulse rate, many other important physiological parameters such as respiratory rate, heart rate variability and arterial blood oxygen saturation can potentially be estimated using the proposed technique.

• Creating a real-time, multi parameter physiological measurement platform based on this technology will be the subject of future work.

Page 19: Medical Mirror for Non Contact Health Monitoring 1 - Copy

REFERENCES • [1] POH, M.-Z., MCDUFF, D.J. AND PICARD, R.W. 2010. Non-contact, Automated

Cardiac Pulse Measurements Using Video Imaging and Blind Source Separation. Optics Express, vol. 18, no. 10, 10762-10774.

• [2] S. Cook, M. Togni, M. C. Schaub, P. Wenaweser, and O. M. Hess, “High heart

rate: a cardiovascular risk factor?” Eur. Heart J. 27(20), 2387–2393 (2006). • [3] I. Pavlidis, J. Dowdall, N. Sun, C. Puri, J. Fei, and M. Garbey, “Interacting with

human physiology,” Comput. Vis. Image Underst. 108(1-2), 150–170 (2007). • [4] M. Garbey, N. Sun, A. Merla, and I. Pavlidis, “Contact-free measurement of

cardiac pulse based on the analysis of thermal imagery,” IEEE Trans. Biomed. Eng. 54(8), 1418–1426 (2007).

Page 20: Medical Mirror for Non Contact Health Monitoring 1 - Copy

Thank you for your

attention….

Any question

s??