HapticMed Presentation

HapticMed – Haptic Interfaces in Medical Applications

Dorin Mircea Popovici

Faculty of Mathematics and InformaticsOvidius University of Constanta

Programul Operaţional Sectorial “Creşterea Competitivităţii Economice”“Investiţii pentru viitorul dumneavoastră”

cofinanţat prin Fondul European de Dezvoltare Regională

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Outline

Introducing CERVA team Background Practice-based Learning – Surgery Haptic User Interfaces – Architecture Surgical Training Application Acknowledgements

Introducing CERVA team

UOC

Applying Virtual and Augmented Reality technologies in virtual environments dedicated to education, training and cultural heritage

Education & Research

CERVA’s mission

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Education Undergraduate

Computer graphics Programming languages IA

Master Virtual and Augmented reality Human-Computer multimodal interfaces MAS Behavioral modeling and simulation in VE Ubiquitous interfaces

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Research HapticMed 2010 – 2013 Emulaction 2008-2010 TOMIS 2007 – 2010 VirDenT 2008 – 2011 Venus 2007 – 2008 EVE 1998 – 2005

INTUITION 2004 – 2008

HapticMed @ CERV http://www.cerva.ro 26.04.2012

3DS Max, VRML Pad, Poser, Matlab AReVi, Blender 3D

MAS, ontology, 3D, behaviors, speech recognition

6 infrared Motion Capture System (Motion Analysis) Active stereoscopic System (projection + desktop), HMD Phantom Omni, SpaceMouse Color + Laser 3D scanning system handheld MicroScribe

arm

Handmade (Navoramique)

Technology insights

HapticMed @ CERV http://www.cerva.ro 26.04.2012

CERVA team

HapticMed @ CERV http://www.cerva.ro 26.04.2012

UTBV – Brasov (RO) ENIB - France MINAC – Constanta (RO)

CERV - France

SC.NR.TECH.SRL – Brasov (RO) SENSEGRAPHICS – Sweden UBISOFT (RO)

Partners

HapticMed @ CERV http://www.cerva.ro 26.04.2012

ICVL – International Conference on Virtual Learning (2006 - :)

Events

HapticMed @ CERV http://www.cerva.ro 26.04.2012

VR Summer schools (august-september)

Human resources exchanges (students, masters, PhD researchers, professors)

Research frameworks (PN, POSCCE, FP, NFS, …)

Collaboration means

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Programul Operaţional Sectorial “Creşterea Competitivităţii Economice”“Investiţii pentru viitorul dumneavoastră”

cofinanţat prin Fondul European de Dezvoltare Regională

HapticMed Haptic Feedback in Medical Applications

Project Director: Felix G. Hamza-LupArmstrong Atlantic State University

Executive Director: Dorin M. Popovici

Background

Haptic - sense of touch – bidirectional (I/O)

Has 2 components: Tactile Force/torque feedback

Haptic Devices – simulate sense of touch

6 force/torque DOF feedback system offers: 3 – force – translations 3 – torque – rotations

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Practice-based Learning – Surgery

Learning in a safe environment where mistakes can be safely made

Force/torque feedback can provide benefits (both passive and informational)

at little cost to cognitive demand because of its intuitive nature

refine the required skills until the operator reaches a target level of proficiency before commencing training via the traditional apprentice model upon patients

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Haptic User Interfaces – Architecture Input InputOutputOutputHard

ware

Graphic API

GLUT

Haptic API SpaceMouse SDK Input Driver

HapticMed Prototype

Multimodal output Multimodal input

Simulation engine

Persistence management

Database Management

Software OpenGL

HapticMed @ CERV http://www.cerva.ro 26.04.2012

AReVi

Haptic User Interfaces – Visual Component

OpenGL industrial standard robust

X3D open standard MedX3D advancing fast Web enabled

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Haptic User Interfaces – Haptic Component

CHAI3D ReachIn OpenHaptics SOFA Gipsi

H3D

X3D Python

H3DAPI Scene graph nodes

Fields

OpenGL HAPI

Graphics devices Haptic devices

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Surgical Training Application

Set of tools for basic surgical skill acquisition

First module Liver Diagnostics through Palpation

Liver palpation can be used in diagnostics of: increased diaphragmatic descent; presence of a palpable caudate or Riedel's lobe; presence of emphysema with an associated depressed

diaphragm; thin body habitus with narrow thoracic cage; fatty infiltration (enlarged with rounded edge); active hepatitis (enlarged and tender); cirrhosis (enlarged with nodular irregularity); hepatic neoplasm (enlarged with rock-hard or nodular

consistency).

HapticMed @ CERV http://www.cerva.ro 26.04.2012

Prepare your popcorn…

Prepare your popcorn…

Do you really have questions?

http://www.cerva.ro

Do you still have popcorn?