Dr. M. Ciucci 1 Intraoperative Endoscopic Augmented Reality in Third Ventriculostomy Meeting 10.03.2010 Dr. M. Ciucci Institute for Process Control and Robotics (IPR) Karlsruhe Institute of Technology (KIT)
Jun 26, 2015
Dr. M. Ciucci 1
Intraoperative Endoscopic Augmented Reality in Third
Ventriculostomy
Meeting 10.03.2010
Dr. M. Ciucci
Institute for Process Control and Robotics (IPR)Karlsruhe Institute of Technology (KIT)
Dr. M. Ciucci 2
1. Medical Introduction
2. Technical Introduction
3. Project Setup4. Project Results
Agenda
Dr. M. Ciucci 3
Medical Introduction
Dr. M. Ciucci 4
Minimally Invasive Surgery: key-hole surgery carried out through a cavity or an anatomical opening which uses endoscopic devices with indirect observation of the surgical field.
Medical Introduction
Neurosurgery: surgery discipline focused on the central nervous system, peripheral nervous systems and spinal column. Neuroendoscopy: neurosurgical MIS technique where an endoscope is inserted into the patient’s brain.
Dr. M. Ciucci 5
Ventricularsystem
Base of the third
ventricle: fenestration
point
Endoscopic Third Ventriculostomy
Dr. M. Ciucci 6
Find 3rd ventricle floorLocate the entrance pointPerform the fenestrationCheck the fenestration
ETV: Surgeon’s view
Dr. M. Ciucci 7
Technological Introduction
Dr. M. Ciucci 8
The operation room: surgical navigation
Source: Biomedical Optics & Medical Imaging An open source software toolkit for image-guided surgery
Kevin Cleary, Luis Ibanez, David Gobbi, and Kevin Gary
Dr. M. Ciucci 9
Surgical Navigation: simplified version
Tracking systemEndoscope
Surgical Navigation
Image from “Three-Dimensional Reconstruction and Surgical Navigation In Pediatric Epilepsy Surgery”, Chabrerie A. et alii, 1998.
Patient rigid body
Dr. M. Ciucci 10
The NEAR Project
Dr. M. Ciucci 11
The NEAR Project
NEAR: Neuroendoscopy towards Augmented Reality
Goal: build a navigation software with AR support for ETV
Dr. M. Ciucci 12
Material and Methods
Optical Tracking system
Endoscope and camera
Image Source: “Three-Dimensional Reconstruction and Surgical Navigation In Pediatric Epilepsy Surgery”, Chabrerie A. et al., 1998.
Surgical phantom
NDI Polaris, IR passive tools,60 Hz 0.35 mm
R. Wolf single port endoscope, 6 mm, 0 °Sumix M72 2M 48fps + C-mountLucy, neurosurg. Phantom(courtesy of Prof. Dr. C. R. Wirtz and Dr. Paraskevopoulos)
Dr. M. Ciucci 13
System Setup
Dr. M. Ciucci 14
System Overview
Calibration
Simulation
Dr. M. Ciucci 15
Results
Dr. M. Ciucci 16
Augmented Reality
Dr. M. Ciucci 17
Triangulation
1. Track pose 2. Triangulation2. Track features (LTK optical flow)
Dr. M. Ciucci 18
Local Triangulation
Dr. M. Ciucci 19
NEAR
Thank you for your attention.
Acknoledgements:
Prof. H. Woern, Dr. J. Raczkowsky, University of Karlsruhe (TH), Germany; Prof. C. R. Wirtz and Prof. M.-E. Halatsch, Neurosurgical Dept. of Ulm and Günzburg, Germany; the EU for the Marie Curie FP6; the R. Wolf Company for the endoscopes; the SPL of Boston for the image of 3D Slicer and the model of the brain ventricles.