Surgeon Assistive Augmented Reality Model with the use of Endoscopic Camera for Line of Vision Calculation

Surgeon Assistive Augmented Reality Model with the use of Endoscopic Camera for Line of Vision Calculation

Anastasia Daskalaki, Kostas Giokas, Dimitris Koutsouris
Copyright: © 2013 |Pages: 17
DOI: 10.4018/978-1-4666-3994-2.ch034
OnDemand:
(Individual Chapters)
Available
$37.50
Current Special Offers
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

In this paper, the authors describe a surgeon assistive Augmented Reality (AR) model for endoscopic procedures. They analyze the main parts of the model and the processes that need to be established such as, the registration of the patient, the segmentation of medical data, their 3D reconstruction, and the detection of endoscopic instruments and the camera. The authors present two graphical user interfaces, build to serve the needs of segmentation, navigation, and visualization of the final intra-operative scene. By using preoperative data of the patient (MRI-CT) and image processing techniques, the authors can provide a unique view of the surgical scene. The potentials and the advantages of endoscopic-robotic surgeries nowadays can be improved. Augmented surgery scenes with information about the patients underline structures, enables wider situation awareness, precision, and confidence.
Chapter Preview
Top

Augmented Reality

Augmented reality (AR) is considered an extension of Virtual reality field. In 1994, Milgram and Kishino (1994) described the “Reality-Virtuality Continuum” in which AR is a part of a general category named Mixed reality. The main deference between AR and Virtual reality is in the background of the scene. Virtual reality acts in a virtual environment in contrast with AR which acts in a real environment. AR is a live view of a real-world environment that a human being can realize through his senses, whose elements are augmented by virtual information produced by computer-generated systems (Azuma, 1997; Bimber & Raskar, 2005; Valino, 1998; Starner et al., 1997). In order to construct a space where real and virtual world coexist, AR has to follow three basic properties (Azuma et al., 2001):

  • 1.

    Harmonic synthesis between real and virtual elements, into a real environment.

  • 2.

    Interactive in real-time environment.

  • 3.

    Registration between real and virtual elements.

Augmented Reality in Surgery

This survey focuses on AR implementations in surgery. AR has a lot of applications and surgery is a field that can significantly benefit from the growing of this technology. More specific surgical training, pre-operative planning, intra-operative navigation and augmented imaging are some fields that have been aided by AR. Utilizing augmented reality for applications in surgery has been a topic of intense research for several years. A lot of surveys have been written and a lot of systems have been developed, in this direction (Grimson et al., 1996; Raya et al., 2003; Hattori et al., 2003; Khamene et al., 2003; Janin et al., 2000). Currently, the surgeon must convert the 2D tomographic views to a 3D representation and merge it in his mind with what he physically sees. Also has to constantly change his view away from the patient in order to observe and compare the operative image with the tomographic images. AR allows the surgeon to preserve a steady field of vision on the surgical field, because does both the 2D to 3D transformation and projects the views directly onto the patient view.

Complete Chapter List

Search this Book:
Reset