A Prototype Holographic Augmented Reality Interface for Image-Guided Prostate Cancer Interventions

Simple item page
dc.contributor.authorMorales Mojica, Cristina M.en_US
dc.contributor.authorVelazco Garcia, Jose D.en_US
dc.contributor.authorNavkar, Nikhil V.en_US
dc.contributor.authorBalakrishnan, Shidinen_US
dc.contributor.authorAbinahed, Julienen_US
dc.contributor.authorEl Ansari, Waliden_US
dc.contributor.authorAl-Rumaihi, Khaliden_US
dc.contributor.authorDarweesh, Adhamen_US
dc.contributor.authorAl-Ansari, Abdullaen_US
dc.contributor.authorGharib, Mohameden_US
dc.contributor.authorKarkoub, Mansouren_US
dc.contributor.authorLeiss, Ernst L.en_US
dc.contributor.authorSeimenis, Ioannisen_US
dc.contributor.authorTsekos, Nikolaos V.en_US
dc.contributor.editorPuig Puig, Anna and Schultz, Thomas and Vilanova, Anna and Hotz, Ingrid and Kozlikova, Barbora and Vázquez, Pere-Pauen_US
dc.date.accessioned2018-09-19T15:19:11Z
dc.date.available2018-09-19T15:19:11Z
dc.date.issued2018
dc.description.abstractMotivated by the potential of holographic augmented reality (AR) to offer an immersive 3D appreciation of morphology and anatomy, the purpose of this work is to develop and assess an interface for image-based planning of prostate interventions with a head-mounted display (HMD). The computational system is a data and command pipeline that links a magnetic resonance imaging (MRI) scanner/data and the operator, that includes modules dedicated to image processing and segmentation, structure rendering, trajectory planning and spatial co-registration. The interface was developed with the Unity3D Engine (C#) and deployed and tested on a HoloLens HMD. For ergonomics in the surgical suite, the system was endowed with hands-free interactive manipulation of images and the holographic scene via hand gestures and voice commands. The system was tested in silico using MRI and ultrasound datasets of prostate phantoms. The holographic AR scene rendered by the HoloLens HMD was subjectively found superior to desktop-based volume or 3D rendering with regard to structure detection and appreciation of spatial relationships, planning access paths and manual co-registration of MRI and Ultrasound. By inspecting the virtual trajectory superimposed to rendered structures and MR images, the operator observes collisions of the needle path with vital structures (e.g. urethra) and adjusts accordingly. Holographic AR interfacing with wireless HMD endowed with hands-free gesture and voice control is a promising technology. Studies need to systematically assess the clinical merit of such systems and needed functionalities.en_US
dc.description.sectionheadersInteraction and Evaluation
dc.description.seriesinformationEurographics Workshop on Visual Computing for Biology and Medicine
dc.identifier.doi10.2312/vcbm.20181225
dc.identifier.isbn978-3-03868-056-7
dc.identifier.issn2070-5786
dc.identifier.pages17-21
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/vcbm20181225
dc.identifier.urihttps://doi.org/10.2312/vcbm.20181225
dc.publisherThe Eurographics Associationen_US
dc.subjectHuman
dc.subjectcentered computing
dc.subjectHuman computer interaction (HCI)
dc.subjectGraphics systems and interfaces
dc.subjectMixed / augmented reality
dc.titleA Prototype Holographic Augmented Reality Interface for Image-Guided Prostate Cancer Interventionsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
017-021.pdf
Size:
4.16 MB
Format:
Adobe Portable Document Format
Download
Collections
VCBM 18: Eurographics Workshop on Visual Computing for Biology and Medicine