Maki Sugimoto, MD, PhD. International University of Health and Welfare
We developed an integrated surgical navigation system of patient-based immersive virtual reality, holographic augmented reality, and bio-elastic 3D organ printing replication for laparoscopic surgery.
At first, by reconstructing the patient-specific 3D surface models of each organs out of the patient’s MDCT images, immersive virtual reality navigation system was developed using side-by side volume rendering. Second, we also developed a holographic augmented reality system by sensing the user's hand or arm position using motion sensor and 3D grasses. We developed a new spatial imaging system by interactive superimposing 3D hologram and 3D printing technology by tracking the user's head and hand/arm position.
Finally we integrated these navigation systems and hybrid multi-material 3D-printed injection molding technology for manufacturing bio-elastic organ replicas for actual model-guided surgery.
We will report Illustrative examples and beneficial applications of the VR/AR devices (HMD, 3D tablet, and motion sensor) of these integration and benefits in surgical planning, surgical simulation, and image guided surgery. It allowed the user to manipulate the spatial attributes of the virtual and real printed organs, which can enhance spatial reasoning and augmented tangibility.
Presented at the SAGES 2017 Annual Meeting in Houston, TX.
Abstract ID: 80153
Program Number: P416
Presentation Session: Poster (Non CME)
Presentation Type: Poster