• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

Log in
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
www.sages.org

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Awards
    • Who Is SAGES?
    • Leadership
    • Our Mission
    • Advocacy
    • Committees
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Committee Rosters
      • SAGES Past Presidents
  • Meetings
    • SAGES NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2026 Scientific Session Call for Abstracts
      • 2026 Emerging Technology Call for Abstracts
    • CME Claim Form
    • SAGES Past, Present, Future, and Related Meeting Information
    • SAGES Related Meetings & Events Calendar
  • Join SAGES!
    • Membership Application
    • Membership Benefits
    • Membership Types
      • Requirements and Applications for Active Membership in SAGES
      • Requirements and Applications for Affiliate Membership in SAGES
      • Requirements and Applications for Associate Active Membership in SAGES
      • Requirements and Applications for Candidate Membership in SAGES
      • Requirements and Applications for International Membership in SAGES
      • Requirements for Medical Student Membership
    • Member Spotlight
    • Give the Gift of SAGES Membership
  • Patients
    • Join the SAGES Patient Partner Network (PPN)
    • Patient Information Brochures
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find A SAGES Surgeon
  • Publications
    • Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Sustainability in Surgical Practice
    • SAGES Stories Podcast
    • Patient Information Brochures
    • Patient Information From SAGES
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • MesSAGES – The SAGES Newsletter
    • COVID-19 Archive
    • Troubleshooting Guides
  • Education
    • Wellness Resources – You Are Not Alone
    • Avoid Opiates After Surgery
    • SAGES Subscription Catalog
    • SAGES TV: Home of SAGES Surgical Videos
    • The SAGES Safe Cholecystectomy Program
    • Masters Program
    • Resident and Fellow Opportunities
      • MIS Fellows Course
      • SAGES Robotics Residents and Fellows Courses
      • SAGES Free Resident Webinar Series
      • Fluorescence-Guided Surgery Course for Fellows
      • Fellows’ Career Development Course
    • SAGES S.M.A.R.T. Enhanced Recovery Program
    • SAGES @ Cine-Med Products
      • SAGES Top 21 Minimally Invasive Procedures Every Practicing Surgeon Should Know
      • SAGES Pearls Step-by-Step
      • SAGES Flexible Endoscopy 101
    • SAGES OR SAFETY Video Activity
  • Opportunities
    • Fellowship Recognition Opportunities
    • SAGES Advanced Flexible Endoscopy Area of Concentrated Training (ACT) SEAL
    • Multi-Society Foregut Fellowship Certification
    • Research Opportunities
    • FLS
    • FES
    • FUSE
    • Jobs Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • OWLS/FLS
You are here: Home / Abstracts / A novel natural user interface for image-guided minimally invasive surgery

A novel natural user interface for image-guided minimally invasive surgery

Francisco M Sanchez-Margallo, PhD, Juan A Sanchez-Margallo, PhD, Jose L Moyano Cuevas, MsC, Juan Maestre Antequera. Minimally Invasive Surgery Centre

Objective: Image-guided surgical (IGS) systems allow surgeons to plan and guide the intervention providing additional information on the status of the anatomic structures or position of the surgical instruments. In extirpative surgeries such as hepatectomy or partial nephrectomy for tumors, these systems provide the location of the structures involved in the resection as well as the optimal surgical margins for preserving much healthy tissue as possible. However, surgical environments require special aseptic conditions that hamper the use of traditional input devices such as keyboard and mouse for interacting with the IGS systems. The main objective of this work is to test the feasibility of using a touchless interface for image-guided minimally invasive surgery.

Technology and Methods: For interacting with the preoperative imaging during the surgical intervention the TedCube (TedCas Medical Systems, Spain) system has been used. This technology allows surgeon interaction in a completely sterile way by means of touch-free natural user interfaces based on optoelectronic devices. Different gestural control sensors for user interaction have been used in this study such as Microsoft Kinect (Microsoft, USA), Leap Motion (Leap Motion, Inc., USA), MYO (Thalmic Labs Inc., Canada) and voice control (Figure 1).

image

Figure 1. Use of TedCube system during a minimally invasive intervention.

Different minimally invasive surgeries have been performed such as hepatectomy or partial nephrectomy. For the partial nephrectomy an experimental porcine model of a renal pseudotumor was created. The location and extent of pseudotumor was conducted by CT and ultrasound imaging. For the hepatectomy, the identification of the hepatic vascular anatomy was obtained by CT imaging with the use of contrast medium. This preoperative information was provided to the surgeon during the development of both surgical procedures for surgical support and interaction through the IGS system.

A preliminary validation of the system was performed. For this purpose a questionnaire (Likert scale-5, 1 as minimum value and 5 as maximum) was designed to evaluate the usability and usefulness of the system. This questionnaire was complete after performing the surgeries with the support of the IGS system.

Results: All procedures were successfully completed without complications. The surgeon was able to interact properly with the IGS system during the course of all surgical procedures. Some of the preoperative images used during the IGS interventions are shown in Figure 2 and Figure 3. The surgeon showed great satisfaction in the usability of the IGS system and its interaction during the performance of hepatectomy and nephrectomy interventions, considering it a useful tool for the location of the risk structures during surgery such as the tumors and vascular tree of the organs.

image

Figure 2. (a) 3D reconstruction of pseudotumor in left kidney. (b) Ultrasound image of pseudotumor in the left kidney.

image

Figure 3. Maximum intensity projection image of the vascularization of the liver's portal venous system.

Conclusions: Image-guided minimally invasive surgeries based on natural interfaces allow surgeons to interact with preoperative patient information in a more intuitive and sterile manner, and therefore safer for the patient.

302

Share this:

  • Click to share on X (Opens in new window) X
  • Click to share on Facebook (Opens in new window) Facebook
  • Click to share on LinkedIn (Opens in new window) LinkedIn
  • Click to share on Pinterest (Opens in new window) Pinterest
  • Click to share on WhatsApp (Opens in new window) WhatsApp
  • Click to share on Reddit (Opens in new window) Reddit
  • Click to share on Pocket (Opens in new window) Pocket
  • Click to share on Mastodon (Opens in new window) Mastodon
  • Click to share on Threads (Opens in new window) Threads
  • Click to share on Bluesky (Opens in new window) Bluesky

Related


sages_adbutler_leaderboard

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064

1-310-437-0544

[email protected]

Monday – Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Bluesky
  • X
  • Instagram
  • Facebook
  • YouTube

Copyright © 2025 · SAGES · All Rights Reserved

Important Links

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals