• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

Log in
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
www.sages.org

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Awards
    • Who Is SAGES?
    • Leadership
    • Our Mission
    • Advocacy
    • Committees
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Committee Rosters
      • SAGES Past Presidents
  • Meetings
    • SAGES NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2026 Scientific Session Call for Abstracts
      • 2026 Emerging Technology Call for Abstracts
    • CME Claim Form
    • SAGES Past, Present, Future, and Related Meeting Information
    • SAGES Related Meetings & Events Calendar
  • Join SAGES!
    • Membership Application
    • Membership Benefits
    • Membership Types
      • Requirements and Applications for Active Membership in SAGES
      • Requirements and Applications for Affiliate Membership in SAGES
      • Requirements and Applications for Associate Active Membership in SAGES
      • Requirements and Applications for Candidate Membership in SAGES
      • Requirements and Applications for International Membership in SAGES
      • Requirements for Medical Student Membership
    • Member Spotlight
    • Give the Gift of SAGES Membership
  • Patients
    • Join the SAGES Patient Partner Network (PPN)
    • Patient Information Brochures
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find A SAGES Surgeon
  • Publications
    • Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Sustainability in Surgical Practice
    • SAGES Stories Podcast
    • Patient Information Brochures
    • Patient Information From SAGES
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • MesSAGES – The SAGES Newsletter
    • COVID-19 Archive
    • Troubleshooting Guides
  • Education
    • Wellness Resources – You Are Not Alone
    • Avoid Opiates After Surgery
    • SAGES Subscription Catalog
    • SAGES TV: Home of SAGES Surgical Videos
    • The SAGES Safe Cholecystectomy Program
    • Masters Program
    • Resident and Fellow Opportunities
      • MIS Fellows Course
      • SAGES Robotics Residents and Fellows Courses
      • SAGES Free Resident Webinar Series
      • Fluorescence-Guided Surgery Course for Fellows
      • Fellows’ Career Development Course
    • SAGES S.M.A.R.T. Enhanced Recovery Program
    • SAGES @ Cine-Med Products
      • SAGES Top 21 Minimally Invasive Procedures Every Practicing Surgeon Should Know
      • SAGES Pearls Step-by-Step
      • SAGES Flexible Endoscopy 101
    • SAGES OR SAFETY Video Activity
  • Opportunities
    • Fellowship Recognition Opportunities
    • SAGES Advanced Flexible Endoscopy Area of Concentrated Training (ACT) SEAL
    • Multi-Society Foregut Fellowship Certification
    • Research Opportunities
    • FLS
    • FES
    • FUSE
    • Jobs Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • OWLS/FLS
You are here: Home / Abstracts / A ground truth 3D video data set for augmented reality robotic MIS algorithms

A ground truth 3D video data set for augmented reality robotic MIS algorithms

Michael Barrow, MS1, Shanglei Liu, MD2, Nelson Ho, BS1, Ryan Kastner, PhD1, Sonia Ramamoorthy, MD2. 1UCSD Department of Computer Science and Engineering, 2UCSD Department of Surgery

Introduction: Augmented reality (AR) is an emerging visualization technology that can enhance intraoperative imaging during robotic surgery by superimposing preoperative studies into the camera display. The biggest challenge of this is the lack of accurate modeling for soft tissue in 3 dimensions. Current operative video recordings only capture image feed without measurements of force or tissue surface location (ground truth 3D data), thus limiting the modeling capabilities. The system resolutions are also too low to explore tradeoffs in system accuracy and speed for practical clinical applications. Our goal is to measure ground truth values for soft tissue manipulation and use it to create a clinically relatable AR model.

Methods and Procedures: A porcine liver was used as a homogenous soft tissue model. Mechanical manipulation and incision on the liver is performed using a custom hydraulic tool attachment to the DaVinci S ? robotic surgical system (+/- 0.01mm accuracy). A laser scanner is used to sequentially scan the porcine liver (0.025 mm accuracy up to 1732 dpcm), while a pressure gauge (+/- 5mpa) measures the applied force. These scans are pre-registered to a color video feed using an Iterative Closest Point method. We use three levels of tissue preparation to stress example AR registration algorithms (table 1).

Results: The scanner and hydraulic actuator were mounted to a camera and endowrist arms of a Davinci system (see fig 1). 1.5kg of porcine liver was scanned at a rate of 1 frame per 45 seconds. The hydraulic actuator was graduated at 1mm per frame. The data sets were tested in pairs of video frames with three registration algorithms (table 2). Talc powder coated tissue was found to give the best average convergence time and the most accurate registration in our experiments.

Conclusions: Benchmark values for soft tissue in robotic surgery were easily and effectively collected through our testing algorithm. This is the first time data of this high resolution is reported in the literature. AR developers can now use these values to explore and validate algorithmic, software, and hardware methods for tissue reconstruction in clinical practice.


Presented at the SAGES 2017 Annual Meeting in Houston, TX.

Abstract ID: 80808

Program Number: P437

Presentation Session: Poster (Non CME)

Presentation Type: Poster

109

Share this:

  • Click to share on X (Opens in new window) X
  • Click to share on Facebook (Opens in new window) Facebook
  • Click to share on LinkedIn (Opens in new window) LinkedIn
  • Click to share on Pinterest (Opens in new window) Pinterest
  • Click to share on WhatsApp (Opens in new window) WhatsApp
  • Click to share on Reddit (Opens in new window) Reddit
  • Click to share on Pocket (Opens in new window) Pocket
  • Click to share on Mastodon (Opens in new window) Mastodon
  • Click to share on Threads (Opens in new window) Threads
  • Click to share on Bluesky (Opens in new window) Bluesky

Related


sages_adbutler_leaderboard

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064

1-310-437-0544

[email protected]

Monday – Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Bluesky
  • X
  • Instagram
  • Facebook
  • YouTube

Copyright © 2025 · SAGES · All Rights Reserved

Important Links

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals