• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

Log in
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
www.sages.org

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Awards
    • Who Is SAGES?
    • Leadership
    • Our Mission
    • Advocacy
    • Committees
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Committee Rosters
      • SAGES Past Presidents
  • Meetings
    • SAGES NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2026 Scientific Session Call for Abstracts
      • 2026 Emerging Technology Call for Abstracts
    • CME Claim Form
    • SAGES Past, Present, Future, and Related Meeting Information
    • SAGES Related Meetings & Events Calendar
  • Join SAGES!
    • Membership Application
    • Membership Benefits
    • Membership Types
      • Requirements and Applications for Active Membership in SAGES
      • Requirements and Applications for Affiliate Membership in SAGES
      • Requirements and Applications for Associate Active Membership in SAGES
      • Requirements and Applications for Candidate Membership in SAGES
      • Requirements and Applications for International Membership in SAGES
      • Requirements for Medical Student Membership
    • Member Spotlight
    • Give the Gift of SAGES Membership
  • Patients
    • Join the SAGES Patient Partner Network (PPN)
    • Patient Information Brochures
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find A SAGES Surgeon
  • Publications
    • Sustainability in Surgical Practice
    • SAGES Stories Podcast
    • Patient Information Brochures
    • Patient Information From SAGES
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • MesSAGES – The SAGES Newsletter
    • COVID-19 Archive
    • Troubleshooting Guides
  • Education
    • Wellness Resources – You Are Not Alone
    • Avoid Opiates After Surgery
    • SAGES Subscription Catalog
    • SAGES TV: Home of SAGES Surgical Videos
    • The SAGES Safe Cholecystectomy Program
    • Masters Program
    • Resident and Fellow Opportunities
      • MIS Fellows Course
      • SAGES Robotics Residents and Fellows Courses
      • SAGES Free Resident Webinar Series
      • Fluorescence-Guided Surgery Course for Fellows
      • Fellows’ Career Development Course
    • SAGES S.M.A.R.T. Enhanced Recovery Program
    • SAGES @ Cine-Med Products
      • SAGES Top 21 Minimally Invasive Procedures Every Practicing Surgeon Should Know
      • SAGES Pearls Step-by-Step
      • SAGES Flexible Endoscopy 101
    • SAGES OR SAFETY Video Activity
  • Opportunities
    • Fellowship Recognition Opportunities
    • SAGES Advanced Flexible Endoscopy Area of Concentrated Training (ACT) SEAL
    • Multi-Society Foregut Fellowship Certification
    • Research Opportunities
    • FLS
    • FES
    • FUSE
    • Jobs Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • OWLS/FLS
You are here: Home / Abstracts / Automatic detection and recognition of surgical tools and workflow in laparoscopic sigmoid colectomy

Automatic detection and recognition of surgical tools and workflow in laparoscopic sigmoid colectomy

Nobuyoshi Takeshita, Masaaki Ito. National Cancer Center Hospital East

INTRODUCTION: Recently, the spread of laparoscopic surgery as a standard treatment and the development of information & communication technology have yielded abundant video data of laparoscopic procedures. These data have been accumulated and we can access them anytime, anywhere. However, the direction of how to use the abundant video data are still unclear. Conventionally, surgical procedures have been performed based on surgeon’s subjective decisions and skills, so called “tacit knowledge”. For the purpose of objective analysis of laparoscopic procedures in video data, automatic recognition of surgical tools and understanding of surgical workflow must be the first critical step. We used convolutional neural network (CNN) which is the current trend in machine learning and computer vision tasks.

METHODS: Using video database of laparoscopic sigmoid colectomy in our institute, we performed annotation of tools and phases in every frame of the operating videos. For the tool detection, we annotated bounding boxes for both left and right tools in the videos. Furthermore, phase annotation was performed by watching the videos in consultation with laparoscopic surgeons. The laparoscopic sigmoid colectomy operation passes through 10 phases; 1-Placement of ports and preparation, 2-Dissection of retrorectal space, 3-Medial approach to IMA, 4-Isolation and division of IMA, 5-Medial-to-lateral retromesenteric dissection, 6-Lateral mobilization of left colon, 7-Rectosigmoid mobilization, 8-Division of mesorectum, 9-Rectosigmoid resection and anastomosis, 10-Finishing. We used CNN architecture to perform surgical tool detection and workflow recognition.

RESULTS: We totally labeled 8 tools used in the procedures of laparoscopic sigmoid colectomy and successfully developed tool detection system by CNN. As for surgical workflow, average times of phase 1-10 were 11.3, 9.9, 8.7, 5.9, 11.5, 10.2, 8.7, 11.6, 17.8, 2.7 minutes, respectively. Workflow recognition system using CNN was also successfully developed, while we needed to extract pure operating scenes in advance for efficient recognition outcomes.

CONCLUSION: We’ve developed tool detection and phase recognition systems using CNN. We need more datasets to improve the detecting ability for future clinical uses.


Presented at the SAGES 2017 Annual Meeting in Houston, TX.

Abstract ID: 86764

Program Number: P487

Presentation Session: iPoster Session (Non CME)

Presentation Type: Poster

132

Share this:

  • Click to share on X (Opens in new window) X
  • Click to share on Facebook (Opens in new window) Facebook
  • Click to share on LinkedIn (Opens in new window) LinkedIn
  • Click to share on Pinterest (Opens in new window) Pinterest
  • Click to share on WhatsApp (Opens in new window) WhatsApp
  • Click to share on Reddit (Opens in new window) Reddit
  • Click to share on Pocket (Opens in new window) Pocket
  • Click to share on Mastodon (Opens in new window) Mastodon
  • Click to share on Threads (Opens in new window) Threads
  • Click to share on Bluesky (Opens in new window) Bluesky

Related


sages_adbutler_leaderboard

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064

1-310-437-0544

[email protected]

Monday – Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Bluesky
  • X
  • Instagram
  • Facebook
  • YouTube

Copyright © 2025 · SAGES · All Rights Reserved

Important Links

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals