• Skip to primary navigation
  • Skip to main content
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • SAGES Store
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
    • “Unofficial” Logo Products
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2024 Scientific Session Call For Abstracts
      • 2024 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
      • Exhibit Opportunities
      • Sponsorship Opportunities
    • Future Meetings
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • Wellness Resources – You Are Not Alone
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Fellows Career Development Course
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES Top 21 MIS Procedures
    • SAGES Pearls
    • SAGES Flexible Endoscopy 101
    • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • OWLS
  • Log In

Virtual Pointer for Gaze Guidance in Laparoscopic Surgery

Yuanyuan Feng1, Hannah McGowan1, Azin Semsar1, Hamid R Zahiri2, Ivan M George2, Timothy Turner2, Adrian Park2, Andrea Kleinsmith1, Helena M Mentis1. 1University of Maryland, Baltimore County, 2Anne Arundel Medical Center

Objective of the Technology: Gaze pattern is demonstrated to be an indicator for a surgeon's competency in laparoscopic surgery. Eye-tracking studies have showed that experienced surgeons concentrate their eye gaze on the surgical target, while novices have a more dispersed gaze behavior. However, guiding the gaze of trainees is challenging as it requires the experienced surgeon to provide a series of verbal explanations and references of the laparoscopic video to identify anatomical structures and demonstrate how to perform surgical tasks. To facilitate intraoperative gaze guidance, we designed the Virtual Pointer to enable trainers to point to or draw on laparoscopic video for a trainee to see. We aimed to study the efficacy of this technology in improving trainees’ gaze patterns.

Description of the Technology and Method of Its Use: The Virtual Pointer is a video referencing system that uses a touchless natural user interface based on the Microsoft Kinect sensor. Real-time image telestration, such as pointing and drawing, can be performed by a surgeon using a combination of key words and hand movements. The system, running on a separate laptop computer, takes in the real-time laparoscopic video, overlays the telestrations, and displays the resulting view on the laparoscopic video monitor. The overlay can be on continuously or can be displayed only when needed.

Preliminary Results: The study design was a counterbalanced, within subjects controlled experiment, comparing standard guidance (i.e. verbal instructions and any naturally occurring pointing/gestures at the monitor) with Virtual Pointer guidance. Subjects were seven surgical trainees (1 surgical fellow, 1 research fellow, 2 PYG-2 and 3 PYG-1). Each trainee performed four laparoscopic cholecystectomy tasks on a physical laparoscopic model under the guidance of one of two experienced surgeons (Figure 1). A Tobii Pro X3-120 eye-tracker was used to capture the trainees’ eye movements. Gaze concentration (i.e. areas of gaze focus) was visualized by the gaze heat maps, and measured by the standard deviation of the Euclidean distance between each fixation position and the origin O(0, 0). A linear mixed model was used for the comparison of gaze concentration between Virtual Pointer and standard guidance.

Figure 1. Virtual Pointer guidance.

The heat maps showed Virtual Pointer guidance fixations were more concentrated than standard guidance fixations, and the 10 longest fixations were more prone to cluster together in the Virtual Pointer guidance condition (Figure 2). This trend was confirmed by the significant effect of the guidance conditions identified in the linear mixed models among total fixations (p = 0.039) and 10 longest fixations (p = 0.008) (Figure 3). 

Figure 2. Examples of gaze heat maps.

Figure 3. Gaze concentration for total fixations, 10 longest fixations and 10 shortest fixations. 

Conclusions and Future Directions: This study demonstrates that the Virtual Pointer reduces novices’ gaze dispersion and concentrates their attention on the target. This shows that an easily deployed virtual pointer could substantially improve surgical trainees’ in-the-moment gaze focus. Future studies are needed to assess the trainees’ performance with this gaze focus as well as the longer-term gaze focus effects after using this technology.


Presented at the SAGES 2017 Annual Meeting in Houston, TX.

Abstract ID: 91193

Program Number: ETP893

Presentation Session: Emerging Technology iPoster Session (Non CME)

Presentation Type: Poster

110

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064
1-310-437-0544
[email protected]
Monday - Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube

Important Links

SAGES 2024 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons