• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • COVID-19 Annoucements
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2024 Scientific Session Call For Abstracts
      • 2024 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
      • Exhibit Opportunities
      • Sponsorship Opportunities
    • Future Meetings
    • Past Meetings
      • SAGES 2022
      • SAGES 2021
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Video Based Assessments (VBA)
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES at Cine-Med
      • SAGES Top 21 MIS Procedures
      • SAGES Pearls
      • SAGES Flexible Endoscopy 101
      • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • Store
    • “Unofficial” Logo Products
  • Log In

Assessing Surgical Performance in Foregut Surgery: a Systematic Review

Elif Bilgic1, Mohammed Al Mahroos1, Tara Landry2, Gerald M Fried1, Melina C Vassiliou1, Liane S Feldman1. 1Mcgill University, 2Montreal General Hospital Medical Library

Introduction: Operative skills have been shown to correlate with patient outcomes, yet at the completion of training or after learning a new procedure, these skills are not formally evaluated.  SAGES and others are interested in using video of procedures for summative assessment of laparoscopic foregut surgery (LFS). As this may be used to determine competency, it must meet the robust criteria established for “high-stakes” assessments. The purpose of this review is to identify tools that have been used to assess LFS and evaluate the available validity evidence for each instrument.

Methods: A systematic search was conducted up to July 2017. Eligible studies reported data on tools used to assess performance in the operating-room during LFS. Two independent reviewers considered 1084 citations for eligibility. The characteristics of each assessment tool were recorded. Validity evidence was evaluated using 5 sources of validity (content, response process, internal structure, relationship to other variables, and consequences). Evidence was summarized by providing a score of 0-3 for each source, for a maximum score of 15(1-5 limited evidence, 6-10 moderate, 11-15 strong).

Results: Overall, 10 separate tools were identified, all evaluating technical skills. Four tools were generic to laparoscopy, 1 was specific to laparoscopic suturing(LS), and 5 specific to LFS (2 specific to nissen fundoplication(NF), 1 heller myotomy (HM), 1 paraesophageal hernia repair (PEH), and 1 LS during NF. Overall, only 2 assessments were supported by moderate evidence (one specific to LS in NF and one generic), while the others had limited or unknown evidence. Validity evidence was based mainly on internal structure (8 tools reporting reliability and item analysis) and relationship to other variables (6 comparing scores in subjects with different clinical experience). There was little or no evidence supporting test content (3 studies referencing previous papers for tool development in the context of clinical assessment, regarding laparoscopy, NF, and LS in NF), test response process (2 studies reporting rater training), and consequences (no studies). Six tools were identified to have evidence for video-assessment; 2 generic, 2 specific to NF, 1 to LS, and 1 to LS in NF. Only the tool specific for LS in NF had moderate evidence, while others had limited evidence.

Conclusion: There is limited evidence supporting the validity of intraoperative assessment tools for laparoscopic forgut surgery. This precludes their use for summative video-based assessment to verify competency. Further research is needed to develop an assessment tool for this purpose. 


Presented at the SAGES 2017 Annual Meeting in Houston, TX.

Abstract ID: 85167

Program Number: S082

Presentation Session: MIS Education Session

Presentation Type: Podium

42

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related

« Return to SAGES 2018 abstract archive

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064
1-310-437-0544
sagesweb@sages.org
Monday - Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube

Important Links

SAGES 2023 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons