• Skip to primary navigation
  • Skip to main content
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • SAGES Store
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
    • “Unofficial” Logo Products
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2024 Scientific Session Call For Abstracts
      • 2024 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
      • Exhibit Opportunities
      • Sponsorship Opportunities
    • Future Meetings
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Fellows Career Development Course
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES at Cine-Med
      • SAGES Top 21 MIS Procedures
      • SAGES Pearls
      • SAGES Flexible Endoscopy 101
      • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • OWLS
  • Log In

Technology-based procedure for automatic and objective error measurement in FLS pattern cutting task

Jeff T Flinn, David Wood, Caroline G Cao

Wright State University

The manual skills component of the FLS Test requires scoring by a trained evaluator. The scoring methodologies being used, though accepted by the surgical community, are resource intensive, and require subjective judgment on the part of the evaluator. A particularly cumbersome and error-prone scoring method is the one used for the pattern-cutting task. One part of the scoring procedure requires the evaluator to manually cut out from the mesh sample all deviations from the drawn circle. These bits are then placed onto a grid to determine how many squares they cover. This procedure has several inherent limitations. It is labor- and time-intensive. Since the cut bits are irregularly shaped they cannot be fit together seamlessly on the grid, thus introducing errors in the area estimation. Additionally, there are many possible ways to arrange the cut bits of deviation so the method is vulnerable to problems with inter- and intra-rater reliability. This source of variability, along with built-in measurement error due to the relative coarseness of the measuring scale (grids are 1 mm squares), is in effect a loss of measurement precision. We have developed a technology-based approach that algorithmically computes the precise area of deviation for the pattern cutting task. This automatic scoring method can objectively provide a quick, accurate, and precise error measurement for the purpose of scoring the FLS pattern cutting task.

The procedure consists of two simple steps and requires minimal instruction to perform. First, the cut pieces of gauze are each digitally scanned. Second, the scanned images are analyzed by custom-developed image analysis software to produce the area of error, both inside and outside the prescribed circle.

Performance evaluations were conducted to compare both the accuracy and the efficiency of the automated and manual methods. In order to provide a standard for comparison, a test sample was prepared for which the total area and the area of error were known quantities. This test sample was then repeatedly measured 5 times per method by an untrained evaluator. The measure of accuracy indicates how much an error estimate deviates from the true error. It was calculated as the difference between the error estimate of the method and the actual error, expressed as a percentage of the actual error. Therefore, 0% deviation represents an exact estimate of the actual error. Results show that the mean accuracy of the automated method was -0.094% deviation with a SD of 0.44, whereas the manual method had a mean of 26.19% deviation with an SD of 3.22. The automated method took an average of 2.0 minutes to scan and calculate the area of error, whereas the manual method took 10.1 minutes to photocopy, cut, assemble, and estimate the area of error.

Based on these results we conclude that our objective technology-based approach to error measurement provides advantages in speed, accuracy, and precision over the manual scoring method currently in use. Consequently, this approach could result in lower administrative costs and increased confidence in testing results.


Session: Poster Presentation

Program Number: ETP066

166

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064
1-310-437-0544
[email protected]
Monday - Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube

Important Links

SAGES 2023 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons