• Skip to primary navigation
  • Skip to main content
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • SAGES Store
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
    • “Unofficial” Logo Products
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2024 Scientific Session Call For Abstracts
      • 2024 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
    • Future Meetings
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • Wellness Resources – You Are Not Alone
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Fellows Career Development Course
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES Top 21 MIS Procedures
    • SAGES Pearls
    • SAGES Flexible Endoscopy 101
    • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • OWLS
  • Log In

Comprehensive Proficiency-based Inanimate Training for Robotic Surgery: Reliability, Feasibility, and Educational Benefit

Nabeel A Arain, MD MBA, Genevieve Dulan, MD, Deborah C Hogg, BS, Robert V Rege, MD, Cathryn Powers, MD, Seifu T Tesfay, RN MS, Linda S Hynan, PhD, Daniel J Scott, MD. University of Texas Southwestern Medical Center

 

Introduction: We previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique technical skills identified via task deconstruction of robotic operations. Prior studies supported construct, content, and face validity. The purpose of this study was to assess reliability, feasibility, and educational outcomes associated with curricular implementation.

Methods: Over an 11-month period, novice robotic trainees (n=55: 47 residents, 5 faculty, and 3 fellows) from general surgery (n=20), urology (n=18), and gynecology (n=17) were enrolled in a 2-month curriculum which included: 1) online-didactics, 2) half-day hands-on tutorial, and 3) self-practice (individually scheduled sessions) using 9-inanimate exercises until proficiency levels were achieved. Each trainee completed a questionnaire (5-point Likert scale) and performed a single proctored repetition of each task before (pre-test) and after (post-test) training. Training was supervised by a designated proctor and feedback was given accordingly. Five exercises used FLS models with modifications (peg, clutch/camera peg, pattern-cut, and interrupted and running suture) and 4 used custom-made components (rubber-band, stair-rubber-band, clutch/camera, and cutting-rubber-band). Each task was scored for time and errors using modified FLS metrics; task scores were normalized to proficiency levels and a composite score equaled the sum of the 9 normalized task scores. For inter-rater reliability (IRR; degree of agreement among raters), 3 trainees (3 repetitions per task) were scored by two trained raters on all 9 tasks and intra-class correlation coefficients (ICC; measure of reliability) were analyzed. Data from 8 experts was analyzed using ICC and Cronbach’s alpha to determine test/retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pre-test) and final (post-test) trainee performance; comparisons used Wilcoxon signed rank test.

Results: Of 55 trainees that pre-tested, 53 (96%) completed all curricular components in 9.0 to 16.8 hours. All 53 trainees reached proficiency for all 9 exercises after completing an average of 71.6 ± 28.2 repetitions over 5.0 ± 1.4 hours; practice was completed during 3-8 self-practice sessions with relatively extensive (4.8 ± 0.5) proctor feedback. Proficiency levels were rated as moderately difficult (2.9 ± 0.9), highly appropriate (4.5 ± 0.7), and provided excellent feedback (98% agreement amongst trainees). While trainees felt moderately to very comfortable with their laparoscopic skills (3.4 ± 0.9), they had minimal prior robotic experience and poor comfort with robotic skills (1.8 ± 0.9) at baseline (pre-test) compared to final (post-test) (3.1 ± 0.8, p<0.001). Analysis of IRR data for the composite score revealed an ICC of 0.96 [95% confidence interval (CI), 0.71-1.00; p<0.001]. Test/retest reliability was 0.91 [95% CI, 0.40-0.91; p<0.001] and internal consistency was 0.81. Performance improved after training for all 9 tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p<0.001) demonstrating significant educational benefit. 100% of trainees indicated that their robotic skills improved.

Conclusion: This curriculum is associated with high reliability measures, was feasible for a large number of trainees, and resulted in significant performance improvement. Further studies and adoption are encouraged.


Session Number: SS05 – Education
Program Number: S027

108

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related



Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064
1-310-437-0544
[email protected]
Monday - Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube
  • Instagram
  • TikTok

Important Links

SAGES 2024 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons