• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • COVID-19 Annoucements
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2023 Scientific Session Call For Abstracts
      • 2023 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
      • Exhibit Opportunities
      • Sponsorship Opportunities
    • Future Meetings
    • Past Meetings
      • SAGES 2022
      • SAGES 2021
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Video Based Assessments (VBA)
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES at Cine-Med
      • SAGES Top 21 MIS Procedures
      • SAGES Pearls
      • SAGES Flexible Endoscopy 101
      • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy-Coming Soon!
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • Store
    • “Unofficial” Logo Products
  • Log In

Comprehensive Proficiency-based Inanimate Training for Robotic Surgery: Reliability, Feasibility, and Educational Benefit

Nabeel A Arain, MD MBA, Genevieve Dulan, MD, Deborah C Hogg, BS, Robert V Rege, MD, Cathryn Powers, MD, Seifu T Tesfay, RN MS, Linda S Hynan, PhD, Daniel J Scott, MD. University of Texas Southwestern Medical Center

 

Introduction: We previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique technical skills identified via task deconstruction of robotic operations. Prior studies supported construct, content, and face validity. The purpose of this study was to assess reliability, feasibility, and educational outcomes associated with curricular implementation.

Methods: Over an 11-month period, novice robotic trainees (n=55: 47 residents, 5 faculty, and 3 fellows) from general surgery (n=20), urology (n=18), and gynecology (n=17) were enrolled in a 2-month curriculum which included: 1) online-didactics, 2) half-day hands-on tutorial, and 3) self-practice (individually scheduled sessions) using 9-inanimate exercises until proficiency levels were achieved. Each trainee completed a questionnaire (5-point Likert scale) and performed a single proctored repetition of each task before (pre-test) and after (post-test) training. Training was supervised by a designated proctor and feedback was given accordingly. Five exercises used FLS models with modifications (peg, clutch/camera peg, pattern-cut, and interrupted and running suture) and 4 used custom-made components (rubber-band, stair-rubber-band, clutch/camera, and cutting-rubber-band). Each task was scored for time and errors using modified FLS metrics; task scores were normalized to proficiency levels and a composite score equaled the sum of the 9 normalized task scores. For inter-rater reliability (IRR; degree of agreement among raters), 3 trainees (3 repetitions per task) were scored by two trained raters on all 9 tasks and intra-class correlation coefficients (ICC; measure of reliability) were analyzed. Data from 8 experts was analyzed using ICC and Cronbach’s alpha to determine test/retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pre-test) and final (post-test) trainee performance; comparisons used Wilcoxon signed rank test.

Results: Of 55 trainees that pre-tested, 53 (96%) completed all curricular components in 9.0 to 16.8 hours. All 53 trainees reached proficiency for all 9 exercises after completing an average of 71.6 ± 28.2 repetitions over 5.0 ± 1.4 hours; practice was completed during 3-8 self-practice sessions with relatively extensive (4.8 ± 0.5) proctor feedback. Proficiency levels were rated as moderately difficult (2.9 ± 0.9), highly appropriate (4.5 ± 0.7), and provided excellent feedback (98% agreement amongst trainees). While trainees felt moderately to very comfortable with their laparoscopic skills (3.4 ± 0.9), they had minimal prior robotic experience and poor comfort with robotic skills (1.8 ± 0.9) at baseline (pre-test) compared to final (post-test) (3.1 ± 0.8, p<0.001). Analysis of IRR data for the composite score revealed an ICC of 0.96 [95% confidence interval (CI), 0.71-1.00; p<0.001]. Test/retest reliability was 0.91 [95% CI, 0.40-0.91; p<0.001] and internal consistency was 0.81. Performance improved after training for all 9 tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p<0.001) demonstrating significant educational benefit. 100% of trainees indicated that their robotic skills improved.

Conclusion: This curriculum is associated with high reliability measures, was feasible for a large number of trainees, and resulted in significant performance improvement. Further studies and adoption are encouraged.


Session Number: SS05 – Education
Program Number: S027

106

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related

« Return to SAGES 2012 abstract archive

Our Mission

Innovate, educate and collaborate to improve patient care.

Recently, on SAGES…

Critical View of Safety (CVS) Challenge QR Code

The SAGES Critical View of Safety Challenge – Donate Your Lap Chole Videos!

The Society of American Gastrointestinal and Endoscopic Surgeons is hosting the first Artificial Intelligence Data Challenge conducted by surgeons. The aim of this challenge is to generate a large and diverse dataset of laparoscopic cholecystectomy videos, annotated with respect to the subcomponents of the Critical View of Safety (CVS). Computer scientists from all over the […]

Respuesta de SAGES al Estudio NordICC sobre el beneficio de las colonoscopias de detección

SAGES desea aclarar los resultados del estudio NordICC y colocarlos en contexto de los esfuerzos de varias agencias nacionales para reducir el riesgo de cáncer colorrectal – la segunda causa de muerte por cáncer más frecuente en los Estados Unidos-, mediante la promoción de la detección y tratamiento oportuno de las lesiones.

SAGES Response to NordICC Study Regarding Benefit of Screening Colonoscopies

The NordICC Study recently published in The New England Journal of Medicine and widely reported on by media outlets has raised questions regarding the benefit of screening colonoscopy in lowering the risk of colorectal cancer and cancer-related deaths among otherwise healthy and symptom-free men and women aged 55 to 64. Provocative headlines and commentaries have […]

Contact SAGES

Society of American Gastrointestinal and Endoscopic Surgeons
11300 W. Olympic Blvd Suite 600
Los Angeles, CA 90064 USA
webmaster@sages.org
Tel: (310) 437-0544

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube

Important Links

SAGES 2023 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons