• Skip to primary navigation
  • Skip to main content
  • Skip to footer

SAGES

Reimagining surgical care for a healthier world

  • Home
    • Search
    • SAGES Home
    • SAGES Foundation Home
  • About
    • Who is SAGES?
    • SAGES Mission Statement
    • Advocacy
    • Strategic Plan, 2020-2023
    • Committees
      • Request to Join a SAGES Committee
      • SAGES Board of Governors
      • Officers and Representatives of the Society
      • Committee Chairs and Co-Chairs
      • Full Committee Rosters
      • SAGES Past Presidents
    • Donate to the SAGES Foundation
    • SAGES Store
    • Awards
      • George Berci Award
      • Pioneer in Surgical Endoscopy
      • Excellence In Clinical Care
      • International Ambassador
      • IRCAD Visiting Fellowship
      • Social Justice and Health Equity
      • Excellence in Community Surgery
      • Distinguished Service
      • Early Career Researcher
      • Researcher in Training
      • Jeff Ponsky Master Educator
      • Excellence in Medical Leadership
      • Barbara Berci Memorial Award
      • Brandeis Scholarship
      • Advocacy Summit
      • RAFT Annual Meeting Abstract Contest and Awards
    • “Unofficial” Logo Products
  • Meetings
    • NBT Innovation Weekend
    • SAGES Annual Meeting
      • 2024 Scientific Session Call For Abstracts
      • 2024 Emerging Technology Call For Abstracts
    • CME Claim Form
    • Industry
      • Advertising Opportunities
      • Exhibit Opportunities
      • Sponsorship Opportunities
    • Future Meetings
    • Related Meetings Calendar
  • Join SAGES!
    • Membership Benefits
    • Membership Applications
      • Active Membership
      • Affiliate Membership
      • Associate Active Membership
      • Candidate Membership
      • International Membership
      • Medical Student Membership
    • Member News
      • Member Spotlight
      • Give the Gift of SAGES Membership
  • Patients
    • Healthy Sooner – Patient Information for Minimally Invasive Surgery
    • Patient Information Brochures
    • Choosing Wisely – An Initiative of the ABIM Foundation
    • All in the Recovery: Colorectal Cancer Alliance
    • Find a SAGES Member
  • Publications
    • SAGES Stories Podcast
    • SAGES Clinical / Practice / Training Guidelines, Statements, and Standards of Practice
    • Patient Information Brochures
    • TAVAC – Technology and Value Assessments
    • Surgical Endoscopy and Other Journal Information
    • SAGES Manuals
    • SCOPE – The SAGES Newsletter
    • COVID-19 Annoucements
    • Troubleshooting Guides
  • Education
    • OpiVoid.org
    • SAGES.TV Video Library
    • Safe Cholecystectomy Program
      • Safe Cholecystectomy Didactic Modules
    • Masters Program
      • SAGES Facebook Program Collaboratives
      • Acute Care Surgery
      • Bariatric
      • Biliary
      • Colorectal
      • Flexible Endoscopy (upper or lower)
      • Foregut
      • Hernia
      • Robotics
    • Educational Opportunities
    • HPB/Solid Organ Program
    • Courses for Residents
      • Advanced Courses
      • Basic Courses
    • Fellows Career Development Course
    • Robotics Fellows Course
    • MIS Fellows Course
    • Facebook Livestreams
    • Free Webinars For Residents
    • SMART Enhanced Recovery Program
    • SAGES OR SAFETY Video
    • SAGES at Cine-Med
      • SAGES Top 21 MIS Procedures
      • SAGES Pearls
      • SAGES Flexible Endoscopy 101
      • SAGES Tips & Tricks of the Top 21
  • Opportunities
    • NEW-Area of Concentrated Training Seal (ACT)-Advanced Flexible Endoscopy
    • SAGES Fellowship Certification for Advanced GI MIS and Comprehensive Flexible Endoscopy
    • Multi-Society Foregut Fellowship Certification
    • SAGES Research Opportunities
    • Fundamentals of Laparoscopic Surgery
    • Fundamentals of Endoscopic Surgery
    • Fundamental Use of Surgical Energy
    • Job Board
    • SAGES Go Global: Global Affairs and Humanitarian Efforts
  • Search
    • Search All SAGES Content
    • Search SAGES Guidelines
    • Search the Video Library
    • Search the Image Library
    • Search the Abstracts Archive
  • OWLS
  • Log In

The Quality of Survey Methodology in the Surgical Literature: A Call for Publication Guidelines?

Sami Chadi, MD1, Biniam Kidane, MD2, Patrick H Colquhoun, MD3, Nawar AlKhamesi, MD3, Christopher M Schlachta3, Steven D Wexner, MD, PhD, Hon1. 1Digestive Disease Center, Cleveland Clinic Florida, 2Division of Thoracic Surgery, University of Toronto, Toronto, Canada, 3Division of General Surgery, Western University, London, Canada

Introduction: Survey research is an important step in current quantitative and qualitative research methods. Reviews of survey methodology in critical care and nephrology have demonstrated a need for standards. The objective of this study was to review current standards of survey methods and reporting in the surgical literature.

Methods: All issues of 8 surgical journals were reviewed to identify surveys of health professionals between 2002-2013, excluding mixed-methods studies and surveys of specific interventions (4 general: Journal of the American College of Surgeons, Surgical Endoscopy, Annals of Surgery and World Journal of Surgery; 4 subspecialty: Journal of Pediatric Surgery, Journal of Vascular Surgery, Diseases of the Colon and Rectum, Annals of Surgical Oncology).  Four other journals were initially included a priori that were subsequently excluded due to (1) no surveys being published, (2) publication of articles for only a part of the cohort. The main outcome was the overall transparency and quality of surveys (5 point Likert scale).

Results: We included 219 surveys in this review. Overall inter-rater reliability was strong for both publication transparency (weighted κ 0.8; 0.67-0.93) and publication quality (weighted κ 0.83; 0.72-0.93). The median response rate was 62%. The most common method of survey dissemination was email (46%) followed by postal (33%), with 20% using multiple methods. Publication rates were assessed per 1000 citations from each journal per year. No overall trend of increasing publication rate was identified (p=0.43) although there was evidence of differing rates of publication among journals (p<0.001). Although 48% reported sending reminders, 46% did not report whether this was done. Regarding instrument development, item generation and item reduction were mentioned in 11.6% and 2.5% of papers. Regarding instrument testing, 19% of papers piloted their instrument prior to dissemination whereas clinimetric properties of at least one of face, content, construct validity, intra- or inter-rater reliability, or consistency were mentioned in less than 13% of studies. Median quality and transparency scores were 3. Higher survey quality (as determined by reviewers) appeared associated with reporting a previously published instrument (OR 3.0; p<0.001), single survey metric (OR 22.0; p<0.001) and discussing the management of incomplete surveys (OR 2.9; p=0.014).

Conclusion: The quality of survey methods and reporting is suboptimal in the surgical literature. In particular, reporting survey metrics and instrument testing appears to need significant improvement, with even lower rates than the medical literature. Guidelines of reporting and methods are necessary to standardize and improve quality. 

49

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • WhatsApp
  • Reddit

Related

Hours & Info

11300 West Olympic Blvd, Suite 600
Los Angeles, CA 90064
1-310-437-0544
[email protected]
Monday - Friday
8am to 5pm Pacific Time

Find Us Around the Web!

  • Facebook
  • Twitter
  • YouTube

Important Links

SAGES 2023 Meeting Information

Healthy Sooner: Patient Information

SAGES Guidelines, Statements, & Standards of Practice

SAGES Manuals

 

  • taTME Study Info
  • Foundation
  • SAGES.TV
  • MyCME
  • Educational Activities

Copyright © 2023 Society of American Gastrointestinal and Endoscopic Surgeons