Intraoperative Assessment of Surgical Technical and Non-Technical Skills in Open and Laparoscopic Cases

Pierre-Anthony E Leake, MD, Julie Takata, MA, David R Urbach, MD MSc. Toronto General Hospital, University Health Network

INTRODUCTION: The purpose of this study was to evaluate technical and non-technical operative skills of professional surgeons in real clinical settings, performing open and laparoscopic general surgical procedures. There has been recent interest in the evaluation of technical and non-technical skills in clinical settings and their relationship to outcome. While technical skill measurement tools have been used increasingly in clinical education settings, non-technical skill assessment is a relatively new concept to surgery which has not been previously evaluated. Neither has been assessed with respect to patient outcome.

METHODS AND PROCEDURES: General surgeons in Ontario who perform colorectal cancer operations formed the basis of the present study. A single trained observer performed evaluations within the operating room during a single surgical procedure. The global rating scale of the Objective Structured Assessment of Technical Skill (OSATS) tool and the Non-Technical Skills for Surgeons (NOTSS) tool were used to assess technical and non-technical skills respectively.

RESULTS: Twenty-five surgeons practicing in academic hospitals were assessed. Tables 1 and 2 demonstrate the OSATS and NOTSS scores. No significant statistical difference in OSATS or NOTSS scores was found between open and laparoscopic cases.

Table 1. OSATS Scores*
Overall (n=)Open (n=)Laparoscopic (n=)P value
Respect for Tissue4 (4-5)4 (4-5)4 (4-4.75)0.605
Time and Motion4 (4-5)4 (4-5)4 (4-4) 0.428
Instrument Handling5 (4-5) 5 (5-5)4 (4-5)0.160
Knowledge of Instruments5 (5-5) 5 (5-5)5 (5-5)1.000
Use of Assistants4 (3-5)4 (4-5)3.5 (3-4)0.144
Flow of Operation and Forward Planning4 (4-5)4 (4-5)4 (4-4)0.723
Knowledge of Specific Procedures5 (4-5)5 (5-5)5 (4-5)0.428
Subjective Global Assessment4 (4-5)4 (4-5)4 (4-4.75)0.807
Overall Global Rating Score31 (28-33)32 (30-33.5)29 (28-32.25)0.196
Table 2. NOTSS Scores*
Overall (n=)Open (n=)Laparoscopic (n=)P value
Cognitive SkillsSituation Awareness4 (3-4)4 (3-4)4 (3-4)0.807
Decision Making4 (3-4)4 (3-4)3 (3-4)0.439
Interpersonal SkillsLeadership4 (3-4)4 (3-4)3.5 (3-4)0.892
Communication and Teamwork4 (3-4)4 (3-4)3 (3-4)0.216

*Values are medians (25th – 75th percentiles)

CONCLUSION: This preliminary analysis shows that the assessment of technical and non-technical skills of surgeons in actual clinical settings is possible for both open and laparoscopic procedures. Surgeon skills appear uniform regardless of surgical approach (open or laparoscopic). The study provides the basis for future work on surgeon skills as measures of surgical quality.


Session: Poster
Program Number: P179
View Poster

« Return to SAGES 2011 abstract archive