Pierre-Anthony E Leake, MD, Julie Takata, MA, David R Urbach, MD MSc. Toronto General Hospital, University Health Network
INTRODUCTION: The purpose of this study was to evaluate technical and non-technical operative skills of professional surgeons in real clinical settings, performing open and laparoscopic general surgical procedures. There has been recent interest in the evaluation of technical and non-technical skills in clinical settings and their relationship to outcome. While technical skill measurement tools have been used increasingly in clinical education settings, non-technical skill assessment is a relatively new concept to surgery which has not been previously evaluated. Neither has been assessed with respect to patient outcome.
METHODS AND PROCEDURES: General surgeons in Ontario who perform colorectal cancer operations formed the basis of the present study. A single trained observer performed evaluations within the operating room during a single surgical procedure. The global rating scale of the Objective Structured Assessment of Technical Skill (OSATS) tool and the Non-Technical Skills for Surgeons (NOTSS) tool were used to assess technical and non-technical skills respectively.
RESULTS: Twenty-five surgeons practicing in academic hospitals were assessed. Tables 1 and 2 demonstrate the OSATS and NOTSS scores. No significant statistical difference in OSATS or NOTSS scores was found between open and laparoscopic cases.
| Overall (n=) | Open (n=) | Laparoscopic (n=) | P value | |
| Respect for Tissue | 4 (4-5) | 4 (4-5) | 4 (4-4.75) | 0.605 |
| Time and Motion | 4 (4-5) | 4 (4-5) | 4 (4-4) | 0.428 |
| Instrument Handling | 5 (4-5) | 5 (5-5) | 4 (4-5) | 0.160 |
| Knowledge of Instruments | 5 (5-5) | 5 (5-5) | 5 (5-5) | 1.000 |
| Use of Assistants | 4 (3-5) | 4 (4-5) | 3.5 (3-4) | 0.144 |
| Flow of Operation and Forward Planning | 4 (4-5) | 4 (4-5) | 4 (4-4) | 0.723 |
| Knowledge of Specific Procedures | 5 (4-5) | 5 (5-5) | 5 (4-5) | 0.428 |
| Subjective Global Assessment | 4 (4-5) | 4 (4-5) | 4 (4-4.75) | 0.807 |
| Overall Global Rating Score | 31 (28-33) | 32 (30-33.5) | 29 (28-32.25) | 0.196 |
| Overall (n=) | Open (n=) | Laparoscopic (n=) | P value | ||
| Cognitive Skills | Situation Awareness | 4 (3-4) | 4 (3-4) | 4 (3-4) | 0.807 |
| Decision Making | 4 (3-4) | 4 (3-4) | 3 (3-4) | 0.439 | |
| Interpersonal Skills | Leadership | 4 (3-4) | 4 (3-4) | 3.5 (3-4) | 0.892 |
| Communication and Teamwork | 4 (3-4) | 4 (3-4) | 3 (3-4) | 0.216 |
*Values are medians (25th – 75th percentiles)
CONCLUSION: This preliminary analysis shows that the assessment of technical and non-technical skills of surgeons in actual clinical settings is possible for both open and laparoscopic procedures. Surgeon skills appear uniform regardless of surgical approach (open or laparoscopic). The study provides the basis for future work on surgeon skills as measures of surgical quality.
Session: Poster
Program Number: P179
View Poster
