PubMed Health⌕ Search

Biomedical subjects

Simon Bann

Publications and source records attributed to Simon Bann.

11 recordsLinked to original sources

The surgical efficiency score: a feasible, reliable, and valid method of skills assessment.

BACKGROUND: Technical skills assessments are being increasingly used in surgical residency programs, with the objectivity and validity of several techniques well established. However, many of these methods are labor and time intensive, limiting their feasibility. This study aims to compare more efficient techniques of skills appraisals with an established gold standard. METHODS: Thirty surgeons completed 2 previously validated laboratory-based surgical models: small bowel anastomosis and vein patch insertion. Gold standard evaluation was the Objective Structured Assessment of Technical Skills (OSATS) method. "Efficient" techniques used were (1) quality of final product (FP); (2) snapshot assessment (SS), in which task performance was edited to a 2-minute sound bite and scored with OSATS; and (3) the surgical efficiency score (SES), a combination of final product quality and hand-motion analysis. All human observer evaluations used retrospective video analysis with 3 trained observers. Nonparametric tests were used to analyze the results. RESULTS: With respect to small bowel anastomosis, correlations with OSATS were as follows: FP 0.341 (P=.07), SS 0.577 (P<.001), and SES 0.842 (P<.001). For vein patch insertion, the correlations were as follows: FP 0.545 (P=.001), SS 0.609 (P<.001), and SES 0.700 (P<.001). Interobserver concordance was high for both models with respect to FP (Cronbach's alpha 0.80 for small bowel anastomosis and 0.84 for vein patch insertion). With respect to SS, interobserver reliability was high for vein patch insertion (Cronbach's alpha 0.80) but only moderate for small bowel anastomosis (0.59). CONCLUSIONS: The surgical efficiency score and snap shot assessments both show significant correlations with the traditional OSATS appraisals and suggest that skills assessment can be made more feasible. Correlations were closer with the former and interobserver concordance more variable with the latter, suggesting the surgical efficiency score as the most reliable of the methods evaluated.

Anastomosis, Surgical↗

Surgical skill is predicted by the ability to detect errors.

BACKGROUND: Objective analysis methods of surgical performance are now available so comparison between surgeons is available. One such method is by direct observation using the Objective Structured Assessment of Technical Skills (OSATS), but this is a time-consuming process; therefore, a simple screening tool for the ability to detect errors (previously validated) was analyzed and considered as a predictor of qualitative performance. METHODS: Thirty-eight volunteer surgeons were recruited to the skills laboratory to undertake 3 exercises. Two were bench-top surgical tasks that were scored using the global rating of the OSATS technique. The third task was the ability to detect simple errors in 22 synthetic models of common surgical procedures, some of which contained purposefully made errors. P<.05 was deemed to be statistically significant. RESULTS: The scores (interquartile ranges in parentheses) for the 3 sections were excision of sebaceous cyst=21 (19,24), closure of small bowel enterotomy=23 (21,27), and identification of errors=31 (27,34). Three scorers blinded to the operative models exhibited an interobserver reliability of .9 and .91 for the video tasks, respectively. Spearman's rank correlations between the error examination and performance on the 2 tasks were both statistically significant at .69 (cystectomy) and .54 (enterotomy). CONCLUSIONS: The ability to detect simple surgical errors is a predictor of technical skill and performance of bench tasks. What must be answered is whether the use of such models and principles can shorten the qualitative surgical learning curve.

Clinical Competence↗

The reliability of multiple objective measures of surgery and the role of human performance.

BACKGROUND: There is a need for reliable and valid objective methods of technical skills in surgery. Six-bench surgical top stations have been combined to assess basic surgical trainees (BSTs) objectively. The current study examines its reliability and validity across repeat sittings. METHODS: Eleven surgical trainees (6 senior BSTs and 5 higher surgical trainees [HSTs]) undertook 5 sittings of the 6-station assessment designed to be completed within 90 minutes. The 6 stations consisted of knot tying, suturing, closure of enterotomy, excision of sebaceous cyst, laparoscopic task, and instrument examination. Methods of analysis employed were motion analysis, observation with criteria, and inbuilt simulation metrics. RESULTS: On analysis 3 knot tying and suturing stations exhibited significant differences in either time or movement; any difference was over by the second run. The intertest reliabilities were .66, .74, .55, .51, and .65 for the 5 runs. The intratest reliability across repeated sittings varied from .56 to .96. The inter-rater reliability for video assessment varied from .77 to .94. CONCLUSION: The assessment is reliable and valid across repeated sittings. Its use in assessment of basic technical skills needs to be encouraged.

Clinical Competence↗

Selection of individuals for training in surgery.

Surgical training in the United Kingdom and Europe is in transition given the pressure to decrease the number of workweek hours and the numbers of years in training. To achieve this shortened training in the United Kingdom, the primary component will be the foundational education, which will last for 2 years, with the second year perhaps counting toward specialist training. It would be a potential advantage for achieving rapid surgical training if we could preselect those students with the necessary attributes of a surgeon. During the foundation period there is exists the question of assessment, so this might be a natural point at which to preselect these students. This article considers psychometric assessment as a methodology of preselecting surgeons and considers objective assessment as a possibility during the foundational education period.

Career Choice↗

Technical performance: relation between surgical dexterity and technical knowledge.

Technical performance consists of surgical knowledge, judgment, and dexterity. Although assessment of surgical dexterity is now possible, assessing technical knowledge and its relation to dexterity has not been elucidated. Surgeons of varying experience were recruited to the skills laboratory to undertake three assessments: simple surgical dexterity (at 14 stations scored by motion analysis), an operating room equipment examination, and a novel error analysis. The scores were correlated, and p < 0.05 was deemed to be significant. Thirty surgeons were recruited; and construct validity was exhibited in all areas. Correlations were shown to exist between the two knowledge examinations (Spearman's rho = 0.39). Correlations existed between all dexterity task parameters and the equipment examination, whereas they existed for only 15 of the 28 parameters of the error examination and were always weaker. The stronger correlations between dexterity and instrument and operating room (OR) equipment reflect greater surgical experience and time spent in the OR. The weaker correlations between the error analysis and dexterity suggest that these skills are learned at different times. The identification of common surgical errors should be more formally taught to ensure greater uniformity.

Anastomosis, Surgical↗

Ceiling effect in technical skills of surgical residents.

BACKGROUND: Objective evaluation of technical skills is now possible. The aim of this study was to evaluate whether a previously validated assessment tool can discriminate between junior and senior higher surgical trainees (HST) with regard to their technical skills. METHODS: Fifteen junior trainees (years 1 to 3) and 15 senior (years 4 to 6) were asked to perform a series of bench-model tasks, which included knot-tie at depth, vertical mattress suturing, sebaceous cyst excision, small bowel anastomosis, and saphenofemoral junction dissection. Analysis of performance included the Imperial College Surgical Assessment Device, which analyzed positional data such as total number of movements, total distance traveled, and time taken, and video-based qualitative evaluation of performance using global rating scales. In addition, all participants were asked to complete a self-assessment using exactly the same scoring system used by the observers. Statistical analysis included nonparametric tests and Cronbach's alpha was used for interrater reliability (IRR) A P value less than 0.05 was deemed significant. RESULTS: There were no significant differences in performance between junior and senior trainees for most of the tasks (IRR was 0.8 to 0.9). However, significant differences in performance were noted, in favor of the junior group, for knot-tie at depth, for two of the three parameters measured (total number of movements, P = 0.004; time taken, P = 0.01). CONCLUSIONS: In the absence of any significant differences between the groups, we can conclude that there is a ceiling effect (years 3 to 4) in performance beyond which pure technical skills, as measured by this tool, can no longer discriminate between levels of experience. Increasing the sensitivity of future assessment tools is necessary for better evaluation of performance levels. This finding also may imply that for the evaluation of senior trainees, other aspects of surgical competence should be assessed.

Adult↗

Comparison of bench test evaluations of surgical skill with live operating performance assessments.

BACKGROUND: Attempts at assessing surgical proficiency have generally used laboratory simulation to evaluate skill. The aim of this study was to compare technical ability as measured on a bench simulation with actual operative performance. STUDY DESIGN: Twenty-two general surgeons and trainees were recruited: consultants (n = 4), specialist registrars (n = 14), and senior house officers (n = 4). They were assessed while performing a saphenofemoral dissection on an anesthetized patient in the operating theater, and performing the same procedure on an inanimate model within the laboratory. The Objective Structured Assessment of Technical Skill method, consisting of a 7-parameter global rating (maximum score 35) and 17-point step-by-step checklist (maximum score 17) was used to measure performance in both environments. Face, content, and construct validity of the synthetic model were established as part of this study. RESULTS: There was a significant relationship between technical skill as measured on the bench test model and performance within the operating theater with respect to both global rating (Spearman correlation coefficient 0.824, p < 0.001; alpha coefficient 0.89) and checklist ratings (r = 0.514, p < 0.02; alpha coefficient 0.68) rating assessments. Global rating scores correlated with experience for both operative (r = 0.822, p < 0.001) and bench (r = 0.515, p < 0.05) settings. There was no difference in level of measured performance between operating theater and bench model (global rating mean 23.25 +/- 6.66 versus 23.75 +/- 5.62, respectively; paired t-test p = 0.559). CONCLUSIONS: Assessment of technical skill using inanimate procedural simulation translates to actual surgical performance within the operating theater. This further validates use of bench test evaluations to measure surgical technical ability.

Clinical Competence↗

The surgical error examination is a novel method for objective technical knowledge assessment.

BACKGROUND: Objective analysis of surgical skill is necessary. A novel method of assessment using simple error analysis in synthetic models is examined for construct validity. METHODS: Two examination protocols were devised using synthetic models. These contained either a purpose made error or were representative of good surgical practice. Protocol one contained models of skin closure and minor operations. Protocol two in addition more complex procedures. Face validity was established by the approval of senior surgeons. Junior surgeons were recruited to undertake the assessment. A p value of less than 0.05 was deemed to be significant. RESULTS: Eighty-nine surgeons were recruited. Both protocol one and two were able to discriminate between groups at statistically significant levels. CONCLUSIONS: Construct validity has been established by showing that error analysis is able to distinguish surgeons with varying levels of experience.

Clinical Competence↗

Laparoscopic transhiatal surgery of the esophagus.

OBJECTIVE: Esophagectomy is an operation with high morbidity and mortality. Its adoption as a minimally invasive operation worldwide has been slow, but the potential benefits of reducing the trauma of surgery need to be considered. Our 30-month experience with transhiatal esophagectomy in a district general hospital is presented herein. METHODS: Patients were considered for surgery after radiological staging had excluded inoperable disease. Laparoscopic staging was initially performed. Patients with tumors of the esophagus and high-grade dysplasia in a Barrett's esophagus were included. RESULTS: Twenty-nine patients were referred for consideration for resectional surgery. Nine underwent outpatient laparoscopy only. Twenty patients (age range, 34 to 78, 15 males:5 females) underwent resectional surgery. Seventeen transhiatal resections were completed, 2 were converted to open procedures, and 1 transhiatal resection of a benign tumor was performed. Median time of surgery was 415 minutes (range, 320 to 480) and blood loss was 300 mL (range, 200 to 350). The median length of post-operative ventilation and critical care stay were 1 (range, 1 to 4) and 4 (range, 2 to 8) days. Median duration of hospitalization was 17 days (range, 10 to 28). Thirty-day mortality was 0; 1 patient who was converted to an open procedure died after a cerebrovascular event on day 34. CONCLUSION: A zero mortality rate for laparoscopic resection and a low-morbidity rate compare well with morbidity and mortality in reported series using this method and open surgery. Laparoscopic transhiatal esophagectomy is an advanced, complex procedure that can be performed safely in a district general hospital setting.

Adenocarcinoma↗