PubMed Health⌕ Search

Biomedical subjects

Emil R Petrusa

Publications and source records attributed to Emil R Petrusa.

11 recordsLinked to original sources

Effect of practice on standardised learning outcomes in simulation-based medical education.

OBJECTIVES: This report synthesises a subset of 31 journal articles on high-fidelity simulation-based medical education containing 32 research studies drawn from a larger qualitative review published previously. These studies were selected because they present adequate data to allow for quantitative synthesis. We hypothesised an association between hours of practice in simulation-based medical education and standardised learning outcomes measured as weighted effect sizes. METHODS: Journal articles were screened using 5 exclusion and inclusion criteria. Response data were extracted and 3 judges independently coded each study. Learning outcomes were standardised using a common metric, the average weighted effect size (AWES), due to the heterogeneity of response measures in individual studies. anova was used to evaluate AWES differences due to hours of practice on a high-fidelity medical simulator cast in 5 categories. The eta squared (eta2) statistic was used to assess the association between AWES and simulator practice hours. RESULTS: There is a strong association (eta2=0.46) between hours of practice on high-fidelity medical simulators and standardised learning outcomes. The association approximates a dose-response relationship. CONCLUSIONS: Hours of high-fidelity simulator practice have a positive, functional relationship with standardised learning outcomes in medical education. More rigorous research methods and more stringent journal editorial policies are needed to advance this field of medical education research.

Analysis of Variance↗

Stroke training of prehospital providers: an example of simulation-enhanced blended learning and evaluation.

Since appropriate treatment of patients in the first few hours of ischemic stroke may decrease the risk of long-term disability, prehospital providers should recognize, assess, manage and communicate about stroke patients in an effective and time-efficient manner. This requires the instruction and evaluation of a wide range of competencies including clinical skills, patient investigation and management and communication skills. The authors developed and assessed the effectiveness of a simulation-enhanced stroke course that incorporates several different learning strategies to evaluate competencies in the care of acute stroke patients. The one-day, interactive, emergency stroke course features a simulation-enhanced, blended-learning approach that includes didactic lectures, tabletop exercises, and focused-examination training and small-group sessions led by paramedic instructors as standardized patients portraying five key neurological syndromes. From January to October 2000, 345 learners were assessed using multiple-choice tests as were randomly selected group of 73 learners using skills' checklists during two pre- and two post-course simulated patient encounters. Among all learners there was a significant gain in knowledge (pre: 53.9%+/-13.9 and post: 85.4%+/-8.5; p<0.001), and for the 73 learners a significant improvement in their clinical and communication skills (p<0.0001 for all). By using a simulation-enhanced, blended-learning approach, pre-hospital paraprofessionals were successfully trained and evaluated in a wide range of competences that will lead to the more improved recognition and management of acute stroke patients.

Brain Ischemia↗

Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review.

REVIEW DATE: 1969 to 2003, 34 years. BACKGROUND AND CONTEXT: Simulations are now in widespread use in medical education and medical personnel evaluation. Outcomes research on the use and effectiveness of simulation technology in medical education is scattered, inconsistent and varies widely in methodological rigor and substantive focus. OBJECTIVES: Review and synthesize existing evidence in educational science that addresses the question, 'What are the features and uses of high-fidelity medical simulations that lead to most effective learning?'. SEARCH STRATEGY: The search covered five literature databases (ERIC, MEDLINE, PsycINFO, Web of Science and Timelit) and employed 91 single search terms and concepts and their Boolean combinations. Hand searching, Internet searches and attention to the 'grey literature' were also used. The aim was to perform the most thorough literature search possible of peer-reviewed publications and reports in the unpublished literature that have been judged for academic quality. INCLUSION AND EXCLUSION CRITERIA: Four screening criteria were used to reduce the initial pool of 670 journal articles to a focused set of 109 studies: (a) elimination of review articles in favor of empirical studies; (b) use of a simulator as an educational assessment or intervention with learner outcomes measured quantitatively; (c) comparative research, either experimental or quasi-experimental; and (d) research that involves simulation as an educational intervention. DATA EXTRACTION: Data were extracted systematically from the 109 eligible journal articles by independent coders. Each coder used a standardized data extraction protocol. DATA SYNTHESIS: Qualitative data synthesis and tabular presentation of research methods and outcomes were used. Heterogeneity of research designs, educational interventions, outcome measures and timeframe precluded data synthesis using meta-analysis. HEADLINE RESULTS: Coding accuracy for features of the journal articles is high. The extant quality of the published research is generally weak. The weight of the best available evidence suggests that high-fidelity medical simulations facilitate learning under the right conditions. These include the following: providing feedback--51 (47%) journal articles reported that educational feedback is the most important feature of simulation-based medical education; repetitive practice--43 (39%) journal articles identified repetitive practice as a key feature involving the use of high-fidelity simulations in medical education; curriculum integration--27 (25%) journal articles cited integration of simulation-based exercises into the standard medical school or postgraduate educational curriculum as an essential feature of their effective use; range of difficulty level--15 (14%) journal articles address the importance of the range of task difficulty level as an important variable in simulation-based medical education; multiple learning strategies--11 (10%) journal articles identified the adaptability of high-fidelity simulations to multiple learning strategies as an important factor in their educational effectiveness; capture clinical variation--11 (10%) journal articles cited simulators that capture a wide variety of clinical conditions as more useful than those with a narrow range; controlled environment--10 (9%) journal articles emphasized the importance of using high-fidelity simulations in a controlled environment where learners can make, detect and correct errors without adverse consequences; individualized learning--10 (9%) journal articles highlighted the importance of having reproducible, standardized educational experiences where learners are active participants, not passive bystanders; defined outcomes--seven (6%) journal articles cited the importance of having clearly stated goals with tangible outcome measures that will more likely lead to learners mastering skills; simulator validity--four (3%) journal articles provided evidence for the direct correlation of simulation validity with effective learning. CONCLUSIONS: While research in this field needs improvement in terms of rigor and quality, high-fidelity medical simulations are educationally effective and simulation-based education complements medical education in patient care settings.

Clinical Competence↗

A multicenter study to provide evidence of construct validity in a computer-based outcome measure of neurology clinical skills.

BACKGROUND: Using computer-based simulation to assess clinical skill-a key competence for medical trainees-enables standardization and exposure to a broad sample of physical findings. The purpose of this study is to provide evidence of construct validity for a computer-based outcome measure of neurology clinical skills. METHOD: A total of 128 medical students and neurology residents at four institutions volunteered to take a 34-question computer-based test designed to measure neurology clinical skills. Subjects were classified into three groups based on level of training: novice, intermediate, and experienced. RESULTS: Overall performance increased with level of training. Question difficulty discriminated between groups as predicted. Twenty-six of 34 individual items discriminated between novices and more advanced learners. This test separated learners at different levels of training with a consistency of .92. CONCLUSION: This study provided evidence of construct validity for a computer-based outcome measure of neurology clinical skills.

Clinical Competence↗

Taking standardized patient-based examinations to the next level.

PURPOSE: The purpose of this article is to summarize this author's view on "where we are" with standardized patient-based assessments of clinical performance and to offer three directions for further research and development. SUMMARY: The push for more objective outcome data has fueled proliferation of the most researched innovation in the history of medical education. Near-random clinical experiences of students do not provide consistent, repeated practice with important clinical cases to achieve minimally adequate performance on these objective performance examinations, leading to scoring "psychogymnastics" to titrate fail rates. The second area is to modify these examinations to reflect features at higher levels of professional development such as situational awareness. Theories of professional development should guide changes. The third area incorporates multiperson scenarios; a clinician with a family or a team in the operating room. Simulation of complex situations, especially those requiring rapid, accurate communication and action can reduce medical errors and improve patient safety. CONCLUSIONS: Standardized patient-based examinations provide objective outcome data but require artificial adjustments in scoring due to inconsistent learning opportunities. Theoretical research on professional development, acquisition of expertise and team functioning provides fertile, new directions to take standardized patient-based examinations to the next level.

Education, Medical↗

Development of a reliable multimedia, computer-based measure of clinical skills in bedside neurology.

PURPOSE: This study reports the development of reliable multimedia, computer-based measures of bedside neurology skills. METHOD: A consortium of neurologists and medical educators (1) identified bedside skills and (2) created a computer-based test. Test-item stems were multimedia clips of standardized patients. Options appeared as text. Sixty-one junior medical students responded to these items. RESULTS: The 77-item test yielded a reliability coefficient of 0.85. Subgroup item analysis resulted in reliability coefficients of 0.73 for the 20-question "pretest" (Test A) and 0.75 for the 20-question "posttest" (Test B). CONCLUSION: Two sets of test items were developed that can be used as outcome measures in studies that assess the effectiveness of educational interventions in bedside neurology.

Clinical Competence↗

Factors influencing outcome of the American Board of Surgery Certifying examination: an observational study.

BACKGROUND: Because of the content of the American Board of Surgery (ABS) certifying (oral) examination, there is a perception that those in some subspecialty surgical training programs at the time of the examination may have a lower pass rate. In addition, the format of the oral examination has prompted the use of specialized preparation such as "mock orals" and commercial courses. The purpose of this study was to correlate the pass rates on the ABS certifying examination with the practice status and methods of specialized preparation. MATERIALS AND METHODS: A survey covering demographic information, type of surgical practice at the time of the examination, methods of preparation, and results of the examination was distributed to 1997 and 1998 graduates via a request to surgical residency program directors. RESULTS: One hundred one of 268 program directors supplied 717 names. There were 465 responses. Surveys distributed by the other 167 program directors resulted in an additional 81 responses. Four hundred ten (75%) of the respondents had taken the certifying examination. The total pass rate was 91%. There were no significant differences in the pass rate between those in private practice general surgery; those in academic general surgery; Thoracic, Vascular, or Plastic Surgery Fellows; those in other surgical fellowships; and those in the military or research. No significant differences in the pass rates were noted between those who prepared with formal mock orals, with informal mock orals, with a commercial course, with combinations of the three, and with no specialized preparation. CONCLUSION: Performance on the ABS certifying examination was not influenced by the candidate's practice status at the time of the examination. A substantial percentage of examinees either are exposed to or perceive the need to pursue specialized preparation for the examination, a behavior that in general produces good results.

Certification↗

Effectiveness of a cardiology review course for internal medicine residents using simulation technology and deliberate practice.

BACKGROUND: Objective evaluations of residents' clinical skills reveal serious deficits. PURPOSE: To develop, implement, and evaluate outcomes from a review course in cardiology bedside skills for internal medicine residents. METHODS: We used a 1-group pretest-posttest design with historical comparisons. The study was conducted at the University of Miami School of Medicine as part of the internal medicine residency program from July 1999 to June 2000. A total of 67 2nd- and 3rd-year medicine residents received an educational intervention involving deliberate practice using simulation technology. A total of 155 4th-year medical students in one intervention and one comparison group (n = 53) served as historical comparisons. Outcome measures were a reliable computer-delivered pretest and posttest that evaluate cardiology bedside skills. RESULTS: Residents who received the review course and medical students who received a comparable educational intervention showed large and statistically significant pretest-to-posttest improvement in bedside skills. These 2 groups are also significantly and substantially different at posttest from a comparison group of 4th-year medical students that did not receive a specific educational intervention. CONCLUSION: Educational interventions using simulation technology that engage learners in deliberate practice of clinical skills produce large improvements in a relatively short time, with little faculty involvement.

Cardiology↗

Development, implementation and outcomes of a training program for responders to acts of terrorism.

INTRODUCTION: Responding to acts of terrorism requires the effective use of public-safety and medical-response resources. The knowledge, skills and attitudes necessary to respond to future threats is unfamiliar to most emergency responders. OBJECTIVES: The purpose of this report to describe the development, implementation and evaluation of a multidisciplinary, interactive and simulation-enhanced course to prepare responders to acts of terrorism. METHODS: We used a 5-step systematic process to develop a blended-learning, simulation-enhanced training program. Learners completed a self-confidence questionnaire and written examination prior to the course and a self-confidence questionnaire, written examination and course evaluation when they finished the course. RESULTS: From July 7, 2003 to March 8, 2005, 497 consenting learners completed the course. After course completion, learners demonstrated significant increases in their knowledge of terrorism response (t = -64.3, df = 496, p < 0.05) and their confidence in responding to terrorist events (t = -45.5, df = 496, p < 0.05). Learner feedback about the course was highly positive. CONCLUSIONS: We successfully implemented a two-day course for professionals likely to respond to terrorist acts that included scenario-based performance training and assessment. Course participants increased their knowledge and were more confident in their ability to respond to acts of terrorism after participating in this course.

Adult↗

Skill improvement during emergency response to terrorism training.

OBJECTIVES: To assess the individual and team skills acquired from an interactive training program to prepare emergency personnel to respond to terrorist acts. METHODS: We developed a 16-hour, two-day, multimedia- and simulation-enhanced course that places learners in realistic situations using the equipment required to respond to various chemical, biologic, radiologic, and explosive acts of terrorism. Small-group sessions and drills were conducted. Errors in skill performance were corrected immediately, and then skills were repeated to achieve mastery. Participants included emergency medical technicians, paramedics, nurses, and physicians. Team performance was assessed over four successive scenarios using a 100-mm visual analog scale. Individual learner skill acquisition was assessed with precourse and postcourse evaluation of selected skills in a randomized sampling of consenting learners. RESULTS: Nearly all teams achieved mastery of the required skills by the second assessment rotation. Individual learners demonstrated significant gains in the ability to emergently don personal protective equipment and administer a nerve agent antidote kit. CONCLUSIONS: An interactive, simulation-enhanced curriculum of terrorism response training for emergency responders can produce significant, quantifiable individual and team skill gain. Future studies should further address performance benchmarks for these newly acquired skills.

Adult↗