PubMed Health⌕ Search
Home/Archive/PubMed

PubMed · 16904971

Implementation of a novel web-based objective structured clinical evaluation.

Gary B Nackman·Michelle Griggs·Jim Galt
View original source ↗Export metadata ↓

Abstract

BACKGROUND: This study was performed to identify factors that impact student performance on a web-based objective structured clinical evaluation (OSCE) that was developed to improve the evaluation process of students who complete a fourth-year surgical clerkship in trauma-critical care. METHODS: We created a multiple-choice OSCE with commercially available software. Clinical cases were developed for incorporation into 7 quizzes that were assembled to appear as 1 examination. Students used intensive care unit flow sheets to review data, to develop a systems-based problem list and differential diagnoses, and to produce treatment recommendations. RESULTS: No difference was noted in a comparison of the mean scores that were achieved by students on a previous paper (essay format) OSCE and the new web OSCE. There was a correlation of student performance on the web OSCE to the National Board of Medical Examiners (NBME) subject examination that had been completed the previous year (r = 0.60; P < .0001). Performance on the NBME subject examination was the only independent factor that affected reporter, interpreter, and manager skills that were assessed by the OSCE (P < .01). CONCLUSION: Implementation of a web OSCE resulted in similar performance of the class as compared with performance on the previous paper OSCE. Correlation of student achievement on the web OSCE to the NBME subject examination supported the construct validity of this institutional examination beyond the areas of face and content validity in which OSCEs may excel.

Explore related subjects

Clinical ClerkshipComputer-Assisted InstructionCritical CareEducational MeasurementGeneral SurgeryHumansInternetRegression AnalysisReproducibility of ResultsEvaluation StudyJournal Article

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Gary B Nackman, Michelle Griggs, Jim Galt. 2006. Implementation of a novel web-based objective structured clinical evaluation.. https://doi.org/10.1016/j.surg.2006.05.004

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Surgical residents as medical student mentors.

BACKGROUND: Medical students' decreasing interest in surgery may be caused by the inadequate availability of role models. We believe that surgical residents show the qualities of outstanding surgical mentors and are in a key position to influence students' career choices. METHODS: In 2004-2005, 117 medical students at Mount Sinai School of Medicine completed their third-year surgery clerkship. They were asked to complete an anonymous survey regarding a career in surgery and surgical mentors. RESULTS: A total of 107 students (91%) completed the survey. Seventy-nine percent were influenced positively toward a surgical career after the clerkship. A higher fraction of these students identified a mentor or role model than the students who did not increase their interest in surgery (95% vs 52%). Residents scored higher than attendings in 12 of 14 qualities describing outstanding clinical mentors (P < .001). CONCLUSIONS: Role models are crucial in bolstering medical students' interest in surgical careers. Residents are identified as having qualities that are essential to being an outstanding mentor and residents may play a role in influencing students' career choices.

Clinical Clerkship↗
PubMed2007

A web-based system for students to document their experiences within six core competency domains during all clinical clerkships.

The authors describe the design and implementation of a new Web-based system that allows students to record important features of their clinical encounters during all 10 required clinical clerkships, document their learning experiences in six major competency domains, and generate detailed real-time reports for themselves and their clerkship directors. A new Web-based system, DMEDS (Dartmouth Medical Encounter Documentation System), accepts input from computers and PDAs. Its design permits students to describe their patients, learning sites, interactions with preceptors, and important aspects of their clinical encounters in all of our medical school's competency domains. Using a common format for all required clerkships, clerkship directors select specific items most relevant to their clerkships from a common menu and set learning targets for specific diagnoses and clinical skills. This new system was designed in the fall of 2003, tested in the spring of 2004, and implemented in all clerkships for the 2004 to 2005 academic year. During the first full academic year that DMEDS was used, students documented nearly 32,000 discrete student-patient-preceptor encounters, an average of between 21 and 120 clinical encounters per Year 3 clerkship. Highlights of the analysis of these initial data include the following: (1) insights into how educational targets are set, (2) the extent of site-to-site variation in clerkship experiences, (3) the epidemiology of patients' declining student involvement, and (4) student experiences in and understanding of the newer competency domains.DMEDS can be used in all clinical clerkships and can address student experiences in all competency domains. It provides substantial value to students, clerkship directors, preceptors, and medical school administrators. As secondary benefits, the authors found that DMEDS facilitates educational research and is readily adapted for use in residency and fellowship programs as well. Student feedback highlights the need to pay close attention to the time invested by students documenting their clinical encounters. Course directors must ensure that the benefits to students (such as knowledge of meeting learning targets and preceptors providing direct feedback to students) are transparent. Finally, for other schools contemplating the change to a competency-based curriculum with the use of a clinical encounter documentation system, the time required for both students and faculty to adopt and fully engage these major educational culture shifts seems to be at least several years.

Clinical Clerkship↗