PubMed Health⌕ Search
Home/Archive/PubMed

PubMed · 1520417

Screening test length for sequential testing with a standardized-patient examination: a receiver operating characteristic (ROC) analysis.

J A Colliver·N V Vu·H S Barrows
View original source ↗Export metadata ↓

Abstract

The feasibility of using sequential testing (i.e., using a screening test) to reduce the length and expense of a performance-based examination with standardized-patient cases was demonstrated previously. In the present study, quantitative criteria rather than practical considerations were used to determine optimal values for the length of the screening test (i.e., number of cases) and the location of the screening pass-fail cutoff (i.e., its relation to the mean of the pass levels for the different cases). Data were derived from five classes of senior students at the Southern Illinois University School of Medicine, 1987-1991. Specifically, receiver operating characteristic (ROC) curves were plotted for screening tests of varying lengths, with the points on each ROC curve corresponding to different pass-fail cutoffs on the screening test. The results showed that good accuracy can be attained with a screening test that is only one-third the length of the full examination and that the cutoff for this screen should be set slightly above the mean of the case pass levels to maximize sensitivity and specificity. The authors conclude that their study demonstrates the value of an ROC analysis in evaluating the psychometric properties of a screening test in sequential testing.

Explore related subjects

Clinical ClerkshipClinical CompetenceEducation, Medical, UndergraduateEducational MeasurementFeasibility StudiesHumansPsychometricsROC CurveJournal Article

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J A Colliver, N V Vu, H S Barrows. 1992. Screening test length for sequential testing with a standardized-patient examination: a receiver operating characteristic (ROC) analysis.. https://doi.org/10.1097/00001888-199209000-00010

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Surgical residents as medical student mentors.

BACKGROUND: Medical students' decreasing interest in surgery may be caused by the inadequate availability of role models. We believe that surgical residents show the qualities of outstanding surgical mentors and are in a key position to influence students' career choices. METHODS: In 2004-2005, 117 medical students at Mount Sinai School of Medicine completed their third-year surgery clerkship. They were asked to complete an anonymous survey regarding a career in surgery and surgical mentors. RESULTS: A total of 107 students (91%) completed the survey. Seventy-nine percent were influenced positively toward a surgical career after the clerkship. A higher fraction of these students identified a mentor or role model than the students who did not increase their interest in surgery (95% vs 52%). Residents scored higher than attendings in 12 of 14 qualities describing outstanding clinical mentors (P < .001). CONCLUSIONS: Role models are crucial in bolstering medical students' interest in surgical careers. Residents are identified as having qualities that are essential to being an outstanding mentor and residents may play a role in influencing students' career choices.

Clinical Clerkship↗
PubMed2007

A web-based system for students to document their experiences within six core competency domains during all clinical clerkships.

The authors describe the design and implementation of a new Web-based system that allows students to record important features of their clinical encounters during all 10 required clinical clerkships, document their learning experiences in six major competency domains, and generate detailed real-time reports for themselves and their clerkship directors. A new Web-based system, DMEDS (Dartmouth Medical Encounter Documentation System), accepts input from computers and PDAs. Its design permits students to describe their patients, learning sites, interactions with preceptors, and important aspects of their clinical encounters in all of our medical school's competency domains. Using a common format for all required clerkships, clerkship directors select specific items most relevant to their clerkships from a common menu and set learning targets for specific diagnoses and clinical skills. This new system was designed in the fall of 2003, tested in the spring of 2004, and implemented in all clerkships for the 2004 to 2005 academic year. During the first full academic year that DMEDS was used, students documented nearly 32,000 discrete student-patient-preceptor encounters, an average of between 21 and 120 clinical encounters per Year 3 clerkship. Highlights of the analysis of these initial data include the following: (1) insights into how educational targets are set, (2) the extent of site-to-site variation in clerkship experiences, (3) the epidemiology of patients' declining student involvement, and (4) student experiences in and understanding of the newer competency domains.DMEDS can be used in all clinical clerkships and can address student experiences in all competency domains. It provides substantial value to students, clerkship directors, preceptors, and medical school administrators. As secondary benefits, the authors found that DMEDS facilitates educational research and is readily adapted for use in residency and fellowship programs as well. Student feedback highlights the need to pay close attention to the time invested by students documenting their clinical encounters. Course directors must ensure that the benefits to students (such as knowledge of meeting learning targets and preceptors providing direct feedback to students) are transparent. Finally, for other schools contemplating the change to a competency-based curriculum with the use of a clinical encounter documentation system, the time required for both students and faculty to adopt and fully engage these major educational culture shifts seems to be at least several years.

Clinical Clerkship↗