PubMed Health⌕ Search

PubMed · 16354136

The cognitive validity of the Script Concordance Test: a processing time study.

Abstract

BACKGROUND: According to the theory on which the Script Concordance Test (SCT) is based, scripts contain expectations on features that are associated with each illness and about the range of values that are typical, atypical, or incompatible. PURPOSE: To document the construct validity of the SCT, we investigated the theory prediction that once a script is activated, new incoming information (e.g., additional clinical features) is processed faster if it is typical for that script than if it is atypical. If it is incompatible, processing time falls in between. METHODS: We presented 2 groups of participants (30 fourth-year medical students and 30 full-time geriatricians) with 64 clinical vignettes (divided over 5 types of prevalent clinical presentations in geriatrics), each accompanied by a diagnostic hypothesis aimed to instantiate an appropriate script. Next, we presented a new finding, which could be typical, atypical, or incompatible given the hypothesis. Participants had to decide as quickly and accurately as possible whether the new finding increased, decreased, of did not affect the likelihood of the diagnostic hypothesis. We administered the test on a computer. The dependent variable was processing time. We analyzed data with a repeated measure 2 x 3 analysis of variance. RESULTS: Typical information was processed faster than atypical and incompatible information (M = 10.6 sec vs. 19.2 sec and 16.4 sec, respectively; p lt; .001 for both). Incompatible information was processed faster than atypical information (16.4 sec vs. 19.2; p < .001). There was no significant difference between the groups of geriatricians and students. CONCLUSION: It is possible to predict what kind of information will be processed faster depending of the typicality and compatibility of clinical data for given hypotheses. Results support SCT construct validity.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Robert Gagnon, Bernard Charlin, Louise Roy, Monique St-Martin, Evelyne Sauvé, Henny P A Boshuizen, Cees van der Vleuten. 2006. The cognitive validity of the Script Concordance Test: a processing time study.. https://doi.org/10.1207/s15328015tlm1801_6

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Surgical residents as medical student mentors.

BACKGROUND: Medical students' decreasing interest in surgery may be caused by the inadequate availability of role models. We believe that surgical residents show the qualities of outstanding surgical mentors and are in a key position to influence students' career choices. METHODS: In 2004-2005, 117 medical students at Mount Sinai School of Medicine completed their third-year surgery clerkship. They were asked to complete an anonymous survey regarding a career in surgery and surgical mentors. RESULTS: A total of 107 students (91%) completed the survey. Seventy-nine percent were influenced positively toward a surgical career after the clerkship. A higher fraction of these students identified a mentor or role model than the students who did not increase their interest in surgery (95% vs 52%). Residents scored higher than attendings in 12 of 14 qualities describing outstanding clinical mentors (P < .001). CONCLUSIONS: Role models are crucial in bolstering medical students' interest in surgical careers. Residents are identified as having qualities that are essential to being an outstanding mentor and residents may play a role in influencing students' career choices.

Clinical Clerkship↗

A web-based system for students to document their experiences within six core competency domains during all clinical clerkships.

The authors describe the design and implementation of a new Web-based system that allows students to record important features of their clinical encounters during all 10 required clinical clerkships, document their learning experiences in six major competency domains, and generate detailed real-time reports for themselves and their clerkship directors. A new Web-based system, DMEDS (Dartmouth Medical Encounter Documentation System), accepts input from computers and PDAs. Its design permits students to describe their patients, learning sites, interactions with preceptors, and important aspects of their clinical encounters in all of our medical school's competency domains. Using a common format for all required clerkships, clerkship directors select specific items most relevant to their clerkships from a common menu and set learning targets for specific diagnoses and clinical skills. This new system was designed in the fall of 2003, tested in the spring of 2004, and implemented in all clerkships for the 2004 to 2005 academic year. During the first full academic year that DMEDS was used, students documented nearly 32,000 discrete student-patient-preceptor encounters, an average of between 21 and 120 clinical encounters per Year 3 clerkship. Highlights of the analysis of these initial data include the following: (1) insights into how educational targets are set, (2) the extent of site-to-site variation in clerkship experiences, (3) the epidemiology of patients' declining student involvement, and (4) student experiences in and understanding of the newer competency domains.DMEDS can be used in all clinical clerkships and can address student experiences in all competency domains. It provides substantial value to students, clerkship directors, preceptors, and medical school administrators. As secondary benefits, the authors found that DMEDS facilitates educational research and is readily adapted for use in residency and fellowship programs as well. Student feedback highlights the need to pay close attention to the time invested by students documenting their clinical encounters. Course directors must ensure that the benefits to students (such as knowledge of meeting learning targets and preceptors providing direct feedback to students) are transparent. Finally, for other schools contemplating the change to a competency-based curriculum with the use of a clinical encounter documentation system, the time required for both students and faculty to adopt and fully engage these major educational culture shifts seems to be at least several years.

Clinical Clerkship↗