PubMed Health⌕ Search

Biomedical subjects

N V Vu

Publications and source records attributed to N V Vu.

35 records · Page 2Linked to original sources

Standardized (simulated) patients' accuracy in recording clinical performance check-list items.

In large-scale performance-based assessment of medical professionals' clinical competence, simulated patients (standardized patients-SPs) are used not only to simulate case problems but also to record on check-list the examinees' clinical performance during their encounter with the SPs. The purposes of this study were to determine the SPs' overall accuracy in recording check-list items, and whether their accuracy was affected by the various characteristics of the check-list, and by the different times during a day and the different days within the examination when the recordings were obtained. Results showed that the SPs' accuracy in recording check-list items was good to very good and was affected by the length of the check-list, as well as by the type and the clarity of the check-list item. It was further found that the SPs' accuracy was consistent and did not vary over the course of a one-day or a 15-day examination.

Clinical Competence↗

Test security in examinations that use standardized-patient cases at one medical school.

The use of performance-based examinations consisting of standardized-patient (SP) cases has increased greatly in recent years. These examinations are typically long and thus require the presentation of the same SP cases to several consecutive examinee groups. Consequently, concerns have arisen about the potential for violations of test security whereby students who were tested early in the examination period pass on information to students tested later. These concerns are addressed using data from the SP-based examinations administered to five classes (1986-1990) of senior medical students at Southern Illinois University School of Medicine. Because of the length of the examinations, each class was randomly divided into five groups and the examination was administered to one group at a time, requiring three days of testing time per group and three weeks of testing time per class. The results showed no consistent, systematic changes in case means across the five groups tested at different times throughout the examination period, and thus provide no evidence of serious, widespread violations of test security.

Education, Medical↗

Effects of using two or more standardized patients to simulate the same case on case means and case failure rates.

The effects of using two or more standardized patients (multiple SPs) to simulate the same case in a performance-based examination were studied at the case level by comparing case means and case failure rates for multiple SPs simulating the same case, using data from the classes of 1988, 1989, and 1990 at the Southern Illinois University School of Medicine. For total scores and scores on the students' written answers, the effects on means and failure rates were negligible and could be explained as due to sampling error. For scores on the checklists completed by the SPs, there were more significant differences than would be expected by chance alone, even though the number of significant differences was relatively small. The results demonstrate a need for caution in the interpretation of scores obtained from a case checklist completed by multiple SPs, particularly in regard to making pass-fail decisions.

Achievement↗

Reliability and efficiency of components of clinical competence assessed with five performance-based examinations using standardized patients.

The present study was conducted to provide in-depth information on the reliabilities of measures of the separate components of clinical competence (e.g. data collection, test interpretation, diagnosis, etc.) assessed by a performance-based examination consisting of standardized-patient cases administered to five classes of senior medical students at Southern Illinois University School of Medicine. In general, the reliabilities of the competencies as they were actually measured on the examination (using the number of cases on which each competency was actually measured) were small, with 54% less than 0.30 and 75% less than 0.40. For generalizability coefficients pooled across the five classes and projected to a common number of k = 10 cases, two of the nine competencies had reliabilities in the 40s, a third was close to 0.40, and the remaining six were in the low 20s. The number of cases needed for the competencies to achieve the recommended reliability of 0.80 ranged from 45 to 170 cases, with six of the nine competencies requiring over 100 cases to reach the 0.80 level. The low reliabilities of these measures of the components of clinical competence raise serious questions about using the scores as indicators of student performance.

Clinical Clerkship↗

The use of performance-based assessment scores and traditional measures in predicting first-year residency performance.

The purpose of this study is to examine the relationship between students' performance on a performance-based clinical examination and their subsequent performance during the first year of residency. Additionally, its purpose is to further examine the relationship between the performance-based clinical examination and existing measures of clinical competence (clerkship ratings, and NBME Part I and II scores).

Clinical Clerkship↗

Use of a medical reasoning aptitude test to help predict performance in medical school.

A medical reasoning aptitude test (MRAT) was designed to assess aptitude for clinical problem-solving in medical school applicants. The purpose of the study reported here was to determine whether the information provided by this test, when used in conjunction with college grade-point averages (GPAs) and scores on the Medical College Admission Test (MCAT), would improve the prediction of medical school performance. Specifically, the authors investigated the incremental predictive value of the MRAT relative to students' overall performance in medical school and, more specifically, to their knowledge and clinical reasoning during preclinical years and clinical performance during the clerkship year. Overall, it was found that, with the exception of the first year, the addition of MRAT scores to the GPAs and MCAT scores increased precision in identifying students who performed poorly or exceptionally well in the second year and the clinical clerkship year. This last finding is especially useful, since few other tests have provided that information. On the basis of the preliminary findings, the authors propose further use and validation of the MRAT.

Achievement↗

Direct, standardized assessment of clinical competence.

Doctor ratings of clerkship performance are often discounted as not accurately reflecting clinical competence. Such ratings are influenced by the following uncontrolled variables: case difficulty; differing rater focus and standards; lack of agreement on what constitutes acceptable performance; and collective patient care responsibility masks individual contributions. Standardized direct measures of clinical competence were developed to control these factors and allow direct comparisons of student performance. Students saw 18 patients representing frequently occurring and important patient problems. Student actions and decisions were recorded and subsequent responses to questions revealed knowledge of pathophysiology, basis for actions, use and interpretation of laboratory investigations, and management. Actions and responses were graded using a pre-set key. The examination covered 73% of designated clinical competencies. Examinations scores corresponded with independent measures of clinical competence. Reliability studies indicated that new cases can be substituted in subsequent years with confidence that scores will maintain similar meaning. Costs are +6.95 per student per case, which is modest considering the quality and quantity of information acquired. Methods described are practical for evaluation of clerks and residents and for licensing and specialty certification examinations.

Clinical Clerkship↗

How medical students learn.

With recent concerns over and attempts to address issues regarding medical students' processes of learning and development of lifelong learning habits, a question often asked is: How do medical students learn in the present medical curriculum? In this study, the authors directly attempt to answer that question--they assess the learning behaviors of 254 students in two medical schools, one with an objectives-based mastery and one with a traditional curricula, and discuss whether the students' adopted behaviors are conducive to the development of effective, analytic, and independent learning. Most students of both medical schools reported very similar effective and ineffective learning behaviors. The students' behaviors were found to dispose them more to analytic learning than to independent learning. Suggestions to restructure the curriculum for better development of students' independent learning habits are proposed.

Behavior↗

The effect of clinical experiences in medical school on specialty choice decisions.

Medical students' specialty choice decisions are usually made by the middle or end of the clinical year. In the study here, the authors investigated the extent to which various factors during clinical clerkships affected specialty choice. Debts, other financial considerations, and length of residency had little overall effect on students' choices. The order of clerkships was of particular significance for the undecided students. Members of the clinical teaching faculty exercised a strong role-modeling effect throughout medical school. During clerkships, however, the greatest influence on specialty choice came first from the interplay of faculty members and experiences and second from faculty members by themselves; experiences alone affected few students. The influence of faculty members and clerkship experiences was greatest among students who chose psychiatry. Additionally, most students who selected psychiatry had originally intended to enter other specialties. The large majority of those who chose family practice, internal medicine, and surgery had made their decision prior to emerging clerkships and, therefore, clinical experiences and the faculty tended to affect them the least.

Career Choice↗