PubMed Health⌕ Search

PubMed · 1985673

Comparing students' feedback about clinical instruction with their performances.

Abstract

Validation of students' feedback as a measure of teaching effectiveness has been problematic for courses teaching clinical skills. This is true in part because establishing a valid and reliable method of assessing students' mastery of clinical skills has been a stumbling block. Reported here is the correlation of students' performances on an objective structured clinical examination (OSCE) with previously and independently collected feedback from students. In 1987-88, 190 second-year medical students at the University of Minnesota Medical School--Minneapolis spent one fourth of a second-year clinical skills course on neurology randomly assigned to one of four teaching sites--hospitals A, B, C, and D. Following their rotations, 180 of the students completed usable feedback forms. The students were consistently and significantly more positive about the teaching at hospital A. At the end of the year, all 190 students were tested using an OSCE having 20 stations, four of which presented neurologic problems. The students who had the neurology course at hospital A performed better on all four neurology problems, and differences were statistically significant for two of the problems. Feedback in this case accurately reflected a more effective teaching program.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

D C Anderson, I B Harris, S Allen, L Satran, C J Bland, J A Davis-Feickert, G A Poland, W J Miller. 1991. Comparing students' feedback about clinical instruction with their performances.. https://doi.org/10.1097/00001888-199101000-00009

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Conditional reliability of admissions interview ratings: extreme ratings are the most informative.

CONTEXT: Admissions interviews are unreliable and have poor predictive validity, yet are the sole measures of non-cognitive skills used by most medical school admissions departments. The low reliability may be due in part to variation in conditional reliability across the rating scale. OBJECTIVES: To describe an empirically derived estimate of conditional reliability and use it to improve the predictive validity of interview ratings. METHODS: A set of medical school interview ratings was compared to a Monte Carlo simulated set to estimate conditional reliability controlling for range restriction, response scale bias and other artefacts. This estimate was used as a weighting function to improve the predictive validity of a second set of interview ratings for predicting non-cognitive measures (USMLE Step II residuals from Step I scores). RESULTS: Compared with the simulated set, both observed sets showed more reliability at low and high rating levels than at moderate levels. Raw interview scores did not predict USMLE Step II scores after controlling for Step I performance (additional r2 = 0.001, not significant). Weighting interview ratings by estimated conditional reliability improved predictive validity (additional r2 = 0.121, P < 0.01). CONCLUSIONS: Conditional reliability is important for understanding the psychometric properties of subjective rating scales. Weighting these measures during the admissions process would improve admissions decisions.

Education, Medical, Undergraduate↗