Developing a clinical competency examination in radiology: part I--test structure.

Abstract

BACKGROUND: There is a need for radiology educational outcome measures that evaluate clinical competency. This is the first of two articles introducing a clinical competency examination in radiology. This first article describes the evolution and structure of the examination. The second article presents the results of two administrations of the examination and evaluates possible outcome predictors. OBJECTIVE: To develop a measure of clinical competency in radiology. DESIGN: Descriptive. METHODS: A test was developed to simulate the radiologic interpretive skills needed in clinical chiropractic practice. Students were timed as they responded to questions regarding the localization, categorization, management, and identification of pathologic conditions presented on plain film images of the spine and chest. Twenty-five radiographic cases were displayed at individual viewbox stations, and student responses to the 4 questions were compared with the consensus responses of 2 radiology instructors. RESULTS: Two versions of the test, using different cases, were given to the same ninth trimester class of 210 chiropractic students in a 10-trimester program. Of the 210 students, 116 (55.2%; 86 men and 30 women) took version 1 of the examination, and 1 month later 181 (86.2%: 138 men and 43 women) took version 2 of the examination. Student comments after each examination were favorable. CONCLUSION: The test structure uniquely provides information related to the student's ability to localize, categorize, manage, and identify pathologic conditions on imaging studies. At present the examination is instructor time intensive; further refinement is needed before wide implementation can occur.