PubMed Health⌕ Search

PubMed · 16123262

A work-centered approach for setting passing scores on performance-based assessments.

Abstract

Standardized patient examinations are being used for high-stakes decisions (e.g., graduation, licensure, and certification) with growing frequency. Concurrently, research on methods to determine the passing score for these types of performance-based assessments has increased. A wide variety of approaches have been considered in the past several years, many based on traditional techniques developed for use with multiple-choice examinations. More and more, techniques that center on review of examinee work have been employed, often resulting in the establishment of defensible, reproducible standards. The purpose of this article is to describe and evaluate a work-centered approach for determining the passing score for a performance-based assessment of clinical skills. A description of an approach to set passing scores that involves expert review of examinee work is presented. Application and evaluation of the method are illustrated using examination materials obtained from a high-stakes certification assessment.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Danette Waller McKinley, John R Boulet, Ronald K Hambleton. 2005. A work-centered approach for setting passing scores on performance-based assessments.. https://doi.org/10.1177/0163278705278282

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Assessing the American Board of Orthodontics objective grading system: digital vs plaster dental casts.

INTRODUCTION: The purposes of this study were to determine whether the American Board of Orthodontics objective grading system (ABO OGS) can be assessed accurately from digital dental casts and whether there are statistical differences between digital and plaster dental casts in scoring the ABO OGS. METHODS: Thirty posttreatment plaster dental casts were selected and scanned by OrthoCAD (Cadent, Carlstadt, NJ) to produce 30 corresponding digital dental casts. The plaster and digital casts were compared by using the criteria of the ABO OGS. Because the data were ordinal, a nonparametic statistical analysis was used. RESULTS: The Wilcoxon test for paired samples showed significant differences between the plaster and digital casts for occlusal contacts, occlusal relationships, and total scores (P <.05). No significant differences were found for alignment, marginal ridges, overjet, and interproximal contacts. Buccolingual inclination was not included in this study because of inability to perform proper measurements with the OrthoCAD program. Mean differences of points deducted ranged from .03 point for marginal ridges to 5.07 points for the total score. The variable with the most points deducted related to occlusal relationships, and the fewest points were deducted for interproximal contacts. CONCLUSIONS: Based on this study, the current OrthoCAD program (version 2.2) was not adequate for scoring all parameters as required by the ABO OGS.

Certification↗