PubMed Health⌕ Search
Home/Archive/PubMed

PubMed · 2790130

On assessing interrater agreement for multiple attribute responses.

L L Kupper·K B Hafner
View original source ↗Export metadata ↓

Abstract

New methods are developed for assessing the extent of interrater agreement when each unit to be rated is characterized by a (possibly empty) subset of a specified set of distinct nominal attributes. For such multiple attribute response data, a two-rater concordance statistic is derived, and associated statistical inference-making procedures are provided. This concordance statistic is corrected for chance agreement by using an underlying hypergeometric model. Numerical examples are given to illustrate the proposed methodology, and comparisons to other agreement statistics (e.g., kappa) are made.

Explore related subjects

BiometryHumansMathematicsModels, StatisticalResearch DesignComparative StudyJournal ArticleResearch Support, U.S. Gov't, P.H.S.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

L L Kupper, K B Hafner. 1989. On assessing interrater agreement for multiple attribute responses.. https://pubmed.ncbi.nlm.nih.gov/2790130/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Tutorial in biostatistics: competing risks and multi-state models.

Standard survival data measure the time span from some time origin until the occurrence of one type of event. If several types of events occur, a model describing progression to each of these competing risks is needed. Multi-state models generalize competing risks models by also describing transitions to intermediate events. Methods to analyze such models have been developed over the last two decades. Fortunately, most of the analyzes can be performed within the standard statistical packages, but may require some extra effort with respect to data preparation and programming. This tutorial aims to review statistical methods for the analysis of competing risks and multi-state models. Although some conceptual issues are covered, the emphasis is on practical issues like data preparation, estimation of the effect of covariates, and estimation of cumulative incidence functions and state and transition probabilities. Examples of analysis with standard software are shown.

Biometry↗
PubMed2007

The role of education in biostatistical consulting.

Medical students, residents, postdoctoral fellows, and faculty commonly consult with biostatistical experts about study design and data analysis when conducting clinical research. The role of biostatistical training during these consultations is examined, and characterizations of the connections between biostatistical consultation and education are reviewed. The presence and kinds of teaching efforts during biostatistical consults at four academic research institutions over various periods of time between 1999 and 2005 (237 consultations in total) were recorded and are described. By site, 67, 70, 78, and 100 per cent of the consulting sessions included biostatistical training, with an overall 78 per cent (95 per cent CI: 73-83 per cent) of consultations including an educational component when all consultations were combined. Training covered a wide range of biostatistical topics. Seventy-five per cent of the consultations with faculty (120/161), 79 per cent with fellows and residents (31/39), and 100 per cent with medical students (10/10) included some degree of instruction in study design or statistical analysis topics. Results show that both the need and the opportunity exist for specialized biostatistical instruction during one-on-one sessions between a consulting biostatistician and physicians, medical students, and research staff. Academic researchers are ideally positioned to absorb this kind of training when they initiate a request for assistance with their own research project.

Biometry↗
PubMed2007

Improving the quality of patient care using reliability measures: a classification tree approach.

This paper considers the application and interpretation of new reliability measures for a classification tree-based medical risk assessment tool. Following the construction of a classification tree reliability measures may then be used to provide an estimate of the precision of the classification and the probability in each terminal node of the classification tree. Identification of unreliable nodes (those that have low precision) in this application may indicate patient groups requiring closer monitoring or scenarios in which further information about the patient is required, thereby providing medical practitioners with an avenue for more informed decision making.

Biometry↗