PubMed Health⌕ Search
Home/Archive/PubMed

PubMed · 11675161

The case for comprehensive quality indicator reliability assessment.

J D Scinto·D H Galusha·H M Krumholz·T P Meehan
View original source ↗Export metadata ↓

Abstract

To demonstrate the importance of evaluating overall quality indicator reliability, in addition to component or variable level reliability, a comparison of interrater agreement on four chart-abstracted pneumonia-related processes of care was conducted. The hospital medical records of 356 Medicare patients' recent discharges for pneumonia were independently abstracted by different abstractors. Kappa, prevalence and bias-adjusted kappa, P(pos), P(neg), and the Bias Index were used to assess reliability of composite quality indicators and their components. The adjusted kappas for the data elements used to determine eligibility to receive as well as to derive the pneumonia-related processes of care ranged from 0.68 to 1.0. The adjusted kappa associated with overall eligibility to receive the pneumonia-related processes of care was 0.63. The kappa statistics for determining if processes of care were provided ranged from 0.56 to 0.83 and increased to 0.65 and 0.85 upon adjustment for the prevalence effect. Kappas for the composite quality indicators were lower, but improved with adjustment for the prevalence effect. The composite quality indicator with the highest adjusted kappa value was oxygenation assessment (0.93); the composite quality indicator with the lowest adjusted kappa value was antibiotic administration within 8 hours of hospital arrival (0.74). This study establishes the reliability of pneumonia indicators and underscores the need for reliability assessment at the quality indicator level, as well as at the component level.

Explore related subjects

HumansObserver VariationPneumoniaProcess Assessment, Health CareQuality Indicators, Health CareReproducibility of ResultsStatistics as TopicJournal ArticleResearch Support, U.S. Gov't, Non-P.H.S.Validation Study

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J D Scinto, D H Galusha, H M Krumholz, T P Meehan. 2001. The case for comprehensive quality indicator reliability assessment.. https://doi.org/10.1016/s0895-4356(01)00381-x

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2027

Global Genomic Surveillance.

Global genomic surveillance has emerged as a foundational pillar of public health in the twenty-first century, enabling real-time tracking of pathogen evolution and informing outbreak response. This chapter examines the strategic architecture of global genomic surveillance, focusing on its application to arboviruses such as chikungunya virus (CHIKV). It explores the integration of genomic data with epidemiological, clinical, and environmental information within a One Health framework, while addressing critical challenges in governance, equity, and interoperability. The discussion covers the entire genomic surveillance workflow, from sample collection and sequencing to bioinformatic analysis and phylogenetic inference, and highlights the transformative role of artificial intelligence (AI) in predictive surveillance. By analyzing global initiatives, operational barriers, and emerging technologies, this chapter underscores the necessity of sustainable, equitable, and interoperable genomic systems to proactively address current and future infectious disease threats.

Humans↗
PubMed2027

Systematic Dissection of Key Driver Perturbation Signatures in Single Cells via ECCITE-seq.

CRISPR screens, such as expanded CRISPR-compatible cellular indexing of transcriptomes and epitopes by sequencing (ECCITE-seq), enable the simultaneous measurement of transcriptomes, gRNA identity, and cell-surface protein expression at single-cell resolution to systematically interrogate gene function. This platform provides a powerful and scalable experimental approach for validating disease-associated regulators identified by large-scale association studies and other computational methods, including network-based analyses of multi-omics data. Here, as an example application, we describe an ECCITE-seq framework to characterize the transcriptomic consequences of perturbing multiple neuronal key driver genes associated with Alzheimer's disease (AD) in human-induced pluripotent stem cell (hiPSC)-derived neurons. More broadly, by integrating customized pooled gRNA libraries with different CRISPR effectors across multiple cell types, this approach allows for the assessment of the regulatory impact of candidate genes implicated in development and disease processes.

Humans↗
PubMed2027

Identification of Genome-Wide Chromatin Structural Aberration in Cancer by Hi-C Analysis.

Aberrant three-dimensional genome organization is a hallmark of cancer, often driving oncogene activation through mechanisms such as enhancer hijacking. High-throughput chromosome conformation capture (Hi-C) maps these interactions on a genome-wide scale. Unlike earlier dilution-based methods, in situ Hi-C performs proximity ligation within intact nuclei, minimizing random ligation noise and enabling fine-scale structure detection. This chapter describes an optimized in situ Hi-C protocol tailored for cancer cell lines using MboI digestion and biotin-mediated pull-down to generate high-complexity libraries. We further outline a computational workflow that extends beyond standard topological mapping of compartments and topologically associating domains to identify cancer-specific aberrations. Specifically, we focus on detecting chromosomal rearrangements (structural variants) and characterizing the distinct circular topology of extrachromosomal DNA. This integrated experimental and analytical framework provides the necessary tools to dissect the spatial dysregulation underlying tumor evolution.

Humans↗