PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Performance benchmarking”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98Linked to original sources

Eye examinations for VA patients with diabetes: standardizing performance measures.

OBJECTIVE: To demonstrate the potential of the Health Plan Employer Data and Information Set (HEDIS) for the calculation of a performance measure for eye exams in the diabetic population using Veterans Health Administration (VA) administrative data. DESIGN: We calculated a 1-year HEDIS-defined patient denominator and three alternative denominators that considered coding factors in identifying a VA patient as diabetic. We calculated the HEDIS-defined numerator, along with alternative specifications that captured other types of eye exams. Finally, we supplemented national data with VA pharmacy and Medicare claims data to identify all VA diabetic patients at 14 selected VA facilities and to establish a more accurate picture of non-VA health care utilization. RESULTS: The national average annual HEDIS-defined eye exam rate in the VA was 26% in fiscal 1997 compared with 39% for managed care organizations. Medicare utilization raised this by 15 percentage points at 14 northeastern VA hospitals. Over 2 years, at least two-thirds of diabetic VA patients had some type of eye exam through VA or Medicare. CONCLUSION: A HEDIS measure of eye exams for VA patients with diabetes can be calculated using VA administrative data only. However, the question remains to what extent the denominator and numerator accurately and completely identify all diabetic patients using VA services and all appropriate eye exams. We recommend caution in interpreting the results of performance measurement across different health care sectors based on what we currently know are data system limitations.

Adult↗

Analysis and management of home health nursing caseloads and workloads.

The Easley-Storfjell Instruments for Caseload/Workload Analysis have been used successfully by home health managers to document the type quantity, and complexity of services provided by clinicians, teams, and the entire nursing staff. By measuring both the time requirements and complexity of interventions, these tools have been useful in assigning cases, managing caseloads and workloads establishing benchmarks, and monitoring productivity. Directions for use of these tools and examples are provided.

Community Health Nursing↗

Assessing public health performance in Iowa's counties.

Local health agencies in Iowa were surveyed to assess the performance of public health practices in their communities. Responses were received from 97 percent of counties. Less than 50 percent of counties were performing half of the indicators of the Assessment function. Policy Development functions also were frequently not performed. Performance was best in the Assurance function, with 86 percent of counties reporting that they inform and educate the public. However, the other three types of Assurance practices (Manage, Implement, and Evaluate) were performed less frequently. Comparison of the performance of Iowa's rural counties reveals a profile nearly identical to that reported elsewhere for a group of six other states.

Benchmarking↗

Best practices for world-class call centers.

Quality, not quantity, counts more in performance measures for best-practice call centers. Spend money on effective upfront training to save later through increased employee and customer loyalty. Give structured feedback and strong internal support to call-center representatives.

Benchmarking↗

Application of performance indicators in water utilities management--a case-study in Portugal.

This paper presents some issues concerning water supply systems assessment through performance indicators, based upon research work recently carried out in Portugal about water utilities. A proposal of 50 performance indicators divided into five different groups is presented here, namely structural indicators, operational indicators, water and service quality indicators, personnel indicators and economic indicators. These indicators were associated with a hierarchical structure of knowledge or development according to different levels: basic level, development level and strategic level. The performance indicators, structure, their implementation and assessment methodology and examples of some indicators, use concerning the characterisation or assessment of a water utility are also presented in the paper.

Benchmarking↗

Fluid-solid interaction: benchmarking of an external coupling of ANSYS with CFX for cardiovascular applications.

Fluid-solid interaction is a primary feature of cardiovascular flows. There is increasing interest in the numerical solution of these systems as the extensive computational resource required for such studies becomes available. One form of coupling is an external weak coupling of separate solid and fluid mechanics codes. Information about the stress tensor and displacement vector at the wetted boundary is passed between the codes, and an iterative scheme is employed to move towards convergence of these parameters at each time step. This approach has the attraction that separate codes with the most extensive functionality for each of the separate phases can be selected, which might be important in the context of the complex rheology and contact mechanics that often feature in cardiovascular systems. Penrose and Staples describe a weak coupling of CFX for computational fluid mechanics to ANSYS for solid mechanics, based on a simple Jacobi iteration scheme. It is important to validate the coupled numerical solutions. An extensive analytical study of flow in elastic-walled tubes was carried out by Womersley in the late 1950s. This paper describes the performance of the coupling software for the straight elastic-walled tube, and compares the results with Womersley's analytical solutions. It also presents preliminary results demonstrating the application of the coupled software in the context of a stented vessel.

Arteries↗

Monte Carlo modeling of gamma cameras for I-131 imaging in targeted radiotherapy.

INTRODUCTION: Dosimetric studies for targeted radiotherapy require the quantification of activity from scintigraphic images. Quantitative imaging is difficult to achieve because of several effects that can lead to errors in activity estimates, some of which are more apparent when I-131 is considered as a source. An evaluation of these phenomena was performed by modeling the gamma camera and its behavior using Monte Carlo simulations. Two gamma cameras were modeled: DST-XLi and Millennium VG Hawk-Eye (GEMS), and two Monte Carlo codes were used: MCNP (LANL) and GATE (openGate collaboration). GATE is a dedicated single photon emission computed tomography/positron emission tomography (SPECT)/(PET) software based on Geant4 (CERN, Geneve). MATERIALS AND METHODS: Gamma-camera modeling was performed in 2 steps: first without a collimator, then with a high-energy, all-purpose (HEAP) collimator according to the specifications given by the manufacturer (the simulation took the hexagonal shape of collimator holes into account). Simulated and measured energy spectra from point sources in air were compared (with or without a collimator). Spatial resolution was obtained from line sources in air at various distances from the detector heads. The photons detected in the 20% energy window from a point source were analyzed in order to determine the amount of primary photons, scattered photons (in the collimator), and septal photons (i.e., photons that crossed the collimator septa without interacting). RESULTS: Both codes agree well with experimental measurements for the two gamma cameras considered in this study. This allowed us to validate gamma-camera modeling and also served as a benchmark of GATE (new code) versus MCNP (reference code). As shown previously by Dewaraja et al., septal penetration is an important source of image degradation when HEAP collimators are used for I-131 imaging. With the DST-XLi, and for a point source in air, our simulations have shown that 53% of scattered (30%) and septal penetration (23%) photons are detected in the 20% window. CONCLUSION: The modeling of two gamma cameras (DST-XLi and Millennium VG Hawk-Eye) has been performed with two Monte Carlo codes (MCNP and Gate). Results obtained with the two Monte Carlo codes agree well with experimental results. As already indicated by several authors, septal penetration and scattered photons in the collimator have a major impact on I-131 scintigraphic imaging.

Computer Simulation↗

[Blunt pelvic injury].

Life-threatening complex pelvic fractures are commonly associated with vast peripelvine soft-tissue injuries and hemorrhage. Correct assessment and classification of the existing pelvic trauma and additional severe injuries present is required for accurate diagnosis and effective therapy. Treatment of the usually multiply injured patient is time-sensitive. The circulatory situation is the benchmark for diagnostic and therapeutic actions. Emergency stabilization of an initially unstable pelvic ring should be done first, followed by an extraperitoneal tamponade, if needed to control bleeding. The positive results of these actions can be measured by hemodynamic parameters. Delayed definitive internal stabilization of the anterior and/or posterior pelvic ring is then performed according to the fracture classification.

Emergencies↗

CIRCE: a scalable Python package to predict cis-regulatory DNA interactions from single-cell chromatin accessibility data.

MOTIVATION: Chromatin 3D folding creates numerous DNA interactions, participating in gene expression regulation. Single-cell chromatin-accessibility assays now profile hundreds of thousands of cells, challenging existing methods for mapping cis-regulatory interactions. RESULTS: We present CIRCE, a fast and scalable Python package to predict cis-regulatory DNA interactions from single-cell chromatin accessibility data. CIRCE re-implements the Cicero workflow to analyse single-cell atlases, cutting runtime and memory use by several orders of magnitude. We also provide new options to compute metacells, grouping similar cells to reduce data sparsity. We benchmarked CIRCE against Cicero on two datasets of different sizes and demonstrated the improvement from CIRCE's metacells' strategy with promoter capture Hi-C data. We also evaluated how DNA interaction predictions are impacted by different pre-processing. We observed a negative impact of Cicero's count normalization, and the best performance was obtained with the single-cell count matrix directly. Finally, we demonstrated the scalability of CIRCE by processing a dataset of more than 700 000 cells and 1 million DNA regions in less than an hour. CIRCE should greatly facilitate the prediction of DNA region interactions for scverse and Python users, while providing new and up-to-date pre-processing insights. AVAILABILITY AND IMPLEMENTATION: CIRCE is released as an open-source software under the AGPL-3.0 licence. The package source code is available on GitHub at https://github.com/cantinilab/CIRCE, and its documentation is accessible at https://circe.readthedocs.io. The code to reproduce the presented results is available as a Snakemake pipeline at https://github.com/cantinilab/circe_reproducibility.s.

Software↗

ProMeta: a meta-learning framework for robust disease diagnosis and prediction from plasma proteomics.

MOTIVATION: The plasma proteome offers a dynamic window of human health, capturing the real-time intersections between genetics and physiology. However, the application of deep learning to proteomics is currently hindered by a reliance on large-scale labeled datasets, rendering standard models ineffective for rare or novel diseases where patient samples are inherently scarce. RESULTS: Here, we present ProMeta, a meta-learning framework designed to enable robust disease modeling under extreme data restrictions. By integrating knowledge-guided pathway encoding with bi-level meta-optimization, ProMeta projects unstructured proteomic profiles into biologically interpretable functional tokens. This architecture allows the model to learn a global initialization containing transferable biological priors from biobank-scale data, facilitating rapid adaptation to novel tasks. Through comprehensive benchmark experiments, ProMeta consistently outperformed transfer learning and traditional machine learning baselines in both disease diagnosis and prediction tasks. In the most challenging 4-shot scenarios (utilizing only 2 cases and 2 controls), the model achieved robust generalization with an average AUROC of ∼0.69, representing a 24.6% relative improvement over the best-performing baseline methods. Mechanistic investigation revealed that ProMeta disentangles cases from controls in the latent space prior to task-specific adaptation, confirming the acquisition of universal biological rules rather than rote memorization. Furthermore, gradient-based interpretation identified disease-specific protein biomarkers and functional pathways consistent with known pathophysiology. Collectively, ProMeta overcomes the data-scarcity bottleneck in precision medicine, providing a scalable, interpretable framework for characterizing the full spectrum of human diseases, particularly for rare conditions lacking extensive clinical cohorts. AVAILABILITY AND IMPLEMENTATION: The source code of ProMeta is available at GitHub (https://github.com/lihan97/ProMeta).

Proteomics↗

Online resources for assessment and evaluation.

OBJECTIVE: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This article reviews characteristics of Web-based evaluation and assessment systems and recommends areas for further development. METHOD: The authors review functions common to a variety of online evaluation and curriculum management systems with attention to their adaptation for competency documentation and assessment. Details of online global assessments, examination methods, electronic portfolios, procedure/case logs, and survey systems are provided along with a list of Internet resources. RESULTS: Online evaluation and assessment systems not only provide data on trainee competence but can provide valuable feedback on faculty teaching, curriculum quality, and the learning environment. Suggestions for future development, legal ambiguities that could become obstacles, and the need to clarify the responsibility for funding this work are discussed. Web-based performance assessment and evaluation are seen in the larger context of moving toward competency assessment of practicing physicians. CONCLUSIONS: Online assessment systems offer advantages over paper systems in allowing robust data analysis, reporting, and flexibility. A national online procedure/case log tracking system would facilitate gathering data that could provide one type of experiential benchmark for determining competency.

Clinical Competence↗

Toward AI Virtual Cells for Hepatology: Representation, Generation, Dynamics, and Intervention in Single-Cell Models.

``Single-cell and spatial atlases describe the healthy and diseased liver at high resolution, including lobular hepatocyte zonation, fibrotic macrophage-stellate niches, cholangiocyte reactions, immune remodeling, and hepatocellular carcinoma ecosystems. These maps show where cell states occur but do not, by themselves, predict whether liver injury will progress or how the liver will respond to an untested drug, toxicant, or genetic perturbation. In this review, we organize current approaches toward an AI Virtual Cell (AIVC) for the liver into three complementary modeling routes. Generative models represent cell states, dynamics and transport models infer state transitions, and pretrained or foundation models test whether learned representations transfer across donors, etiologies, disease stages, and platforms. Perturbation-response prediction serves as a cross-cutting assessment of whether these layers can predict responses to untested genetic, chemical, inflammatory, or metabolic interventions. Available evidence can be categorized as direct liver validation, liver-included benchmarks, general single-cell evidence, and conceptual applications. Published models demonstrate individual components, including atlas integration, inferred trajectories, transferable representations, and retrospective response programs. However, these models do not constitute a prospectively validated liver simulator. At minimum, evaluation should include donor-, etiology-, stage-, platform-, and perturbation-level hold-outs. Model performance should be reported using response direction, recovery of differentially expressed genes and rare states, and calibrated uncertainty. Claims about tissue- or function-level prediction additionally require independent spatial, histologic, metabolic, and functional readouts. Near-term use should prioritize experiment selection and hypothesis generation, whereas clinical decision support remains a longer-term objective.

AI Virtual Cell↗

Optimal parameters for arterial repair using light-activated surgical adhesives.

The clinical acceptance of laser-tissue repair techniques is dependent on the reproducibility of viable repairs. Reproducibility is dependent on two factors: (i) the choice of materials to be used as the adhesive; and (ii) obtaining temperatures high enough to cause protein denaturation at the vital tissue interface without causing excessive thermal damage to the surrounding tissue. The use of a polymer scaffold as a carrier for the protein solder provides for uniform application of the solder to the tissue, thus allowing for pre-selection of optimal laser parameters. The scaffold also facilitates precise tissue alignment and ease of clinical application. In addition, the scaffold can be doped with various pharmaceuticals such as hemostatic and thrombogenic agents to aid wound healing. An ex vivo study was performed to correlate solder and tissue temperature with the tensile strength of arterial repairs formed using scaffold-enhanced light-activated surgical adhesives. Previous studies by our group using solid protein solder without the scaffold indicate that a solder/tissue, interface temperature of 65 degrees C is optimal. Using this parameter as a benchmark, laser irradiance was varied and temperatures were recorded at the surface and at the tissue interface of scaffold-enhanced protein solder using an infrared temperature monitoring system, designed by the researchers, and a type-K thermocouple, respectively.

Animals↗

Synthetic community Hi-C benchmarking provides a baseline for virus-host inferences.

Microbiomes influence diverse ecosystems, and viruses increasingly appear to impose key constraints. While viromics has expanded genomic catalogs, host identification for these viruses remains challenging due to the limitations in scaling cultivation-based approaches and the uncertain reliability and relative low resolution of in silico predictions - particularly for understudied viral taxa. Towards this, Hi-C proximity ligation uses sequenced, cross-linked virus and host genomic fragments to infer virus-host linkages and has now been applied in at least ten studies. However, its accuracy remains unknown. Here we assess Hi-C performance in recovering virus-host interactions using synthetic communities (SynComs) composed of four marine bacterial strains and nine phages with known interactions and then apply optimized bioinformatic protocols to natural soil samples. In SynComs, standard Hi-C sample preparations and analyses showed poor normalized contact score performance (26% specificity, 100% sensitivity, incorrect matches up to class level) that could be dramatically improved by Z-score filtering (Z ≥ 0.5, 99% specificity), though at reduced sensitivity (62% down from 100%). Detection limits were established as reproducibility was poor below minimal phage abundances of 105 PFU/mL. Applying optimized bioinformatic protocols to natural soil samples, we compared virus-host linkages inferred from proximity-ligated Hi-C sequencing with predictions generated by in silico homology-based and machine learning-based bioinformatic approaches. Prior to Z-score thresholding, agreement was relatively high at the phylum to family levels (72%), but not at the genus (43%) or species (15%) levels. Z-score thresholding reduced sensitivity (only 34% of predictions were retained), with only modest improvements in congruence with bioinformatic methods (48% or 18% at genus or species levels, respectively). Regardless, this led to 79 genus-level-congruent virus-host linkages and 293 new ones revealed by Hi-C alone - i.e., providing many new virus-host interactions to explore in already well-studied climate-critical soils. Overall, these findings provide empirical benchmarks and methodological guidelines to improve the accuracy and reliability of Hi-C for virus-host linkage studies in complex microbial communities.

Genomics↗

Useful benchmarks to evaluate outcomes after esophagectomy and pancreaticoduodenectomy.

BACKGROUND: Multiple publications have suggested that outcomes after complex operations are better at high-volume centers. However, of all the potential "outcomes" to measure, only mortality has been studied extensively. The broadest difference in mortality between low- and high-volume centers has been measured after esophagectomy (EG) and pancreaticoduodenectomy (PD). If a low-volume center recorded high mortality, then a broader set of outcomes beyond mortality would be useful for self-assessment. METHODS: Two single-surgeon prospective databases for outcomes of EG and PD were reviewed in a multispecialty clinic within a tertiary-referral, resident-training hospital. Between January 1996 and December 2002, 174 consecutive patients underwent EG performed by 1 surgeon (25 cases/y), and 232 consecutive patients underwent PD performed by another surgeon (34 cases/y). We measured hospital and 30-day mortality rate, mean operation time (OR time), mean estimated intraoperative blood loss (EBL), mean length of stay (LOS), and the anastomotic leak rate. These outcomes were compared with those of recently published cases for EG and PD. RESULTS: Mortality for both operations was zero. After EG, OR time was 394 minutes (literature = 336), EBL was 204 mL (literature = 964), transfusion rate was 3.5% (literature = 34%), LOS was 11.1 days (literature = 16.6), leak was 2.9% (literature = 9.1%), and reoperation was 1.7% (literature = not stated). After PD, OR time was 450 minutes (literature = 431), EBL was 382 mL (literature = 1,183), transfusion rate was 7.3% (literature = not stated), LOS was 11.2 days (literature = 17.8), leak was 6.5% (literature = 9.9%), and reoperation was 0.4% (literature = 3.8%). CONCLUSIONS: These 2 single-surgeon series provide benchmarks to help better define acceptable outcomes after EG and PD. This assessment demonstrated lower mortality and LOS in a high-volume surgical practice. These outcomes are not associated with OR time but with lower EBL, less need for transfusion, and lower need for reoperation. Anastomotic leaks occurred in both series; however, this was not associated with mortality because of early recognition and the use of nonsurgical minimally invasive techniques. If mortality is high at a low-volume center, then the additional benchmarks of this study, in addition to mortality and LOS, could be used to lower mortality through self-assessment by identifying specific outcomes that need improvement.

Adolescent↗

The public release of performance data: what do we expect to gain? A review of the evidence.

CONTEXT: Information about the performance of hospitals, health professionals, and health care organizations has been made public in the United States for more than a decade. The expected gains of public disclosure have not been made clear, and both the benefits and potential risks have received minimal empirical investigation. OBJECTIVE: To summarize the empirical evidence concerning public disclosure of performance data, relate the results to the potential gains, and identify areas requiring further research. DATA SOURCES: A literature search was conducted on MEDLINE and EMBASE databases for articles published between January 1986 and October 1999 in peer-reviewed journals. Review of citations, public documents, and expert advice was conducted to identify studies not found in the electronic databases. STUDY SELECTION: Descriptive, observational, or experimental evaluations of US reporting systems were selected for inclusion. DATA EXTRACTION: Included studies were organized based on use of public data by consumers, purchasers, physicians, and hospitals; impact on quality of care outcomes; and costs. DATA SYNTHESIS: Seven US reporting systems have been the subject of published empirical evaluations. Descriptive and observational methods predominate. Consumers and purchasers rarely search out the information and do not understand or trust it; it has a small, although increasing, impact on their decision making. Physicians are skeptical about such data and only a small proportion makes use of it. Hospitals appear to be most responsive to the data. In a limited number of studies, the publication of performance data has been associated with an improvement in health outcomes. CONCLUSIONS: There are several potential gains from the public disclosure of performance data, but use of the information by provider organizations for quality improvement may be the most productive area for further research.

Attitude to Health↗

Good practices in managing work-related indoor air problems: a psychosocial perspective.

BACKGROUND: Indoor air problems at workplaces are often exceedingly complex. Technical questions are interrelated with the dynamics of the work community, and the cooperation and interaction skills of the parties involved in the problem solving process are also put to the test. The objective of our study was to analyze the process of managing and solving indoor air problems from a psychosocial perspective. METHODS: This collective case study was based on data from questionnaires, interviews and various documentary materials. Technical inspections of the buildings and indoor air measurements were also carried out. RESULTS: The following four factors best differentiated successful cases from impeded cases: extensive multiprofessional collaboration and participative action, systematic action and perseverance, investment in information and communication, and process thinking and learning. The study also proposed a theoretical model for the role of the psychosocial work environment in indoor air problems. CONCLUSIONS: The expertise related to social and human aspects of problem solving plays a significant role in solving indoor air problems. Failures to properly handle these aspects may lead to resources being wasted and result in a problematic situation becoming stagnant or worse.

Air Pollutants, Occupational↗

MULTIPROSPECTOR: an algorithm for the prediction of protein-protein interactions by multimeric threading.

In this postgenomic era, the ability to identify protein-protein interactions on a genomic scale is very important to assist in the assignment of physiological function. Because of the increasing number of solved structures involving protein complexes, the time is ripe to extend threading to the prediction of quaternary structure. In this spirit, a multimeric threading approach has been developed. The approach is comprised of two phases. In the first phase, traditional threading on a single chain is applied to generate a set of potential structures for the query sequences. In particular, we use our recently developed threading algorithm, PROSPECTOR. Then, for those proteins whose template structures are part of a known complex, we rethread on both partners in the complex and now include a protein-protein interfacial energy. To perform this analysis, a database of multimeric protein structures has been constructed, the necessary interfacial pairwise potentials have been derived, and a set of empirical indicators to identify true multimers based on the threading Z-score and the magnitude of the interfacial energy have been established. The algorithm has been tested on a benchmark set comprised of 40 homodimers, 15 heterodimers, and 69 monomers that were scanned against a protein library of 2478 structures that comprise a representative set of structures in the Protein Data Bank. Of these, the method correctly recognized and assigned 36 homodimers, 15 heterodimers, and 65 monomers. This protocol was applied to identify partners and assign quaternary structures of proteins found in the yeast database of interacting proteins. Our multimeric threading algorithm correctly predicts 144 interacting proteins, compared to the 56 (26) cases assigned by PSI-BLAST using a (less) permissive E-value of 1 (0.01). Next, all possible pairs of yeast proteins have been examined. Predictions (n = 2865) of protein-protein interactions are made; 1138 of these 2865 interactions have counterparts in the Database of Interacting Proteins. In contrast, PSI-BLAST made 1781 predictions, and 1215 have counterparts in DIP. An estimation of the false-negative rate for yeast-predicted interactions has also been provided. Thus, a promising approach to help assist in the assignment of protein-protein interactions on a genomic scale has been developed.

Algorithms↗