PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Performance benchmarking”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90Linked to original sources

ELISA (Embedding-Linked Interactive Single-cell Agent): an interpretable hybrid generative Artificial Intelligence agent for expression-grounded discovery in single-cell genomics.

Translating single-cell RNA sequencing (scRNA-seq) data into mechanistic biological hypotheses remains a critical bottleneck, as agentic AI systems lack direct access to transcriptomic representations while expression foundation models remain opaque to natural language. Here, we introduce ELISA (Embedding-Linked Interactive Single-cell Agent), an interpretable framework that unifies single-cell generative pretrained transformer expression embeddings with biomedical bidirectional encoder representations from transformers-based semantic retrieval and large-language model (LLM)-mediated interpretation for interactive single-cell discovery. An automatic query classifier routes inputs to gene marker scoring, semantic matching, or reciprocal rank fusion pipelines depending on whether the query is a gene signature, natural language concept, or mixture of both. Integrated analytical modules perform pathway activity scoring across 60+ gene sets, ligand-receptor interaction prediction using 280+ curated pairs, condition-aware comparative analysis, and cell-type proportion estimation, all operating directly on embedded data without access to the original count matrix. Benchmarked across six diverse scRNA-seq datasets spanning inflammatory lung disease, pediatric and adult cancers, organoid models, healthy tissue, and neurodevelopment, ELISA significantly outperforms CellWhisperer, a classical lexical retriever (BM25), and a random baseline in cell type retrieval (combined permutation test, $p < 2\times 10^{-5}$ for each), with particularly large gains on gene-signature queries (Cohen's $d = 5.98$ for mean reciprocal rank). ELISA replicates published biological findings (mean composite score 0.88), and generates candidate hypotheses through grounded LLM reasoning, bridging the gap between transcriptomic data exploration and biological discovery.

Generative Artificial Intelligence↗

Correcting the loss of cell-cycle synchrony in clustering analysis of microarray data using weights.

MOTIVATION: Due to the existence of the loss of synchrony in cell-cycle data sets, standard clustering methods (e.g. k-means), which group open reading frames (ORFs) based on similar expression levels, are deficient unless the temporal pattern of the expression levels of the ORFs is taken into account. METHODS: We propose to improve the performance of the k-means method by assigning a decreasing weight on its variable level and evaluating the 'weighted k-means' on a yeast cell-cycle data set. Protein complexes from a public website are used as biological benchmarks. To compare the k-means clusters with the structures of the protein complexes, we measure the agreement between these two ways of clustering via the adjusted Rand index. RESULTS: Our results show the time-decreasing weight function--exp[-(1/2)(t(2)/C(2))]--which we assign to the variable level of k-means, generally increases the agreement between protein complexes and k-means clusters when C is near the length of two cell cycles.

Algorithms↗

A benchmark of multiple sequence alignment programs upon structural RNAs.

To date, few attempts have been made to benchmark the alignment algorithms upon nucleic acid sequences. Frequently, sophisticated PAM or BLOSUM like models are used to align proteins, yet equivalents are not considered for nucleic acids; instead, rather ad hoc models are generally favoured. Here, we systematically test the performance of existing alignment algorithms on structural RNAs. This work was aimed at achieving the following goals: (i) to determine conditions where it is appropriate to apply common sequence alignment methods to the structural RNA alignment problem. This indicates where and when researchers should consider augmenting the alignment process with auxiliary information, such as secondary structure and (ii) to determine which sequence alignment algorithms perform well under the broadest range of conditions. We find that sequence alignment alone, using the current algorithms, is generally inappropriate <50-60% sequence identity. Second, we note that the probabilistic method ProAlign and the aging Clustal algorithms generally outperform other sequence-based algorithms, under the broadest range of applications.

Algorithms↗

The prehospital treatment of pediatric trauma.

Prehospital pediatric trauma care is an important part of the EMS system. Review of 458 pediatric ALS trauma responses over two years treated in an urban, tiered ALS system revealed a male predominance. Violence (gunshot, stab, or assault) accounted for 46% of injuries, followed by vehicular accidents (occupant or pedestrian), with 35%. Important ALS resuscitation interventions were commonly performed en route, with a high degree of success (IVs = 93%, intubation = 79%), and did not greatly prolong field times (9 min BLS vs 11.7 min ALS). ALS procedure success rates and field times reported here are lower than previously described. Benchmark standards for the prehospital care of pediatric trauma are proposed.

Adolescent↗

MCNPX simulation of a multileaf collimator.

Our purpose in this work was to validate a very detailed Monte Carlo model, developed in MCNPX, of a Millennium 120 multileaf collimator integrated into a Varian Clinac 21EX treatment head. The Monte Carlo results were compared with measurements for both the 6-MV and 18-MV photon modes. The following comparisons were performed: depth-dose curves, lateral profiles, multileaf collimator leakage, the tongue-and-grove test, and the round leaf-end test. The good agreement between the Monte Carlo simulations and measurements showed that our model is accurate. Consequently, the benchmarks provided by our study can be used in future Monte Carlo studies.

Computer Simulation↗

Predicting conditional probability distributions: a connectionist approach.

Most traditional prediction techniques deliver a single point, usually the mean of a probability distribution. For multimodal processes, instead of predicting the mean, it is important to predict the full distribution. This article presents a new connectionist method to predict the conditional probability distribution in response to an input. The main idea is to transform the problem from a regression problem to a classification problem. The conditional probability distribution network can perform both direct predictions and iterated predictions, the latter task being specific for time series problems. We compare this new method to fuzzy logic and discuss important differences, and also demonstrate the architecture on two time series. The first is the benchmark laser series used in the Santa Fe competition, a deterministic chaotic system. The second is a time series from a Markov process which exhibits structure on two time scales. The network produces multimodal predictions for this series. We compare the predictions of the network with a nearest-neighbor predictor and find that the conditional probability network is more than twice as likely a model.

Neural Networks, Computer↗

Taking to the road for PI: use the balance scorecard to find your way.

The financial pressures of today's healthcare environment require healthcare professionals to be able to keep all quadrants of quality in check. Tools such as the data card will assist the users of quality data in providing the organization with a catalyst for change. The reproducibility of both the process and the tool has proven to assist an individual organization in creating a clear concise message in the integration of performance measures. This article discusses a methodology and tool for organizations to integrate and evaluate disparate sources of information that can be used to direct priorities for Performance Improvement. The data card is a tool adapted from the Dartmouth Clinical Value Compass used to assist Performance Improvement teams in both the tracking and evaluation of measures related to patient satisfaction, functional status, clinical outcomes, and financial outcomes. The visual enhancement of adding color to the arrows of the compass allows the end users to quickly identify performance improvement opportunities. Examples of the data card are included to assist the readers in identifying specific indicators that can be measured with a specific clinical population as well as adaptation to other uses such as organization-wide indicator measurement Benchmarking is key in defining best practices and has been integrated into the data card.

Arthroplasty, Replacement↗

ASIS healthcare security benchmarking study.

Effective security has aligned itself into the everyday operations of a healthcare organization. This is evident in every regional market segment, regardless of size, location, and provider clinical expertise or organizational growth. This research addresses key security issues from an acute care provider to freestanding facilities, from rural hospitals and community hospitals to large urban teaching hospitals. Security issues and concerns are identified and addressed daily by senior and middle management. As provider campuses become larger and more diverse, the hospitals surveyed have identified critical changes and improvements that are proposed or pending. Mitigating liabilities and improving patient, visitor, and/or employee safety are consequential to the performance and viability of all healthcare providers. Healthcare organizations have identified the requirement to compete for patient volume and revenue. The facility that can deliver high-quality healthcare in a comfortable, safe, secure, and efficient atmosphere will have a significant competitive advantage over a facility where patient or visitor security and safety is deficient. Continuing changes in healthcare organizations' operating structure and healthcare geographic layout mean changes in leadership and direction. These changes have led to higher levels of corporate responsibility. As a result, each organization participating in this benchmark study has added value and will derive value for the overall benefit of the healthcare providers throughout the nation. This study provides a better understanding of how the fundamental security needs of security in healthcare organizations are being addressed and its solutions identified and implemented.

Benchmarking↗

A benchmark dose analysis of prenatal exposure to polychlorinated biphenyls.

Benchmark dose (BMD) analysis is used to determine levels of exposure to environmental contaminants associated with increased public health risk. In this study we used a benchmark approach to evaluate the risks associated with prenatal exposure to polychlorinated biphenyls (PCBs). We evaluated for intellectual impairment a cohort of children whose prenatal PCB exposure had been assessed from biologic specimens. We calculated BMDs and lower-bound confidence limits (BMDLs) for four end points using four sets of risk criteria. BMDLs were estimated using three different statistical methodologies. The BMDs and BMDLs were remarkably consistent across the four end points for each set of risk criteria, but differed substantially for the different risk criteria. The proportion of the sample considered at risk ranged from 9.8% for the least protective criteria to 74.1% for the most protective. Two methodologies, likelihood ratio and bootstrapping, generated generally similar BMDLs. BMD analysis provides a straightforward, reliable method for evaluating levels of exposure associated with increased public health risk. In the analyses performed in this study, the number of individuals considered at risk depended more on the risk criterion selected than on the outcome assessed.

Adult↗

A comparison of recovery in outpatients receiving fentanyl versus those receiving butorphanol.

The frequency of postanesthesia side effects and times to reach "benchmarks" in the recovery process for IV preinduction doses of 20 micrograms/kg butorphanol, 40 micrograms/kg butorphanol, or a 2 micrograms/kg dose of fentanyl were compared in a double-blinded study involving ambulatory surgical patients. The authors hypothesized that all drugs would perform equally well in all study areas. Sixty ASA physical status I and II women undergoing laparoscopic tubal sterilization were randomly assigned to one of three groups: Group I (n = 20) received 20 micrograms/kg butorphanol as a preinduction agent; Group II (n = 20) received 40 micrograms/kg butorphanol; Group III (n = 20) received 2 micrograms/kg fentanyl. Anesthesia management for all groups was the same. Statistically significant variance was found in time to discharge-ready status and duration of nausea (p less than 0.05) between 40 micrograms/kg butorphanol and 2 micrograms/kg fentanyl, but no significant difference was found between 20 micrograms/kg butorphanol and 2 micrograms/kg fentanyl in these areas. Statistically significant variance was found in duration of dizziness and time to obtain a 10 on the Aldrete Post Anesthesia Recovery Score (APARS) between 40 micrograms/kg butorphanol and 20 micrograms/kg butorphanol and 40 micrograms/kg butorphanol and 2 micrograms/kg fentanyl. From the study, 20 micrograms/kg butorphanol appears to be as suitable as 2 micrograms/kg fentanyl for use as a preinduction narcotic analgesic, whereas 40 micrograms/kg butorphanol appears to be unsuitable due to increased duration of nausea, dizziness, and time to score 10 on APARS and reach discharge-ready status.

Adult↗

High precision EPR dosimetry as a reference tool for validation of other techniques.

We present here a particular application area for EPR dosimetry with teeth--use as a source of reference dose values for validation/verification of other retrospective dosimetry techniques and existing dose records. The conditions of application of EPR dosimetry in this role as well as practical design of such studies are shown. Particular attention is given to the requirements to the techniques in terms of precision and throughput, as well as to the issue of availability of samples for analysis and practical solution of this problem. Practical application of this approach is illustrated by several examples of completed validation sub-studies, which were performed in the framework of large-scale post-Chernobyl epidemiological studies.

Benchmarking↗

Automatic karyotyping of metaphase cells with overlapping chromosomes.

Image analysis research aimed at analyzing images of banded, human chromosomes is described. An experimental automated karyotyping system (AKS) has been assembled. The goal of the system is to label the chromosomes from a metaphase image with minimal human intervention. The AKS is unique in that it is designed to automatically process cells containing overlapping chromosomes. It also has four novel algorithmic features: the use of cross section sequence graphs, an over-segmentation-based segmentation strategy, the use of the 'pale path' concept for banded chromosomes and the application of mathematical programming for cell-level chromosome classification in cells with overlapping chromosomes. System performance was analyzed using a variety of metaphase images exhibiting various levels of overlapping chromosomes.

Algorithms↗

Wavelet change-point prediction of transmembrane proteins.

MOTIVATION: A non-parametric method, based on a wavelet data-dependent threshold technique for change-point analysis, is applied to predict location and topology of helices in transmembrane proteins. A new propensity scale generated from a transmembrane helix database is proposed. RESULTS: We show that wavelet change-point performs well for smoothing hydropathy and transmembrane profiles generated using different scales. We investigate which wavelet bases and threshold functions are overall most appropriate to detect transmembrane segments. Prediction accuracy is based on the analysis of two data sets used as standard benchmarks for transmembrane prediction algorithms. The analysis of a test set of 83 proteins results in accuracy per segment equal to 98.2%; the analysis of a 48 proteins blind-test set, i.e. containing proteins not used to generate the propensity scales, results in accuracy per segment equal to 97.4%. We believe that this method can also be applied to the detection of boundaries of other patterns such as G + Cisochores and dot-plots. AVAILABILITY: The transmembrane database, TMALN and source code are available upon request from the authors.

Bacterial Proteins↗

Best-practice protocols: preventing adverse drug events.

Analysis of Stanford's electronic Patient Safety Net revealed a pattern of unrecognized, widespread, low-frequency I.V.-PCA adverse events. A performance improvement-failure modes and effects analysis identified causes, and a multidisciplinary team developed solutions.

Adverse Drug Reaction Reporting Systems↗

Developing performance measures for immunization registries.

Quantitative performance indicators were developed to monitor immunization registry progress of the 16 All Kids Count (AKC) grantees. Results were reviewed to determine if (1) the indicators measured immunization registry progress, (2) the results could be compared across AKC projects, and (3) other immunization registries could use the indicators. The study found that the AKC performance indicators provide a useful template for registries to measure their progress toward developing fully mature registries. Public health leaders should join with private health sector representatives to build on the immunization registry experience and develop and test performance indicators for integrated information systems in order to develop common goals and monitor changes in a comprehensive way.

Benchmarking↗

Test of radiation detectors used in homeland security applications.

This work was performed as part of the National Institute of Standards and Technology (NIST) program to support the development of the new American National Standards Institute (ANSI) standards N42.32-2003 and N42.33-2003 for hand-held detectors, and personal electronic dosimeters, as well as to support the Office of Law Enforcement Standards (OLES) and the Department of Homeland Security (DHS) in testing these types of detectors for their use by first responders. These instruments are required to operate over a photon energy range of 60 keV to 1.33 MeV and over a wide range of air-kerma rates. The performance and response of various radiation detectors, purchased by the NIST, was recorded when placed in 60Co, 137Cs, and x-ray beams at different air-kerma rates. The measurements described in this report were performed at the NIST x-ray and gamma-ray radiation calibration facilities. The instruments' response (exposure or dose rate readings) shows strong energy dependence but almost no dependence to different air-kerma rates. The data here reported provide a benchmark in support of current protocols that are being developed for radiation detection instrumentation used in homeland security applications. A future plan is to test these devices, plus other commercially available detectors, against ANSI standards N42.32-2003 and N42.33-2003.

Benchmarking↗

A review of HEDIS measures and performance for mental disorders.

Performance on mental health HEDIS measures has been modest, with only minimal improvements in recent years. Performance on mental health measures has been consistently worse than that for other medical conditions. A critical step toward improving performance is to understand where care is provided and then to identify clinicians who are responsible for ensuring that care is delivered appropriately.

Antidepressive Agents↗

Using a systemwide care path to enhance compliance with guidelines for acute myocardial infarction.

BACKGROUND: Several acute myocardial infarction (MI) guidelines and policy statements have been developed, but compliance rates are suboptimal. The cardiology section at Gundersen Lutheran Medical Center (La Crosse, Wisconsin) used a systemwide approach to enhance compliance with guidelines. METHODS AND RESULTS: Data were collected prospectively for a 4-year period (May 15, 1995-May 15, 1999) for all patients presenting with acute MI. In 1995 a multidisciplinary team developed protocols for each phase of MI management and designed clinical care paths with built-in accountability. The initiative resulted in improvements in all phases of acute MI care and met the benchmark recommendations in mean time to electrocardiogram, thrombolytic therapy, and aspirin and beta-blocker administration. Rates of prescriptions for secondary prevention were 92% for aspirin and beta-blocker and 97% for smoking cessation education at 4 years. SUMMARY: The care path for acute MI involved multiple disciplines and empowerment of nonspecialists and nonphysician practitioners during development and implementation, as well as continual education and retraining. The care path led to several improvements in performance scores. These findings indicate that the recommendations as set forth in the American College of Cardiology (ACC) and the American Heart Association (AHA) guidelines for managing acute MI are realistic and achievable, and they do not require additional resources.

Acute Disease↗