PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Performance benchmarking”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66Linked to original sources

Benchmarking computational decontamination of ambient RNA.

Gene expression profiling of single cells using single-cell and single-nucleus RNA sequencing (sxRNA-seq) enables researchers to characterize cellular heterogeneity and unraveling complex biological processes at unprecedented resolution. However, sxRNA-seq faces challenges due to the presence of ambient RNA, extraneous RNA molecules not originating from the cells of interest. Sample preparation is a major source of ambient RNA, where harsh conditions can lead to cell lysis and the release of intracellular RNA. This inescapable inclusion of ambient RNA can cause erroneous results and hinder downstream analyses. To address this issue, various methodologies have been developed to identify, quantify, and remove ambient RNA. Here, we rigorously evaluate 7 state-of-the-art methodologies for ambient RNA removal using simulated datasets, species-mixing experiments of varying complexities, and genotype-mixing experiments. We find that no single method performs the best across all datasets and metrics, but CellBender, DecontX and SoupX generally perform well.

ambient RNA↗

A survey of infection control professional staffing patterns at University HealthSystem Consortium institutions.

BACKGROUND: Proper staffing of infection control departments has long been a topic of interest. The most complete report on the subject, the Study on the Efficacy of Nosocomial Infection Control, was published in 1985. To provide current benchmarking comparison data for expected staff reductions at the University of Michigan Health System, a survey of University HealthSystem Consortium members was performed. METHODS: A survey tool was developed to obtain general demographic, staffing, and case-mix information. An infection control professional at each institution was contacted to obtain most of the information. Additional information was obtained from standard references. RESULTS: Responses were obtained from 45 University HealthSystem Consortium members (67%). Full-time equivalent ratios were based on the following parameters and compared for the institutions: number of occupied beds (according to occupancy rate, median 137 occupied beds/full-time equivalent), number of intensive care unit beds (median 28 beds/full-time equivalent), number of admissions or discharges (median 6686 admissions/full-time equivalent), number of ambulatory care visits (median 104,426 visits/full-time equivalent), and case-mix index (median 1.75). CONCLUSIONS: Many institutions are using benchmarking comparison data to make decisions regarding staff reductions. This survey provides preliminary data for determining the "best practice" in staffing for infection control departments. More information may be needed to evaluate other factors that affect infection control professionals' workload.

Academic Medical Centers↗

Predictive neural networks for gene expression data analysis.

Gene expression data generated by DNA microarray experiments have provided a vast resource for medical diagnosis and disease understanding. Most prior work in analyzing gene expression data, however, focuses on predictive performance but not so much on deriving human understandable knowledge. This paper presents a systematic approach for learning and extracting rule-based knowledge from gene expression data. A class of predictive self-organizing networks known as Adaptive Resonance Associative Map (ARAM) is used for modelling gene expression data, whose learned knowledge can be transformed into a set of symbolic IF-THEN rules for interpretation. For dimensionality reduction, we illustrate how the system can work with a variety of feature selection methods. Benchmark experiments conducted on two gene expression data sets from acute leukemia and colon tumor patients show that the proposed system consistently produces predictive performance comparable, if not superior, to all previously published results. More importantly, very simple rules can be discovered that have extremely high diagnostic power. The proposed methodology, consisting of dimensionality reduction, predictive modelling, and rule extraction, provides a promising approach to gene expression analysis and disease understanding.

Animals↗

An institutional approach to maintenance of excellent outcomes for carotid endarterectomy in a setting with moderate-to-low procedure volume.

BACKGROUND: Institutions and surgeons with high procedure volumes have been reported to have lower morbidity and mortality rates for patients undergoing carotid endarterectomy. Demonstrating comparable results is essential for centers with moderate or low volume. If comparable results cannot be demonstrated, a low- to moderate-volume center should not perform the procedure. STUDY DESIGN: A prospective study of a program to achieve and sustain excellent outcomes after carotid endarterectomy was conducted at a single institution with low-to-moderate volumes. Results of this effort from January 1997 through December 2005 are reported. Key features of our approach include institutional control over which and how many surgeons can perform carotid endarterectomy. Surgeons must be experienced carotid surgeons and consistently perform more than 12 procedures annually and be continuously monitored. Surgical outcomes were independently audited through a mandated institutional carotid endarterectomy data registry. Surgeons with poor outcomes are barred from doing carotid endarterectomies; and annually updated outcomes data are posted on the Internet. RESULTS: This approach was used for 555 carotid endarterectomies in 503 patients. Our outcomes-with total death and disabling stroke rate of 1.6%-compare favorably with, and are not statistically different from, published benchmarks, despite volumes at our institution ranging from 44 to 81 patients annually and the participation of 8 surgeons during the study period. CONCLUSIONS: Surgeons should perform carotid endarterectomies only if excellent outcomes can be demonstrated. We conclude that by using an approach like ours, even institutions with moderate-to-low carotid endarterectomy volumes can achieve excellent outcomes. We propose that all institutions should assume responsibility for ensuring excellent carotid endarterectomy outcomes using a comprehensive outcomes-based approach with independent auditing similar to that presented here.

Aged↗

An evaluation of HACCP implementation status in UK small and medium enterprises in food manufacturing.

To reduce foodborne illnesses, hazard and risk-based quality management systems are essential. Small and medium sized companies (SMEs) tend to have a poor understanding of such systems and limited adoption of the Hazard Analysis Critical Control Point system (HACCP). The requirement for full HACCP implementation by 2006 will place an even greater burden on these businesses. The aim of this project is to assess the current levels of understanding of hazards and risks in SMEs in the manufacturing sector. A questionnaire survey was made of 850 SMEs, including microbusinesses. This determined the industry sector and processes carried out, whether the company operated hazard-based quality management and the knowledge of the technical manager regarding the associated hazards and risks. Follow-up visits to the manufacturing plant observed the processes and the operatives to determine their level of understanding. A benchmarking audit was carried out and each company was rated. The results show that the majority of respondents stated that they operated hazard analysis-based quality management. The ability of the respondents to correctly define a hazard or risk or identify different types of hazard was, however, poor. There was no correlation between business type and audit score. The microbusinesses did, however, perform significantly less well than the larger SMEs.

Benchmarking↗

Improved third-order Møller-Plesset perturbation theory.

Based on a partitioning of the total correlation energy into contributions from parallel- and antiparallel-spin pairs of electrons, a modified third-order Møller-Plesset (MP) perturbation theory is developed. The method, termed SCS-MP3 (SCS for spin-component-scaled) continues previous work on an improved version of MP2. A benchmark set of 32 isogyric reaction energies, 11 atomization energies, and 11 stretched geometries is used to assess to performance of the model in comparison to the standard quantum chemical approaches MP2, MP3, and QCISD(T). It is found, that the new method performs significantly better than usual MP2/MP3 and even outperforms the more costly QCISD method. Opposite to the usual MP series, the SCS third-order correction uniformly improves the results. Dramatic enhancements are especially observed for the more difficult atomization energies, some of the stretched geometries, and reaction and ionization energies involving transition metal compounds where the method seems to be competitive or even superior to the widely used density functional approaches. Further tests performed for other complex systems (biradicals, C(20) isomers, transition states) demonstrate that the SCS-MP3 model yields often results of QCISD(T) accuracy. The uniformity with which the new approach improves for very different correlation problems indicates significant robustness, and suggests it as a valuable quantum chemical method of general use.

Journal Article↗

A comparison of two microcomputer-based programs for bibliographic retrieval and formatting.

We evaluated two representative microcomputer-based programs for organizing a biomedical literature filing system. With a bibliography of 100 anesthetic references, a series of benchmark tests was developed to measure the speed and accuracy of typical searching, sorting, and formatting tasks. Each program performed the searching tasks accurately and at about the same speed. One program performed sorting without errors, provided the field order of the template used to enter references was unchanged. Both programs used "punctuation files," that is, templates for controlling author presentation; punctuation to suit style requirements of individual journals; and order of particular fields, such as publisher and year of publication. Each program was able to format journal, book, and chapter references correctly, but the resulting output required some refining in a word processor. Both require a major time commitment to learn and to create custom punctuation files for journals not included in the predesigned punctuation files. Once mastered, both programs are quite competent at organizing reprints and formatting journal references.

Humans↗

Constant-volume hydrogel osmometer: a new device concept for miniature biosensors.

A new type of biosensor is proposed that combines the recognition properties of "intelligent" hydrogels with the sensitivity and reliability of microfabricated pressure transducers. In the proposed device, analyte-induced changes in the osmotic swelling pressure of an environmentally responsive hydrogel are measured by confining it within a small implantable enclosure between a rigid semipermeable membrane and the diaphragm of a miniature pressure transducer. Proof-of-principle tests of this device were performed in vitro using pH-sensitive hydrogels, with osmotic deswelling data for the same hydrogels used as a benchmark for comparison. The swelling pressure of the hydrogel was accurately determined from osmotic deswelling measurements against reservoirs of known osmotic stress. Values of swelling pressure vs salt concentration measured with a preliminary version of the sensor agree well with osmotic deswelling results. Through modification of the hydrogel with various enzymes or pendant binding moieties, the sensor has the potential to detect a wide range of biological analytes with good specificity.

Biosensing Techniques↗

Excitation energies through the locally renormalized equation-of-motion formalism: singles and doubles model.

The stationary conditions obtained from approximate coupled-cluster functional derived from the numerator-denominator connected expansion (NDC) [K. Kowalski and P. Piecuch, J. Chem. Phys. 122, 074107 (2005)] are employed to calculate the linear response of cluster amplitudes. A simple scheme that involves singly and doubly excited amplitudes, termed locally renormalized equation-of-motion approach with singles and doubles (LR-EOMCCSD), is compared with other excited-state methods that include up to two-body operators in the wave function expansion. In particular, the impact of the local denominators on the excitation energies is discussed in detail. Several benchmark calculations on the CH(+), C(2), N(2), O(3), and ClOCl molecules are presented to illustrate the performance of the LR-EOMCCSD approach.

Journal Article↗

Statistical evaluation of pairwise protein sequence comparison with the Bayesian bootstrap.

MOTIVATION: Protein sequence comparison methods are routinely used to infer the intricate network of evolutionary relationships found within the rapidly growing library of protein sequences, and thereby to predict the structure and function of uncharacterized proteins. In the present study, we detail an improved statistical benchmark of pairwise protein sequence comparison algorithms. We use bootstrap resampling techniques to determine standard statistical errors and to estimate the confidence of our conclusions. We show that the underlying structure within benchmark databases causes Efron's standard, non-parametric bootstrap to be biased. Consequently, the standard bootstrap underpredicts average performance when used in the context of evaluating sequence comparison methods. We have developed, as an alternative, an unbiased statistical evaluation based on the Bayesian bootstrap, a resampling method operationally similar to the standard bootstrap. RESULTS: We apply our analysis to the comparative study of amino acid substitution matrix families and find that using modern matrices results in a small, but statistically significant improvement in remote homology detection compared with the classic PAM and BLOSUM matrices. AVAILABILITY: The sequence sets and code for performing these analyses are available from http://compbio.berkeley.edu/. CONTACT: brenner@compbio.berkeley.edu.

Algorithms↗

Mitochondrial versus nuclear gene sequences in deep-level mammalian phylogeny reconstruction.

Both mitochondrial and nuclear gene sequences have been employed in efforts to reconstruct deep-level phylogenetic relationships. A fundamental question in molecular systematics concerns the efficacy of different types of sequences in recovering clades at different taxonomic levels. We compared the performance of four mitochondrial data sets (cytochrome b, cytochrome oxidase II, NADH dehydrogenase subunit I, 12S rRNA-tRNA-16S rRNA) and eight nuclear data sets (exonic regions of alpha-2B adrenergic receptor, aquaporin, ss-casein, gamma-fibrinogen, interphotoreceptor retinoid binding protein, kappa-casein, protamine, von Willebrand Factor) in recovering deep-level mammalian clades. We employed parsimony and minimum-evolution with a variety of distance corrections for superimposed substitutions. In 32 different pairwise comparisons between these mitochondrial and nuclear data sets, we used the maximum set of overlapping taxa. In each case, the variable-length bootstrap was used to resample at the size of the smaller data set. The nuclear exons consistently performed better than mitochondrial protein and rRNA-tRNA coding genes on a per-residue basis in recovering benchmark clades. We also concatenated nuclear genes for overlapping taxa and made comparisons with concatenated mitochondrial protein-coding genes from complete mitochondrial genomes. The variable-length bootstrap was used to score the recovery of benchmark clades as a function of the number of resampled base pairs. In every case, the nuclear concatenations were more efficient than the mitochondrial concatenations in recovering benchmark clades. Among genes included in our study, the nuclear genes were much less affected by superimposed substitutions. Nuclear genes having appropriate rates of substitution should receive strong consideration in efforts to reconstruct deep-level phylogenetic relationships.

Animals↗

Validation of a precision radiochromic film dosimetry system for quantitative two-dimensional imaging of acute exposure dose distributions.

We present an evaluation of the precision and accuracy of image-based radiochromic film (RCF) dosimetry performed using a commercial RCF product (Gafchromic MD-55-2, Nuclear Associates, Inc.) and a commercial high-spatial resolution (100 microm pixel size) He-Ne scanning-laser film-digitizer (Personal Densitometer, Molecular Dynamics, Inc.) as an optical density (OD) imaging system. The precision and accuracy of this dosimetry system are evaluated by performing RCF imaging dosimetry in well characterized conformal external beam and brachytherapy high dose-rate (HDR) radiation fields. Benchmarking of image-based RCF dosimetry is necessary due to many potential errors inherent to RCF dosimetry including: a temperature-dependent time evolution of RCF dose response; nonuniform response of RCF; and optical-polarization artifacts. In addition, laser-densitometer imaging artifacts can produce systematic OD measurement errors as large as 35% in the presence of high OD gradients. We present a RCF exposure and readout protocol that was developed for the accurate dosimetry of high dose rate (HDR) radiation sources. This protocol follows and expands upon the guidelines set forth by the American Association of Physicists in Medicine (AAPM) Task Group 55 report. Particular attention is focused on the OD imaging system, a scanning-laser film digitizer, modified to eliminate OD artifacts that were not addressed in the AAPM Task Group 55 report. RCF precision using this technique was evaluated with films given uniform 6 MV x-ray doses between 1 and 200 Gy. RCF absolute dose accuracy using this technique was evaluated by comparing RCF measurements to small volume ionization chamber measurements for conformal external-beam sources and an experimentally validated Monte Carlo photon-transport simulation code for a 192Ir brachytherapy source. Pixel-to-pixel standard deviations of uniformly irradiated films were less than 1% for doses between 10 and 150 Gy; between 1% and 5% for lower doses down to 1 Gy and 1% and 1.5% for higher doses up to 200 Gy. Pixel averaging to form 200-800 microm pixels reduces these standard deviations by a factor of 2 to 5. Comparisons of absolute dose show agreement within 1.5%-4% of dose benchmarks, consistent with a highly accurate dosimeter limited by its observed precision and the precision of the dose standards to which it is compared. These results provide a comprehensive benchmarking of RCF, enabling its use in the commissioning of novel HDR therapy sources.

Brachytherapy↗

Colonoscopy in rural communities: can family physicians perform the procedure with safe and efficacious results?

BACKGROUND: Colonoscopy is becoming increasingly necessary for many patients in screening, diagnosing, and treating colorectal problems. Because the majority of rural doctors are family physicians, providing colonoscopy for the enlarging group of patients with valid indications in rural areas is difficult, unless rural family physicians perform the procedure. Subspecialists in academic settings have been responsible for most of the previously reported studies regarding colonoscopy. We have studied the safety and efficacy of the procedure when performed by rural family physicians. METHODS: A total of 200 sequential colonoscopies performed by family physicians in a rural setting were prospectively collected. Outcomes were measured based on current recommendations and benchmarks, including rate of reaching the cecum, time to reach the cecum, time to completion of the study, pathologic lesions found, and complications. RESULTS: The rate of reaching the cecum was 96.5%, and the average time to the cecum was 15.9 minutes. The average time to study completion was 34.4 minutes. The rate of neoplastic polyps and cancer found was 22.5% and 2.5%, respectively. There were no serious complications. CONCLUSIONS: Adequately trained family physicians can provide safe and technically competent colonoscopy in a rural setting. Their results compare favorably to the currently reported comparative benchmarks from other endoscopists.

Adolescent↗

NQF seeks measures for reporting of infections.

Proposed measures had to be fully developed for use (e.g., research and testing have been completed) and be applicable to health care-associated infections. Initiative guided by NQF mission to help standardize the way quality of performance is measured and reported. Main objective is to establish "best in class" standards that hospitals can use in benchmarking.

Consensus↗

Clinically validated benchmarking of normalisation techniques for two-colour oligonucleotide spotted microarray slides.

Acquisition of microarray data is prone to systematic errors. A correction, called normalisation, must be applied to the data before further analysis is performed. With many normalisation techniques published and in use, the best way of executing this correction remains an open question. In this study, a variety of single-slide normalisation techniques, and different parameter settings for these techniques, were compared over many replicated microarray experiments. Different normalisation techniques were assessed through the distribution of the standard deviation of replicates from one biological sample across different slides. It is shown that local normalisation outperformed global normalisation, and intensity-based 'LOWESS' outperformed trimmed mean and median normalisation techniques. Overall, the top performing normalisation technique was a print-tip-based LOWESS with zero robust iterations. Lastly, we validated this evaluation methodology by examining the ability to predict oestrogen receptor-positive and -negative breast cancer samples with data that had been normalised using different techniques.

Algorithms↗

Criteria and benchmarks for laparoscopic cholecystectomy in a free-standing ambulatory center.

BACKGROUND AND OBJECTIVES: Keys to economic survival in an era of decreasing reimbursement include controlling costs and avoiding complications. In an effort to reduce costs, laparoscopic cholecystectomy has been performed with same-day discharge from a hospital setting. The free-standing ambulatory surgery center offers even greater cost savings if safety can be assured. Facility charges, surgical technique and instrument selection influence the costs of the procedure. METHODS: A database was accumulated prospectively on the first 100 laparoscopic cholecystectomies performed in a free-standing ambulatory surgery center to assess costs, logistical constraints, and safety. RESULTS: Laparoscopic cholecystectomies were accomplished in 99 of 100 patients. One patient was suspected of having cancer during laparoscopy and was transferred to a nearby hospital for open cholecystectomy. There were no other postoperative hospitalizations for complications. The fixed facility charge for the procedure was $2,990, and the total costs for all routinely disposable items (gowns, gloves, instruments, and adhesive bandages was $98. The mean OR time was 29 minutes (standard deviation 13.7). CONCLUSIONS: The free-standing ambulatory surgery center is an appropriate facility for an experienced operating team to perform laparoscopic cholecystectomy in selected patients. The surgeon's selection of appropriate energy sources and instruments is essential to complete the operation in a most cost-effective manner.

Adult↗

Benchmarking as a tool for the improvement of health services' supply departments.

This paper presents a benchmarking study carried out on the supply departments of Quebec's health services. The paper begins with the definition of a methodology to collect the information needed, both environmental (to enable institutions to be sorted into homogenous groups) and performance related. The analysis of indicators and the data envelopment analysis (DEA) models allowed classification of each hospital's performance and explained the operational approaches used, either at a general level or for each subprocess of the supply chain. It was observed that important economies of scale may be achieved with better co-ordination and with the regrouping of the supplying activities, both for purchasing management and central store management. The study showed that the best performance of central store services comes with flexible administrative structures, by receiving packages as small as possible and by using employees from the lowest range of the hierarchy. Purchasing services should employ highly qualified and well-paid staff. Although such services are relatively small with respect to their purchase volume, they show a higher activity rate. As a result of the discovered performing strategies, the possible economies range from 20% to 30% of the actual supply-chain management cost.

Benchmarking↗