PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “bootstrap”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 recordsLinked to original sources

Bayes or bootstrap? A simulation study comparing the performance of Bayesian Markov chain Monte Carlo sampling and bootstrapping in assessing phylogenetic confidence.

Bayesian Markov chain Monte Carlo sampling has become increasingly popular in phylogenetics as a method for both estimating the maximum likelihood topology and for assessing nodal confidence. Despite the growing use of posterior probabilities, the relationship between the Bayesian measure of confidence and the most commonly used confidence measure in phylogenetics, the nonparametric bootstrap proportion, is poorly understood. We used computer simulation to investigate the behavior of three phylogenetic confidence methods: Bayesian posterior probabilities calculated via Markov chain Monte Carlo sampling (BMCMC-PP), maximum likelihood bootstrap proportion (ML-BP), and maximum parsimony bootstrap proportion (MP-BP). We simulated the evolution of DNA sequence on 17-taxon topologies under 18 evolutionary scenarios and examined the performance of these methods in assigning confidence to correct monophyletic and incorrect monophyletic groups, and we examined the effects of increasing character number on support value. BMCMC-PP and ML-BP were often strongly correlated with one another but could provide substantially different estimates of support on short internodes. In contrast, BMCMC-PP correlated poorly with MP-BP across most of the simulation conditions that we examined. For a given threshold value, more correct monophyletic groups were supported by BMCMC-PP than by either ML-BP or MP-BP. When threshold values were chosen that fixed the rate of accepting incorrect monophyletic relationship as true at 5%, all three methods recovered most of the correct relationships on the simulated topologies, although BMCMC-PP and ML-BP performed better than MP-BP. BMCMC-PP was usually a less biased predictor of phylogenetic accuracy than either bootstrapping method. BMCMC-PP provided high support values for correct topological bipartitions with fewer characters than was needed for nonparametric bootstrap.

Bayes Theorem↗

ODS_BOOTSTRAP: assessing the statistical reliability of physical maps by bootstrap resampling.

In the program ODS_BOOTSTRAP we provide a methodology for quickly ordering clones in a genomic library into a physical map and for applying a statistical tool known as the bootstrap to assess the statistical reliability of a clonal ordering. Each clone is assigned a binary fingerprint by one of a variety of experimental approaches to physical mapping. For example, the binary fingerprints might be generated by hybridizing a panel of m probes to a library of n clones. The resulting n x m binary data matrix, X, is input to ODS_BOOTSTRAP, which utilizes the similarity in binary fingerprints of clones to construct a physical map. Under this particular implementation of bootstrap resampling, the m probes (or columns of the data matrix) are sampled randomly with replacement in the computer to generate a new n x m data matrix, X*, from which a second physical map is constructed. The resampling process is repeated 100 or more times to generate 100 or more X* matrices. The resulting 100 or more physical maps are compared with the original physical map based on the original data matrix X by counting how often links in the original physical map reappear. Three confidence statistics are introduced for each link in a physical map. The statistic C1 is defined as the percentage of time two neighboring clones on the original map reappear as neighbors under resampling. The statistic C2 is defined as the percentage of time that two neighboring clones i and j on the original map reappear as neighbors or that a clone with an identical binary fingerprint to clone i reappears as a neighbor to clone j. The statistic C3 is defined as the percentage of time that two neighboring clones on the original map reappear in the same contig under resampling.

Algorithms↗

Bootstrap approach for constructing confidence intervals for population pharmacokinetic parameters. I: A use of bootstrap standard error.

In population pharmacokinetic studies, one of the main objectives is to estimate population pharmacokinetic parameters specifying the population distributions of pharmacokinetic parameters. Confidence intervals for population pharmacokinetic parameters are generally estimated by assuming the asymptotic normality, which is a large-sample property, that is, a property which holds for the cases where sample sizes are large enough. In actual clinical trials, however, sample sizes are limited and not so large in general. Likelihood functions in population pharmacokinetic modelling include a multiple integral and are quite complicated. We hence suspect that the sample sizes of actual trials are often not large enough for assuming the asymptotic normality and that the asymptotic confidence intervals underestimate the uncertainties of the estimates of population pharmacokinetic parameters. As an alternative to the asymptotic normality approach, we can employ a bootstrap approach. This paper proposes a bootstrap standard error approach for constructing confidence intervals for population pharmacokinetic parameters. Comparisons between the asymptotic and bootstrap confidence intervals are made through applications to a simulated data set and an actual phase I trial.

Adult↗

Bootstrap approach for constructing confidence intervals for population pharmacokinetic parameters. II: A bootstrap modification of standard two-stage (STS) method for phase I trial.

For population pharmacokinetics in phase I trials, the standard two-stage (STS) method is quite appealing, especially to non-statisticians, because the method is theoretically and computationally simple. The method, however, does not take into account the uncertainty in estimating individual-specific parameters and gives biased estimates for population variances of pharmacokinetic parameters. This is one of the main reasons why the STS method is not generally recommended. This paper proposes a simple bootstrap modification of the STS method for estimating confidence intervals of population means and standard deviations of pharmacokinetic parameters in phase I trials. The proposed approach adopts a bootstrap bias correction in estimating population variances of pharmacokinetic parameters. Applications are given to a simulated data set and an actual phase I trial to show how the proposed approach works in practice.

Clinical Trials, Phase I as Topic↗

Comparison of bootstrap approaches for estimation of uncertainties of DTI parameters.

Bootstrap is an empirical non-parametric statistical technique based on data resampling that has been used to quantify uncertainties of diffusion tensor MRI (DTI) parameters, useful in tractography and in assessing DTI methods. The current bootstrap method (repetition bootstrap) used for DTI analysis performs resampling within the data sharing common diffusion gradients, requiring multiple acquisitions for each diffusion gradient. Recently, wild bootstrap was proposed that can be applied without multiple acquisitions. In this paper, two new approaches are introduced called residual bootstrap and repetition bootknife. We show that repetition bootknife corrects for the large bias present in the repetition bootstrap method and, therefore, better estimates the standard errors. Like wild bootstrap, residual bootstrap is applicable to single acquisition scheme, and both are based on regression residuals (called model-based resampling). Residual bootstrap is based on the assumption that non-constant variance of measured diffusion-attenuated signals can be modeled, which is actually the assumption behind the widely used weighted least squares solution of diffusion tensor. The performances of these bootstrap approaches were compared in terms of bias, variance, and overall error of bootstrap-estimated standard error by Monte Carlo simulation. We demonstrate that residual bootstrap has smaller biases and overall errors, which enables estimation of uncertainties with higher accuracy. Understanding the properties of these bootstrap procedures will help us to choose the optimal approach for estimating uncertainties that can benefit hypothesis testing based on DTI parameters, probabilistic fiber tracking, and optimizing DTI methods.

Brain↗

Analysis of the distribution of bootstrap tree lengths using the maximum parsimony method.

The bootstrap is an important tool for estimating the confidence interval of monophyletic groups within phylogenies. Although bootstrap analyses are used in most evolutionary studies, there is no clear consensus as how best to interpret bootstrap probability values. To study further the bootstrap method, nine small subunit ribosomal DNA (SSU rDNA) data sets were submitted to bootstrapped maximum parsimony (MP) analyses using unweighted and weighted sequence positions. Analyses of the lengths (i.e., parsimony steps) of the bootstrap trees show that the shape and mean of the bootstrap tree distribution may provide important insights into the evolutionary signal within the sequence data. With complex phylogenies containing nodes defined by short internal branches (multifurcations), the mean of the bootstrap tree distribution may differ by 2 standard deviations from the length of the best tree found from the original data set. Weighting sequence positions significantly increases the bootstrap values at internal nodes. There may, however, be strong bootstrap support for conflicting species groupings among different data sets. This phenomenon appears to result from a correlation between the topology of the tree used to create the weights and the topology of the bootstrap consensus tree inferred from the MP analysis of these weighted data. The analyses also show that characteristics of the bootstrap tree distribution (e.g., skewness) may be used to choose between alternative weighting schemes for phylogenetic analyses.

Animals↗

Supertree bootstrapping methods for assessing phylogenetic variation among genes in genome-scale data sets.

Nonparamtric bootstrapping methods may be useful for assessing confidence in a supertree inference. We examined the performance of two supertree bootstrapping methods on four published data sets that each include sequence data from more than 100 genes. In "input tree bootstrapping," input gene trees are sampled with replacement and then combined in replicate supertree analyses; in "stratified bootstrapping," trees from each gene's separate (conventional) bootstrap tree set are sampled randomly with replacement and then combined. Generally, support values from both supertree bootstrap methods were similar or slightly lower than corresponding bootstrap values from a total evidence, or supermatrix, analysis. Yet, supertree bootstrap support also exceeded supermatrix bootstrap support for a number of clades. There was little overall difference in support scores between the input tree and stratified bootstrapping methods. Results from supertree bootstrapping methods, when compared to results from corresponding supermatrix bootstrapping, may provide insights into patterns of variation among genes in genome-scale data sets.

Algorithms↗

Statistical properties of bootstrap estimation of phylogenetic variability from nucleotide sequences. I. Four taxa with a molecular clock.

The statistical properties of sample estimation and bootstrap estimation of phylogenetic variability from a sample of nucleotide sequences are studied by using model trees of three taxa with an outgroup and by assuming a constant rate of nucleotide substitution. The maximum-parsimony method of tree reconstruction is used. An analytic formula is derived for estimating the sequence length that is required if P, the probability of obtaining the true tree from the sampled sequences, is to be equal to or higher than a given value. Bootstrap estimation is formulated as a two-step sampling procedure: (1) sampling of sequences from the evolutionary process and (2) resampling of the original sequence sample. The probability that a bootstrap resampling of an original sequence sample will support the true tree is found to depend on the model tree, the sequence length, and the probability that a randomly chosen nucleotide site is an informative site. When a trifurcating tree is used as the model tree, the probability that one of the three bifurcating trees will appear in > or = 95% of the bootstrap replicates is < 5%, even if the number of bootstrap replicates is only 50; therefore, the probability of accepting an erroneous tree as the true tree is < 5% if that tree appears in > or = 95% of the bootstrap replicates and if more than 50 bootstrap replications are conducted. However, if a particular bifurcating tree is observed in, say, < 75% of the bootstrap replicates, then it cannot be claimed to be better than the trifurcating tree even if > or = 1,000 bootstrap replications are conducted. When a bifurcating tree is used as the model tree, the bootstrap approach tends to overestimate P when the sequences are very short, but it tends to underestimate that probability when the sequences are long. Moreover, simulation results show that, if a tree is accepted as the true tree only if it has appeared in > or = 95% of the bootstrap replicates, then the probability of failing to accept any bifurcating tree can be as large as 58% even when P = 95%, i.e., even when 95% of the samples from the evolutionary process will support the true tree. Thus, if the rate-constancy assumption holds, bootstrapping is a conservative approach for estimating the reliability of an inferred phylogeny for four taxa.

Phylogeny↗

Guidelines for selecting among different types of bootstraps.

BACKGROUND: The bootstrap has become very popular in health economics. Its success lies in the ease of estimating sampling distribution, standard error and confidence intervals with few or no assumptions about the distribution of the underlying population. OBJECTIVE: The purpose of this paper is three-fold: (1) to provide an overview of four common bootstrap techniques for readers who have little or no statistical background; (2) to suggest a guideline for selecting the most applicable bootstrap technique for your data; and (3) to connect guidelines with a real world example, to illustrate how different bootstraps behave in one model, or in different models. RESULTS: The assumptions of homoscedasticity and normality are key to selecting the best bootstrapping technique. These assumptions should be tested before applying any bootstrapping technique. If homoscedasticity and normality hold, then parametric bootstrapping is consistent and efficient. Paired and wild bootstrapping are consistent under heteroscedasticity and non-normality assumptions. CONCLUSION: Selecting the correct type of bootstrapping is crucial for arriving at efficient estimators. Our example illustrates that if we selected an inconsistent bootstrapping technique, results could be misleading. An insignificant effect of controller treatment on total health expenditures among asthma patients would have been found significant and negative by an improperly chosen bootstrapping technique, regardless of the type of model chosen.

Confidence Intervals↗

Comparison of Bayesian and maximum likelihood bootstrap measures of phylogenetic reliability.

Owing to the exponential growth of genome databases, phylogenetic trees are now widely used to test a variety of evolutionary hypotheses. Nevertheless, computation time burden limits the application of methods such as maximum likelihood nonparametric bootstrap to assess reliability of evolutionary trees. As an alternative, the much faster Bayesian inference of phylogeny, which expresses branch support as posterior probabilities, has been introduced. However, marked discrepancies exist between nonparametric bootstrap proportions and Bayesian posterior probabilities, leading to difficulties in the interpretation of sometimes strongly conflicting results. As an attempt to reconcile these two indices of node reliability, we apply the nonparametric bootstrap resampling procedure to the Bayesian approach. The correlation between posterior probabilities, bootstrap maximum likelihood percentages, and bootstrapped posterior probabilities was studied for eight highly diverse empirical data sets and were also investigated using experimental simulation. Our results show that the relation between posterior probabilities and bootstrapped maximum likelihood percentages is highly variable but that very strong correlations always exist when Bayesian node support is estimated on bootstrapped character matrices. Moreover, simulations corroborate empirical observations in suggesting that, being more conservative, the bootstrap approach might be less prone to strongly supporting a false phylogenetic hypothesis. Thus, apparent conflicts in topology recovered by the Bayesian approach were reduced after bootstrapping. Both posterior probabilities and bootstrap supports are of great interest to phylogeny as potential upper and lower bounds of node reliability, but they are surely not interchangeable and cannot be directly compared.

Animals↗

Use of the bootstrap in analysing cost data from cluster randomised trials: some simulation results.

BACKGROUND: This work has investigated under what conditions confidence intervals around the differences in mean costs from a cluster RCT are suitable for estimation using a commonly used cluster-adjusted bootstrap in preference to methods that utilise the Huber-White robust estimator of variance. The bootstrap's main advantage is in dealing with skewed data, which often characterise patient costs. However, it is insufficiently well recognised that one method of adjusting the bootstrap to deal with clustered data is only valid in large samples. In particular, the requirement that the number of clusters randomised should be large would not be satisfied in many cluster RCTs performed to date. METHODS: The performances of confidence intervals for simple differences in mean costs utilising a robust (cluster-adjusted) standard error and from two cluster-adjusted bootstrap procedures were compared in terms of confidence interval coverage in a large number of simulations. Parameters varied included the intracluster correlation coefficient, the sample size and the distributions used to generate the data. RESULTS: The bootstrap's advantage in dealing with skewed data was found to be outweighed by its poor confidence interval coverage when the number of clusters was at the level frequently found in cluster RCTs in practice. Simulations showed that confidence intervals based on robust methods of standard error estimation achieved coverage rates between 93.5% and 94.8% for a 95% nominal level whereas those for the bootstrap ranged between 86.4% and 93.8%. CONCLUSION: In general, 24 clusters per treatment arm is probably the minimum number for which one would even begin to consider the bootstrap in preference to traditional robust methods, for the parameter combinations investigated here. At least this number of clusters and extremely skewed data would be necessary for the bootstrap to be considered in favour of the robust method. There is a need for further investigation of more complex bootstrap procedures if economic data from cluster RCTs are to be analysed appropriately.

Analysis of Variance↗

Bootstrap estimation of diagnostic accuracy with patient-clustered data.

RATIONALE AND OBJECTIVES: The purpose of this study was to describe a simple bootstrap approach for estimating sensitivity, specificity, and the area under the receiver operating characteristic curve for multisite test outcome data. MATERIALS AND METHODS: The performance of bootstrap estimates was evaluated and compared with that of analytic estimates by using a simulation study. Bootstrapping was demonstrated by using data from a previous study comparing two angiographic methods. RESULTS: Analytic and bootstrap estimates had similar coverage rates for 95% confidence intervals. With many sites per patient, bootstrap estimates had slightly better coverage than analytic estimates. Bootstrap percentile intervals had better coverage than asymptotic normal bootstrap intervals. CONCLUSION: Bootstrapping is a useful method of estimating confidence intervals for the area under the receiver operating characteristic curve, sensitivity, and specificity when data are correlated.

Angiography↗

The dual-bootstrap iterative closest point algorithm with application to retinal image registration.

Motivated by the problem of retinal image registration, this paper introduces and analyzes a new registration algorithm called Dual-Bootstrap Iterative Closest Point (Dual-Bootstrap ICP). The approach is to start from one or more initial, low-order estimates that are only accurate in small image regions, called bootstrap regions. In each bootstrap region, the algorithm iteratively: 1) refines the transformation estimate using constraints only from within the bootstrap region; 2) expands the bootstrap region; and 3) tests to see if a higher order transformation model can be used, stopping when the region expands to cover the overlap between images. Steps 1): and 3), the bootstrap steps, are governed by the covariance matrix of the estimated transformation. Estimation refinement [Step 2)] uses a novel robust version of the ICP algorithm. In registering retinal image pairs, Dual-Bootstrap ICP is initialized by automatically matching individual vascular landmarks, and it aligns images based on detected blood vessel centerlines. The resulting quadratic transformations are accurate to less than a pixel. On tests involving approximately 6000 image pairs, it successfully registered 99.5% of the pairs containing at least one common landmark, and 100% of the pairs containing at least one common landmark and at least 35% image overlap.

Algorithms↗

The defibrillation success rate versus energy relationship: Part II--Estimation with the "bootstrap".

Seventy or so defibrillation trials were typically attempted to determine the relationship between defibrillation success rate and energy (DSRE). Clinically, it may be desirable to estimate the DSRE relationship with fewer trials. We used the statistical resampling technique called the "bootstrap" to determine the number of defibrillation trials necessary for an accurate estimation of the DSRE relationship. The bootstrap technique assumes that the observed database is the maximum likelihood sample of the estimated population. The observed database is repeatedly resampled to produce a large bootstrap data-base and the bootstrap best estimate of a statistic is determined. DSRE data were obtained from ten dogs (20.5 +/- 1.5 kg). We bootstrapped our experimental DSRE data by two methods: (1) randomly choosing with replacement a specified number of defibrillation trials per energy; and (2) randomly choosing with replacement a specified number of defibrillation trials per bootstrap replication. For both bootstrap techniques, 100 replications were made. We performed a linear regression analysis on the bootstrap success rates and the observed success rates determined from 71.0 +/- 6.8 defibrillation attempts from each of the ten dogs. We concluded that 28 defibrillation trials are necessary to estimate the observed DSRE relationship with a correlation coefficient of 0.95.

Animals↗

Non-parametric bootstrap confidence intervals for the intraclass correlation coefficient.

The intraclass correlation coefficient rho plays a key role in the design of cluster randomized trials. Estimates of rho obtained from previous cluster trials and used to inform sample size calculation in planned trials may be imprecise due to the typically small numbers of clusters in such studies. It may be useful to quantify this imprecision. This study used simulation to compare different methods for assigning bootstrap confidence intervals to rho for continuous outcomes from a balanced design. Data were simulated for combinations of numbers of clusters (10, 30, 50), intraclass correlation coefficients (0.001, 0.01, 0.05, 0.3) and outcome distributions (normal, non-normal continuous). The basic, bootstrap-t, percentile, bias corrected and bias corrected accelerated bootstrap intervals were compared with new methods using the basic and bootstrap-t intervals applied to a variance stabilizing transformation of rho. The standard bootstrap methods provided coverage levels for 95 per cent intervals that were markedly lower than the nominal level for data sets with only 10 clusters, and only provided close to 95 per cent coverage when there were 50 clusters. Application of the bootstrap-t method to the variance stabilizing transformation of rho improved upon the performance of the standard bootstrap methods, providing close to nominal coverage.

Cluster Analysis↗

The use of bootstrap methods for estimating sample size and analysing health-related quality of life outcomes.

Health-related quality of life (HRQoL) measures are increasingly used in trials as primary outcome measures. Investigators are now asking statisticians for advice on how to plan and analyse studies using such outcomes. HRQoL outcomes, like the SF-36, are usual measured on an ordinal scale, although most investigators assume that there exists an underlying continuous latent variable and that the actual measured outcomes (the ordered categories) reflect contiguous intervals along this continuum. The ordinal scaling of HRQoL measures means they tend to generate data that have discrete, bounded and skewed distributions. Thus, standard methods of analysis that assume Normality and constant variance may not be appropriate. For this reason, conventional statistical advice would suggest non-parametric methods be used to analyse HRQoL data. The bootstrap is one such computer intensive non-parametric method for estimating sample sizes and analysing data. We describe three methods of estimating sample sizes for two-group cross-sectional comparisons of HRQoL outcomes. We then compared the power of the three methods for a two-group cross-sectional study design using bootstrap simulation. The results showed that under the location shift alternative hypothesis, conventional methods of sample size estimation performed well, particularly Whitehead's method. Whitehead's method is recommended if the HRQoL outcome has a limited number of discrete values (<7) and/or the expected proportion of cases at either of the bounds is high. If a pilot data set is readily available then bootstrap simulation will provide a more accurate and reliable estimate, than conventional methods.Finally, we used the bootstrap for hypothesis testing and the estimation of standard errors and confidence intervals for parameters, in an example data set. We then compared and contrasted the bootstrap with standard methods of analysing HRQoL outcomes. In the data set studied, with the SF-36 outcome, the use of the bootstrap for estimating sample sizes and analysing HRQoL data produces results similar to conventional statistical methods. These results suggest that bootstrap methods are not more appropriate for analysing HRQoL outcome data than standard methods.

Adolescent↗

The bootstrap: a technique for data-driven statistics. Using computer-intensive analyses to explore experimental data.

BACKGROUND: The concept of resampling data--more commonly referred to as bootstrapping--has been in use for more than three decades. Bootstrapping has considerable theoretical advantages when it is applied to non-Gaussian data. Most of the published literature is concerned with the mathematical aspects of the bootstrap but increasingly this technique is being utilized in medical and other fields. METHODS: I reviewed the published literature following a 1994 publication assessing the transfer of technology, including the bootstrap, to the biomedical literature. RESULTS: In the ten-year period following that 1994 paper there were 1679 published references to the technique in Medline. In that same time period the following citations were found in the four major medical journals-British Medical Journal (48), JAMA (51), Lancet (52) and the New England Journal of Medicine (45). CONTENT: I introduce the basic theory of the bootstrap, the jackknife, and permutation tests. The bootstrap is used to estimate the accuracy of an estimator such as the standard error, a confidence interval, or the bias of an estimator. The technique may be useful for analysing smallish expensive-to-collect data sets where prior information is sparse, distributional assumptions are unclear, and where further data may be difficult to acquire. Some of the elementary uses of bootstrapping are illustrated by considering the calculation of confidence intervals such as for reference ranges or for experimental data findings, hypothesis testing such as comparing experimental findings, linear regression, and correlation when studying association and prediction of variables, non-linear regression such as used in immunoassay techniques, and ROC curve processing. CONCLUSIONS: These techniques can supplement current nonparametric statistical methods and should be included, where appropriate, in the armamentarium of data processing methodologies.

Computers↗

Internal validation of risk models in lung resection surgery: bootstrap versus training-and-test sampling.

OBJECTIVE: The objective of the present analysis was to compare the performance of a lung resection mortality model developed by means of logistic regression and bootstrap analysis with that of multiple mortality models developed by using the traditional training-and-test method from the same dataset. METHODS: Eleven mortality models (1 developed by means of logistic regression and bootstrap validation and the other 10 developed by means of the traditional training-and-test random splitting of the dataset) were generated by the data of unit A (571 patients submitted to major lung resection). The performances of each of the 11 mortality models were then evaluated by assessing the distribution of the respective c-statistics in 1000 bootstrap samples derived from unit B (224 patients). RESULTS: The first model (logistic regression and bootstrap analysis) had good discrimination among the 1000 bootstrap external samples (c-statistics >0.7 in 80% of samples and >0.8 in 38% of samples). Among the 10 training-and-test models, only one model had a similar performance, whereas the others had a poorer discrimination. CONCLUSIONS: The traditional training-and-test method for risk model building proved to be unreliable across multiple external populations and was generally inferior to bootstrap analysis for variable selection in regression analysis. Therefore the use of bootstrap analysis must be recommended for every future model-building process.

Aged↗