PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “bootstrap”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

Multireader, multicase receiver operating characteristic methodology: a bootstrap analysis.

RATIONALE AND OBJECTIVES: We evaluated by bootstrapping the conclusions obtained by the Dorfman-Berbaum-Metz (DBM) receiver operating characteristic (ROC) method and by the Toledano-Gatsonis (TG) method on a well-known data set. METHODS: We bootstrapped in two ways, resampled cases while holding readers fixed and resampled both cases and readers. RESULTS: When an analysis of variance of pseudovalues implies that reader variance and all random interactions with treatment are essentially zero, then case-resampling bootstrap and the DBM and TG methods should give the same results. Case-resampling bootstrap and the DBM and TG methods did give highly similar results for both individual readers and the averages over all readers. Both the case-resampling bootstrap and the reader-case resampling bootstrap gave smaller standard errors for group than for individual reader means, thereby providing evidence for a trade-off of readers and cases with regard to precision and power in this data set. CONCLUSION: Case-resampling bootstrap provides some justification for the DBM and TG methods.

Analysis of Variance↗

Making bootstrap statistical inferences: a tutorial.

Bootstrapping is a computer-intensive statistical technique in which extensive computational procedures are heavily dependent on modern high-speed digital computers. The payoff for such intensive computations is freedom from two major limiting factors that have dominated classical statistical theory since its beginning: the assumption that the data conform to a bell-shaped curve, and the need to focus on statistical measures whose theoretical properties can be analysed mathematically. The name "bootstrap" was derived from an old saying about pulling oneself up by one's bootstraps. In this case, bootstrapping means redrawing samples randomly from the original sample with replacement. The key idea, computations, advantages, limitations, and application potential of bootstrapping in the field of physical education and exercise science are introduced and illustrated using a set of national physical fitness testing data. Finally, an example of a bootstrapping application is provided. Through a step-by-step approach, the development and implementation of the bootstrap statistical inference are illustrated.

Data Interpretation, Statistical↗

Comparing bootstrap and posterior probability values in the four-taxon case.

Assessment of the reliability of a given phylogenetic hypothesis is an important step in phylogenetic analysis. Historically, the nonparametric bootstrap procedure has been the most frequently used method for assessing the support for specific phylogenetic relationships. The recent employment of Bayesian methods for phylogenetic inference problems has resulted in clade support being expressed in terms of posterior probabilities. We used simulated data and the four-taxon case to explore the relationship between nonparametric bootstrap values (as inferred by maximum likelihood) and posterior probabilities (as inferred by Bayesian analysis). The results suggest a complex association between the two measures. Three general regions of tree space can be identified: (1) the neutral zone, where differences between mean bootstrap and mean posterior probability values are not significant, (2) near the two-branch corner, and (3) deep in the two-branch corner. In the last two regions, significant differences occur between mean bootstrap and mean posterior probability values. Whether bootstrap or posterior probability values are higher depends on the data in support of alternative topologies. Examination of star topologies revealed that both bootstrap and posterior probability values differ significantly from theoretical expectations; in particular, there are more posterior probability values in the range 0.85-1 than expected by theory. Therefore, our results corroborate the findings of others that posterior probability values are excessively high. Our results also suggest that extrapolations from single topology branch-length studies are unlikely to provide any general conclusions regarding the relationship between bootstrap and posterior probability values.

Computer Simulation↗

Bootstrap methods for statistical inference from stereological estimates of volume fraction.

We suggest the use of bootstrap methods for inference from stereological estimates of volume fraction. An informal introduction to stereological estimation of volume fraction and to principles of bootstrap techniques is given. The bootstrap method is a robust computer-intensive resampling technique, based on independent random sampling from a data set with replacement. Bootstrap methods were used to estimate confidence intervals for volume fractions, and to test for a significant difference between estimated volume fractions from two samples. Two sampling designs are considered: independent replicated samples (visual fields) from a single object, and estimates of volume fraction from multiple independent objects. The methods are presented as worked examples on real data sets obtained from tumour pathology (mammary cancer, pancreatic cancer). The volume fraction of glandular lumina per total volume of the epithelial phase was chosen as target parameter. It indicates the degree of glandular differentiation in adenocarcinomas and is estimated as a ratio-of-means statistic with variable denominator within cases. The confidence intervals of the volume fraction estimated by the bootstrap method were slightly narrower than the parametrically calculated confidence intervals for all data sets. The outcomes of significance tests based on the bootstrap technique were unchanged as compared with classical tests based on the assumptions of normality and homoscedasticity of the data. Special attention was paid to the reproducibility of the bootstrap technique in replicated trials on the same data.

Breast Neoplasms↗

Type I errors and power of the parametric bootstrap goodness-of-fit test: full and limited information.

In sparse tables for categorical data well-known goodness-of-fit statistics are not chi-square distributed. A consequence is that model selection becomes a problem. It has been suggested that a way out of this problem is the use of the parametric bootstrap. In this paper, the parametric bootstrap goodness-of-fit test is studied by means of an extensive simulation study; the Type I error rates and power of this test are studied under several conditions of sparseness. In the presence of sparseness, models were used that were likely to violate the regularity conditions. Besides bootstrapping the goodness-of-fit usually used (full information statistics), corrected versions of these statistics and a limited information statistic are bootstrapped. These bootstrap tests were also compared to an asymptotic test using limited information. Results indicate that bootstrapping the usual statistics fails because these tests are too liberal, and that bootstrapping or asymptotically testing the limited information statistic works better with respect to Type I error and outperforms the other statistics by far in terms of statistical power. The properties of all tests are illustrated using categorical Markov models.

Data Collection↗

Investigation on the improvement of prediction by bootstrap model averaging.

OBJECTIVES: We illustrate a recently proposed two-step bootstrap model averaging (bootstrap MA) approach to cope with model selection uncertainty. The predictive performance is investigated in an example and in a simulation study. Results are compared to those derived from other model selection methods. METHODS: In the framework of the linear regression model we use the two-step bootstrap MA, which consists of a screening step to eliminate covariates thought to have no influence on the response, and a model-averaging step. We also apply the full model, variable selection using backward elimination based on Akaike's Information Criterion (AIC), the Bayes Information Criterion (BIC) and the bagging approach. The predictive performance is measured by the mean squared error (MSE) and the coverage of confidence intervals for the true response. RESULTS: We obtained similar results for all approaches in the example. In the simulation the MSE was reduced by all approaches in comparison to the full model. The smallest values are obtained for bootstrap MA. Only the bootstrap MA and the full model correctly estimated the nominal coverage. The backward elimination procedures led to substantial underestimation and bagging to an overestimation of the true coverage. The screening step of bootstrap MA eliminates most of the unimportant factors. CONCLUSION: The new bootstrap MA approach shows promising results for predictive performance. It increases practical usefulness by eliminating unimportant factors in the screening step.

Body Composition↗

Pulling cost-effectiveness analysis up by its bootstraps: a non-parametric approach to confidence interval estimation.

The statistic of interest in the economic evaluation of health care interventions is the incremental cost effectiveness ratio (ICER), which is defined as the difference in cost between two treatment interventions over the difference in their effect. Where patient-specific data on costs and health outcomes are available, it is natural to attempt to quantify uncertainty in the estimated ICER using confidence intervals. Recent articles have focused on parametric methods for constructing confidence intervals. In this paper, we describe the construction of non-parametric bootstrap confidence intervals. The advantage of such intervals is that they do not depend on parametric assumptions of the sampling distribution of the ICER. We present a detailed description of the non-parametric bootstrap applied to data from a clinical trial, in order to demonstrate the strengths and weaknesses of the approach. By examining the bootstrap confidence limits successively as the number of bootstrap replications increases, we conclude that percentile bootstrap confidence interval methods provide a promising approach to estimating the uncertainty of ICER point estimates. However, successive bootstrap estimates of bias and standard error suggests that these may be unstable; accordingly, we strongly recommend a cautious interpretation of such estimates.

Bias↗

Analysis of cost data in randomized trials: an application of the non-parametric bootstrap.

Health economic evaluations are now more commonly being included in pragmatic randomized trials. However a variety of methods are being used for the presentation and analysis of the resulting cost data, and in many cases the approaches taken are inappropriate. In order to inform health care policy decisions, analysis needs to focus on arithmetic mean costs, since these will reflect the total cost of treating all patients with the disease. Thus, despite the often highly skewed distribution of cost data, standard non-parametric methods or use of normalizing transformations are not appropriate. Although standard parametric methods of comparing arithmetic means may be robust to non-normality for some data sets, this is not guaranteed. While the randomization test can be used to overcome assumptions of normality, its use for comparing means is still restricted by the need for similarly shaped distributions in the two groups. In this paper we show how the non-parametric bootstrap provides a more flexible alternative for comparing arithmetic mean costs between randomized groups, avoiding the assumptions which limit other methods. Details of several bootstrap methods for hypothesis tests and confidence intervals are described and applied to cost data from two randomized trials. The preferred bootstrap approaches are the bootstrap-t or variance stabilized bootstrap-t and the bias corrected and accelerated percentile methods. We conclude that such bootstrap techniques can be recommended either as a check on the robustness of standard parametric methods, or to provide the primary statistical analysis when making inferences about arithmetic means for moderately sized samples of highly skewed data such as costs.

Cognitive Behavioral Therapy↗

Just how much data need to be collected for reliable bootstrap DT-MRI?

Diffusion tensor MRI (DT-MRI) can provide estimates of fiber orientation derived from the orientational dependence of the diffusivity of water molecules, enabling the reconstruction of white matter fiber pathways using tractography methods. However, noise arising from various sources can introduce uncertainty into the estimates of the elements of the diffusion tensor, resulting in errors in fiber orientation estimates such that tractography reconstructions of fiber pathways potentially can be imprecise and inaccurate. Recently, attempts have been made to characterize the uncertainty in DT-MRI-derived parameters using the bootstrap method; however, several questions remain open regarding the number of repeat measurements and bootstraps required to accurately and precisely reconstruct the probability distributions of the DT-MRI parameters. This study investigates the accuracy and precision of the bootstrap method for characterizing distributions of DT-MRI parameters. A number of experimental bootstrap designs and sampling schemes containing different numbers of isotropically distributed gradient vectors are considered, using an idealized system where the true variability in each parameter is known. This study demonstrates that for most DT-MRI experiments, robust results will be obtained if the minimum number of bootstraps is approximately 500, and that at least five repeat samples of each diffusion-weighted intensity should be used for bootstrapping.

Algorithms↗

Estimation of confidence in phylogeny: the complete-and-partial bootstrap technique.

The bootstrap is a statistical technique that is widely used to assess confidence limits on phylogenies. We show that the power of the bootstrap test is lower than those of the C and S tests suggested by Felsenstein, unless the critical value employed in the bootstrap test is correctly selected. If the 95% critical value is used, the bootstrap proportions are underestimates of the confidence level when the number of possible alternative topologies is three or more; the degree of underestimation increases with the number of competing alternative topologies. To overcome this problem, we propose the complete-and-partial bootstrap technique as a method for obtaining an unbiased estimate of the confidence level. The method is based on a multinomial model of many alternatives among which the choice is to be made. The complete-and-partial bootstrap technique can be used to estimate the effective number of competing alternative topologies and the confidence level of the monophyly of a particular group of taxa or of an inferred tree topology. This approach can be used with the maximum parsimony or neighbor-joining tree reconstruction method.

Confidence Intervals↗

Increased reliability for single-case research results: is the bootstrap the answer?

There is need for objective and reliable single-case research (SCR) results in the movement toward evidence-based interventions (EBI), for inclusion in meta-analyses, and for funding accountability in clinical contexts. Yet SCR deals with data that often do not conform to parametric data assumptions and that yield results of low reliability. A resampling technique, the bootstrap, largely bypasses statistical assumptions and usually yields more reliable results. This study answers questions about the extent of need for the bootstrap in SCR and its impact on effect size reliability. The bootstrap was applied in Allison et al. mean shift analyses (Faith, Allison, & Gorman, 1997) to data from 166 published AB graphs. Results showed the bootstrap improved reliability of 88% of the analyses and reduced reliability of only 3%. The reliability improvement was large enough to be practically useful. The bootstrap was paired with a method for cleansing data of autocorrelation, which also proved effective. Pending replication, the findings encourage broad application within SCR of both the bootstrap and autocorrelation cleansing.

Case-Control Studies↗

Investigations of dipole localization accuracy in MEG using the bootstrap.

We describe the use of the nonparametric bootstrap to investigate the accuracy of current dipole localization from magnetoencephalography (MEG) studies of event-related neural activity. The bootstrap is well suited to the analysis of event-related MEG data since the experiments are repeated tens or even hundreds of times and averaged to achieve acceptable signal-to-noise ratios (SNRs). The set of repetitions or epochs can be viewed as a set of independent realizations of the brain's response to the experiment. Bootstrap resamples can be generated by sampling with replacement from these epochs and averaging. In this study, we applied the bootstrap resampling technique to MEG data from somatotopic experimental and simulated data. Four fingers of the right and left hand of a healthy subject were electrically stimulated, and about 400 trials per stimulation were recorded and averaged in order to measure the somatotopic mapping of the fingers in the S1 area of the brain. Based on single-trial recordings for each finger we performed 5000 bootstrap resamples. We reconstructed dipoles from these resampled averages using the Recursively Applied and Projected (RAP)-MUSIC source localization algorithm. We also performed a simulation for two dipolar sources with overlapping time courses embedded in realistic background brain activity generated using the prestimulus segments of the somatotopic data. To find correspondences between multiple sources in each bootstrap, sample dipoles with similar time series and forward fields were assumed to represent the same source. These dipoles were then clustered by a Gaussian Mixture Model (GMM) clustering algorithm using their combined normalized time series and topographies as feature vectors. The mean and standard deviation of the dipole position and the dipole time series in each cluster were computed to provide estimates of the accuracy of the reconstructed source locations and time series.

Brain Mapping↗

Bootstrap validation of pharmacodynamic models defined via stepwise linear regression.

When a pharmacodynamic model is to be considered as the basis for individualized drug dosing, validation of the model is clearly warranted. Rigorous validation is problematic when the training data set to be modeled has too few data points and no independent test data set exists. A simulation method known as the bootstrap lends itself particularly well to this dilemma. Bootstrap sampling allows simulation of needed test data sets that mimic the initial data set. Model validation is then undertaken by repeating the model formulation procedure on the bootstrap samples. For illustration, a pharmacodynamic model for leukopenia was constructed by stepwise linear regression from data of 41 patients with cancer treated with the drug amonafide. Stepwise regression analyses were then repeated for 100 bootstrap samples, which verified the initial selection of covariates for the model. Next the regression parameters and residual error standard deviation of the model were repeatedly estimated for 200 additional bootstrap samples. The bootstrap results confirmed the initial formulation of the pharmacodynamic model from the training data set.

Acetylation↗

Application of the bootstrap procedure provides an alternative to standard statistical procedures in the estimation of the vitamin B-6 requirement.

The bootstrap procedure is a versatile statistical tool for the estimation of standard errors and confidence intervals. It is useful when standard statistical methods are not available or are poorly behaved, e.g., for nonlinear functions or when assumptions of a statistical model have been violated. Inverse regression estimation is an example of a statistical tool with a wide application in human nutrition. In a recent study, inverse regression was used to estimate the vitamin B-6 requirement of young women. In the present statistical application, both standard statistical methods and the bootstrap technique were used to estimate the mean vitamin B-6 requirement, standard errors and 95% confidence intervals for the mean. The bootstrap procedure produced standard error estimates and confidence intervals that were similar to those calculated by using standard statistical estimators. In a Monte Carlo simulation exploring the behavior of the inverse regression estimators, bootstrap standard errors were found to be nearly unbiased, even when the basic assumptions of the regression model were violated. On the other hand, the standard asymptotic estimator was found to behave well when the assumptions of the regression model were met, but behaved poorly when the assumptions were violated. In human metabolic studies, which are often restricted to small sample sizes, or when statistical methods are not available or are poorly behaved, bootstrap estimates for calculating standard errors and confidence intervals may be preferred. Investigators in human nutrition may find that the bootstrap procedure is superior to standard statistical procedures in cases similar to the examples presented in this paper.

Adult↗

Majority-rule reduced consensus trees and their use in bootstrapping.

Bootstrap analyses are usually summarized with majority-rule component consensus trees. This consensus method is based on replicated components and, like all component consensus methods, it is insensitive to other kinds of agreement between trees. Recently developed reduced consensus methods can be used to summarize much additional agreement on hypothesised phylogenetic relationships among multiple trees. The new methods are "strict" in the sense that they require agreement among all the trees being compared for any relationships to be represented in a consensus tree. Majority-rule reduced consensus methods are described and their use in bootstrap analyses is illustrated with a hypothetical and a real example. The new methods provide summaries of the bootstrap proportions of all n-taxon statements/partitions and facilitate the identification of hypotheses of relationships that are supported by high bootstrap proportions, in spite of a lack of support for particular components or clades. In practice majority-rule reduced consensus profiles may contain many trees. The size of the profile can be reduced by constraints on minimal bootstrap proportions and/or cardinality of the included trees. Majority-rule reduced consensus trees can also be selected a posteriori from the profile. Surrogates to the majority-rule reduced consensus methods using partition tables or tree pruning options provided by widely used phylogenetic inference software are also described. The methods are designed to produce more informative summaries of bootstrap analyses and thereby foster more informed assessment of the strengths and weaknesses of complex phylogenetic hypotheses.

Animals↗

Interior-branch and bootstrap tests of phylogenetic trees.

We have compared statistical properties of the interior-branch and bootstrap tests of phylogenetic trees when the neighbor-joining tree-building method is used. For each interior branch of a predetermined topology, the interior-branch and bootstrap tests provide the confidence values, PC and PB, respectively, that indicate the extent of statistical support of the sequence cluster generated by the branch. In phylogenetic analysis these two values are often interpreted in the same way, and if PC and PB are high (say, > or = 0.95), the sequence cluster is regarded as reliable. We have shown that PC is in fact the complement of the P-value used in the standard statistical test, but PB is not. Actually, the bootstrap test usually underestimates the extent of statistical support of species clusters. The relationship between the confidence values obtained by the two tests varies with both the topology and expected branch lengths of the true (model) tree. The most conspicuous difference between PC and PB is observed when the true tree is starlike, and there is a tendency for the difference to increase as the number of sequences in the tree increases. The reason for this is that the bootstrap test tends to become progressively more conservative as the number of sequences in the tree increases. Unlike the bootstrap, the interior-branch test has the same statistical properties irrespective of the number of sequences used when a predetermined tree is considered. Therefore, the interior-branch test appears to be preferable to the bootstrap test as long as unbiased estimators of evolutionary distances are used. However, when the interior-branch is applied to a tree estimated from a given data set, PC may give an overestimate of statistical confidence. For this case, we developed a method for computing a modified version (P'C) of the PC value and showed that this P'C tends to give a conservative estimate of statistical confidence, though it is not as conservative as PB. In this paper we have introduced a model in which evolutionary distances between sequences follow a multivariate normal distribution. This model allowed us to study the relationships between the two tests analytically.

Computer Simulation↗

Improved option pricing using artificial neural networks and bootstrap methods.

A hybrid neural network is used to predict the difference between the conventional option-pricing model and observed intraday option prices for stock index option futures. Confidence intervals derived with bootstrap methods are used in a trading strategy that only allows trades outside the estimated range of spurious model fits to be executed. Whilst hybrid neural network option pricing models can improve predictions they have bias. The hybrid option-pricing bias can be reduced with bootstrap methods. A modified bootstrap predictor is indexed by a parameter that allows the predictor to range from a pure bootstrap predictor, to a hybrid predictor, and finally the bagging predictor. The modified bootstrap predictor outperforms the hybrid and bagging predictors. Greatly improved performance was observed on the boundary of the training set and where only sparse training data exists. Finally, bootstrap bias estimates were studied.

Algorithms↗

The efficiency of different search strategies in estimating parsimony jackknife, bootstrap, and Bremer support.

BACKGROUND: For parsimony analyses, the most common way to estimate confidence is by resampling plans (nonparametric bootstrap, jackknife), and Bremer support (Decay indices). The recent literature reveals that parameter settings that are quite commonly employed are not those that are recommended by theoretical considerations and by previous empirical studies. The optimal search strategy to be applied during resampling was previously addressed solely via standard search strategies available in PAUP*. The question of a compromise between search extensiveness and improved support accuracy for Bremer support received even less attention. A set of experiments was conducted on different datasets to find an empirical cut-off point at which increased search extensiveness does not significantly change Bremer support and jackknife or bootstrap proportions any more. RESULTS: For the number of replicates needed for accurate estimates of support in resampling plans, a diagram is provided that helps to address the question whether apparently different support values really differ significantly. It is shown that the use of random addition cycles and parsimony ratchet iterations during bootstrapping does not translate into higher support, nor does any extension of the search extensiveness beyond the rather moderate effort of TBR (tree bisection and reconnection branch swapping) plus saving one tree per replicate. Instead, in case of very large matrices, saving more than one shortest tree per iteration and using a strict consensus tree of these yields decreased support compared to saving only one tree. This can be interpreted as a small risk of overestimating support but should be more than compensated by other factors that counteract an enhanced type I error. With regard to Bremer support, a rule of thumb can be derived stating that not much is gained relative to the surplus computational effort when searches are extended beyond 20 ratchet iterations per constrained node, at least not for datasets that fall within the size range found in the current literature. CONCLUSION: In view of these results, calculating bootstrap or jackknife proportions with narrow confidence intervals even for very large datasets can be achieved with less expense than often thought. In particular, iterated bootstrap methods that aim at reducing statistical bias inherent to these proportions are more feasible when the individual bootstrap searches require less time.

Bayes Theorem↗