Principles: when there should be no difference--how to fail to reject the null hypothesis.

Michael J Lew

doi:10.1016/j.tips.2006.03.006

Home/Archive/PubMed

PubMed · 16595154

Principles: when there should be no difference--how to fail to reject the null hypothesis.

Michael J Lew

View original source ↗Export metadata ↓

Abstract

It is common to perform experiments in which a 'success' is claimed when the null hypothesis is discarded. However, there is a category of experiment that has become important in which a success is when the null hypothesis is not rejected. Failing to discard the null hypothesis is different from proving it to be valid, a distinction that is particularly important in experiments in which any inadequacy of experimental design or implementation enhances the likelihood of a success. The appropriate analysis of such experiments tests for evidence of the validity of the null hypothesis rather than simply failing to find evidence against it.

Explore related subjects

Confidence Intervals Humans Monte Carlo Method Pharmacology Reproducibility of Results Research Design Journal Article Review

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Michael J Lew. 2006-04-03. Principles: when there should be no difference--how to fail to reject the null hypothesis.. https://doi.org/10.1016/j.tips.2006.03.006

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Covariates-dependent confidence intervals for the difference or ratio of two median survival times.

In this paper, we are concerned with the estimation of the discrepancy between two treatments when right-censored survival data are accompanied with covariates. Conditional confidence intervals given the available covariates are constructed for the difference between or ratio of two median survival times under the unstratified and stratified Cox proportional hazards models, respectively. The proposed confidence intervals provide the information about the difference in survivorship for patients with common covariates but in different treatments. The results of a simulation study investigation of the coverage probability and expected length of the confidence intervals suggest the one designed for the stratified Cox model when data fit reasonably with the model. When the stratified Cox model is not feasible, however, the one designed for the unstratified Cox model is recommended. The use of the confidence intervals is finally illustrated with a HIV+ data set.

Confidence Intervals↗

PubMed2007

Inferences on standardized mean difference: the generalized variable approach.

The standardized mean difference has been widely used as the most common index of effect magnitude in many applied fields. In this paper, we propose a novel approach using the concept of generalized variable for the confidence interval estimation and hypothesis testing of standardized mean difference. Furthermore, we extend this approach to compare standardized mean differences between two studies or between two strata. Simulation results demonstrate that the proposed approach can provide confidence intervals with excellent coverage properties and can perform hypothesis testing with satisfactory type-I error control.

Confidence Intervals↗

PubMed2007

Interval estimation for rank correlation coefficients based on the probit transformation with extension to measurement error correction of correlated ranked data.

The Spearman (rho(s)) and Kendall (tau) rank correlation coefficient are routinely used as measures of association between non-normally distributed random variables. However, confidence limits for rho(s) are only available under the assumption of bivariate normality and for tau under the assumption of asymptotic normality of tau. In this paper, we introduce another approach for obtaining confidence limits for rho(s) or tau based on the arcsin transformation of sample probit score correlations. This approach is shown to be applicable for an arbitrary bivariate distribution. The arcsin-based estimators for rho(s) and tau (denoted by rho(s,a), tau(a)) are shown to have asymptotic relative efficiency (ARE) of 9/pi2 compared with the usual estimators rho(s) and tau when rho(s) and tau are, respectively, 0. In some nutritional applications, the Spearman rank correlation between nutrient intake as assessed by a reference instrument versus nutrient intake as assessed by a surrogate instrument is used as a measure of validity of the surrogate instrument. However, if only a single replicate (or a few replicates) are available for the reference instrument, then the estimated Spearman rank correlation will be downwardly biased due to measurement error. In this paper, we use the probit transformation as a tool for specifying an ANOVA-type model for replicate ranked data resulting in a point and interval estimate of a measurement error corrected rank correlation. This extends previous work by Rosner and Willett for obtaining point and interval estimates of measurement error corrected Pearson correlations.

Confidence Intervals↗