PubMed HealthSearch

PubMed · 7723466

Measuring effectiveness. What to expect without a randomized control group.

Abstract

Randomized controlled trials or studies are often considered the ideal way to evaluate the effectiveness of a treatment compared to a control. In such a study, the randomization procedure ensures that the subjects receiving the treatment and control are equal with respect to all conditions except for receiving the treatment or the control. Differences found by statistical comparisons of the results of such a study can be attributed to the effect of the treatment or how much the treatment differs from the control when all other things are held constant. Randomized controlled trials are not always possible, and even when possible they are often performed with such restrictions that they do not provide the true measure of the effectiveness of the treatment in the "real world" or under "conditions of usual practice." This article reviews the use of nonrandomized studies to measure effectiveness when a randomized control group is not available. Various types of nonrandomized studies are reviewed, along with their advantages and disadvantages. Often, these studies require statistical adjustments such as matching or covariance analysis to adjust for inequalities or to remove biases between the treatment and control groups; these are reviewed as well.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

R B D'Agostino, H Kwan. 1995. Measuring effectiveness. What to expect without a randomized control group.. https://pubmed.ncbi.nlm.nih.gov/7723466/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Generalized treatment effects for clinical trials.

Practice in the analysis of clinical trials with continuously measured endpoints is to focus on the difference or percentage change in mean or median response. However, treatments may have effects on the distribution of responses other than on the average response. We sought an approach to such generalized treatment effects that: (i) targets a parameter that is easily understood by our clinical colleagues; and (ii) employs confidence intervals as the basis for inference. We consider one such approach based on work in reliability theory, namely setting Pr[Y>X] as the target parameter, and compare this approach to an earlier one due to O'Brien. The two approaches have similar properties when they both seek to reject the null hypothesis of no effect due to different variances but differ when the larger variance corresponds to the larger mean. In that case, our approach views that the larger variance attenuates the effect of the larger mean. Out suggested approach applies easily to positive control (clinical) equivalence trials.

Clinical Trials as Topic

Drug abuse treatment as an HIV prevention strategy: a review.

We review drug abuse treatment as a means of preventing infection with HIV. Thirty-three studies, with an aggregate of over seventeen thousand subjects, were published in peer-reviewed journals from 1988-1998. Research on the utility of drug abuse treatment as an HIV prevention strategy has focused primarily on methadone maintenance treatment (MMT) rather than other modalities such as residential or outpatient drug-free treatment. Recent research provides clear evidence that MMT reduces HIV risk behaviors, particularly needle-use, and strong evidence that MMT prevents HIV infection. There is less definitive evidence that MMT reduces needle-sharing and unsafe sexual behavior, or that other treatment modalities prevent HIV infection. Future research should take into account patient self-selection processes and investigate other treatment modalities for heroin and stimulant abuse to determine their effects on HIV risk behaviors and HIV infection.

Clinical Trials as Topic