PubMed · 12773016
Study samples are too small to produce sufficiently precise reliability coefficients.
Abstract
In a survey of journal articles, test manuals, and test critique books, the author found that a mean sample size (N) of 260 participants had been used for reliability studies on 742 tests. The distribution was skewed because the median sample size for the total sample was only 90. The median sample sizes for the internal consistency, retest, and interjudge reliabilities were 182, 64, and 36, respectively. The author presented sample size statistics for the various internal consistency methods and types of tests. In general, the author found that the sample sizes that were used in the internal consistency studies were too small to produce sufficiently precise reliability coefficients, which in turn could cause imprecise estimates of examinee true-score confidence intervals. The results also suggest that larger sample sizes have been used in the last decade compared with those that were used in earlier decades.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Richard A Charter. 2003. Study samples are too small to produce sufficiently precise reliability coefficients.. https://doi.org/10.1080/00221300309601280
Cite the original work for its findings. Save a collection to share your selection of sources.