Objective standard setting (or truth in advertising).

G E Stone

Home/Archive/PubMed

PubMed · 12021478

Objective standard setting (or truth in advertising).

G E Stone

View original source ↗Export metadata ↓

Abstract

Over the past 40 years criterion referencing has become the major method for setting passing standards on most high-stakes examinations. This paper serves three purposes. First it reveals the limitations and methodological weaknesses of most popular standard setting models, supported by a large volume of prior investigation. Second, it presents a radically different approach to the question of setting standards. The new model called Objective Standard Setting was developed in the early 1990s and has been successfully practiced in a variety of settings since that time. While presented in educational forums for many years, this paper represents the first published account of its methods. Thirdly,suggestions for new considerations of validity in standard setting are addressed. There port concludes with the suggestion that however well-intentioned popular standard setting efforts may be, psychometric experts must more carefully and fully understand the models behind their practices and the validity, meaning and implications of their thought processes.

Explore related subjects

Confidence Intervals Education, Dental Humans Reference Values Reproducibility of Results Specialty Boards United States Journal Article

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

G E Stone. 2001. Objective standard setting (or truth in advertising).. https://pubmed.ncbi.nlm.nih.gov/12021478/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Covariates-dependent confidence intervals for the difference or ratio of two median survival times.

In this paper, we are concerned with the estimation of the discrepancy between two treatments when right-censored survival data are accompanied with covariates. Conditional confidence intervals given the available covariates are constructed for the difference between or ratio of two median survival times under the unstratified and stratified Cox proportional hazards models, respectively. The proposed confidence intervals provide the information about the difference in survivorship for patients with common covariates but in different treatments. The results of a simulation study investigation of the coverage probability and expected length of the confidence intervals suggest the one designed for the stratified Cox model when data fit reasonably with the model. When the stratified Cox model is not feasible, however, the one designed for the unstratified Cox model is recommended. The use of the confidence intervals is finally illustrated with a HIV+ data set.

Confidence Intervals↗

PubMed2007

Inferences on standardized mean difference: the generalized variable approach.

The standardized mean difference has been widely used as the most common index of effect magnitude in many applied fields. In this paper, we propose a novel approach using the concept of generalized variable for the confidence interval estimation and hypothesis testing of standardized mean difference. Furthermore, we extend this approach to compare standardized mean differences between two studies or between two strata. Simulation results demonstrate that the proposed approach can provide confidence intervals with excellent coverage properties and can perform hypothesis testing with satisfactory type-I error control.

Confidence Intervals↗

PubMed2007

Interval estimation for rank correlation coefficients based on the probit transformation with extension to measurement error correction of correlated ranked data.

The Spearman (rho(s)) and Kendall (tau) rank correlation coefficient are routinely used as measures of association between non-normally distributed random variables. However, confidence limits for rho(s) are only available under the assumption of bivariate normality and for tau under the assumption of asymptotic normality of tau. In this paper, we introduce another approach for obtaining confidence limits for rho(s) or tau based on the arcsin transformation of sample probit score correlations. This approach is shown to be applicable for an arbitrary bivariate distribution. The arcsin-based estimators for rho(s) and tau (denoted by rho(s,a), tau(a)) are shown to have asymptotic relative efficiency (ARE) of 9/pi2 compared with the usual estimators rho(s) and tau when rho(s) and tau are, respectively, 0. In some nutritional applications, the Spearman rank correlation between nutrient intake as assessed by a reference instrument versus nutrient intake as assessed by a surrogate instrument is used as a measure of validity of the surrogate instrument. However, if only a single replicate (or a few replicates) are available for the reference instrument, then the estimated Spearman rank correlation will be downwardly biased due to measurement error. In this paper, we use the probit transformation as a tool for specifying an ANOVA-type model for replicate ranked data resulting in a point and interval estimate of a measurement error corrected rank correlation. This extends previous work by Rosner and Willett for obtaining point and interval estimates of measurement error corrected Pearson correlations.

Confidence Intervals↗