Issues in multi-item scale testing and development using structural equation models.

Shaun McQuitty; James W Bishop

Home/Archive/PubMed

PubMed · 16385154

Issues in multi-item scale testing and development using structural equation models.

Shaun McQuitty·James W Bishop

View original source ↗Export metadata ↓

Abstract

Employing a structural equation model to evaluate a measurement scale can be challenging, especially for a multidimensional scale that contains many items. We describe two issues that can contribute to the poor fit of such models: the statistical power associated with the test of a large measurement scale; and the degree of correlation between items and factors within the scale. These issues are not well understood, so our purpose is to explain them at an applied level, clarify their practical implications for tests of measurement scales and other large structural equation models, and discuss potential strategies for addressing them.

Explore related subjects

Data Interpretation, Statistical Models, Statistical Psychometrics Surveys and Questionnaires United States Evaluation Study Journal Article

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Shaun McQuitty, James W Bishop. 2006. Issues in multi-item scale testing and development using structural equation models.. https://pubmed.ncbi.nlm.nih.gov/16385154/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

A nonlinear latent class model for joint analysis of multivariate longitudinal data and a binary outcome.

We consider a joint model for exploring association between several correlated longitudinal markers and a clinical event. A nonlinear growth mixture model exhibits the different latent classes of evolution of the latent quantity underlying the correlated longitudinal markers and a logistic regression models the probability of occurence of the clinical event according to the latent classes. By introducing a flexible nonlinear transformation including parameters to be estimated between each marker and the latent process, the model also deals with non-Gaussian continuous markers. Through an application on cognitive ageing, the two advantages of the model are underlined: (1) the latent profiles of evolution associated with the clinical event are described including covariate effects in the longitudinal model but also in the probability of class membership and in the probability of occurence of the event, and (2) a diagnostic and a prognostic tools are derived from the model for early detection of the clinical event using any available information about the longitudinal markers.

Data Interpretation, Statistical↗

PubMed2007

Measurement of inter-rater agreement for transient events using Monte Carlo sampled permutations.

In this paper we demonstrate the adverse effect of serially observed data sequences containing transient events on the calculation of Cohen's kappa as an index of inter-rater agreement in the detection of these events. We develop and use a Monte-Carlo-based permutation technique to produce an empiric distribution of kappa in the presence of serial dependence. We find that the empiric confidence intervals for kappa tend to be wider than parametrically derived intervals and in the case of longer event lengths, are markedly so. We evaluate the effect of number and length of events, and further, describe and evaluate three permutation methods which match specific rating situations. Finally, we apply these techniques to the measurement of inter-rater agreement for sleep disordered breathing events, a transient event identified during nocturnal polysomnography, for which traditionally computed confidence intervals for kappa are incorrect.

Data Interpretation, Statistical↗

PubMed2007

Induced smoothing for rank regression with censored survival times.

Adaptions of weighted rank regression to the accelerated failure time model for censored survival data have been successful in yielding asymptotically normal estimates and flexible weighting schemes to increase statistical efficiencies. However, for only one simple weighting scheme, Gehan or Wilcoxon weights, are estimating equations guaranteed to be monotone in parameter components, and even in this case are step functions, requiring the equivalent of linear programming for computation. The lack of smoothness makes standard error or covariance matrix estimation even more difficult. An induced smoothing technique overcame these difficulties in various problems involving monotone but pure jump estimating equations, including conventional rank regression. The present paper applies induced smoothing to the Gehan-Wilcoxon weighted rank regression for the accelerated failure time model, for the more difficult case of survival time data subject to censoring, where the inapplicability of permutation arguments necessitates a new method of estimating null variance of estimating functions. Smooth monotone parameter estimation and rapid, reliable standard error or covariance matrix estimation is obtained.

Data Interpretation, Statistical↗