PubMed Health⌕ Search

PubMed · 10269328

Are validity and reliability "relevant" in qualitative evaluation research?

Abstract

Interest in and use of qualitative methodological strategies in evaluating research have increased considerably in the last few years. Many of the recent evaluation frameworks or models are entirely or partly oriented toward use of qualitative methods. A number of methodological issues and concerns have been raised, including the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations becoming more common in health and other fields. In this article, the views of prominent qualitative methodologists on this topic are briefly summarized; a case is made for the relevance of validity and reliability estimation; definitions of validity and reliability for qualitative measurement are presented; and appropriate estimation techniques are suggested. It is hoped that discussions such as this will promote increased attention to validity and reliability concerns in qualitative evaluations and thus help improve the quality of those evaluations.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

L D Goodwin, W L Goodwin. 1984. Are validity and reliability "relevant" in qualitative evaluation research?. https://doi.org/10.1177/016327878400700403

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Complex adaptive systems: a response to Luchins.

Luchins (2003, Administration and Policy in Mental Health, 31(2), 183-186) distinguishes the mutual strengths and shortcomings of qualitative and quantitative approaches as applied to the complexities of evaluation psychiatric hospital functioning in particular, and behavioral healthcare practice in general. This brief response offers an examination of the complex interplay of factors within non-linear models in a conceptualization of complex adaptive systems for understanding causal factors in mental health administration as well as calling into question the myth of the relationship between measurement and hence control and understanding and prediction.

Evaluation Studies as Topic↗

In search of a familial cancer risk assessment tool.

Approximately one in three individuals will be affected by cancer in their lifetime in the United States, and some are at elevated risk because of family history. Although assessment of family history of cancer and cancer risk is the standard of care, the current health-care system appears unable to meet this need. Because individuals are increasingly using the Internet, web-based cancer risk assessment tools (CRATs) may provide a way to meet this need. The purpose of this review was to evaluate the types of familial CRATs available on the Internet and their nature. The current review evaluated five CRATs identified through an Internet search based on (i) their ability to identify those at the highest risk of cancer (i.e. those with hereditary cancer syndromes), (ii) their strengths and limitations based on criteria adapted from Rich and colleagues (2004, 2005), (iii) their readability based on four readability calculations, and (iv) their quality based on criteria from Health on the Net. The general limitations of CRATs as a whole were also delineated, including concerns about availability to those who are poor and underserved and those who have lower levels of literacy. Recommendations for future tools include assessing risk for a greater number of diseases, using theoretically driven approaches to increase the likelihood that individuals will engage in appropriate health behaviors, and making a greater effort to reach diverse populations.

Evaluation Studies as Topic↗

Challenges in approaching metasynthesis research.

The overall aim of this study was to contribute to the development of metasynthesis through an analysis of the challenges involved. The study grew out of the critique of qualitative metaresearch raised by current developers of metamethodologies. Different views on the application of methodologies have emerged in the literature, contributing to confusion and ambiguity concerning the challenging questions of what, why, how, and who in metasynthesis research, which might increase the risk of misunderstanding. The roots of metasynthesis research are seen as multifaceted and influencing the development of the methods in different directions. The primary worth of metasynthesis is theoretical and/or methodological development (synthesis) combined with the potential for reflection: going beyond and behind the studies (meta). Metasynthesis research has also the potential to raise questions of research collaboration, culture, and language.

Evaluation Studies as Topic↗