PubMed Health⌕ Search

PubMed · 9255920

Validating a satisfaction questionnaire using multiple approaches: a case study.

Abstract

We examined the validity of a questionnaire designed to measure the satisfaction of users of health services, using multiple tests of construct validity. Members of 2 health insurance plans in Geneva (Switzerland) answered a mailed questionnaire in 1992 (n = 1007) and 1993 (n = 1424). Response rates were 82% participants were 18-44 years old in 1992. The questionnaire included 22 questions on satisfaction with medical care received during the past 12 months. Most items were adapted from the Patient Satisfaction Questionnaire. Four dimensions of satisfaction were measured: satisfaction with physician services (8 items), communication (8 items), access (4 items) and insurance services (2 items). Reliability (Cronbach's alpha) was satisfactory for the 2 former dimensions (alpha = 0.81 and 0.82 respectively), but lower than desired for the 2 latter (alpha = 0.63 and 0.49 respectively). Participants who gave positive open-ended comments had satisfaction scores 0.7-1.2 standard deviation units higher than participants who gave negative comments. Satisfaction scores were weakly correlated with satisfaction with private life, which indicates that the instrument did not simply measure a general tendency to be satisfied. Participants who said that care received in 1993 was worse than care received in 1992 (retrospective assessment) experienced a decrease in satisfaction scores between 1992 and 1993 (prospective assessment). Most validation procedures provided independent but partial evidence for the validity of the instrument. Triangulation of several validation methods, as illustrated in this paper, may greatly improve the understanding of an instrument's properties.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J F Etter, T V Perneger. 1997. Validating a satisfaction questionnaire using multiple approaches: a case study.. https://doi.org/10.1016/s0277-9536(96)00428-5

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Analysis of a study of the users, uses, and future agenda of the UMLS.

OBJECTIVES: The UMLS constitutes the largest existing collection of medical terms. However, little has been published about the users and uses of the UMLS. This study sheds light on these issues. DESIGN: We designed a questionnaire consisting of 26 questions and distributed it to the UMLS user mailing list. Participants were assured complete confidentiality of their replies. To further encourage list members to respond, we promised to provide them with early results prior to publication. Sector analysis of the responses, according to employment organizations is used to obtain insights into some responses. RESULTS: We received 70 responses. The study confirms two intended uses of the UMLS: access to source terminologies (75%), and mapping among them (44%). However, most access is just to a few sources, led by SNOMED, MeSH, and ICD. Out of 119 reported purposes of use, terminology research (37), information retrieval (19), and terminology translation (14) lead. Four important observations are that the UMLS is widely used as a terminology (77%), even though it was not designed as one; many users (73%) want the NLM to mark concepts with multiple parents in an indented hierarchy and to derive a terminology from the UMLS (73%). Finally, auditing the UMLS is a top budget priority (35%) for users. CONCLUSIONS: The study reports many uses of the UMLS in a variety of subjects from terminology research to decision support and phenotyping. The study confirms that the UMLS is used to access its source terminologies and to map among them. Two primary concerns of the existing user base are auditing the UMLS and the design of a UMLS-based derived terminology.

Consumer Behavior↗

Essential tips for measuring levels of consumer satisfaction with rural health service quality.

INTRODUCTION: Quality of health services is a matter of increasing importance to health authorities. Monitoring consumer satisfaction of health care is an important input to improving the quality of health services. This article highlights a number of important considerations learned from rural consumer studies relevant to ensuring the valid measurement of consumer satisfaction with rural health services, as a means of contributing to quality improvements. METHODS: This article compares two methods of analysing rural consumers' satisfaction with healthcare services. In one study of three rural communities in western New South Wales (NSW) and eight communities in north-west Victoria, residents were asked to rate their satisfaction with five key aspects of local health services (availability, geographical accessibility, choice, continuity, economic accessibility as measured by affordability) using a 5 point Likert scale from: one = very satisfied to five = very dissatisfied. An alternative method of assessing levels of consumer satisfaction was undertaken in the survey of eight rural communities in north-west Victoria by investigating consumers' experiences with actual and potential complaints in relation to health services. RESULTS: Both the NSW and Victorian respondents reported generally high levels of satisfaction with the five indicators of quality of health care. At the same time, 11% of Victorian study respondents reported having made a complaint about a health service in the previous 12 months, and one-third of the Victorian respondents reported experiences with their health services about which they wanted to complain but did not, over the same period. CONCLUSIONS: Interpretation of apparent consumer satisfaction with their health services must take particular account of the measures and research methods used. In assessing consumer satisfaction with health services in rural areas, specific attention should be given to maximising the engagement of rural consumers in order to ensure representativeness of findings, and to minimise possible biases in satisfaction ratings associated with the use of particular tools.

Consumer Behavior↗