SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64Linked to original sources

PubMed2004

Towards the development of scales to measure 'will' to promote heart health within health organizations in Canada.

This paper describes the development and psychometric evaluation of scales measuring the dimensions of 'will' (belief, confidence, prior action and desire) for heart health promotion specifically and health promotion in general at both an individual and organizational level. Content validity was established through a series of focus groups and expert opinion assessments, based on a compilation of capacity-assessment instruments developed by other provinces involved in the Canadian Heart Health Initiative and the literature. Psychometric analyses of questionnaire data provided empirical evidence of the construct validity and reliability of the 16 individual and 21 organizational level 'will' scales. A series of principal component analyses assisted in verifying the unidimensionality of the measures and all scales yielded high internal consistencies with Cronbach's alpha coefficients ranging between 0.73 and 0.96. These measures can be used by both researchers and practitioners for assessing the 'will' to promote heart health specifically and health promotion in general.

Alberta↗

PubMed2000

Development of an instrument for monitoring adolescent health issues.

The aim of the project was to develop a survey instrument to monitor relevant health status and health-related behaviors among secondary school students. The development of the instrument occurred in three main phases: collection of existing surveys, workshops with relevant health professionals and focus groups with adolescents. The topics for inclusion were refined using Health Goals and Targets for Australian Children and Youth and consultations with health professionals, and included alcohol/illicit drug use, smoking, nutrition, exercise, injury, mental health, violence and sexual health. Content validity was demonstrated through a comprehensive literature review, review and application of existing instrumentation, dialog and exchange with health professionals, and focus groups with adolescents. The process of peer review through correspondence with health professionals, and the coordination of workshops and focus groups established face validity. Responses from students also indicated that they interpreted the questions as intended. The instrument was piloted in five secondary schools during class periods. Process evaluation was also conducted to determine the appropriateness of the survey and the procedures used in administering the survey. Feedback from school staff was supportive and favorable with respect to the choice of issues. Reliability was assessed by a test-re-test procedure 2 weeks apart. In general, most of the questions showed moderate to high reliability (kappa > 0.5) indicating agreement of 50% or greater. This instrument was developed as a monitoring instrument and places emphasis on determining prevalence levels of a range of health issues and health behaviors to assist with identifying clustering patterns of negative health outcomes. Although the instrument is primarily for use with students in school hours, the nature of the instrument allows modification for use in older groups of adolescents and out-of-school youth. The final version of the questionnaires for senior and junior students can be accessed via the Internet (http://;+www.spmed.uq.edu.au/CHPCPR /qu estionnaire).

Adolescent↗

PubMed2000

Stages of change in two modes of health-enhancing physical activity: methodological aspects and promotional implications.

Measurement scales for stages of change were developed and the stages were assessed in two specific modes of Health-Enhancing Physical Activity (HEPA) in a cross-sectional survey (N = 1516); representative samples were selected from three age groups, i.e. from three phases of adult life. Outdoor Aerobic Exercise (OAE) was used as an example of fitness activity; Everyday Commuting Activity (ECA) was selected to represent lifestyle physical activity. Scales used by the Prochaska team were modified for this study, and the stages of Precontemplation and Preparation were each divided into two new stages. Consistency of the stage measurement was moderate for OAE and good for ECA. As regards content validity, consistent associations were found between stage scores and contextual variables for both behaviors. The results show that, at a given time, a person can be in different stages in different modes of HEPA. Therefore, the behavior of interest must be specified before accurate information on the stages of change in a population can be obtained. The results also indicate the importance of contextual factors in HEPA promotion.

Adult↗

PubMed2001

Development of a French inpatient satisfaction questionnaire.

OBJECTIVE: To develop a brief French-language, generic, self-administered questionnaire to measure inpatient satisfaction. DESIGN: Issues relevant to patients were identified using three open-ended questions designed in accordance with the disconfirmation paradigm. The content of patients' responses was analysed and then supplemented by items taken from published instruments in order to generate a pool of 93 items. Twenty-nine items were selected following a strict procedure. Content validity was judged by comparing the questionnaire to existing instruments. Construct validity was supported by testing specific hypotheses derived from the literature and by performing principal component analysis. Reliability was estimated by calculating Cronbach's alpha. SETTING: A 2200-bed French teaching hospital. SUBJECTS: A mail survey was carried out on a random sample of 1000 inpatients within 2-4 weeks of discharge. Eligible subjects were medical, surgical and obstetrics inpatients who had stayed in the hospital for more than 24 hours. RESULTS: The participation rate (71%) and the completion rate (95%) were indicators of acceptability. There were modest differences between the questionnaire and published instruments (financial aspects, amenities). Construct representation by principal component analysis consisted of six scales which accounted for 58% of the variance in total satisfaction scores. The reliability estimates of internal consistency ranged from 0.67 to 0.86. CONCLUSION: We propose that the self-administered multidimensional inpatient satisfaction questionnaire provided encouraging preliminary psychometric information. This instrument is intended to involve patient feedback in a continuous quality health care improvement strategy.

Adult↗

PubMed1993

What is important in psychiatric inpatient care? Quality of care from the patient's perspective.

The development of quality assurance programs for psychiatric care has increased the interest in quality of care and accountability from the patient's perspective. However, most investigations of patient satisfaction use instruments which rate aspects of care defined and held to be important by professionals and care givers. The aims of this study were 2-fold. To map descriptive characteristics of ideal inpatient psychiatric care through open patient interviews, using a sample of 78 hospitalized patients and, secondly, based on a content analysis of these interviews, to have another sample of 77 hospitalized patients rank the importance of 48 treatment characteristics extracted from the qualitative analysis. Results of the content analysis showed that characteristics of ideal inpatient treatment could be classified in six categories: staff-patient relationship, patient co-influence, treatment content, activities, ward atmosphere and staff competence. Results from the patients' rating of the importance of treatment characteristics showed that patients put the highest emphasis on staff empathic qualities: being caring, interested and understanding, respecting patients, devoting time to patients, and creating a safe treatment environment. The least importance was ascribed to characteristics of the physical environment and daily routines on the ward. It is concluded that in order to secure content validity of investigations of the quality of psychiatric inpatient care from the patient's perspective, effort should be put into including the areas of staff-patient relationships and patient information and co-influence.

Adult↗

PubMed1995

What is important in psychiatric outpatient care? Quality of care from the patient's perspective.

The development of quality assurance programmes for psychiatric care has increased the interest in quality of care and accountability from the patient's perspective. The aims of this study were threefold. First, to map descriptive characteristics of ideal outpatient psychiatric care through open-ended patient interviews, using a sample of 94 psychiatric outpatients, second, to have another sample of 84 outpatients rank the importance of 57 treatment characteristics extracted from the qualitative analysis of the interviews, and third to make comparisons with a previously performed investigation on quality of care of psychiatric inpatients. Results of the content analysis showed that characteristics of ideal outpatient treatment could be classified in eight content categories: accessibility of care, treatment content, staff-patient relationship, continuity of care, staff's professionalism, patient information/co-influence, treatment environment and cost of care. Results from the patients' rating of the importance of treatment characteristics showed that patients put the highest emphasis on staff's empathetic qualities in being interested, understanding, listening and respecting patients. Comparisons with the previously studied inpatient sample, showed great similarities in what was considered important to reach a satisfactory care situation. It is concluded that in order to secure content validity of investigations of the quality of psychiatric care from the patient's perspective, effort should be put into including the areas of staff-patient relationship and patient information and co-influence.

Adult↗

PubMed2005

The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events.

BACKGROUND: The current US national discussions on patient safety are not based on a common language. This hinders systematic application of data obtained from incident reports, and learning from near misses and adverse events. OBJECTIVE: To develop a common terminology and classification schema (taxonomy) for collecting and organizing patient safety data. METHODS: The project comprised a systematic literature review; evaluation of existing patient safety terminologies and classifications, and identification of those that should be included in the core set of a standardized taxonomy; assessment of the taxonomy's face and content validity; the gathering of input from patient safety stakeholders in multiple disciplines; and a preliminary study of the taxonomy's comparative reliability. RESULTS: Elements (terms) and structures (data fields) from existing classification schemes and reporting systems could be grouped into five complementary root nodes or primary classifications: impact, type, domain, cause, and prevention and mitigation. The root nodes were then divided into 21 subclassifications which in turn are subdivided into more than 200 coded categories and an indefinite number of uncoded text fields to capture narrative information. An earlier version of the taxonomy (n = 111 coded categories) demonstrated acceptable comparability with the categorized data requirements of the ICU safety reporting system. CONCLUSIONS: The results suggest that the Joint Commission on Accreditation of Healthcare Organizations (JCAHO) Patient Safety Event Taxonomy could facilitate a common approach for patient safety information systems. Having access to standardized data would make it easier to file patient safety event reports and to conduct root cause analyses in a consistent fashion.

Causality↗

PubMed1992

Development of an instrument to measure the behaviors and expectations of parents of young children.

Designed a study to develop an instrument, the Parenting Inventory: Young Children (PI), to assess the behaviors and developmental expectations of parents who have a child between 1 and 4 years of age. Item development for the PI occurred within a developmental-environmental theoretical framework and was based on literature reviews and clinical experience. Experts working with parents and/or children and parents of young children established the content validity of the items. The PI was tested with a sample of 1,140 mothers. This sample was representative of the population from which it was drawn, a large urban area, in terms of the sample children's sex and ethnicity. A diverse range of socioeconomic levels were included. The resulting 100-item PI was found to reliably measure three aspects of parenting: Expectations, Discipline, and Nurturing. These factors demonstrated good internal consistency and test-retest reliability. Future research needs relative to the continued development of the PI are addressed.

Adult↗

PubMed2006

Brief report: initial testing of scales measuring parent and adolescent Perceptions of Adolescents' Assumption of Diabetes Management.

OBJECTIVE: This study tested parallel adolescent and parent versions of the Perceptions of Adolescents' Assumption of Diabetes Management scales. METHODS: First, 78 items developed from interview data were reviewed by a panel of adolescent and diabetes experts. Next, the scales were piloted with 43 adolescents with type 1 diabetes and their parents and, finally, tested with 100 dyads. Item and principal component analyses were performed. RESULTS: Following content validity and item analyses, five and four items remained in the advantages and disadvantages scales, respectively. One factor accounted for between 54 and 63% of variance, and internal consistency reliability ranged between .78 and .84 for the various versions of the scales. CONCLUSIONS: The Perceptions of Adolescents' Assumption of Diabetes Management scales show promise as parsimonious and reliable tools for use in research and practice related to parent-adolescent relationships in regard to adolescents' assumption of diabetes management.

Adolescent↗

PubMed1991

Development of a quality-of-movement measure for children with cerebral palsy.

Development of a suitable measure of quality of movement, or gross motor performance, for children with cerebral palsy is a complex undertaking. A variety of conceptual, methodological, and practical issues inherent in such a project are discussed in this article. We report on the methodology used in the planning and construction of the Gross Motor Performance Measure. The measure has been developed by a multicenter, interdisciplinary group of therapists, methodologists, research staff, and international experts. Five attributes of gross motor performance have been defined, scaled, and operationalized. Results of content validity studies demonstrate that the measure has adequate completeness, clarity, and potential for evaluating change in quality of movement in children who have cerebral palsy. The measure is currently undergoing extensive testing to determine the reliability, validity, and responsiveness of the obtained scores. [Boyce WF, Gowland C, Hardy S, et al. Development of a quality-of-movement measure for children with cerebral palsy.

Cerebral Palsy↗

PubMed2003

Self-efficacy in sleep apnea: instrument development and patient perceptions of obstructive sleep apnea risk, treatment benefit, and volition to use continuous positive airway pressure.

STUDY OBJECTIVES: The purpose of this study was to evaluate the Self-Efficacy Measure for Sleep Apnea (SEMSA) designed to assess adherence-related cognitions. DESIGN: Subjects completed the questionnaire prior to the initiation of continuous positive airway pressure (CPAP) treatment. Test-retest reliability of the instrument was evaluated by having a subset of subjects complete the SEMSA a second time at home, 1 week later, returning the questionnaire by mail. PATIENTS: 213 subjects with newly diagnosed obstructive sleep apnea were recruited from the clinic populations of 2 sleep disorders centers. MEASUREMENTS AND RESULTS: Content validity was confirmed by a panel of expert judges. Confirmatory factor analysis validated the 3 a priori sub-scales: risk perception, outcome expectancies, and treatment self-efficacy. The internal consistency of the total instrument was 0.92. Test-retest reliability coefficients (N = 20) were estimated to be 0.68, P = 0.001, for Perceived Risk; 0.77, P more more than 0.0001, for Outcome Expectancies; and 0.71, P = 0.0005, for the Treatment Self-Efficacy subscale. Subject responses indicated that approximately half of the subjects did not perceive problems with concentration, sexual performance, sleepy driving, or an accident as related to sleep apnea. More than 60% of the subjects acknowledged most of the benefits of CPAP presented to them, but only 53% associated CPAP use with enhanced sexual performance. Frequently identified barriers to treatment use were nasal stuffiness, claustrophobia, and disturbing bed partner sleep. CONCLUSION: These findings indicate that the SEMSA has strong psychometric properties and has the potential for identifying patient perceptions that may indicate those most likely to not adhere to treatment.

Adult↗

PubMed1993

Creating an objective structured clinical examination for the internal medicine clerkship: pitfalls and benefits.

The objective-structured clinical examination (OSCE) is a useful tool in evaluating clinical competence. Traditional clinical-evaluation measures have been criticized as arbitrary and lacking reliability, whereas written exams test primarily cognitive aspects. The OSCE focuses on learner actions rather than abstract knowledge and evaluates in a uniform fashion. A 15-station OSCE was created for an internal medicine junior clerkship, based on predetermined skill and content goals. The exams then were scored by a single, blinded reviewer, again in a predetermined fashion. The OSCE has been studied in terms of reliability, content validity, and construct validity. The exam has become accepted by the department and has guided the continuing curricular development. The OSCE is not designed to measure all the domains of a learner's educational process. However, when used in conjunction with other evaluating mechanisms, it provides an objective outcome measure of the medical education process.

Clinical Clerkship↗

PubMed1999

The development and testing of the patient record pain management assessment tool.

The article reports a study whose purpose was to develop and test the Patient Record Pain Management Assessment Tool, an instrument to evaluate compliance with the American Pain Society's quality assurance standards on acute pain and cancer pain in chart documentation. Content validity, overall validity, and interrater reliability were all found to be acceptable. The instrument is therefore a useful tool for documenting the level of pain management practice in institutional settings.

Forms and Records Control↗

PubMed2000

Initial field testing of an instrument to measure: observable indicators of nursing home care quality.

The "Observable Indicators of Nursing Home Care Quality" instrument was developed as a new measure of nursing home care quality. The instrument is based on a theoretical model of quality nursing home care grounded in data from provider and consumer focus groups. The instrument was piloted in 10 Missouri nursing homes. Subsequent versions were tested in 109 Missouri and 11 Icelandic nursing homes. Content validity was established using experts. Concurrent and known groups validity was evaluated using Minimum Data Set quality indicators, survey citations, and a process of care measure. Interrater and test-retest reliabilities were calculated as well as coefficient alpha. The "Observable Indicators of Nursing Home Care Quality" instrument is a new measure that can be used by researchers, and potentially by regulators, consumers, or providers, to observe and score specific indicators of quality care following a 20- to 30-minute inspection of a nursing home.

Focus Groups↗

PubMedDate not supplied

Developing a residential care facility version of the observable indicators of Nursing Home Care Quality Instrument.

The last decade has seen a substantial growth in the development of residential care facilities (assisted living facilities). Evaluation of the quality of care in this service delivery sector has been hampered by the lack of a consensus definition of quality and the lack of reliable instruments to measure quality. Founded on extensive research on nursing home care quality, a field test of the Residential Care Facility Version of the Observable Indicators of Nursing Home Care Quality Instrument was conducted in 35 residential care facilities in Missouri. Content validity of the 34 items was rated by 4 expert raters as 3.4 on a 4-point scale of relevance. Test-retest was 0.94, interrater reliability was 0.73, and internal consistency was 0.90 for the total scale, indicating excellent results for initial field-testing. A focus group confirmed the 5 dimensions of quality of care measured by the instrument as important in residential care settings.

Aged↗

PubMed1987

Evaluation and redesign of a system to rank applicants for surgical residencies.

The present paper is a report of the evaluation and subsequent revision of a selection system for surgical house officers. The authors conducted a series of studies to determine the content validity, concurrent validity, and predictive validity of the system used by the surgery department prior to 1982. The results did not support the validity of that ranking system. In particular, the system was found not to evaluate candidates on criteria considered important by the faculty. Based on these findings, the department adopted a new ranking system organized around a multimethod-multitrait matrix (that is, using multiple methods to assess multiple traits) and based on a new set of traits that had been identified as important in the earlier validity studies. The new system has been used for five years, since 1982, with acceptance and favorable evaluation by the faculty. During that period, the median and mean rank of candidates who were matched to the residency program improved.

Educational Measurement↗

PubMed1992

Six years of comprehensive, clinical, performance-based assessment using standardized patients at the Southern Illinois University School of Medicine.

By the end of 1990-91, the Southern Illinois University School of Medicine had had six years of experience with comprehensive, performance-based examinations of senior medical students' levels of clinical competence; this report assesses the psychometric aspects of the six examinations given during that period. The examinations were aimed at determining the students' readiness for postgraduate training. Compared with other clinical performance-based assessments that use standardized patients (SPs), these examinations had two important and unique features: (1) the examinations assessed a comprehensive range of clinical skills and reasoning; and (2) they approximated the challenges of real clinical practice wherein a practitioner's skills need to be orchestrated and prioritized in order to meet the challenges of the case encountered. Each year, the performance-based assessment given was an intensive clinical examination requiring each student to work up 13 to 18 SP problems over a three-day period. To administer an examination to an entire class of students took three weeks. Because all students after the first year of administration (1986) were required to pass these examinations, the fairness of test design and scoring and the setting of performance standards for the examinations became important issues for the faculty. The results, accumulated over six years and based on a total of 6,804 student-patient encounters involving 405 students, indicate that this kind of clinical performance-based examination can discriminate a wide range of students' clinical performances. The results provide evidence for the examinations' test security, content validity, construct validity, and reliability.

Clinical Clerkship↗

PubMed1995

Developing key-feature problems and examinations to assess clinical decision-making skills.

This article introduces the concept of a key feature and describes its function as the cornerstone of key-feature problems, a new problem format for the written assessment of clinical decision-making skills of medical trainees and practitioners. The rationale for using this problem format and the steps in problem and examination development--including issues of scoring and standard setting--are described. A key feature is defined as a critical step in the resolution of a clinical problem, and a key-feature problem consists of a clinical case scenario followed by questions that focus on only those critical steps. The questions can be presented to require examinees either to write in their responses or to select them from a list of options. For each question, examines can be instructed to supply or select whatever number of responses is appropriate to the clinical task being tested, and answer keys can comprise one or several responses. This problem format, with its focus on only the critical steps in problem resolution, and with its flexibility in question format and scoring keys, effectively addresses the psychometric considerations of content validity and test score reliability, and accommodates the complexity and configurations of actions often required in the resolution of clinical problems.

Clinical Competence↗