PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11Linked to original sources

Development of an exercise expert system for older adults.

The purpose of this study was to develop a computerized exercise expert system (CEES) that creates tailored exercise plans for older adults. A panel of experts was selected in the areas of medicine, exercise physiology, health promotion, exercise psychology, and gerontology. The experts communicated with the principal investigator and the project members by mail, email, telephone, and expert meetings. A two-day workshop was held during the second year for the project members as well as local and national experts to review the CEES. The CEES demonstrated adequate inter-rater reliability (0.80) and criterion validity (0.70). Content validity was achieved by literature review and expert opinion. The CEES gathers information on the elder's health status, clinical factors, and exercise determinants that characterize specific barriers or incentives to exercise. The software program then develops individualized exercise prescriptions that are customized to older adults.

Adult↗

[Reliability and validity of a 7-day physical activity questionnaire for elementary students].

OBJECTIVE: To evaluate the use of a 7-day physical activity questionnaire in epidemiologic studies on 4-6th grades children. METHODS: Focus group discussion, observation and expert consultation were used to develop 7-day physical activity questionnaire. The reliability and validity of questionnaire were determined in a sample of 92 children in 4-6th grades who were randomly selected from four schools in urban Beijing. A two-week test-retest reliability was determined. The questionnaire was validated against experts' evaluation and Caltrac motion sensor. RESULTS: For different measures of activity, the agreement was good between the test and retest. Kappa values ranged from 0.46 to 0.79, and the Spearman correlations ranged from 0.66 to 0.87 in boys and 0.57 to 0.82 in girls, with significant difference (P < 0.01). The face validity and content validity were good by experts' evaluation. There was no significant difference between questionnaire results and Caltrac motion sensor for both boys and girls, and the questionnaire correlated significantly (r = 0.46, 0.38 for different measures of activity) with Caltrac motion sensor for boys. CONCLUSION: These data provided evidence that the 7-day physical activity questionnaire yield a reliable estimate of past week physical activity for 4 - 6-grade children and provided valid estimation of past week physical activity for boys.

Child↗

A practical approach to quality improvement: the experience of the RNZCGP practice standards validation field trial.

AIM: This paper describes the development, implementation and validation of general practice standards, supported by a continuous quality improvement (CQI) process that teaches practice teams how to work together to identify and enhance the quality of care they provide. METHODS: Practice standards were developed through consensus by key stakeholders in general practice, pre-tested in four practices, and refined and piloted in 20 practices throughout New Zealand during 1999. A further field trial was undertaken to validate the standards and test the process of practice assessment. During 2000-2001, 74 practices volunteered to be assessed against the standards. Sixty one general practitioners, practice nurses and practice managers, nominated from independent practitioner associations (IPAs) or primary care organisations (PCOs), were trained to undertake the assessments. RESULTS: On five of 13 variables, no statistically significant differences at the 0.05 level were identified between the practices in the field trial and a random sample of practices studied by Kljakovic. The Royal New Zealand College of General Practitioners (RNZCGP) standards were found to have excellent face validity and content validity, and good construct validity. Internal consistency was fair. Lessons from the evaluation have informed an improved version of the practice assessment tool. CONCLUSIONS: The validation field trial provided the RNZCGP with a framework and tool for an accreditation process based on the principles of CQI. The tool offers patients and other stakeholders a credible measure of quality and safety at the practice level through a process bridging quality control and quality improvement.

Accreditation↗

[Investigation and analysis of quality of life for patients after laryngectomy].

OBJECTIVE: To institute and test the quality of life for laryngectomy, and evaluate the feasibility of above questionnaire in patients after laryngectomy. METHODS: A questionnaire of quality of life for laryngectomy was instituted. An investigation was conducted in patients treated by partial (36, Group A) or total (45, Group B) laryngectomy for laryngeal cancer with above questionnaire. The feasibility, reliability and validity of the questionnaire was evaluated, the quality of life and the influencing factors in laryngectomy were also analyzed. RESULTS: The questionnaire of quality of life for laryngectomy consists of 22 items, covering six aspects. The questionnaire has a comparatively good reliability, and the criterion-related validity and content validity of the questionnaire is valid. The correlation coefficient of split-half method and Cronback's alpha of questionnaire were 0.842 and 0.889 respectively. The composite quality of life scores of group A were significant higher than those of group B ( P < 0.001). The differences in physical function, laryngeal function, psychological state, the ability of living independently were statistically significant (P < 0.001; P < 0.001; P < 0.01; P < 0.05) as well. Seven factors including operative modality, tumor stage, postoperative complication, coexisted disease, family incomes, voicing modality and wearing tracheo-cannula were related to postlaryngectomy quality of life. CONCLUSIONS: The questionnaire of quality of life for laryngectomy has speciality in laryngectomy and a comparatively good reliability and validity, and it is suitable for quality of life research in patients after laryngectomy.

Adult↗

[Evaluation study of the chronic headache questionnaire].

INTRODUCTION: Semi-structured questionnaires, based on clinical criteria are used in the diagnosis of headache, but none has been used to study the two commonest types of chronic headache. The first step, before clinical application, is to carry out a study of the questionnaire's validity and predictive value. OBJECTIVE: The objectives of our study were to evaluate the validity and determine the effectiveness of the ZZA questionnaire in the differential diagnosis between transformed migraine (TM) and chronic tension headache (CTH), in a specialist Neurology Clinic. MATERIAL AND METHODS: The ZZA questionnaire, elaborated by one of the investigators, was made up of 20 questions aimed at TM, CTH or the chronicity of the headache. An observer, who did not know the diagnosis, gave the questionnaire to patients who had previously been diagnosed by the head of the Headache Clinic as having TM or CTH. The process of validation of the questionnaire consisted in showing that it was reliable, with valid contents and valid criteria. RESULTS: On analysis of reliability, the items ZZA1, ZZA15, ZZA16 and ZZA18 gave the highest indices. The Cochran Q test showed lack of uniformity of replies. Only ZZA1, ZZA15 and ZZA18 were predictive items showing MT. None of the questions to show CTH were predictive. After final adjustment the definitive model was made up of ZZA1, ZZA15 and ZZA18. CONCLUSIONS: The proposed questionnaire was not found to be useful for differential diagnosis between TM and CTH. Only 3 of the 20 questions were accepted as having some degree of validity and effectiveness. Two of these 3 questions, based on clinical impressions of the author, might well be included in the diagnostic criteria of TM.

Adult↗

Validity of goal attainment scaling in infants with motor delays.

BACKGROUND AND PURPOSE: The purpose of this study was to examine (1) content validity of goal attainment scaling (GAS), (2) the responsiveness of GAS compared with a behavioral objective, and (3) concurrent validity of GAS and the Peabody Developmental Gross Motor Scale. SUBJECTS AND METHODS: Two motor goals were developed for two consecutive 3-month periods for 21 infants with motor delays. The goals were put into behavioral objective and GAS formats and scored by independent examiners. Content validity was examined by having 10 physical therapists rate 10 randomly selected GAS-formatted goals on three dimensions: (1) the importance of the goal for motor development and function, (2) whether the expected progress was achievable, and (3) whether each of the four levels of change was clinically important. RESULTS: Between 77% and 88% of the therapists' ratings for each dimension met the criterion for content validity. The ratings did not differ significantly among the therapists for any of the three dimensions. Change that could not be measured with the behavioral objective format was measured with the GAS format for 61% of the goals, including 73% of the goals in which the behavioral objective was achieved. Correlations between GAS T-scores and Peabody gross motor age-equivalent change scores were not significant. CONCLUSION AND DISCUSSION: The results support content validity and the responsiveness of GAS, and provide evidence that GAS and the Peabody Scale measure different aspects of motor development. Goal attainment scaling is recommended for use in clinical practice and in treatment outcomes research.

Child, Preschool↗

The Inventory of Functional Status-Dialysis: development and testing.

OBJECTIVE: Development and psychometric testing of the Inventory of Functional Status-Dialysis (IFS-Dialysis), which was designed to measure functional status in persons who are receiving chronic incenter hemodialysis treatment. DESIGN: Three-phase instrument development design: Phase 1--content validity assessment; Phase 2--examination of internal consistency reliability; Phase 3--examination of construct validity. SAMPLE/SETTING: 175 chronic hemodialysis patients recruited from an urban, free-standing, outpatient dialysis center. METHODS: Content validity was determined using Popham's average congruency proceudre. Internal consistency reliability was determined using Cronbach's alpha reliability coefficient. Construct validity was examined by bivariate correlations between the IFS-Dialysis and the Karnofsky Performance Scale (KPS), and the Medical Outcomes Study Short Form-36 Health Survey (SF-36) in a subsample of 60 patients. RESULTS: Content validity was established at 90%. The alpha reliability coefficient for the IFS-Dialysis was 0.86. Subscale alpha coefficients ranged from 0.71-0.82. Correlation between the IFS-Dialysis and the KPS was 0.55. Correlations between the IFS-Dialysis and SF-36 subscales ranged from 0.14-0.53. CONCLUSIONS: The IFS-Dialysis has acceptable content validity, internal consistency, and initial construct validity. Use of the IFS-Dialysis in clinical practice is appropriate.

Activities of Daily Living↗

[Development and initial validation of an instrument to measure the lifestyles of type 2 diabetes mellitus patients 2].

OBJECTIVE: To develop and validate a specific instrument to measure lifestyle of type 2 diabetes mellitus (DM2) patients. MATERIAL AND METHODS: A longitudinal, observational, prospective study was conducted between March 2001 and April 2002 at family medicine healthcare units of the Instituto Mexicano del Seguro Social (Mexican Institute of Social Security (MISS)) in Mexico State's East District. A self-administered instrument (instrument to measure diabetic lifestyles, IMEVID) was designed to measure the lifestyles of diabetic patients. It was submitted for review by a multidisciplinary group of experts who assessed its logical and content validity to measure the lifestyle in DM2 patients. The instrument was administered on two different days to 412 adult subjects with DM2. Some items were excluded on the basis of the frequency with which their answer choices were selected, as well as the item-total correlation, and the item's significant loads in several domains in factorial analysis. RESULTS: The sample population consisted of 389 (94.7% response) subjects who completed the study. Intraclass correlation coefficients for logical and content validity were 0.91 and 0.95 respectively. After depuration of items, the instrument had 25 closed items grouped in 7 domains: nutrition, physical activity, tobacco consumption, alcohol consumption, information on diabetes, emotions, and therapeutic adherence. The global rating of the questionnaire had a Cronbach's alpha of 0.81 and a test-retest correlation coefficient of 0.84. CONCLUSIONS: The specific questionnaire IMEVID is the first to measure the lifestyle in subjects with DM2. It has logical validity, content validity, and a good level of consistency.

Adult↗

Evaluation of the educational effectiveness of a virtual reality intravenous insertion simulator.

OBJECTIVE: To evaluate construct and content validity as well as learners' perceptions of CathSim, a virtual reality intravenous (IV) insertion simulator. METHODS: A prospective cohort study design was employed to determine construct validity, and a participant survey was used to ascertain content validity as well as user perceptions of CathSim. Forty-one attendings, residents, and medical students in emergency medicine and anesthesia attempted five simulated IV insertions on CathSim. Subject performances were scored by the computer, and subject perceptions of the simulator were measured using a Likert scale questionnaire (1 = worst rating; 5 = best rating). The subjects were divided into three groups (novices, intermediates, and experts) based on previous IV experience. To determine construct validity, performances of the three groups were compared using one-way analysis of variance (ANOVA). To determine content validity, the experts' perceptions of the simulator's realism and usefulness were assessed. Study subjects' perceptions of the simulator's ease of use and overall appeal were analyzed. RESULTS: The experts scored better than the others in five of nine scoring parameters (p < 0.05). The experts rated the realism of CathSim's four major simulation components at 3.85, 3.46, 3.69, and 3.46; the overall realism of CathSim at 2.93; and its utility for medical student training at 4.57. The simulator's ease of use was rated at 2.34 by all subjects. Novices reported a score of 4.59 regarding their likelihood to use the simulator. CONCLUSIONS: CathSim demonstrated construct validity in five of nine internal scoring parameters and was judged to be adequately realistic and highly useful for medical student training. Despite being difficult to learn to use, it remained appealing to the users, especially the novices.

Adult↗

A reliability and validity study of the Women's Role Strain Inventory.

The purpose of this study was to theoretically conceptualize, develop and test the Women's Role Strain Inventory (WRSI) which assesses role strain in women who have multiple roles. There is limited research published related to role strain of women, although role strain, role conflict and role stress have been documented to have negative and positive effects (Hall 1975, Hall 1992). The theoretical basis for this study is based upon Goode's Theory of Role Strain (1960) and Sieber's Theory of Role Accumulation (1974). The pilot consisted of 62 female nurses, and the sample used for construct validity consisted of 445 female nurses. Content validity resulted in a content validity index of (.91). Exploratory factor analysis with varimax rotation resulted in a three-factor solution supporting Goode's (1960) theory of role strain, and Sieber's (1974) theory of role accumulation. Alpha coefficients for the three subscales were .89 (role distress), .86 (role enhancement), and .81 (role support). Internal consistency of .93 was achieved for the overall WRSI. Test-retest coefficients ranged from .61 to .91. The high reliability and validity of the WRSI make it a reliable and valid instrument to measure role strain of women.

Adult↗

EDITS: development of questionnaires for evaluating satisfaction with treatments for erectile dysfunction.

OBJECTIVES: To develop Patient and Partner versions of a psychometrically sound questionnaire, the EDITS (Erectile Dysfunction Inventory of Treatment Satisfaction), to assess satisfaction with medical treatments for erectile dysfunction. METHODS: Treatment satisfaction differs from treatment efficacy as it focuses on a person's subjective evaluation of treatment received. Twenty-nine items representing the domain of treatment satisfaction for men and 20 representing partner satisfaction were generated. Two independent samples of 28 and 29 couples completed all items at two points in time. Spearman rank-order correlations were derived to assess test-retest reliability and couple coefficients of validity. Internal consistency coefficients were calculated for both Patient and Partner versions and a content validity panel was used to analyze content validity. RESULTS: Only items that met all the following criteria were selected to comprise the final questionnaires: (a) range of response four or more out of five; (b) test-retest reliability greater than 0.70; (c) ratings by at least 70% of the content validity panel as belonging in and being important for the domain; and (d) significant correlation between the subjects' and partners' responses. Eleven patient items met criteria and formed the Patient EDITS; five partner items met criteria and formed the Partner EDITS. Scores on the two inventories were normally distributed with internal consistencies of 0.90 and 0.76, respectively. Test-retest reliability for the Patient EDITS was 0.98; for the Partner EDITS, it was 0.83. CONCLUSIONS: Reliability and validity were well established, enabling the EDITSs to be used to assess satisfaction with treatment modalities for erectile dysfunction and to explore the impact of patient and partner satisfaction on treatment continuation.

Erectile Dysfunction↗

The development of an instrument to match individuals with disabilities and service animals.

PURPOSE: There has been an increase in the use of service animals assisting persons with disabilities in the past decade. However many of the service dog agencies do not utilize an assessment that is designed to match the person to the animal in the rehabilitation and psycho-social domains. The purpose of this study was to develop the Service Animal Adaptive Intervention Assessment (SAAIA) and to measure the content validity, inter-rater reliability and clinical utility of the assessment. METHOD: Two subject groups were used. Subject group one had 43 subjects who measured the content validity and clinical utility of the SAAIA Survey. Subject group two had 12 subjects who measured the inter-rater reliability by completing the SAAIA using information obtained through a video-taped client case scenario. RESULTS: Content validity results indicated a good to high percentage of agreement and a fair percentage of agreement for clinical utility. Inter-rater reliability results indicate good to high agreement on six of the eight variables of the SAAIA. However, the Kappa score indicates low inter-rater reliability. CONCLUSION: Results indicate the SAAIA has good content validity and inter-rater reliability and fair clinical utility based on percent agreement. However, further research is needed on the reliability of the SAAIA.

Animals↗

Assessment of reliability and validity of the behavioral observation record for developmental care.

Due to time constraints, clinicians are rarely able to carry out neurobehavioral assessments that use the Naturalistic Observation of Newborn Behavior Instrument. The content validity, interrater reliability, and criterion-related validity for a less time-consuming instrument, the Modified Infant Behavioral Observation Record (MIBOR) for developmental care was evaluated in this study. Eight developmental care specialists evaluated the MIBOR for content validity. Fifteen infants (birth weight < 1,500 g) were observed to determine interrater reliability, and three were observed to evaluate criterion-related validity. The content validity of the MIBOR, as determined by average congruence, was 96.9%. Interrater reliability for each developmental care subsystem ranged from 67% to 98%. Three of the four subsystems on the MIBOR achieved criterion-related validity, achieving an agreement of r = .60.

Attention↗

Validation of the Chinese version of the satisfaction with the nursing home instrument.

AIM: To assess the psychometric properties of the Chinese version of the Satisfaction with the Nursing Home Instrument. BACKGROUND: Resident's satisfaction has been regarded by the literature as a gold standard for quality of nursing home care. Accurate assessment of resident's satisfaction can provide valuable information for implementation of quality nursing home care. However, there is not a validated Chinese tool to serve the purpose. DESIGN: A cross-sectional descriptive survey design. METHODS: Content validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by the use of expert panel. Construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was determined by assessing the correlation between satisfaction with other theoretically related constructs. Internal consistency and stability of the Chinese version of the Satisfaction with the Nursing Home Instrument were determined by Cronbach's method and two-week test-retest reliability. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by confirmatory factor analysis. Testing was performed on a cluster sample of 330 residents from 16 nursing homes in Hong Kong. RESULTS: The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated good content validity by having content validity index of 0.93. High construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was supported by its significant correlation with depression (r = -0.42, P = 0.000), health-related quality of life (physical component) (r = 0.16, P = 0.042), health-related quality of life (mental component) (r = 0.41, P = 0.000) and global quality of care (r = 0.49, P = 0.000). The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated satisfactory internal consistency and good stability by having Cronbach's alpha of 0.79 and intra-class correlation coefficient of 0.94, respectively. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was not fully supported by confirmatory factor analysis. CONCLUSIONS: The Chinese version of the Satisfaction with the Nursing Home Instrument is a useful instrument for assessing satisfaction of cognitively intact Chinese nursing home residents. Findings provided initial evidence on its validity and reliability. Further empirical testing is recommended to explore its factor structure. RELEVANCE TO CLINICAL PRACTICE: The Chinese version of the Satisfaction with the Nursing Home Instrument can provide guidance to enhance delivery of high-quality nursing home care for the Chinese population.

Aged↗

Staff attitudes towards working with drug users: development of the Drug Problems Perceptions Questionnaire.

AIM: To evaluate the psychometric properties of an adaptation of the Alcohol and Alcohol Problems Perceptions Questionnaire to measure the attitudes of staff to working with drug users (the DDPPQ). DESIGN: Postal survey: a questionnaire was mailed to participants on two occasions. SETTING: A large urban National Health Service (NHS) mental health service. PARTICIPANTS: A stratified random sample of medical staff, clinical psychologists, occupational therapists and nurses (n = 672) who work within generic mental health, adolescent psychiatry, forensic psychiatry and alcohol and drug services. Response rate at Time 1 was 56% and 68% at Time 2. MEASUREMENTS: A structured demographic questionnaire; individual item and total scores for the DDPPQ administered on two occasions 4 weeks apart; data relating to the content validity of the instrument. FINDINGS: A principal component analysis confirmed the DDPPQ's construct validity and participants confirmed its content validity. Following analysis of the instrument's test-retest reliability and its principal component structure it was reduced to a 20-item scale. Its five subscales related to role adequacy, role support, job satisfaction, role-specific self-esteem and role legitimacy. CONCLUSION: The refined DDPPQ was shown to be a valid and reliable tool which can be used to measure attitudes of people in relation to working with drug users.

Alcoholism↗

Validating an instrument for clinical supervision using an expert panel.

Use of research instruments standardised in English-speaking countries is commonplace in non-English speaking countries. This article describes technical, linguistic and conceptual issued raised in the translation and validation of an acceptable country-specific instrument. The Manchester Clinical Supervision Scale was validated for use in clinical supervision in Finland using quantitative and qualitative methods. The approach applied was triangulation. The focus of this paper, is to describe the item validation process of the scale using an expert panel (n=11) by means of the content validity index and panel interview. The process resulted in a country-specific 33-item instrument. The study indicated that content validity index and panel discussion are easy, but reliable ways of demonstrating the instrument's content validity.

Cross-Cultural Comparison↗

The Psychiatric Care Satisfaction Questionnaire: a reliability and validity study.

Patient satisfaction can be a useful marker in evaluating the quality of psychiatric care. However, this form of measurement has been hampered by the lack of attention paid to the psychometric properties of instruments devised. The Psychiatric Care Satisfaction Questionnaire (PCSQ) was developed and tests of acceptability, validity and reliability were undertaken using 52 inpatients. Content validity was assessed by surveying psychiatrists, other mental health professionals, MIND workers and patient groups. Thirty-six (67.9%) of all mental health professionals felt that the questionnaire was a useful measure of patients' satisfaction with their care, and many comments also suggested high consensual validity. In terms of content validity, responses from patient groups indicated that the majority (63.6%) felt it to be a useful measure of patient satisfaction and 70.5% felt all the areas covered were important. Concurrent and criterion validity were also good, with high correlations with existing scales and with those on a section being significantly less satisfied on the PCSQ (F = 13.3, P = 0.0004). Test-retest reliability was adequate (Cohen's kappa 0.48-0.80) and the internal consistency of the PCSQ was good, at 0.82 (Cronbach's alpha). The PCSQ performed well in all aspects of validity and reliability, indicating that it has good psychometric properties and can be a useful tool for measuring patient satisfaction. However, there remains the need to analyse more closely the concept of satisfaction and its determinants.

Humans↗

Validation of Web-based questionnaires regarding osteoporosis prevention in young British women.

OBJECTIVES: The aim was to assess the content, validity and reproducibility of web-based questionnaires, for a study on osteoporosis prevention among young British women. Twenty-two questionnaires to assess knowledge, self-efficacy, physical activity, calcium intake, health beliefs and stages of change relevant to osteoporosis prevention were identified. Nine were selected and modified to compensate for cultural differences, to suit young women, for completion on the Web. DESIGN: Subjects were recruited by e-mail and asked to complete the web-based questionnaires. Subjects completed the questionnaires again, on paper and were asked to assess the content validity, at least seven days later. SETTING: University of Glasgow, Scotland. SUBJECTS: Sixteen female students and staff aged 19-49. RESULTS: The questionnaires' reproducibility, as measured by the intraclass correlation coefficient was significant at p < 0.01 and acceptable, i.e. above 0.70 for knowledge, 0.85; for self-efficacy, 0.72; for exercise stage of change, 0.79; for exercise benefits, 0.89 and for exercise barriers, 0.82. The intraclass correlation coefficient was significant at p < 0.01 for health belief, 0.43, for weight-bearing physical activity, 0.67, for calcium barriers, 0.48, for 'others around you', 0.65, for calcium stage of change, 0.50 and for calcium intake, 0.56. The intraclass correlation coefficient was not significant for calcium benefits. CONCLUSIONS: Assessing content validity was valuable in ensuring questionnaires were relevant and interpreted correctly by the sample population. Nine web-based questionnaires suitable for, and validated with, young British women are now available for use as outcome measures in studies of health education to prevent osteoporosis.

Adult↗