PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16Linked to original sources

Construct validity and content analysis.

We clarify points of agreement and disagreement with Schnurr, Rosenberg, and Oxman, as put forth in their article appearing this issue. Speech samples elicited under different conditions may or may not be interchangeable. This is a matter of empirical research, but it is also dependent upon the meaningfulness of the content categories. used in the analysis. We prefer a theory-driven, construct validational approach that employs well validated coding schemes to assess psychologically meaningful concepts.

Comment↗

Physical activity and self-perception in school children assessed with the Children and Youth--Physical Self-Perception Profile.

AIM: This study validated the Swedish translation of the Children and Youth--Physical Self-Perception Profile (CY-PSPP) scale and examined the relation between physical self-perception and daily physical activity as well as the relationship between physical self-perception and body mass index (BMI) among Swedish school children. METHODS: Forty-eight children aged 11-12 years completed the CY-PSPP twice with 2 weeks in between. Test-retest reliability, concurrent and content validity were calculated. Five hundred and one children, aged 10-14 years, were measured for height and weight and perceived physical self-perception. Activity levels were analyzed using pedometers for 4 consecutive days. RESULTS: Good validity concerning concurrent and content validity was found. Test-retest reliability over a 2-week period was acceptable. In boys a fair and in girls a poor correlation between the sub-domains of the CY-PSPP and physical activity were found and a fair negative correlation between the sub-domains and BMI except for Physical Strength. CONCLUSION: The CY-PSPP distinguishes between children with low and high physical self-perception. The information is of importance when designing physical activity programs reachable for children with low physical self-esteem. According to the findings it is important to form physical activity programs that support and develop Sport Competence, Physical Condition and sense of Body Attractiveness among children.

Adolescent↗

The health assessment questionnaire disability index and scleroderma health assessment questionnaire in scleroderma trials: an evaluation of their measurement properties.

OBJECTIVE: To evaluate the measurement properties of the Health Assessment Questionnaire (HAQ) disability index (DI) for group comparisons in scleroderma trials, and to determine if the Scleroderma Health Assessment Questionnaire (SHAQ) visual analog scales confer any measurement advantage over the HAQ DI. METHODS: A computer search for articles describing the use of the HAQ DI and SHAQ in scleroderma was performed. Evidence supporting the sensibility, reliability, validity, and responsiveness of these measures was evaluated. RESULTS: The SHAQ has incremental face and content validity over the HAQ DI because it addresses scleroderma-specific manifestations that also contribute to disability. The HAQ DI has good concurrent validity, construct validity, and predictive validity. Whether SHAQ confers incremental construct, concurrent, or predictive validity over the HAQ DI is uncertain. The HAQ DI appears more reliable than the SHAQ; however, reliability studies provide insufficient data to ascertain if minimum standards have been achieved. Responsiveness of the HAQ DI subscales has been demonstrated. CONCLUSION: The SHAQ has incremental face and content validity over the HAQ DI. The HAQ DI has greater reliability and demonstrated construct, concurrent, and predictive validity. Further investigation into the measurement properties of the HAQ DI and SHAQ visual analog scales, and their relation to the required standards of measurement is needed.

Clinical Trials as Topic↗

COOP Charts in French: translation and preliminary data on instrument properties.

This paper describes the procedure used to translate the COOP Charts into French and provides preliminary information on the instrument's acceptability, reliability and validity. The charts were translated in several steps: seven initial translations were combined into a first pilot version, which was then tested for acceptability, clarity and alternative wordings in two convenience samples taken from the general population (n = 53). The modified version was then reviewed by a lay panel and another translator and submitted by mail to 209 congress participants to test several construct validity hypotheses through known-groups comparisons. A panel of public health professionals discussed the content validity of the charts. Finally, test-retest reliability and concurrent validity with SF-36 Health Survey scores were examined among 65 patients with end-stage renal disease. The translation process identified a wide variability in translation options for several items. The acceptability of the charts was excellent. The test-retest correlations ranged from 0.60 to 0.87. Content validity appeared to be appropriate, except for the chart on 'social support', which combines the questions of need and availability of social support. The utility of illustrations was questioned by some respondents: many claimed not to have used the illustrations in selecting their response, while others found them to be not expressive enough. Most preliminary tests of construct validity were consistent with theory. This French translation of the COOP Charts appears to be ready for more extensive testing in the intended target population of ambulatory patients.

Adolescent↗

Development and validation of the Diabetes Bowel Symptom Questionnaire.

BACKGROUND: Although gastrointestinal symptoms occur frequently, there is no validated measure of gastrointestinal symptoms in patients with diabetes mellitus. AIM: To develop the Diabetes Bowel Symptom Questionnaire. METHODS: A questionnaire derived from previously validated symptom measures was compiled to assess all relevant gastrointestinal and diabetes items. Face and content validity were ascertained by expert review. One hundred and sixty-eight patients with diabetes mellitus completed the instrument, and reliability was evaluated by a test-re-test procedure 1 week later. Concurrent validity was evaluated by an independent physician interview (n = 33). Measures of glycaemic control (glycated haemoglobin and plasma glucose) were compared with self-reported glycaemic control on a five-point Likert scale in diabetic out-patients (n = 166). RESULTS: The questionnaire had adequate face and content validity. There was good to excellent test-re-test reliability for the gastrointestinal and diabetes items (median kappa: 0.63 and 0.79, respectively); concurrent validity was good to excellent (median kappa: 0.47 and 0.65, respectively), except for the items assessing the severity of gastrointestinal symptoms. Both glycated haemoglobin (P < 0.0001) and plasma glucose (P = 0.005) correlated significantly with self-reported glycaemic control. CONCLUSION: The Diabetes Bowel Symptom Questionnaire appears to be a useful measure of gastrointestinal symptoms and glycaemic control in diabetes mellitus, and should have applicability in epidemiological and clinical studies.

Adult↗

Validation of the smoking self-efficacy survey for Taiwanese children.

PURPOSE: To determine the psychometric properties of the Chinese version of the smoking self-efficacy (SSE) survey. DESIGN AND METHODS: The SSE survey was translated into Chinese then was back-translated into English, reviewed for content validity, pilot tested, and administered to 401 children between December 1998 and August 1999. A random cluster sampling method was used in this study. FINDINGS: Reliability was indicated by Cronbach's alpha coefficient, .98. The validity of the SSE scale was determined by face validity, item-total correlation coefficient, content validity index, and concurrent validity. Principal component analysis was done to determine the construct validity of the SSE scale. The revised SSE scale had three components accounting for 74.3% of the total variance with alpha of .96. The correlation coefficient between the SSE and revised SSE scale was .99. CONCLUSIONS: Findings show that the revised SSE scale is not only parsimonious but also it is as reliable and valid as is the original SSE scale. This translated instrument is appropriate for use in studies of smoking behavior in Taiwanese children aged 11 to 14 years. Further research will be needed to validate the SSE scale with different populations and settings in Taiwan.

Child↗

Psychometric validation of a patient-reported sensory perception and preference instrument: the Sensory Perceptions Questionnaire.

This study evaluated the psychometric properties of content validity, construct validity, and test-retest reliability of a 23-item Sensory Perceptions Questionnaire (SPQ) used to survey sensory perceptions of intranasal corticosteroid sprays. Two patient cohorts (men and women aged > or =18 years who had at least a 1-year history of allergic rhinitis and had been using a corticosteroid nasal spray) were enrolled. The content validity and construct validity of the SPQ questions were evaluated using a cognitive debriefing method after cohort 1 (n=15) completed the SPQ. Test-retest reliability (assessed with intraclass correlation coefficients [ICCs] of the SPQ questions) was evaluated in cohort 2 (n=50), after they answered a Web-based version of the SPQ on two occasions, each separated by 7 days. In cohort 1, 7 of 15 patients believed all relevant sensory perceptions were addressed in the questionnaire. Although 8 patients mentioned at least 1 sensory perception that was not addressed, only 4 sensory perceptions were mentioned by more than 1 patient, and none was mentioned reliably by more than 2 patients. Those 4 sensory perceptions not addressed in the SPQ were all intentionally excluded, because they were potential symptoms of rhinitis or adverse events associated with intranasal corticosteroid spray use. Patients regarded the questions as straightforward, nonburdensome, and nonthreatening, signs suggesting the questions were not likely to challenge the construct validity of the SPQ. The responses to 2 questions (one in which patients were asked to indicate whether they were pleased or displeased overall with a particular spray; the other to indicate their overall product preference) were somewhat influenced by the effectiveness of the sprays. Results of test-retest reliability (cohort 2) showed both high (>0.8) and low (<0.7) ICCs. A high degree of correspondence between the 2 administrations produced a low between-patient variance, which likely resulted in lower ICCs. The SPQ adequately represents the sensory attributes reported by patients regarding intranasal corticosteroid spray use and, overall, is a valid measure of patient preference based on sensory perception.

Administration, Intranasal↗

The Neurobehavioural Rating Scale: replication in an acute, inpatient rehabilitation setting.

The Neurobehavioural Rating Scale (NRS) was developed to allow quantification of clinical observations of the behaviour of individuals following traumatic head injury. Initial validation of this instrument reported satisfactory interobserver reliability, as well as preliminary support for its validity in differentiating both severity and chronicity of head injury. In the present study, reliability and content validity of the NRS were replicated using a population of severe head injury patients undergoing inpatient rehabilitation. Concurrent, independent assessment using the NRS was conducted weekly by two members of an inpatient, traumatic head injury team. Acceptable levels of interobserver reliability were found, despite less control over observed behaviour in the naturalistic setting used. Content validity was also supported in this replication, although recommendations for 'tightening' the NRS included better definition of the seven-point severity rating for each item, as well as potential deletion of two items that contributed little to differential variance in the total NRS score. The NRS appears to be a promising clinical and research tool for assessing the neurobehavioural sequelae of traumatic head injury. Its strengths include efficiency of administration and the flexibility to administer through brief, structured interviews or observations in a naturalistic setting. Continued research on the NRS in different settings and with different populations is required to establish its validity.

Adolescent↗

Global Rating Assessment of Skills in Intraocular Surgery (GRASIS).

OBJECTIVE: The American Board of Ophthalmology in conjunction with the Accreditation Council for Graduate Medical Education has mandated the systematic assessment of surgical competence of ophthalmology residents at all residency programs. We present a tool complementary to the Objective Assessment of Skills in Intraocular Surgery (OASIS) to assess residents' surgical competence. PARTICIPANTS: Twenty experts in resident education, including the chiefs of all ophthalmology services and the chief resident at the Harvard Medical School Department of Ophthalmology. METHODS: A 1-page subjective evaluation form was developed in conjunction with the Objective Assessment of Skills in Intraocular Surgery evaluation form to assess the surgical skills of residents. A panel of surgeons at the Harvard Medical School Department of Ophthalmology at the Massachusetts Eye and Ear Infirmary reviewed the form and provided constructive feedback. RESULTS: Experts' comments were incorporated, establishing face and content validity. CONCLUSIONS: The Global Rating Assessment of Skills in Intraocular Surgery (GRASIS) has face and content validity. It can be used to assess a resident's surgical care of patients as well as a resident's surgical knowledge, preparedness, and interpersonal skills. Reliability and predictive validity will be determined at our institution. We believe the GRASIS evaluation form will be a valuable tool in conjunction with the OASIS evaluation form for assessing ophthalmology residents' surgical skills at other residency programs as well.

Accreditation↗

Respondent burden and patient-perceived validity of the PDQ-39.

OBJECTIVES: To evaluate the respondent burden and patient-perceived content validity of the Parkinson's disease (PD)-specific health status questionnaire PDQ-39, and the linguistic validity of its revised Swedish version. MATERIALS AND METHODS: Eighteen PD patients completed the revised Swedish version of the PDQ-39. Respondent burden was assessed by recording the time taken to complete the questionnaire. Content and linguistic validity was evaluated qualitatively. RESULTS: Patients with mild, moderate and advanced PD needed a mean time of 9.5, 11.3 and 20.1 min, respectively, to complete the PDQ-39. One-third of the patients identified irrelevant items and 50% identified important health-related areas that were missing. Revisions had eliminated previous linguistic problems with the Swedish PDQ-39. CONCLUSIONS: Undue respondent burden challenged the appropriateness of the PDQ-39 among patients with more advanced disease. Overall content validity was acceptable but compromised by lack of important content areas. Observations supported the linguistic validity of the revised Swedish PDQ-39.

Adult↗

The development of the Melbourne low-vision ADL index: a measure of vision disability.

PURPOSE: To develop a new test of activities of daily living (ADLs) appropriate for the low-vision population: the Melbourne Low-Vision ADL Index (MLVAI). METHODS: The MLVAI was designed as a desk-based clinical assessment, comprising 18 observed items on complex ADLs in part (a) and 9 questions on broad self-care ADLs in part (b). Each item was rated on a five-level descriptive scale from 0 to 4, based on independence, speed, and accuracy of performance. It was designed to be administered under standardized conditions with regard to the instructions, illumination, and working distances. The validity and reliability of the new MLVAI was determined for 122 subjects who were representative of the general low-vision population, in a cross-sectional study. RESULTS: Two items were found to be redundant and were eliminated from the test. Thus, the final test comprised 25 items, with 100 being the highest possible score. Cronbach's alpha indicated an internal reliability of 0.96, and an intraclass correlation coefficient indicated an overall reliability of 0.95. The SE of measurement was 4.5. According to Spearman's correlation coefficient, the test-retest reliability was 0.94 (P < 0.001), and the interpractitioner reliability for five different pairs of practitioners was 0.90 or higher (P < 0.001). With regard to validity, there was a moderately high correlation with vision impairment (r = -0.68, P < 0.001). Using Rasch analysis, content validity was also demonstrated by good separation indexes (4.70 and 9.88) and high reliability scores (0.96 and 0.99) for the person and items parameters, respectively. Separate calculation of indexes and reliability scores for parts (a) and (b) indicated high content validity and reliability of each part. However, the separation indexes and reliability scores were higher for part (a) than for part (b). The correlation coefficient for part (a) and part (b) was 0.68. CONCLUSIONS: The MLVAI is a highly valid and reliable standardized test of ADL performance for the general low-vision population. It may be used to assess patients with low vision and has the potential to be used as a measure of low-vision rehabilitation outcomes.

Activities of Daily Living↗

The development, validity and reliability of a multimodality objective structured clinical examination in psychiatry.

OBJECTIVES: To evaluate the development, validity and reliability of a multimodality objective structured clinical examination (OSCE) in undergraduate psychiatry, integrating interactive face-to-face and telephone history taking and communication skills stations, videotape mental state examinations and problem-oriented written stations. METHODS: The development of the OSCE on a restricted budget is described. This study evaluates the validity and reliability of 4 15-18-station OSCEs for 128 students over 1 year. Face and content validity were assessed by a panel of clinicians and from feedback from OSCE participants. Correlations with consultant clinical 'firm grades' were performed. Interrater reliability and internal consistency (interstation reliability) were assessed using generalisability theory. RESULTS: The OSCE was feasible to conduct and had a high level of high perceived face and content validity. Consultant firm grades correlated moderately with scores on interactive stations and poorly with written and video stations. Overall reliability was moderate to good, with G-coefficients in the range 0.55-0.68 for the 4 OSCEs. CONCLUSIONS: Integrating a range of modalities into an OSCE in psychiatry appears to represent a feasible, generally valid and reliable method of examination on a restricted budget. Different types of stations appear to have different advantages and disadvantages, supporting the integration of both interactive and written components into the OSCE format.

Clinical Competence↗

Development of the Physical Activity Interactive Recall (PAIR) for Aboriginal children.

BACKGROUND: Aboriginal children in Canada are at increased risk for type 2 diabetes. Given that physical inactivity is an important modifiable risk factor for type 2 diabetes, prevention efforts targeting Aboriginal children include interventions to enhance physical activity involvement. These types of interventions require adequate assessment of physical activity patterns to identify determinants, detect trends, and evaluate progress towards intervention goals. The purpose of this study was to develop a culturally appropriate interactive computer program to self-report physical activity for Kanien'kehá:ka (Mohawk) children that could be administered in a group setting. This was an ancillary study of the ongoing Kahnawake Schools Diabetes Prevention Project (KSDPP). METHODS: During Phase I, focus groups were conducted to understand how children describe and graphically depict type, intensity and duration of physical activity. Sixty-six students (40 girls, 26 boys, mean age = 8.8 years, SD = 1.8) from four elementary schools in three eastern Canadian Kanien'kehá:ka communities participated in 15 focus groups. Children were asked to discuss and draw about physical activity. Content analysis of focus groups informed the development of a school-day and non-school-day version of the physical activity interactive recall (PAIR). In Phase II, pilot-tests were conducted in two waves with 17 and 28 children respectively to assess the content validity of PAIR. Observation, videotaping, and interviews were conducted to obtain children's feedback on PAIR content and format. RESULTS: Children's representations of activity type and activity intensity were used to compile a total of 30 different physical activity and 14 non-physical activity response choices with accompanying intensity options. Findings from the pilot tests revealed that Kanien'kehá:ka children between nine and 13 years old could answer PAIR without assistance. Content validity of PAIR was judged to be adequate. PAIR was judged to be comprehensive, acceptable, and enjoyable by the children. CONCLUSIONS: Results indicate that PAIR may be acceptable to children between nine and 13 years old, with most in this age range able to complete PAIR without assistance. The flexibility of its programming makes PAIR an easily adaptable tool to accommodate diverse populations, different seasons, and changing trends in physical activity involvement.

Journal Article↗

The validity and reliability of EQ-5D health state valuations in a survey of Măori.

This note reports on a 2000 study of the content validity of the EQ-5D's representation of health for 66 Măori (New Zealand's indigenous people, comprising 14.5% of the population) accessed through cultural networks. Also examined was the construct validity of the health state valuation instrument and its test-retest reliability based on repeated valuations for the two extreme health states. The possibility that the EQ-SD fails to capture what Măori regard as 'health' derives from the so-called 'Măori health model' that augments biological health with mental, spiritual and family well-being. Seventy six percent of respondents considered the EQ-5D's representation of health to be adequate. This proportion is not statistically significantly different from the rates for non-Măori and Măori respectively in an earlier study and might suggest the EQ-5D has content validity for Măori. However, the high prevalence of missing valuations, particularly for dead, and logical inconsistencies suggests that the health state valuation instrument lacks construct validity, although there is evidence of test retest reliability.

Adult↗

Construction of the Patient-Oriented Prostate Utility Scale (PORPUS): a multiattribute health state classification system for prostate cancer.

Health status indexes, such as the EuroQol, consist of a health state classification system and a set of utility weights. Indexes measure quality of life using a 0-1 utility score. Utilities for outcomes in prostate cancer (PC) are of unique importance, but generic indexes do not represent PC outcomes (e.g., sexual, urinary, bowel dysfunction) well, and may not capture their full impact. As a step toward improved utility measurement, we constructed a classification system for PC. We generated items for each of six health domains and rated their importance using interviews with 10 clinical experts and 80 patients. Key concepts were selected for each domain using item importance weightings, and a set of predetermined criteria. Text was developed to express levels of severity within each domain. Experts and two additional groups of patients (n = 40, n = 96) evaluated textual clarity and endorsed the content validity of the instrument. The final system consists of 10 domains with 4-6 levels each. The content validity of the system was endorsed by patients and experts. In conjunction with a set of utility weights, it may be used to develop a health status index, to improve utility measurement in patients, and to serve as a short psychometric (nonutility) instrument.

Health Status Indicators↗

Development and testing of the Stressor Scale for Pediatric Oncology Nurses.

Pediatric oncology nursing has been identified as a stressful specialty, but the exact sources of the stress have not been comprehensively specified nor put into measurable form. Effective interventions can best be developed when the stressors are known and measured. The purpose of this study was to develop and test an instrument that could accurately and sensitively measure the job-related stressors for pediatric oncology nurses. A 61-item, visual analogue instrument, the Stressor Scale for Pediatric Oncology Nurses (SSPON), was inductively developed from interviews with 30 pediatric oncology nurses. Subsequently, the SSPON was tested in three geographically separated samples of pediatric oncology nurses (n = 78). After an item analysis, 11 items were deleted from the scale. Reliability of the SSPON was estimated using both stability and internal consistency methods. The test-retest correlation coefficient was 0.88, and the total scale alpha coefficient was 0.94. Content validity was estimated using a two-stage process of developmental and judgment quantification with a panel of three specialty nurses. Construct validity was estimated through testing of theoretically derived hypotheses and a cluster analysis. Findings indicated the SSPON is content valid. Six meaningful clusters that represented sources of job-related stress were identified and defined. The revised SSPON appears to have adequate psychometric properties for a new instrument.

Evaluation Studies as Topic↗

Development of an instrument to measure the responses and management of Chinese primary caregivers in caring of children with minor upper respiratory disorders.

This article focuses on the development of a valid, reliable and culturally sensitive instrument to assess the responses and management of Chinese primary caregivers caring for children aged below 10 with minor upper respiratory disorders. Thirty-two semi-structured interviews were conducted as the point of saturation of qualitative data was reached. The qualitative findings contributed to the development of the instrument items. Five main categories and 29 sub-categories were identified with satisfactory inter-coder reliability. A panel of three experts judged the content validity of the instrument with a content validity index of 0.98. A test-retest procedure with 40 subjects was adopted and the correlation coefficient for the instrument was 0.850 (p< or =0.000).

Attitude to Health↗

Development of an instrument to measure cardiac illness dependency.

OBJECTIVE: Dependency is frequently mentioned in the literature as a response of patients with cardiac disease. The purpose of this study was to develop and test a measure of dependency occurring in response to a cardiac illness. Illness dependency is defined as the need for emotional protection and social support after a significant change in health. DESIGN: Instrument development study. SAMPLE: Convenience sample of 311 patients with cardiac disease. RESULTS: The final version of the instrument has 25 items, each of which is measured on a 5-point Likert-type scale. Content validity was demonstrated using a panel of experts. Internal consistency of the total scale was 0.90; subscale alpha coefficients ranged from 0.64 to 0.81. Exploratory factor analysis supported a four factor solution: Attention, Reassurance, Concern, and Assistance, which accounted for 57.4% of the variance in scores. Discriminant validity was demonstrated by a low correlation with neuroticism. Social desirability of responses was minimal. CONCLUSION: Internal consistency reliability, content validity, and discriminant validity of the Illness Dependency Scale have initial support. This instrument is ready for use in research in which the investigator wishes to measure dependency associated with cardiac illness.

Aged↗