PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32Linked to original sources

Development and validation of a functional dyspepsia-related quality of life (FD-QOL) scale in South Korea.

BACKGROUND: Quality of life (QOL) in patients with functional dyspepsia in South Korea has never been studied, mostly due to the lack of a psychometrically validated disease-specific instrument for measuring the QOL. The aim of the present study was to develop and validate a QOL scale for patients with functional dyspepsia. METHODS: A Functional Dyspepsia-Related QOL (FD-QOL) scale was developed and validated as follows: item generation, pilot test, and psychometric test. Patients with functional dyspepsia (n = 220) were recruited from seven university hospitals. The participants were asked to complete the preliminary item-generated FD-QOL, the Short Form-36 (SF-36), and the Index of Dyspepsia Symptoms-Korean (IDS-K). The data were analyzed using factor analysis, correlation, anova, and Cronbach's alpha. RESULTS: Twenty-three items were generated based upon content validity. Factor analysis extracted a four-factor solution, and two items were deleted because they were not loaded significantly on any factor. The FD-QOL was correlated with the SF-36 subscales, of which scores were differentiated according to the levels of dyspepsia symptoms. Cronbach's alpha of the FD-QOL was 0.94. CONCLUSIONS: The FD-QOL scale is a rapid and easily applicable instrument with excellent psychometric properties of content, factorial, convergent, and known-groups validity, and internal consistency reliability in Korean patients with functional dyspepsia.

Adult↗

A national job analysis of certified diabetes educators by the National Certification Board for Diabetes Educators.

PURPOSE: The job analysis described in this report was conducted by the National Certification Board for Diabetes Educators (NCBDE) to (1) provide a basis for documenting the continuing validity of the certified diabetes educator examination (CDE), (2) define areas that should be assessed in future certification examinations, and (3) ensure that the content of certification examinations is job related. METHODS: A diabetes educator job task list was developed and used to create a job analysis survey. The survey was distributed randomly to 1079 CDEs throughout the United States. RESULTS: Of the 1079 surveys that were distributed, 327 were suitable for analysis, with relevant demographic subgroups adequately represented. An examination matrix and detailed content outline were constructed from the survey data that will be used by the NCBDE to assemble future test forms. CONCLUSIONS: Specifications for the CDE examination were developed that were directly related to the important activities that diabetes educators perform. Future forms of the CDE examination will be matched to job-related, criterion-referenced test specifications and will have strong evidence of content validity. Future forms of the exam will contain 200 items at specified cognitive levels with a representative sampling of tasks within 4 core areas from the detailed content outline.

Certification↗

Validity of two oral health-related quality of life measures.

OBJECTIVES: To assess the validity of the Oral Impacts on Daily Performance (OIDP) and the short form of the Oral Health Impact Profile (OHIP 14) in the UK. SETTING: Primary care department at a UK dental hospital. SAMPLE: Consecutive patients. METHOD: Cross-sectional comparison of impacts using OIDP and OHIP 14 against clinical findings, Global Oral Health Ratings and pain. RESULTS: A total of 179 patients participated (83.2% response rate). OIDP had weak face validity because it contained contingency questions. Both instruments were developed from the same theoretical model and appeared to have reasonable content validity. In regression analyses, the number of impacts detected by each measure and the total score using OHIP 14 were related to the presence of oral disease and inversely related to age. No suitable transformation could be found to allow regression analysis of OIDP total scores. OHIP 14 correlated more closely with Global Oral Health Ratings but both measures correlated similarly to the experience of pain (0.43 < r < 0.47). The correlation between OHIP and OIDP scores was +0.78. The use of a simple additive method for calculating the total OHIP 14 score did not compromise its validity. CONCLUSION: Both instruments have some validity as measures of Oral Health-Related Quality of Life (OHRQoL) among dental hospital patients. The superior face, criterion and convergent validity and greater amenability to analysis of OHIP 14 render it more suitable for questionnaire-based research and for comparing groups. The additive method may be used to calculate the total score for OHIP 14.

Activities of Daily Living↗

A new method of evaluating attachment representations in young school-age children: the Manchester Child Attachment Story Task.

We describe a new instrument, using a doll-play vignette completion method, which applies concepts and methodologies from infant and adult attachment research to enable identification and detailed classification of internal representations of attachment relationships in young school-age children. Validation of the Manchester Child Attachment Story Task (MCAST) in a normal population (N = 53) shows good interrater reliability and content validity. Patterns of attachment representation identified show stability over time. Comparisons are made with existing methodologies, and potential applications of the instrument and directions for future research are discussed.

Child↗

Assessment of the equivalence of the Spanish and English versions of the CAHPS Hospital Survey on the quality of inpatient care.

OBJECTIVE: To describe translation and cultural adaptation procedures, and examine the degree of equivalence between the Spanish and English versions of the Agency for Healthcare Research and Quality's (AHRQ) Consumer Assessments of Healthcare Providers and Systems (CAHPS) Hospital Survey (H-CAHPS) of patient experiences with care. DATA SOURCES: Cognitive interviews on survey comprehension with 12 Spanish-speaking and 31 English-speaking subjects. Psychometric analyses of 586 responses to the Spanish version and 19,134 responses to the English version of the H-CAHPS survey tested in Arizona, Maryland, and New York in 2003. STUDY DESIGN: A forward/backward translation procedure followed by committee review and cognitive testing was used to ensure a translation that was both culturally and linguistically appropriate. Responses to the two language versions were compared to evaluate equivalence and assess the reliability and validity of both versions. DATA COLLECTION/EXTRACTION METHODS: Comparative analyses were carried out on the 32 items of the shortened survey version, focusing on 16 items that comprise seven composites representing different aspects of hospital care quality (communication with nurses, communication with doctors, communication about medicines, nursing services, discharge information, pain control, and physical environment); three items that rate the quality of the nursing staff, physician staff, and the hospital overall; one item on intention to recommend the hospital. The other 12 items used in the analyses addressed mainly respondent characteristics. Analyses included item descriptives, correlations, internal consistency reliability of composites, factor analysis, and regression analysis to examine construct validity. PRINCIPAL FINDINGS: Responses to both language versions exhibit similar patterns with respect to item-scale correlations, factor structure, content validity, and the association between each of the seven qualities of care composites with both the hospital rating and intention to recommend the hospital. Internal consistency reliability was slightly, yet significantly lower for the Spanish-language respondents for five of the seven composites, but overall the composites were generally equivalent across language versions. CONCLUSIONS: The results provide preliminary evidence of the equivalence between the Spanish and English versions of H-CAHPS. The translated Spanish version can be used to assess hospital quality of care for Spanish speakers, and compare results across these two language groups.

Adult↗

["My work"--adaptation to work questionnaire].

BACKGROUND: Although the interest in the problem of adaptation to work among psychologists is still growing, there are a few methods for investigating this issue. The present study was undertaken to develop a new instrument for assessing one's adaptation to work and to evaluate the psychometric parameters of the test. MATERIALS AND METHODS: A questionnaire called "My work", based on the person-environment fit theory model, has been elaborated. RESULTS: The questionnaire consists of 23 items, describing various aspects of adaptation to work. The results of a survey, performed on 292 individuals, provided the grounds for testing the validation parameters of the questionnaire. The following psychometric properties were assessed: Cronbach's alpha reliability coefficient (0.92), stability (0.75), and content validity. Preliminary normative values for the test were also established. CONCLUSIONS: The "My work" test shows a good psychometric characteristic and it can be useful for both research work and practical application (as a diagnostic tool).

Adult↗

Thai Short-form McGill Pain Questionnaire.

OBJECTIVE: To validate the Thai Short-Form McGill Pain Questionnaire (Th-SFMPQ). MATERIAL AND METHOD: A postal survey to find the most corresponding terms to those used in the original English short-form McGill Pain Questionnaire had been performed The Thai version was created and validated. Sixty patients who had either musculoskeletal or neuropathic pain were assessed by two interviewers with this Th-SFMPQ. RESULTS: Forty four women and sixteen men participated in this study. Average age was 44.3 +/- 12.8 years and 80% of them had musculoskeletal pain. Means of sensory score was 8.98, affective score was 5.73, total score was 14.71, total count was 7.33, Present Pain Intensity (PPI) was 3.21 and Visual Analog Scale (VAS) was 53.61. Cronbach's a value was 0.7881 and inter-rater validity value of PPI was more than 0.7. The correlation coefficient was quite high (r > 0.8) for all scales. Regarding content validity, three pain descriptors (ie. stabbing, gnawing, and splitting) did not meet 33% in Melzack's criteria. CONCLUSION: The Th-SFMPQ has good internal consistency and inter-rater validity. Three uncommon descriptors should be substituted by other words or discarded in later version.

Adult↗

Psychometric evaluation of a brief geriatric depression screen.

This article is a psychometric evaluation of the experimental Geriatric and Extended Careline Depression Screen (GEDS) for geriatric nursing care residents. The GEDS is a five-item depression screen based on an abbreviated version of the Center for Epidemiological Studies Depression Scale (CES-D). A total sample of 91 male residents over the age of 60 were recruited from a Veterans Administration Nursing Home Care Unit. The Geriatric Depression Scale-Short Form (GDS-SF) was used as a gold standard test to examine the convergent validity of the GEDS. The Discriminant Trait Inventory was used to assess divergent validity and the confounding effects of method variance in this research design. Test-retest reliability, redundance and omission in item content validity were systematically evaluated. A receiver operating characteristics (ROC) curve was used to identify the most effective cut-off score for clinical selection. Reliability was significant, but moderate. Convergent validity with the Geriatric Depression Scale was high. No items were identified as redundant. A review of literature suggested that irritability is an important factor of geriatric depression that had not been included in the original screen. The inclusion of an experimental item to assess irritability, however, did not improve the psychometric properties of the GEDS.

Aged↗

The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions.

OBJECTIVE: To test the feasibility of creating a valid and reliable checklist with the following features: appropriate for assessing both randomised and non-randomised studies; provision of both an overall score for study quality and a profile of scores not only for the quality of reporting, internal validity (bias and confounding) and power, but also for external validity. DESIGN: A pilot version was first developed, based on epidemiological principles, reviews, and existing checklists for randomised studies. Face and content validity were assessed by three experienced reviewers and reliability was determined using two raters assessing 10 randomised and 10 non-randomised studies. Using different raters, the checklist was revised and tested for internal consistency (Kuder-Richardson 20), test-retest and inter-rater reliability (Spearman correlation coefficient and sign rank test; kappa statistics), criterion validity, and respondent burden. MAIN RESULTS: The performance of the checklist improved considerably after revision of a pilot version. The Quality Index had high internal consistency (KR-20: 0.89) as did the subscales apart from external validity (KR-20: 0.54). Test-retest (r 0.88) and inter-rater (r 0.75) reliability of the Quality Index were good. Reliability of the subscales varied from good (bias) to poor (external validity). The Quality Index correlated highly with an existing, established instrument for assessing randomised studies (r 0.90). There was little difference between its performance with non-randomised and with randomised studies. Raters took about 20 minutes to assess each paper (range 10 to 45 minutes). CONCLUSIONS: This study has shown that it is feasible to develop a checklist that can be used to assess the methodological quality not only of randomised controlled trials but also non-randomised studies. It has also shown that it is possible to produce a checklist that provides a profile of the paper, alerting reviewers to its particular methodological strengths and weaknesses. Further work is required to improve the checklist and the training of raters in the assessment of external validity.

Bias↗

Reliability and validity of a modified Colorado Symptom Index in a national homeless sample.

This study examined the reliability and construct validity of a modified version of the Colorado Symptom Index (MCSI), a brief, self-report measure of psychological symptomatology, in a study of interventions to prevent homelessness. Eight projects in a national, cooperative study collected new data at baseline, 6, and 12 months using a set of common measures as well as site-specific instruments. The pooled sample consisted of 1,381 persons in treatment for mental illness or substance abuse (or both), of which 84% had a history of homelessness. The analyses employed classical and Rasch methods to examine the MCSI's content validity, internal consistency and item quality, test/retest reliability, dimensionality, appropriateness for the sample, construct validity, and responsiveness to change. This 14-item scale was found to be a reliable and valid measure of psychological symptoms in this sample. Its content was consistent with other symptom measures, its high internal consistency and test-retest coefficients supported its reliability, its relationships to other measures indicated that it had good construct validity, and it was responsive to change. We conclude that the MC

Adolescent↗

Development of validated disease activity and damage indices for the juvenile idiopathic inflammatory myopathies: I. Physician, parent, and patient global assessments. Juvenile Dermatomyositis Disease Activity Collaborative Study Group.

OBJECTIVE: To determine the reliability, content validity, and responsiveness of physician global assessments of disease activity and damage in the juvenile idiopathic inflammatory myopathies (IIM), and to investigate concordance among physician, parent, and patient global ratings. METHODS: Sixteen pediatric rheumatologists rated 10 juvenile IIM paper patient cases for global disease activity and damage, and assessed the importance of 51 clinical and laboratory parameters in formulating their global assessments. Then, 117 juvenile IIM patients were enrolled in a protocol to examine the relationship between Likert and visual analog scale global assessments, their sensitivity to change, and the comparability of physician, parent, and patient global ratings. RESULTS: Pediatric rheumatologists demonstrated excellent interrater reliability in their global assessments of juvenile IIM disease activity and damage (97.7% and 94.7% agreement among raters, respectively), and agreed on a core set of clinical parameters in formulating their judgments. Likert scale ratings correlated with those on a visual analog scale, and both were comparable in responsiveness (standardized response means -0.56 for disease activity, 0.02 [Likert] and 0.14 [visual analog] for damage, measured over 8 months). Parent global ratings of disease activity correlated with physician assessments, but were not colinear (Spearman's correlation [r] = 0.41-0.45). Patient global disease activity assessments correlated with those done by parents (r = 0.57-0.84) and physicians (r = 0.37-0.63), but demonstrated less responsiveness (standardized response means -0.21 and -0.12, respectively, over 8 months). CONCLUSION: Physician global assessments of juvenile IIM disease activity and damage demonstrated high interrater reliability and were shown to be comprehensive measures. Both physician and parent disease activity assessments should be considered valuable as quantitative measures for evaluating therapeutic responses in juvenile IIM patients.

Arthritis, Juvenile↗

Cultural diversity issues in the development of valid and reliable measures of health status.

The development of instruments for use in culturally diverse settings and populations really involves much more than mere translation. Measurements must be tested for content validity and appropriate meaning among members of the group to be studied. Attention to issues of validity, reliability, and cross-cultural differences will lead to effective assessment, culturally competent health care, and the enhancement of the client/provider relationship. The concerns surrounding the use of quantitative measurement in diverse cultural groups are substantial. While the refinement of scales to meet the needs of various groups is a challenging task, such effort is essential to the diagnosis of disease, determination of health status, and the measurement of health outcomes in the diverse subgroups of this country's population.

Cross-Cultural Comparison↗

The Chinese version of the social problem-solving inventory: some initial results on reliability and validity.

The development of an instrument that measures social problem solving of Chinese adolescents is reported. The Social Problem-Solving Inventory Revised (SPSI-R) was translated to Chinese, and content validity, cultural relevance, and reading level of the translated measure were reviewed by panels of experts. The Chinese version of the scale (C-SPSI-R) was then administered to a sample of 352 junior secondary-school students. Exploratory factor analyses revealed a 5-factor structure that was largely consistent with the structure of the original English-language SPSI-R. The C-SPSI-R and its subscales were found to be internally consistent and temporally stable over time. The scores of the subscales were also correlated with depression scores, a correlation that supported the convergent validity of the subscales. Adolescents with high and low Chinese Beck Depression Inventory scores had significant differences in four out of five subscales of the C-SPSI-R (except Rational Problem-Solving). On the whole, the results supported that the C-SPSI-R is a reliable and valid instrument in the assessment of social problem solving in Chinese adolescents.

Adolescent↗

The Toronto Breast Self-Examination Instrument (TBSEI): its development and reliability and validity data.

The Toronto Breast Self-Examination Instrument (TBSEI) was developed out of the need for a self-administered survey that is reliable and valid. This article describes the development of the TBSEI, its dimensions, and reliability and validity data to support its continued use. To analyze the reliability and validity properties of the three TBSEI scales, we surveyed 729 Toronto, Ontario women. The TBSEI was found to have good face and content validity, internal consistency reliability (0.91, 0.69, 0.85), and test-retest reliability (0.89). Age norms for each of the three scales are also provided. These results are consistent with previous research findings in breast cancer and breast self-examination research.

Adult↗

Behavioral pharmaceutical care scale for measuring pharmacists' activities.

The development and validation of a behavioral pharmaceutical care scale (BPCS) is described. The BPCS items were constructed by conducting an extensive review of the literature on pharmaceutical care and a focus group meeting. To validate the instrument, data were collected from 617 community pharmacists in Florida. Reliability coefficients for the BPCS domains were > 0.70, and the content validity index value for the whole instrument was 0.79. Evidence supporting trait validity of the BPCS was provided by using confirmatory factor analysis to confirm the instrument's dimensionality. Nomologic validity was established by confirming the hypothesis that pharmacists who in a prior survey reported they intend to provide pharmaceutical care would have a significantly higher BPCS score than those who reported they do not intend to provide pharmaceutical care. The behavioral pharmaceutical care scale, developed as a tool for measuring pharmacists' efforts to provide pharmaceutical care, was found to be reliable, sensitive, and valid.

Adult↗

Defining disease activity in ankylosing spondylitis: is a combination of variables (Bath Ankylosing Spondylitis Disease Activity Index) an appropriate instrument?

OBJECTIVE: Disease activity has been defined using a self-administered instrument, focusing on fatigue, axial pain, peripheral pain, enthesopathy and morning stiffness [Bath Ankylosing Spondylitis Disease Activity Index (BASDAI)]. This validated instrument is simple and takes 40 s to complete, but whether the index is an accurate expression of the component parts, or whether additional weighting would enhance its efficacy, is unclear. METHODS: Four hundred and seventy-three patients with ankylosing spondylitis received placebo or active non-steroidal anti-inflammatory drug (NSAID) for 6 weeks, and changes between entry and completion were captured by BASDAI and the individual components. Principle component analysis (PCA) was used to explore the best combinations of variables in decreasing order of explained total dispersion and to assess whether a single sum (or algebraic expression) best defined disease activity status. RESULTS: At entry, the correlation between BASDAI and the first axis was 0.99, 0.11 with the second, and zero thereafter. Data at study end and relating to change revealed a 100% correlation (R = 1) between the first axis and the sum, with zero for the remainder. CONCLUSIONS: The data support BASDAI as being a valid and appropriate composite to define disease activity in ankylosing spondylitis. Developed as a simple sum of its components, BASDAI has excellent content validity.

Aged↗

[Health-related quality of life as an outcome measure].

Objective health measures often correlate poorly with the personal burden of illness. Thus, over recent years, there has been a growing interest in health-related quality of life (QOL) as an outcome measure when evaluating treatment effects and health. Self-report instruments are the most commonly used method for measuring QOL, and estimates of reliability and validity assist the selection of appropriate QOL measures. The primary criteria for evaluating QOL instruments are test-retest reliability, internal consistency, content validity, criteria validity, construct validity and responsiveness. Responsiveness refers to an instrument's sensitivity towards changes in health. Knowledge about the methods used when validating QOL instruments may increase confidence in QOL as a relevant outcome measure in medical science. In the clinical setting, using QOL measures may help patients communicate their problems and help doctors and nurses to identify patients' major concerns.

Humans↗

Structured interviews for assessing children.

Structured interviews provide a valuable means of obtaining and quantifying information about the mental status of children. This review indicates that children can reliably self-report and that the information they provide can concur with the opinion of adults knowledgeable about them. However, considerably more research is warranted before it may be assumed that these interviews are adequately reliable and valid. In general, it appears that the task of documenting the psychometric soundness of these interviews has not been taken seriously, as if content validity were sufficient. For example, except for the CAS and the DISC, there has been little effort to study contrast group validity (i.e. whether the interview even differentiates "known groups"). More specifically, review of the reliability and validity data relevant to DSM-III-R diagnoses provides support for the CAS, DICA, ISC and K-SADS, with the validity data for the DICA being weaker than for the others. One limitation of these data for the DICA, ISC and K-SADS is that the diagnoses were clinician-generated, rather than algorithm-generated. Unfortunately the processes for generating clinical diagnoses were not specified, except for criterion reference to DSM-III-R. The findings for the DISC and the DISC-R are notably weak. There is no evidence for DISC reliability, except for adolescents, and the validity studies have demonstrated only weak relationships. There has been limited study of the psychometric properties of symptom scales. In fact, for two interviews (i.e. DICA and ISC), there are no data available. Reliability for the DISC scales is adequate only for adolescents. Psychometric data have been generated for the CAS and the K-SADS, with considerably more studies conducted with the CAS. The relative paucity of interest in scale scores is striking given that they provide a continuous variable which can indicate extent of symptoms. Other measures of mental status, besides presence/absence of diagnosis, will become increasingly important as research in child psychopathology progresses toward more sophisticated studies (i.e. treatment effects, risk factors). These interviews are labor intensive and costly to the researcher as well as time-consuming and tedious for the children and parents. Given this commitment, researchers should invest in developing other ways of exploiting the richness of the data generated. An example is the CAS "content" scales, which generate scores reflecting on the child's functioning in various areas (e.g. school, friends, family). As the evolution of these interviews continues, it will be important to remain attentive to the developmental limitations of children.(ABSTRACT TRUNCATED AT 400 WORDS)

Adolescent↗