PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17Linked to original sources

The use of goal attainment scaling in a geriatric care setting.

OBJECTIVE: Goal attainment scaling (GAS) is a measurement approach used extensively in mental health. It accommodates multiple individual patient goals, yet retains mathematical properties allowing comparisons between patients. This study was carried out to investigate the feasibility and measurement properties of GAS in a geriatric care setting. DESIGN: Prospective descriptive study. SETTING: The geriatric restorative care service and geriatric assessment unit at Camp Hill Hospital, a 350-bed tertiary care facility in Halifax, Canada. PATIENTS: Fifteen patients aged 65 to 94 who were consecutively admitted to the two geriatric services (mean age 79 years, mean length of stay 37 days, 9 females). INTERVENTION: Goal Attainment follow-up guides were developed independently for each patient by two geriatricians after a comprehensive assessment of the patient. These guides were later compared to assess level of agreement in goal setting and scale development. A single goal attainment follow-up guide was then developed for each patient by consensus of the two geriatricians. At the end of the follow-up, the guides were scored independently for each patient by one of the geriatricians and by the patient's primary care nurse. MAIN OUTCOME MEASURES: GAS scores were determined on admission and discharge. Each patient also received admission and discharge ratings on the Barthel Index as well as a global rating of outcome (on a subjective 10-point scale) by a geriatrician who was blinded to the Goal Attainment follow-up score. RESULTS: GAS proved feasible, requiring 15-20 minutes to scale an average of six goals per patient. GAS also appears reliable. Of 87 goals, 71 (82%) were identified independently by two geriatricians, and the remainder were determined by consensus. This is also a measure of content validity. The physician-nurse inter-rater reliability was 0.87 (intraclass correlation). Concurrent validity was assessed by correlation with the Barthel Index (r = 0.86) and the global clinical outcome rating (r = 0.82). Content validity was also assessed by comparing our goal areas with those identified in recent consensus reports on geriatric assessment. Of these 13 assessment areas, 12 appeared to be reasonably well covered while one assessment area (sexual problems) was not identified for any of the 15 patients. CONCLUSIONS: GAS appears to be a feasible method of goal setting and outcome evaluation in geriatric care settings, with promising reliability and validity.

Activities of Daily Living↗

Evolving a blueprint for certification: the responsibilities and knowledge comprising American professional oncology nursing practice.

Ensuring adequate content validity of a certification examination is a major concern in the development and administration of a test. To establish content validity of the Oncology Nursing Certification Corporation (ONCC) certification exam, a job analysis study was conducted to provide empirical data about the responsibilities and knowledge areas required for practice at the level of the newly certified oncology nurse. The study involved The Profession of Oncology Nursing: An Inventory of Responsibilities and Knowledge (IRKPON), a questionnaire that was developed based on a review of the literature, professional practice information, interviews with oncology nurses, the original ONCC certification exam table of specifications, and evaluations undertaken by two advisory committees. The IRKPON consisted of three parts: 56 responsibilities clustered into eight job dimensions, 217 knowledge areas grouped into seven knowledge dimensions, and demographic information. The IRKPON was sent to a stratified random sample of 3,000 oncology nurses in the United States, who were asked to rate both the responsibilities and knowledge areas by level of importance. The 1,297 (43%) responding nurses rated 45 of 56 responsibilities (80.4%) as "very important" and 8 of 56 responsibilities (14.3%) as "extremely important"; they also rated 163 of 217 knowledge areas (75.1%) as "very important" and 41 of 217 knowledge areas (18.9%) as "extremely important." These findings identified the specific responsibilities most important to the oncology nurse role at the level of the newly certified nurse, as well as the knowledge areas necessary for competent performance. Subsequent ONCC certification examinations were modified; the test blueprint that guides the construction of the examination was revised, and the passing score was adjusted.

Adult↗

The evolution of an ambulatory nursing intensity system: measuring nursing workload in a day hospital setting.

OBJECTIVE: To establish a methodology for developing a user-friendly, environmentally specific nursing intensity measurement tool. BACKGROUND: Nursing intensity measurement systems assess the demand for nursing care in a given setting and must adapt to changes in technology, patient populations, and treatment profiles. Nowhere is this more evident than in a clinical research setting where demands for nursing care are driven by changing patient populations and new biomedical research protocols. This article traces the extension of an adult oncology ambulatory nursing intensity system at the Clinical Center, National Institutes of Health, into 3 day hospitals: medical surgical, pediatrics, and hematology/oncology. METHODS: A team of stakeholders including nurse managers, clinical nurse specialists, and senior clinical research nurses was assembled. Descriptions of clinical research care for each day hospital were developed and organized into 6 levels with their associated time frames. Descriptions were reviewed by 2 content specialists, and a content validity index quantified the extent of their agreement. A weighted kappa statistic was used to measure interrater reliability. RESULTS: A content validity index of .87 indicated a high level of agreement between specialists. The weighted kappa statistic was .80, demonstrating substantial agreement between 2 raters. CONCLUSION: This ambulatory nursing intensity tool proved to be adaptable to heterogeneous patient populations.

Day Care, Medical↗

Development and preliminary validation of a systemic lupus erythematosus-specific quality-of-life instrument (SLEQOL).

OBJECTIVES: Systemic lupus erythematosus (SLE), a chronic illness with an unpredictable and variable course, profoundly affects the quality of life (QOL). General health questionnaires are used to assess QOL in SLE, but a disease-specific instrument could offer enhanced responsiveness and content validity. We detail the steps we took to develop and validate a new SLE-specific QOL instrument, SLEQOL. METHODS: Rheumatology professionals nominated items that they felt were important determinants of QOL of SLE patients. One hundred SLE patients were asked to assess the importance and frequency of occurrence of these items and to suggest those that had not been listed. Item reduction was performed using Rasch model and factor analyses to create a new questionnaire in English. This final questionnaire was administered to a cohort of 275 patients to study its psychometric properties. RESULTS: Fifty-one items covering a wide range of QOL concerns were identified. The patients' responses led to the elimination of 11. The new questionnaire of 40 items was found to have Cronbach's alpha of 0.95 and to consist of eight domains covering physical, mental and social QOL issues. It has good test-retest reliability, poor to fair cross-sectional correlation with the SF-36, with poor correlation with lupus activity or damage indices. The SLEQOL was more responsive to change than the SF-36. CONCLUSIONS: We have developed a new 40-item SLEQOL in English and showed that it is valid for use in SLE patients in Singapore. It offers better content validity and responsiveness to change than the SF-36.

Activities of Daily Living↗

Psychometrics of a Chinese translation of the swallowing questionnaire.

AIMS OF THE STUDY: The purpose of this study was to determine the psychometric properties of a Chinese version of a swallowing questionnaire. BACKGROUND/RATIONALE: Impaired swallowing may lead to serious complications if health care professionals do not accurately assess the problem and promptly intervene. The recognition of symptoms indicative of a swallowing problem is essential for nurses. The swallowing questionnaire could provide nurses with a valid instrument to assess patients' impaired swallowing. DESIGNS/METHODS: Phase I consisted of experts doing the initial translation into Chinese and back-translations of the questionnaire. Five experts then determined content validity of the Chinese version, and 35 bilingual subjects determined equivalence of the Chinese translation and English version. Phase II determined concurrent validity and internal consistency using 113 screened medical patients as subjects. Phase III used 105 screened long-term care subjects to determine construct validity. RESULTS/FINDINGS: In Phase I, rating on the appropriateness of items on the Chinese version yielding a content validity index of 0.988. The coefficient of equivalence between the Chinese and English versions of the instrument was 0.81, while per cent agreement for all items on the two versions ranged from 0.80--1.00. Phase II established internal consistency with a K-R20 of 0.74, and concurrent validity yielded a correlation between the swallowing questionnaire and the neurological swallowing exam of 0.675 (P < 0.01). Phase III determined construct validity with significant positive correlations found between the swallowing questionnaire and stroke history and masticatory ability. Significant negative correlations were found between swallowing and cognitive status, functional status and albumin. CONCLUSIONS: Although useful as a tool for nursing assessment and intervention, further work on the swallowing questionnaire such as conducting video fluoroscopy and a swallowing speed test, are recommended to further validate its accuracy.

Activities of Daily Living↗

Testing a Swedish version of OCAIRS on two different patient groups.

Occupational Case Analysis Interview and Rating Scale (OCAIRS) is an instrument for assessing occupational performance. Consisting of a semi-structured interview and a rating scale, OCAIRS is based on the Model of Human Occupation (Kielhofner 1985) and has been translated into Swedish. The rater reliability of the Swedish version (OCAIRS-S) was tested on two different populations: acute psychiatric in-patients and patients suffering from chronic muscular pain. The Intraclass Correlation Coefficient and the Percentage Agreement methods were used to calculate the strength of agreement between raters. Content validity was tested using the Percentage Agreement method. Research results indicate that the instrument has a reasonable rater reliability. Although the content validity study produced insufficient information, it nevertheless supports the use of OCAIRS-S as a reliable instrument. Further research and development on the instrument is recommended.

Evaluation Studies as Topic↗

Validity and community-health-nursing sensitivity of six outcomes for community health nursing with older clients.

A survey research design was used to assess the importance, sensitivity to nursing interventions, and content validity of six client outcomes from the Nursing Outcomes Classification (NOC)). Outcomes relevant for elderly community residents and caregivers were included in a questionnaire mailed to American Nurses Credentialing Center-certified expert community health nurses. Two hundred thirty-nine experts rated specific indicators of the six outcomes for their importance in determining the outcomes and the contribution of nursing to their achievement. Outcomes also were rated for their importance for community health nursing clients and responsiveness to community health nursing intervention. Results strongly support the content validity and nursing sensitivity of outcomes and specific indicators. Experts judged all six outcomes to be important and 90% of indicators as important in determining the outcome. All outcomes and 78% of indicators were judged to be responsive to community health nursing intervention. Recommendations include the testing of NOC outcomes in community health nursing clinical practice and inclusion in community health nursing curricula. Areas for further research include development and validation of community-level outcomes, validation of outcomes with rural and home health nursing experts, and exploration of the community health nursing-sensitivity of one study outcome.

Activities of Daily Living↗

Assessment of practicing family physicians: comparison of observation in a multiple-station examination using standardized patients with observation of consultations in daily practice.

PURPOSE: Looking for a valid, reliable, and feasible method to collect data on the performances of practicing family physicians, the authors compare the measurement characteristics of a multiple-station examination (MSE) using standardized patients with those of a video assessment of regular consultations in daily practice (practice video assessment, PVA). METHOD: In a cross-sectional study, consultations of 90 family physicians were videotaped both in an MSE and in their daily practices. Peer-observers used a validated instrument (MAAS-Global) to assess the physicians' communication with patients and their medical performances. The physicians were randomly divided into two groups, comparable for demographic characteristics, and half underwent the assessments in reverse order to test for time-order effects. Content validity, criterion validity, reliability, and feasibility of the two methods were compared. RESULTS: Content validity of the PVA was superior to that of the MSE, since the domain of general family practice care was better covered. Observed participants judged the videotaped practice consultations to be "natural," whereas hardly any family physician, after reviewing the videotaped consultations of the MSE, recognized his or her usual working style. Specific criteria made it possible to standardize real practice. Concerning criterion validity, only the medical-performance components of the two methods correlated. No correlation was found for the communication components. Real-practice performance proved to be less influenced by observation than was performance during the MSE. The reliabilities of the two methods, expected to be better in the controlled MSE, were comparable. The administration of the PVA was more flexible, less costly, and better accepted by the family physicians than was that of the MSE. CONCLUSION: Assessment for quality improvement of family physicians' practices by video observation in daily practice is superior to video assessment in a simulated setting using standardized patients.

Adult↗

Social consequences of long term impairments and disabilities: conceptual approach and assessment of handicap.

OBJECTIVES: To present a conceptual model of disablement adapted from the WHO model and to conduct a pilot study with a measurement tool (LIFE-H) of the concepts of life habits and handicap situations. DESIGN: Content validity and test-retest reliability study. SETTING: General community. PARTICIPANTS: A panel of 12 experts of rehabilitation for the process of content validity and 49 individuals with spinal cord disorders (adults and children) for the reliability study. OUTCOMES MEASURES: a person's life habits (activities of daily living and social roles). RESULTS: The LIFE-H questionnaire was designed to assess the handicap situations observed in daily life of individuals with disability. The experts concluded that the LIFE-H items covered most of a person's life habits (ADL and social roles) and that it could be used to determine the appearance of handicap situations. The LIFE-H total score showed a good level of reliability for the children and the adult samples (ICC = 0.73 and 0.74, respectively). Taken individually, a majority of life habit categories have shown a moderate to high reliability level (ICC > or = 0.50) while a few life habit categories such as the interpersonal relationship or nutrition showed a lower reliability level. CONCLUSION: The development of LIFE-H allows fulfillment of the need to determine the disruptions in life habits of persons with disabilities.

Activities of Daily Living↗

Development of the thirst distress scale.

This article describes the development of a 6-item instrument that measures thirst distress. Items were developed following open-ended interviews with 10 subjects, a literature review, and development of a conceptual definition of thirst. A panel of experts established content validity. A convenience sample (N = 247) of adults receiving outpatient hemodialysis completed the scale. A panel of experts was used to assess content validity. Item analysis was used to select unrelated or redundant items for deletion. Cronbach's alpha was .78. Construct validity was supported by confirmatory and exploratory factor analysis. Positive relationships between thirst distress and, respectively, thirst intensity and interdialytic weight gain provided additional evidence of construct validity. Overall, these preliminary data indicate that the thirst distress scale has sufficient reliability and validity for use in clinical studies.

Adult↗

Measuring leader perceptions of school readiness for reforms: use of an iterative model combining classical and Rasch methods.

This study examines validity of data generated by the School Readiness for Reforms: Leader Questionnaire (SRR-LQ) using an iterative procedure that combines classical and Rasch rating scale analysis. Following content-validation and pilot-testing, principal axis factor extraction and promax rotation of factors yielded a five factor structure consistent with the content-validated subscales of the original instrument. Factors were identified based on inspection of pattern and structure coefficients. The rotated factor pattern, inter-factor correlations, convergent validity coefficients, and Cronbach's alpha reliability estimates supported the hypothesized construct properties. To further examine unidimensionality and efficacy of the rating scale structures, item-level data from each factor-defined subscale were subjected to analysis with the Rasch rating scale model. Data-to-model fit statistics and separation reliability for items and persons met acceptable criteria. Rating scale results suggested consistency of expected and observed step difficulties in rating categories, and correspondence of step calibrations with increases in the underlying variables. The combined approach yielded more comprehensive diagnostic information on the quality of the five SRR-LQ subscales; further research is continuing.

Calibration↗

A study of the reliability and validity of the Chinese version of the Dementia Rating Scale.

BACKGROUND: The present study aims to develop and validate a Chinese version of the Dementia Rating Scale (DRS) for use with Chinese populations in psychogeriatric settings. METHODS: The DRS was translated into Chinese and its content validity was evaluated by an 11-member expert panel. To assess reliability and concurrent validity, 52 subjects with dementia were recruited from medical and psychogeriatric settings using purposive sampling. RESULTS: With percentage of agreement as an indicator, 28 out of 36 items (78%) had satisfactory content validity. Items with a percentage of agreement below 70% were reviewed and modified, based on the comments of the experts. The CDRS had excellent test-retest and inter-rater reliability, with intraclass correlation coefficient (ICC) at 0.94 and 0.93 respectively. Intraclass correlation coefficients ranged between 0.75 and 0.89 for the subscales. The internal consistency of the CDRS subscale, as measured by Cronbach's a, ranged from 0.57 to 0.82. The CDRS had high correlations with the Chinese Mini-mental State Examination (r = 0.80 for total score, r = 0.58 to 0.84 for subscales. CONCLUSIONS: The CDRS is a valid instrument for the assessment of dementia in Chinese-speaking subjects.

Aged↗

Reliability, validity, and responsiveness of the simple shoulder test: psychometric properties by age and injury type.

The purpose of this study was to measure the reliability, validity, and responsiveness of the Simple Shoulder Test (SST) scale and to examine these in patients stratified by age and injury type. Test-retest reliability, content validity, criterion validity, construct validity, and responsiveness were determined for the SST. The study population comprised 1077 patients with shoulder instability and rotator cuff injuries, ranging in age from 14 to 85 years. The SST demonstrated acceptable test-retest reliability (intraclass correlation coefficient >0.90) and content validity (floor and ceiling effects <10%). Correlations with the physical functioning component of the Short Form 12 were significant (r = 0.439, P < .05); however, the correlations were not significant when stratified by age group (>60 years) (r = 0.271, P = .349) and injury type (rotator cuff injury) (r = 0.337, P = .085). Correlations with the American Shoulder and Elbow Surgeons were also significant (r = 0.807, P < .001). The construct validity of the SST was acceptable, with all 8 hypotheses demonstrating significance (P < .05). The SST was responsive to change (effect size, 0.81; standardized response mean, 0.81). However, there were differences after stratification for age group and injury type. The SST demonstrated overall acceptable psychometric performance; however, differences were found when data were stratified by age and injury type.

Adolescent↗

Development and validation of a clinical index for assessment of long-term damage in juvenile idiopathic arthritis.

OBJECTIVE: To develop and validate a clinical measure of articular and extraarticular damage in patients with juvenile idiopathic arthritis (JIA). METHODS: The Juvenile Arthritis Damage Index (JADI), which is derived from physical examination and a brief review of the patient's clinical history, is composed of 2 parts: assessments of articular damage (JADI-A) and extraarticular damage (JADI-E). Instrument validation was accomplished by evaluating 158 JIA patients with disease duration of at least 5 years, seen consecutively over 21 months. The instrument's feasibility, face and content validity, construct and discriminative ability, internal consistency, and interrater reliability were examined. RESULTS: Among the 158 JIA patients, 47% and 37% had articular and extraarticular damage, respectively. The JADI was found to be feasible and to possess both face and content validity. The JADI-A score correlated highly with the number of joints with limited range of motion (Spearman's r [r(S)] = 0.72) and correlated moderately with the Childhood Health Assessment Questionnaire score (r(S) = 0.41), Steinbrocker functional classification (r(S) = 0.50), and Poznanski's score of radiographic damage (r(S) = -0.54), thereby demonstrating good construct validity. Correlations with the JADI-E score were lower, owing to the heterogeneity of its items. The JADI-A discriminated well among different levels of disability. The internal consistency (Chronbach's alpha) of the JADI-A and JADI-E was 0.93 and 0.59, respectively. The intraclass correlation coefficients between pairs of independent observers ranged from 0.85 to 0.97. CONCLUSION: The JADI exhibited good reliability, construct validity, and discriminative ability and is therefore a valid instrument for the assessment of long-term damage in patients with JIA, in the context of both clinical management and research settings.

Arthritis, Juvenile↗

[The critical appraisal of QOL questionnaire for prostate cancer patients].

BACKGROUND: Prostate cancer is a common malignancy that affects Japanese elderly men. Its incidence is increasing, recently, and its treatments are various. The measurement of quality of life (QOL) has become important for the evaluation of and selection of treatments. In Japan, however, there is no standard way of measuring QOL for prostate cancer patients, except the Japanese version of the EORTC QOL questionnaire for prostate cancer patients. We examined the validity and feasibility of this translated EORTC QOL questionnaire for prostate cancer patients. METHODS: Sixty-nine prostate cancer patients who were under treatment in 4 hospitals were selected for this study. We applied the content validity, the factorial validity which was analyzed by the oblique principal component cluster analysis, the internal consistency analyzed by the alpha coefficient of Cronbach, the convergent validity which was used GHQ, IPSS and PS as external measures, and the feasibility. RESULTS: This questionnaire showed good internal consistency, as the alpha coefficient was 0.61 to 0.90 in all domains, except for sex life, which was the lowest. This questionnaire was classified into 7 clusters by the oblique principal component cluster analysis. Consequently, the factorial validity was good, except for items regarding sex life. As domains correlate well with external measures except in sex life, the convergent validity was good. It was suggested that only two items were not acceptable in regard to the content validity and the feasibility, and that the translation into Japanese of 2 items was inadequate. CONCLUSIONS: Our study suggests that the Japanese version of the EORTC QOL questionnaire for prostate cancer patients demands improvement for the practical employment in clinical trials, as there is a problem of translation and feasibility.

Aged↗

Adaptation and validation of the parent-child conflict tactics scale for use in Sri Lanka.

OBJECTIVE: The purpose of the study was to validate the Parent-Child Conflict Tactics Scale (CTSPC) in Sri Lanka, for use with 12-year old children. DESIGN: A Delphi Process determined the consensual and content validity of the CTSPC. Test-retest reliability and internal consistency were determined by a large and a small group administration. SETTING: Professionals from the social and behavioural sciences were the judges in the Delphi Process. Conveniently located schools in the Gampaha District were chosen for determining the test-retest reliability and internal consistency. MEASUREMENTS: This included original CTSPC and its Sinhala translation, a structured interview schedule and a focus group guide. RESULTS: The Sinhala version of the CTSPC showed adequate consensual and content validity. Its test-retest reliability and internal consistency were satisfactory. The instrument is best administered in small rather than in large groups of children. CONCLUSION: The Sinhala version of the CTSPC is appropriate to be used with 12-year old Sinhala speaking schoolchildren in Sri Lanka.

Adult↗

Selection and use of content experts for instrument development.

Content experts frequently are used in the judgment-quantification stage of content validation of instruments. However, errors in instrumentation may arise when important steps in selecting and using these experts are not carefully planned. The systematic process of choosing, orienting, and using content experts in the judgment-qualification stage of instrument development is addressed, with particular attention to the often neglected, important step of familiarizing these experts with the conceptual underpinnings and measurement model of the instrument. An example using experts to validate content for a measure of caregiver burden is used to illustrate this stage of instrument review.

Bias↗

[Development of a tool for evaluating conflict management and sexual negotiation: a contribution to the fight against HIV/AIDS among women].

The development and validation process of the Video Rating Scale of Conflict Management and Sexual Negotiation (EAVI) is presented. This instrument was developed as a response to the growing incidence of HIV/AIDS infection among heterosexual women and recognizes the need to evaluate prevention efforts that focus on the development of sexual negotiation skills. EAVI was used to evaluate taped simulations of couples negotiating safer sex. Content validity and reliability analysis were performed. Overall, the scale has a content validity score of .90 and a reliability of 75%. The validity and reliability of specific subscales was low thus suggesting a need for revision. Suggestions are provided for improving the measure and examples of its actual usefulness in academic and community settings are presented.

Acquired Immunodeficiency Syndrome↗