SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20Linked to original sources

PubMed2004

Development and psychometric evaluation of the pediatric anesthesia emergence delirium scale.

BACKGROUND: Emergence delirium has been investigated in several clinical trials. However, no reliable and valid rating scale exists to measure this phenomenon in children. Therefore, the authors developed and evaluated the Pediatric Anesthesia Emergence Delirium (PAED) scale to measure emergence delirium in children. METHODS: A list of scale items that were statements describing the emergence behavior of children was compiled, and the items were evaluated for content validity and statistical significance. Items that satisfied these evaluations comprised the PAED scale. Each item was scored from 1 to 4 (with reverse scoring where applicable), and the scores were summed to obtain a total scale score. The degree of emergence delirium varied directly with the total score. Fifty children were enrolled to determine the reliability and validity of the PAED scale. Scale validity was evaluated using five hypotheses: The PAED scale scores correlated negatively with age and time to awakening and positively with clinical judgment scores and Post Hospital Behavior Questionnaire scores, and were greater after sevoflurane than after halothane. The sensitivity of the scale was also determined. RESULTS: Five of 27 items that satisfied the content validity and statistical analysis became the PAED scale: (1) The child makes eye contact with the caregiver, (2) the child's actions are purposeful, (3) the child is aware of his/her surroundings, (4) the child is restless, and (5) the child is inconsolable. The internal consistency of the PAED scale was 0.89, and the reliability was 0.84 (95% confidence interval, 0.76-0.90). Three hypotheses supported the validity of the scale: The scores correlated negatively with age (r = -0.31, P <0.04) and time to awakening (r = -0.5, P <0.001) and were greater after sevoflurane anesthesia than halothane (P <0.008). The sensitivity was 0.64. CONCLUSIONS: These results support the reliability and validity of the PAED scale.

Anesthesia Recovery Period↗

PubMed2004

[Scale development of job stress for home care nurses].

The purpose of this study was to develop a job stress scale for hospital-based home care nurses in Korea. The process was construction of the conceptual framework, development of the preliminary items, verification of the content validity, item analysis and test of the reliability. The preliminary items were based on literature review and in-depth interviews with home care nurses. As a result, eight categories and sixty items were selected. These were reviewed by seven specialists for content validity and finally fifty one items were chosen. Data was collected from 180 home care nurses who were engaged in 87 hospitals from August to September 2003. The result of item analysis one was excepted. The final item count was 50. Categories were as follows: overload work (8 items), lack of specialized knowledge and technique (5 items), ethical dilemma (4 items), role conflict (5 items), interpersonal relationships (6 items), visiting home environment (9 items), driving conditions (4 items) and lack of administrative support (9 items), The reliability of the scale by Cronbach's alpha was .948 and the domain's reliability ranged from .649 to .841. The result of this study could be used to measure the job stress of home care nurses. However, for further validity and reliability, repeated studies will be necessary.

Adult↗

PubMed1993

Council on Certification Professional Practice Analysis.

The CCNA has completed a PPA and will begin implementing its recommendations with the December 1993 certification examination. The results of the PPA provide content validation for the CCNA certification examination. The certification examination is reflective of the knowledge and skill required for entry-level practice. Assessment of this knowledge is accomplished through the use of questions that are based on the areas represented in the content outline. Analysis of the PPA has resulted in changes in the examination content outline and percentages of questions in each area to reflect current entry-level nurse anesthesia practice. The new outline is based on the major domains of knowledge required for nurse anesthesia practice. These changes are justified by the consistency in the responses of the practitioners surveyed. There was overall agreement as to the knowledge and skills related to patient conditions, procedures, agents, techniques, and equipment that an entry-level CRNA must have to practice. Members of the CCNA and Examination Committee will use the revised outline to develop questions for the certification examination. The questions will be focused on the areas identified as requiring high levels of expertise and those that appeared higher in frequency. The PPA survey will be used as a basis for subsequent content validation studies. It will be revised to reflect new knowledge, technology, and techniques related to nurse anesthesia practice. The CCNA has demonstrated its commitment to the certification process through completion of the PPA and implementation of changes in the structure of the examination.

Certification↗

PubMed1996

Qualitative evaluation of the Canadian Medical Association's counselling guidelines for HIV serologic testing.

OBJECTIVE: To evaluate the face and content validity of the CMA's counselling guidelines for HIV serologic testing in order to prepare a revised edition. DESIGN: Qualitative evaluation by structured focus groups in September and October 1994 to assess the relevance, clarity and practicality of the guidelines, followed by content analysis of the discussions. SETTING: Vancouver, Winnipeg, Toronto, Montreal, Quebec City and St. John's. PARTICIPANTS: Primary care physicians randomly selected from the CMA database and nonrandomly selected from the Canadian Medical Directory who had limited experience with HIV testing and counselling and who provided an appropriate mix of characteristics in terms of practice type (solo and group), setting (urban and rural), age and sex. A total of 1247 physicians were approached for the study; a convenience sample of 68 were recruited, of whom 56 participated. The average size of each focus group was eight physicians. OUTCOME MEASURES: Clinical experience and information sources with respect to HIV testing, reactions to the counselling guidelines, and suggestions for revisions and improvements to the guidelines. RESULTS: Most (96% [54/56] of the participants had ordered HIV serologic testing for patients in the 6 months preceding the focus groups, and about half of them (52% [28/54]) had at least one patient with a positive test result. Many (59% [33/56]) of the participants had a copy of the guidelines at the time of recruitment; 19 (58%) of them had used the guidelines in the months before the focus groups. The parts of the guidelines most often read were the checklists and inset boxes. Recommendations for revisions in content were for more information on legal and ethical issues, information on new issues (e.g., rapid testing) and guidelines on how best to tell a patient about a positive test result; recommendations for revisions in format included more tables, algorithms, bulleted points and white space, less text, larger type and plainer language. CONCLUSIONS: The focus groups provided detailed, credible and consistent information about the face and content validity of the HIV counselling guidelines. They are a useful qualitative method for evaluating the relevance, clarity and practicality of clinical practice guidelines at the inception or revision stage.

AIDS Serodiagnosis↗

PubMedDate not supplied

The constipation assessment scale for pregnancy.

OBJECTIVE: To determine the reliability and validity of the Constipation Assessment Scale (CAS) during pregnancy. DESIGN: Survey. SETTING: The assessment tool was administered first to a group of healthy women of childbearing age in a school of nursing and then to pregnant women in their physicians' offices. PARTICIPANTS: A nonrandom sample of 16 nonpregnant women of childbearing age and 30 women pregnant 28 weeks or longer, 15 of whom had low-risk pregnancies and 15 of whom had high-risk pregnancies. MAIN OUTCOME MEASURES: The test-retest reliability, content validity, and internal consistency of the CAS were determined. RESULTS: An expert panel review found a calculated percentage of agreement for content validity of .75 and a Cohen's kappa of .714. Test-retest reliability based on 16 nursing students yielded high positive correlations ranging from rH = .84 to rH = .92. Internal consistency of the CAS for pregnancy based on the 30 surveys indicated an alpha coefficient of .82. CONCLUSIONS: The CAS for pregnancy was found to be reliable and valid within the context of this study. Future studies designed to identify potential therapeutic interventions for constipation during pregnancy could use the CAS for pregnancy as a measurement instrument.

Adult↗

PubMed2003

The development of a questionnaire to measure the severity of symptoms and the quality of life before and after surgery for stress incontinence.

OBJECTIVES: To develop and validate a short questionnaire recording the severity of symptoms and the quality of life, pre- and post-operatively, in women undergoing surgery for stress incontinence. DESIGN: The questionnaire was designed from previously designed questionnaires and pilot studies. In this study, it was tested for validity and reliability using standard psychometric techniques. Data from the questionnaire are reported to a national database, which generates reports for comparison of surgical procedures, departments and surgeons. SETTING: Tertiary referral urogynaecology units at Baerum and Aker Hospitals, Norway, and 22 Norwegian departments of gynaecology. POPULATION: Fifty and 65 women with stress incontinence from Baerum and Aker hospitals, respectively, and 628 women with stress incontinence from 22 Norwegian departments of gynaecology. METHODS: Stress Incontinence, Urge Incontinence and Quality of Life Indices were constructed. Internal consistency of the indices was measured by Cronbach's alpha and test-retest reliability by Bland-Altman plots. Stress Incontinence Index was tested against stress test and Urge Incontinence Index and Stress Incontinence Index were tested against the 24-hour pad test. Quality of Life Index was tested against a part of the King's College Hospital Quality of Life Questionnaire. MAIN OUTCOME MEASURES: Face and content validity. Missing values of the questionnaire. Reliability and internal consistency. Criterion validity. RESULTS: The 628 women completed a mean of 98.2% of all the questions. The content validity was good. The reliability was good in terms of test-retest reliability and internal consistency. The criterion validity of stress and urge incontinence was tested against the stress and 24 hour pad tests. The correlation between the indices and the objective tests was moderate. The correlation between the Quality of Life Index and the physical and social part of the previously validated King's College Hospital questionnaire was good. CONCLUSIONS: The questionnaire is easy to understand and complete and is a valid and reliable instrument for assessment of the symptoms of incontinence and the quality of life. Pre- and post-operative evaluation of women with stress incontinence was performed in a standardised setting in 22 of the 37 Norwegian departments and the reporting to a national database was successful. Comparison of surgical procedures, departments and surgeons is possible.

Adult↗

PubMed2005

The CLASI (Cutaneous Lupus Erythematosus Disease Area and Severity Index): an outcome instrument for cutaneous lupus erythematosus.

We developed and validated a measurement instrument (CLASI-Cutaneous Lupus Erythematosus Disease Area and Severity Index) for lupus erythematosus that could be used in clinical trials. The instrument has separate scores for damage and activity. A group of seven American Dermato-Rheumatologists and the "American College of Rheumatology Response Criteria Committee on SLE (systemic lupus erythematosus)" assessed content validity. After a preliminary session, we conducted standardized interviews with the raters and made slight changes to the instrument. The final instrument was evaluated by five dermatologists and six residents who scored nine patients to estimate inter- and intra-rater reliability in two sessions. Consultation with experts has established content validity of the instrument. Reliability studies demonstrated an intra-class correlation coefficient (ICC) for inter-rater reliability of 0.86 for the activity score (95% confidence interval (CI) = 0.73-0.99) and of 0.92 for the damage score (95% CI = 0.85-1.00). The Spearman's rho (Sp) for intra-rater reliability for the activity score was 0.96 (95% CI = 0.89 to 1.00) and for the damage score Sp was 0.99 (95% CI = 0.97-1.00). Clinical responsiveness needs to be evaluated in a prospective clinical trial, which is ongoing.

Humans↗

PubMedDate not supplied

Cardiovascular reactivity to psychological challenge: conceptual and measurement considerations.

OBJECTIVE AND METHODS: This article is a selective review of recent findings bearing on the conceptualization and measurement of cardiovascular reactivity to psychological challenge, with a focus on several issues relevant to the reliability, content validity, construct validity, and criterion validity of these measures. RESULTS AND CONCLUSIONS: With respect to reliability, use of standardized task demands and aggregated scores are associated with enhanced short-term reliability, but the long-term reliability of cardiovascular reactivity has not been sufficiently documented. With respect to content validity, existing evidence suggests that "vascular" or "cardiac" tasks may evoke responses that reflect similar distributions of individual difference, whereas associations between responses to "physical" and "psychological" tasks are modest. The evidence is not clear at present with respect to the importance of including affective or interpersonal stimuli as part of trait reactivity assessments. With respect to construct validity, existing data show that cardiovascular reactivity to psychological challenge is largely independent of standard measures of autonomic function. With respect to criterion validity, recent studies point to a number of methodological limitations that may have restricted our ability to detect lab-to-life generalizability of reactivity measures in the past. Continued progress in understanding and measuring reactivity as an individual difference dimension is essential in helping us to evaluate emerging evidence examining the relationship between reactivity and disease risk.

Cardiovascular Diseases↗

PubMed2000

Evaluating patient distress from cancer-related fatigue: an instrument development study.

PURPOSE/OBJECTIVES: To develop a clinically useful and psychometrically sound tool for the measurement of the distress from fatigue in patients with cancer. DESIGN: Instrument development of a numeric rating scale to assess cancer-related fatigue (CRF) distress. SETTING: A comprehensive cancer center and a Veterans Administration hospital. SAMPLE: The interview sample consisted of 17 adults with cancer experiencing CRF. The sample for instrument testing consisted of 221 adults with cancer. Twenty-nine different types of cancers were among the diagnoses. Seventy-eight percent of the participants were receiving some form of cancer treatment. The mean age was 60. METHODS: The Cancer-Related Fatigue Distress Scale (CRFDS) was developed from 23 in-depth audiotaped interviews with patients experiencing CRF. Krippendorff's content analysis procedures were used for interview analysis. Twenty-three items were generated. Five cancer survivors assessed content validity. Factor analysis was used to assess construct validity, and coefficient alpha was used to estimate the reliability of the CRFDS. FINDINGS: Factor analysis resulted in all items loading on one factor, indicating a single scale. The coefficient alpha was 0.98 after the elimination of three items. CONCLUSIONS: The CRFDS has strong content validity, high reliability, and very good construct validity. IMPLICATIONS FOR NURSING PRACTICE: The CRFDS is a clinically useful and psychometrically sound tool for the measurement of CRF distress. This tool is clinically useful because of its brevity (20 items), clear instructions that required no training to use, and a readability score at the third-grade level.

Adult↗

PubMed2006

Psychometric properties of the Fear-Avoidance Beliefs Questionnaire in patients with neck pain.

OBJECTIVES: To translate the Fear-Avoidance Beliefs Questionnaire and investigate the validity and reliability of the Chinese version of the questionnaire in patients with neck pain. DESIGN: Observational cross-sectional and prospective study. SETTING: Physiotherapy outpatient departments. SUBJECTS: Four samples with 476 consecutive adult patients with neck pain from four physiotherapy centres. METHODS: The original questionnaire was translated into Chinese by forward and backward translation and reviewed by a panel of experts. The subjects completed the Chinese version of the fear-avoidance questionnaire, Northwick Park Neck Pain Questionnaire, Medical Outcomes 36-Item Short-Form Health Survey and their pain intensity was measured using an 11-point pain numerical rating scale. They were observed and measured at the beginning of physiotherapy, at week 3 and at week 6 after treatment began. RESULTS: The questionnaire had very good content validity and test-retest reliability with an intraclass correlation coefficient of 0.81 and Cronbach's alpha coefficient of 0.90. Spearman's correlation coefficients between fear-avoidance and the neck pain questionnaire, the health survey (physical), health survey (mental) and pain scale were 0.56, 0.45, 0.36 and 0.34, respectively. The standard response mean and effect size at week 6 were 0.38 and 0.32, respectively. Factor analysis yielded three factors which accounted for 61.6% of the total variance of the questionnaire. CONCLUSION: The Fear-Avoidance Beliefs Questionnaire is a valid and reliable tool for patients with neck pain. It has been shown to demonstrate very good content validity, a high degree of test-retest reliability and internal consistency, good construct validity and medium responsiveness.

Adult↗

PubMedDate not supplied

The Roter Interaction Analysis System (RIAS) in oncological consultations: psychometric properties.

One of the most frequently used systems to analyse doctor-patient communication is the Roter Interaction Analysis System (RIAS). However, it has mostly been applied and evaluated in primary care settings. Two studies are presented in which the psychometric properties of the RIAS are investigated in an oncological setting. In the first study (N = 25) the feasibility, inter-rater reliability and content validity of the RIAS was investigated. In the second study, we evaluated the discriminant validity of the RIAS. Results of the first study showed that coding of tapes was more time consuming than indicated by the Roter manual. The inter-rater reliability proved to be high for both physician communication (0.68-1) and patient communication (0.60-1). The content validity proved to be acceptable: all utterances could be classified. However, coding dilemmas regarding affective communication occurred. The RIAS provided no option to classify communication of a third person present. Some communication categories were never or rarely used. Results of the second study indicate that the RIAS was able to discriminate between communicative behaviors in oncological consultations (N = 60) and three different GP-samples (random-GP sample N = 329, hypertension sample N = 103, gynaecology sample N = 65). To conclude, the psychometric properties of the RIAS are satisfactory in an oncological setting.

Adult↗

PubMed2004

The scale product technique as a means of enhancing the measurement of patient satisfaction.

Measurement of patient satisfaction has long been hampered by two resolvable problems: a lack of content validity in commonly used instruments, and a lack of variability in satisfaction scores when these same instruments are used. Most patient satisfaction instruments have been developed from the perspective of the provider or institution rather than that of the patient, creating a situation of questionable content validity for these measures. Additionally, most patient satisfaction measures yield data that are invariant and consistently positively biased. Both of these problems can be addressed methodologically--through tool development using a qualitative method designed to obtain the patient's perspective, and through the use of the scale product technique to decrease the effect of acquiescence, thereby increasing variability in item responses.

Bias↗

PubMed2003

Reliability and validity of the Dutch version of QUEST 2.0 with users of various types of assistive devices.

PURPOSE: In this paper, the Dutch version of the Quebec User Evaluation of Satisfaction with assistive Technology (D-QUEST) is validated in users of a large variety of assistive devices (n=2002). METHOD: D-QUEST consists of a written questionnaire. The respondent rates his or her satisfaction with respect to 12 aspects on a five-point scale. Users of 10 different types of assistive devices participated. Analyses were performed for each type of assistive device. Reliability is tested by analysing internal consistency. Content validity is tested by analysing applicability of the 12 aspects. The non-applicability option for answering questions is studied. Construct validity is tested by analysing correlations with problem solving and with general satisfaction. RESULTS: Reliability proves to be good for all types of assistive devices. Including the non-applicability option improves the feasibility of the instrument without affecting content validity. Correlations between D-QUEST scores on the one hand and problem solving and general satisfaction questions on the other are as expected, supporting validity. CONCLUSIONS: D-QUEST (and therefore also QUEST) proves itself to be a highly applicable, reliable and valid instrument to assess user-satisfaction of users of all kinds of assistive device provisions.

Adult↗

PubMed2005

Children's Emotional Manifestation Scale: development and testing.

AIMS AND OBJECTIVES: The objectives of this study were to develop an objective and operationalized behavioural observation scale that can be used to document children's emotional responses during stressful medical procedures, and to test the psychometric properties of this newly developed scale. BACKGROUND: The availability of a valid and reliable instrument that accurately documents the manifestation of children's emotions prior to undergoing surgery or during stressful medical procedures is crucial before any intervention can be appropriately planned and evaluated. There is a lack of such an instrument with effective psychometric properties in the literature. DESIGN: A cross-sectional study was employed. A convenience sample of 82 children admitted for day surgery was recruited in this study. METHOD: Based on systematic literature search, a number of observable emotional behaviours with different levels or intensities were identified. A panel of nurse experts was set up to review this finding and develop the scale. Intra-class correlation was used to estimate the inter-rater reliability coefficient. Internal consistency reliability was assessed by determining the Cronbach's alpha. Content validity was established by six nurse experts' ratings. The validity of the scale was also confirmed by convergent validity. RESULTS: The results showed that there was adequate inter-rater reliability, high internal consistency reliability, good content validity and excellent convergent validity. CONCLUSIONS: This study has addressed a gap in the literature by developing an objective tool to document children's emotional responses during stressful medical procedure, which are under-researched in the literature. RELEVANCE TO CLINICAL PRACTICE: The Children's Emotional Manifestation Scale was developed to provide a simple, objective and consistent method for nurses to document children's emotional behaviour during stressful medical procedures. Clinical nurses can also use this scale to evaluate preoperative interventions directed towards minimizing anxiety and bolstering coping mechanisms in children undergoing surgery.

Ambulatory Surgical Procedures↗

PubMed1994

Instruments for assessing the quality of drug studies published in the medical literature.

OBJECTIVES: To develop valid and reliable instruments to assess the methodologic quality and clinical relevance of drug studies. DESIGN: We developed an instrument to assess the methodologic quality of articles reporting clinical research and an instrument to measure nonmethodologic measures of quality, such as clinical relevance, generalizability, and adherence to ethical standards. Each instrument was pretested by seven independent, masked reviewers and modified based on interrater agreement and content validity of individual items. We determined correlational validity of the final methodologic quality instrument by comparing quality scores assigned to 10 articles by means of our instrument and a previously published one. PARTICIPANTS: Clinical drug studies published in symposium proceedings and peer reviewed biomedical literature. MAIN OUTCOME MEASURES: Interrater reliability of overall quality scores, measured by intraclass correlation (r) and Kendall's coefficient of concordance (W), and interrater reliability of individual items, by percentage agreement. MAIN RESULTS: The interrater reliability of the pretest methodologic quality instrument was high (r = .89 [95% confidence interval, .73 to .96]; W = 0.64). Correlational validity of the final instrument was suggested by the high degree of concordance with another previously published one (W = 0.74). The interrater reliability of the pretest clinical relevance instrument was moderate (r = .41 [95% confidence interval, .18 to .64]; W = 0.47). Reviewers confirmed the content validity of both instruments. CONCLUSIONS: The two instruments we developed, one measuring methodologic quality and one measuring clinical relevance of articles reporting clinical research, are reliable, valid, and applicable to a variety of research designs.

Drug Evaluation↗

PubMed2006

[Development of a critical thinking disposition scale for nursing students].

PURPOSE: The purpose of this study was to develop a critical thinking disposition scale for nursing students. METHOD: The developmental process was construction of a conceptual framework, development of preliminary items, verification of content validity, development of secondary items, verification of construct validity and extraction of final items. The conceptual framework and first preliminary 60 items were obtained through a review of relevant literature and the development of critical disposition scales by 10 researchers who had been studying critical thinking for one year. These items were reviewed by five specialists for content validity and finally 55 items were chosen. The data was collected from October 1 to 15, 2004 and was analyzed using factor analysis and Cronbach's alpha with the SPSS program. The subjects were composed of 560 Bachelor of Science nursing students from 8 nursing schools. RESULT: There were 35 final items which were sorted into 8 factors. The factors were identified as 'intellectual integrity(6 items)', 'creativity(4 items)', 'challenge(6 items)', 'open-mindedness(3 items)', 'prudence(4 items)', 'objectivity(4 items)', 'truth seeking(3 items)' and 'inquisitiveness(5 items)'. The cumulative percent of variance was 55.107%. The reliability of the scale, Cronbach's alpha was .892 and the factors' ranged from .562-.836. CONCLUSION: The result of this study could be used for measuring critical thinking dispositions of nursing students. However, for further validity and reliability, repeated research is necessary.

Adult↗

PubMed2003

International use of health status questionnaires in Parkinson's disease: translation is not enough.

The present study assessed the linguistic and content validity of the Swedish version of the 39-item Parkinson's disease questionnaire (PDQ-39). The frame question, response alternatives and two of the 39 items yielded substantial linguistic and stylistic problems. Such shortcomings would be expected to influence responses to, and the quality of, the whole questionnaire. Data support content validity of the PDQ-39 as a functional health status questionnaire, although some shortcomings were identified. This preliminary study illustrates the need for documented linguistic validity before new language adaptations of patient-reported outcome measures can be considered suitable for use in clinical trials, research, and practice.

Aged↗

PubMed1999

The psychometric properties of the diabetes management self-efficacy scale for patients with type 2 diabetes mellitus.

This article summarizes the development and validation of a scale to measure the level of self-efficacy of patients with type 2 diabetes mellitus. Self-efficacy is described as people's belief in their capability to organize and execute the course of action required to deal with prospective situations. This self-efficacy scale was developed based on the self-care activities these patients have to carry out in order to manage their diabetes. The following psychometric properties of this scale were established: content validity, construct validity, internal consistency and stability. The original scale contained 42 items. A panel of five experts in diabetes and four self-efficacy experts evaluated the original scale two times for relevance and clarity. This content validity procedure resulted in a final scale which consisted of 20 items. Subsequently, patients with type 2 diabetes were asked to complete this 20-item scale and further tests were done with the 94 usable responses. Factor analysis identified four factors, all of which were related to clusters of self-care activities used to manage diabetes which comprised this scale. The internal consistency of the total scale was alpha=0.81 and the test-retest reliability with a 5-week time interval was r=0.79 (P < 0.001).

Adult↗