SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25Linked to original sources

PubMedDate not supplied

The development of a nurse stress checklist from English to Chinese version.

Work stress has been identified as a relevant problem in the field of professional nursing. Many instruments measuring nurse work stress have already been developed in the United States. The Nurse Stress Checklist (NSC), a Likert-type questionnaire with 47 items, was selected for adaptation into the Chinese language from among these instruments, following a literature review and a comparison with the author's personal nursing experiences. The processes of developing the validity of an NSC Chinese version--content validity, concurrent validity, and construct validity--were conducted. In this pilot study, 13 Chinese nurses who had previously worked in the United States and who were fluent in both Chinese and English filled out the NSC in both the Chinese and English versions. Pearson's correlation was performed to build up concurrent validity. Next, 138 Chinese nurses were randomly selected from three medical centers in Taiwan to be participants in the major study. They filled out the NSC in the Chinese version, and a factor analysis was used to build up construct validity. Four factors were extracted: nonproductive reactions, satisfactory responses, professional concerns, and falling behind. A comparison was made of these four factors with the five factors of the NSC in the English version.

Adult↗

PubMed1988

The development and validation of a scale measuring effective clinical teaching behaviors.

The purpose of this methodological study was to describe the development and validation of an instrument that would measure effective clinical teaching behaviors of nursing faculty. Two hundred eighty-one nursing students evaluated their clinical instructors using a 43-item Likert scale entitled "Effective Teaching Clinical Behaviors" (ETCB), and data were used to test the validity and reliability of the instrument. Content validity of the scale is adequately documented, and factor analysis suggests that the tool is measuring one major factor, "effective clinical teaching behaviors." Internal consistency and test-retest reliability coefficients achieved satisfactory standards for reliability. Alternate scales reliability coefficient was also satisfactory. The ETCB fills a void in the instrumentation available for clinical instructors. Since students are the direct recipients of instruction, it seems imperative that a valid and reliable scale be available for them to evaluate their instruction.

Evaluation Studies as Topic↗

PubMed2001

Development of a brief, self-administered instrument for assessing sleep knowledge in medical education: "the ASKME Survey".

STUDY OBJECTIVES: This report describes the construction and validation of a brief self-administered scale to assess sleep knowledge in medical education ("ASKME Survey"). Few measures of this type have been developed previously; none have been validated or widely adopted. The current instrument was designed as a standardized assessment measure for use in medical education in sleep. DESIGN: Instrument was developed in four phases: initial item selection, expert panel review, reliability and construct validity assessment, and final item selection. Content validity was assessed in six general domains: basic sleep principles; circadian sleep/wake regulation; normal sleep architecture; sleep disorders; effects of drugs and alcohol on sleep; and sleep in medical disorders. SETTING: N/A. PARTICIPANTS: Medical students at Robert Wood Johnson Medical School (RWJMS) and University of Kentucky College of Medicine; students in clinical psychology, nursing and other health-related professions at Rutgers University; school nurses at Texas Christian University; practicing physicians; accredited sleep specialists. INTERVENTIONS: N/A. MEASUREMENTS AND RESULTS: Individual item analysis of 30-item survey demonstrated a high degree of discriminant validity. Internal consistency for test items was relatively high (KR-20=0.89). Overall mean percentage correct was highest for accredited sleep specialists (85.3%+/-10.8%) and lowest for school nurses (53.1%+/-13.7%). Significant group differences were observed across all question categories (p < 0.0001). Medical students scored significantly higher than the nurses on questions related to sleep architecture (59.5% vs. 42.5%) and narcolepsy (36.4% vs. 21.3%). CONCLUSIONS: "ASKME" demonstrates a high degree of internal consistency and reliability among survey items. It discriminates between samples with varied levels of education, experience, and specialty training. The survey is currently available via the American Academy of Sleep Medicine website (http://www.aasmnet.org).

Attitude to Health↗

PubMed1993

Exploring the validity of data-gathering instruments.

The validity of an instrument is another important issue for the clinician to consider when selecting a tool for use in data collection. Broadly defined, validity refers to the extent to which an instrument measures what it is supposed to be measuring. Although validity is a unitary concept, this article explores three common categories of validity: content, criterion-related, and construct validity.

Data Collection↗

PubMed2005

Does blueprint publication affect students' perception of validity of the evaluation process?

CONTEXT: A major goal of any evaluation is to demonstrate content validity, which considers both curricular content as well as the ability expected of learners. Whether evaluation blueprints should be published and the degree of blueprint transparency is controversial. OBJECTIVES: To examine the effect of blueprint publication on students' perceptions of the validity of the evaluation process. METHODS: This study examined students' attitudes towards the Renal Course evaluation before and after blueprint publication. There was no significant change in the course objectives, blueprint or evaluation between the two time periods. Students' attitudes were evaluated using a questionnaire containing four items related to evaluation. Also collected were the overall course ratings, minimum performance level (MPL) for evaluations and students' performance on each exam. RESULTS: There were no significant differences in the MPL or evaluation scores between the two time periods. A significantly greater proportion of students perceived that the Renal Course evaluation was a fair test and was reflective of both important subject matter and the delivered curriculum. The increased satisfaction process did not appear to be a reflection of their overall satisfaction with the course as there was a trend towards reduced overall satisfaction with the course. CONCLUSIONS: Publication of the evaluation blueprint appears to improve students' perceptions of the validity of the evaluation process. Further studies are required to identify the reasons for this attitude change. We propose that blueprint transparency drives both instructors teaching and student learning towards key educational elements.

Alberta↗

PubMed1998

Contraceptive knowledge: development of a valid measure and survey of pill users and general practioners.

AIMS: To design, pilot, and validate a questionnaire to test contraceptive knowledge in combined oral contraceptive pill users. METHOD: To ensure face and content validity the questionnaire was developed using existing unvalidated instruments and in consultation with GPs, local and national family planning experts, and with pill users. The questionnaire was then piloted with 15 current oral contraceptive pill users and 10 local GPs, modified, and a contraceptive knowledge 'score' developed. Construct validity-that the degree of family planning training should predict contraceptive knowledge-was tested in four groups: family planning trainers (n=28), GPs (n=40), current pill users (n=53), and male medical students (n=59). Thirty current pill users were sent the questionnaire after two weeks to determine test-retest reliability. RESULTS: The questionnaire showed construct validity: there was a gradient of scores across the four knowledge groups. Family planning trainers had the highest scores, followed by GPs, and current pill users, with male medical students having the lowest scores (Kruskal-Wallis test p<0.001). Women had good knowledge of situations when pill efficacy is reduced but poorer knowledge of what action to take subsequently. Predictors of knowledge in pill users were educational level, age, and the importance attached to not falling pregnant-thus providing further evidence for the construct validity of the questionnaire. Test-retest reliability was good (rank correlation 0. 73). CONCLUSION: A contraceptive knowledge questionnaire suitable for use in audit or research has been developed which is reliable and has face, content and construct validity. Pill users have poor knowledge of what to do in situations of pill failure and about the details of emergency contraception. Trials are needed to assess the effectiveness of different strategies to improve contraceptive knowledge in women.

Adult↗

PubMedDate not supplied

Review and analysis of evaluation measures used in nutrition education intervention research.

The purpose of this review is to provide a summary of the kinds of evaluation measures used in 265 nutrition education intervention studies conducted between 1980 and 1999 and an analysis of psychometric issues arising from such a review. The data are summarized in terms of tables for interventions with each of six key population groups: preschool children, school-aged children, adults, pregnant women and breast-feeding promotion, older adults, and inservice preparation of professionals and paraprofessionals. Measures evaluating knowledge and skills or behavioral capabilities were most widely used in studies with preschool, school-aged, and inservice populations (50%-85%) and less widely used in studies with the other groups, particularly breast-feeding promotion (5%). Measures of potential psychosocial mediators or correlates of behavior such as outcome expectancies, self-efficacy, or behavioral intention were used in 90% of behaviorally focused studies with school-aged children and in about 20% of studies with adults. Dietary intake measures were used in almost all studies, primarily food recalls, records, and quantitative food frequency questionnaires. Short frequency instruments involving only foods targeted in the intervention such as fruits and vegetables are increasingly being used. Measures of specific observable behaviors are also increasingly being used. Physiologic parameters were used in about 33% of behaviorally focused interventions with school-aged children and adults, 20% with older adults, and 65% with pregnant women and/or their infants. Criterion validity of newly developed intake instruments and content validity of instruments measuring mediating variables were reported in the majority (range 50%-90%) of studies. Reliability and stability of measures of mediating variables were reported in 50% to 75% of studies, with reliability coefficients mostly about .6 to .7. Two major conclusions from this review are that evaluation measures should be appropriate to the purpose, duration, and power of the intervention and that measures should have adequate validity and reliability in relation to both the outcomes and characteristics of the target audience. Major implications are that considerable preliminary work needs to be done before any intervention study to develop and test evaluation instruments so that they are appropriate and have adequate psychometric properties, and cognitive testing of published instruments with each new target audience is essential. We will then be better able to make judgments about the effectiveness of nutrition education.

Adolescent↗

PubMed2000

Development of a three-centre simultaneous objective structured clinical examination.

OBJECTIVE: To describe the development, organization, implementation and evaluation of a yearly multicentre, identical and simultaneous objective structured clinical examination (OSCE). SUBJECTS: All fifth-year medical students in a 6-year undergraduate medical programme. SETTING: The Christchurch, Dunedin and Wellington Schools of Medicine of the University of Otago, New Zealand. METHOD: One practice and two full 18-station OSCEs have been completed over 2 years, for up to 72 students per centre, in three centres. The process of development and logistics is described. Data are presented on validity, reliability and fairness. RESULTS: Face and content validity were established. Internal consistency was 0.83-0. 86 and interexaminer reliability, as assessed by the coefficient of correlation, averaged 0.78. Students rated the OSCE highly on relevance. Of the total variance in total OSCE marks, the schools contributed 6.9%, and the students 93.1%, in the first year. In the second year the schools contributed 6.2% and the students 93.8%. CONCLUSION: Implementation of a psychometrically sound, multicentre, simultaneous and identical OSCE is possible with a low level of interschool variation.

Clinical Competence↗

PubMed2006

A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study.

OBJECTIVE: Resuscitation of critically ill patients requires medical knowledge, clinical skills, and nonmedical skills, or crisis resource management (CRM) skills. There is currently no gold standard for evaluation of CRM performance. The primary objective was to examine the use of high-fidelity simulation as a medium to evaluate CRM performance. Since no gold standard for measuring performance exists, the secondary objective was the validation of a measuring instrument for CRM performance-the Ottawa Crisis Resource Management Global Rating Scale (or Ottawa GRS). DESIGN: First- and third-year residents participated in two simulator scenarios, recreating emergencies seen in acute care settings. Three raters then evaluated resident performance using edited video recordings of simulator performance. SETTING: A Canadian university tertiary hospital. INTERVENTIONS: : The Ottawa GRS was used, which provides a 7-point Likert scale for performance in five categories of CRM and an overall performance score. MEASUREMENTS AND MAIN RESULTS: Construct validity was measured on the basis of content validity, response process, internal structure, and response to other variables. One variable measured in this study was the level of training. A t-test analysis of Ottawa GRS scores was conducted to examine response to the variable of level of training. Intraclass correlation coefficient scores were used to measure interrater reliability for both scenarios. Thirty-two first-year and 28 third-year residents participated in the study. Third-year residents produced higher mean scores for overall CRM performance than first-year residents (p < .0001) and in all individual categories within the Ottawa GRS (p = .0019 to p < .0001). This difference was noted for both scenarios and for each individual rater (p = .0061 to p < .0001). No statistically significant difference in resident scores was observed between scenarios. Intraclass correlation coefficient scores of .59 and .61 were obtained for scenarios 1 and 2, respectively. CONCLUSIONS: Data obtained using the Ottawa GRS in measuring CRM performance during high-fidelity simulation scenarios support evidence of construct validity. Data also indicate the presence of acceptable interrater reliability when using the Ottawa GRS.

Adult↗

PubMedDate not supplied

Pain: clinical validation with postoperative heart surgery patients.

PROBLEM: To estimate the content validity of the nursing diagnosis of pain in postoperative heart surgery patients. METHODS: Observation of and interviews with postoperative heart surgery patients (N = 80), 40 experiencing pain and 40 without pain. FINDINGS: The group experiencing pain had statistically different results from the group without pain, with a higher frequency in the following 19 defining characteristics: verbal report of pain, discomfort, fear of reinjury, sleep disturbance, guarding behavior, distraction behavior, irritability, restlessness, facial mask of pain, increased heart rate, immobility, anxiety, loss of appetite, self-focus, withdrawal, impaired thought process, unusual posture, increased blood pressure, and changes in respiratory patterns. CONCLUSIONS: These defining characteristics support the idea that pain is a complex phenomenon of clinical interest to nursing that needs better understanding. Studies using the same defining characteristics in other sample groups of patients with acute and chronic pain might be useful in the refinement of this nursing diagnosis.

Adult↗

PubMed1991

Essential gerontological content for the associate degree nursing curriculum. A national study.

1. The growing number of associate degree registered nurses caring for the elderly underscores the need for gerontological nursing preparation within associate degree programs. 2. The curriculum content validity theory of Taba and Zoot requires content selection criteria to reflect the relationship of course content to program outcomes. 3. Appropriateness of gerontological content for associate degree nursing was defined by the five practice roles of the associate degree nurse. 4. Gerontological nursing content rated essential by nationwide panels of associate degree nursing educators and practicing nurses includes items within the areas of commonly encountered health problems, ethical issues, chronic illness, long-term care of older adults, and nursing process.

Aged↗

PubMed2006

The validation process of incorporating simulation-based accreditation into the anesthesiology Israeli national board exams.

BACKGROUND: The Israeli Board of Anesthesiology Examination Committee added a simulation-based Objective Structured Clinical Evaluation component to the board examination process. This addition was made in order to evaluate medical competence and considers certain domains that contribute to professionalism. This unique and new process needed to be validated. OBJECTIVES: To validate and evaluate the reliability and realism of incorporating simulation-based OSCE into the Israeli Board Examination in Anesthesia. METHODS: Validation was performed before the exam regarding Content Validity using the modified Delphi technique by members of the Task Force of the Israeli Board Examination Committee in Anesthesiology. RESULTS: The examination has been administered six times in the past 3 years to a total of 145 examinees. The pass rate ranged from 62% (trauma) to 91% (regional anesthesia). The mean inter-rater correlations for the total score (all items), for the Critical checklist items score, and for the Global (General) rating were 0.89, 0.86 and 0.76, respectively. The inter-correlations between the five OSCE stations scores were significant (P< 0.01) only between Trauma & Ventilation for the Total score (r = 0.32, n=63), and between Resuscitation & Regional and OR-crisis for the Global score (r = 0.42 and 0.27, n=64 and 104, respectively). The correlation between the OSCE examination score and the success rate at each of the eight different clinical domains of the oral board examination did not reach statistical significance. Most participants (70-90%) found the difficulty level of the examination stations reasonable to very easy. All major errors, which were identified in the initial two exam periods, disappeared later in the next two exam periods. CONCLUSIONS: The exam has gradually progressed from being an optional part of the oral board examination to a prerequisite component of this test. Other anesthesiology programs or medical professions can adopt the model described here.

Accreditation↗

PubMed1997

[Methodological challenges in measurements of functional ability in gerontological research].

This article addresses the advantages and disadvantages of different methods in measuring functional ability with its main focus on frame of reference, operationalization, practical procedure, validity, discriminatory power, and responsiveness. When measuring functional ability it is recommended: 1) Always to consider the theoretical frame of reference as part of the validation process. 2) Always to assess the content validity of items before they are combined into an index and before performing tests for construct validity. 3) Not to combine mobility, PADL and IADL in the same index/scale. 4) Not to use IADL as a health-related functional ability measure or, if used, to ask whether problems with IADL or non-performance of IADL are caused by health-related factors. 5) Always to analyse functional ability separately for men and women. 6) To exclude the dead in analyses of change in functional ability if the focus is on predictors of deterioration in functional ability.

Activities of Daily Living↗

PubMed2001

Assessing depression in Russian psychiatric patients: validity of MMPI and Rorschach.

We tested the criterion, concurrent, and content validity of depression indicators in 180 Russian psychiatric patients. Indicators from the Exner Rorschach (DEPI, CDI) and the Russian MMPI (Berezin Scale 2, Wiggins depression content) were compared to Hamilton (HRSD) scores and 3 types of diagnosis: traditional Russian, contemporary Western (ICD-10), and a mixed version. The MMPI scales had significant associations with each other and each criterion. The Rorschach indexes were unrelated to all other variables, even when their affective, cognitive, and interpersonal components were analyzed separately, response styles were taken into account, or the 2 indexes were used in combination. Nevertheless, sample means on 107 variables were roughly similar to Exner's norms. The study represents an initial step towards establishing the validity of instruments commonly used in Russia and North America for assessing depression among Russians.

Catchment Area, Health↗

PubMedDate not supplied

[Self-rating scales in schizophrenia: validity assessment of the Paranoid-Depression Scale (PD-S), the Frankfurt Self-feeling Scale (FBS) and of two visual analogy scales].

AIM: To assess the validity of the Paranoid-Depressivity Scale (PD-S, Paranoid-Depresivitäts-Skala), the Frankfurt Self-feeling Scale (FBS, Frankfurter Befindlichkeitsskala), and of two visual analogy scales: the Sense of Illness Scale (WAC) and the Self-feeling Scale (WAS). METHOD: 210 patients with schizophrenia of various clinical courses. Diagnostic validity was evaluated by comparing the results of self-rating with clinical assessment using the CGI, KOSS-C, BPRS, and KOSS-W scales. Content validity was evaluated by analysis of the results' correlation with given clinical and social-demographic variables. Theoretical (construct) validity was evaluated through factorial analysis with Varimax rotation of the principal elements. RESULTS: The correlation between the self-rating scales and the clinical assessment scales was moderate in the case of questionnaire scales and low for the visual analogy scales. Scales of a similar type were found to correlate to a very high degree. Correlation with clinical assessment depended significantly on the phase and degree of disorder--it was lower in periods of exacerbation and higher during remission. The results of the complex questionnaire scales en somme, correlate better with symptoms considered as typical for schizophrenia, than with others, whereas the isolated self-rating constructs (paranoid, depressive) correlate well with the appropriate dimensions of clinical assessment. There was no significant correlation between the clinical symptoms and dimensions, and the results of self-rating using the two visual analogy scales. Factorial analysis revealed that the internal structure of the basic constructs of the questionnaire scales (general attitude, mood, self-feeling) was based on a very rational concept, as well as the fact that the factors isolated have a rational foundation within the theoretical and clinical picture of schizophrenic disorders. CONCLUSIONS: The validity of self-rating scales remains a complex question; analysis of diagnostic, content and theoretical validity seems to confine this method to the role of a complementary, albeit interesting, diagnostic tool; the extent and importance of this role, however, is still to be investigated.

Adult↗

PubMed2005

Psychometric validation of a monitoring-blunting measure for social anxiety disorder: the coping styles questionnaire for social situations (CSQSS).

The purpose of this investigation was to conduct a psychometric validation of the Coping Styles Questionnaire for Social Situations (CSQSS). The CSQSS was developed to measure monitoring and blunting coping styles in social situations based on Miller's conceptualization of how individuals cope with threat-related information. Study 1 evaluated the content validity of the CSQSS monitoring and blunting items. Study 2 examined factor structure, reliability, and construct validity of the CSQSS in a sample of 443 college students. Evidence supported the content and face validity of the CSQSS. In addition, an exploratory factor analysis revealed a two-factor solution consistent with the monitoring and blunting constructs. Both monitoring and blunting scores were positively correlated with measures of social anxiety, with blunting having a stronger relationship. Moreover, individuals with high social anxiety engaged in a significantly higher degree of monitoring and blunting than did individuals with low social anxiety. Taken together, these results provide support for the reliability and validity of the CSQSS. The CSQSS may serve as a useful measure for further examination of monitoring and blunting coping styles in a social anxiety disorder sample.

Adaptation, Psychological↗

PubMed2003

Development of the Key Behaviors Change Inventory: a traumatic brain injury behavioral outcome assessment instrument.

OBJECTIVE: To describe the development and initial validation of a neurobehavioral outcome measure, the Key Behaviors Change Inventory (KBCI), for individuals with traumatic brain injury (TBI). DESIGN: Scale construction and development, and validity study. SETTING: Large state university and postal survey. PARTICIPANTS: Seventy-five volunteer undergraduate students and 25 volunteer collateral informants of individuals with TBI participated in the item-analysis phase. Thirty members of the Brain Injury Association and 20 members of the National Multiple Sclerosis Society rated both an identified patient and an age- and gender-equated control in the validation phase. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Content validity was examined through expert panel item sorts. Scale internal consistencies were examined with the Cronbach alpha. Construct validity was examined by comparing scale elevations between controls and 2 neurologic groups. RESULTS: Item-analysis procedures resulted in 8 scales of 8 items each: inattention, impulsivity, unawareness of problems, apathy, interpersonal difficulties, communication problems, somatic difficulties, and emotional adjustment. Internal consistency reliability coefficients ranged from.82 to.91. Multivariate analysis of variance revealed significant (P</=.001) differences in scale elevations among TBI, multiple sclerosis (MS), and control groups. The TBI and MS groups scored significantly higher than the control group on all scales; a subset of KBCI scales discriminated between the 2 neurologic groups. CONCLUSION: The KBCI was both sensitive and specific to typical behavioral changes after TBI, thus supporting its usefulness in rehabilitation settings. Cross-validation and development of a normative database are future steps necessary in its development.

Adaptation, Psychological↗

PubMed2001

Individual differences in the phenomenological impact of social stigma.

In an attempt to define stigmatization from the perspective of stigmatized group members, the author focused on the development and validation of a stigmatization scale. The scale's content validity was established with the assistance of experts in the field. European American, African American, and Native American students from 5 different U.S. universities completed the Stigmatization Scale. The construct validity of the scale was suggested by its convergence with similar measures of social alienation and its divergence from measures of personal subjective well-being. The finding that both the African American and Native American students reported significantly higher stigmatization scores than did the European Americans indicated the scale's known-groups validity. African American students at a predominantly Black university reported lower stigmatization than did African American students at a predominantly White university, suggesting the scale's malleability to context.

Adult↗