PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18Linked to original sources

Patient perspective on quality of geriatric care and rehabilitation--development and psychometric testing of a questionnaire.

The aim was to develop and test a questionnaire for use in telephone interviews concerning patient evaluation of geriatric care and rehabilitation. Instrument development was performed comprising qualitative interviews, construction of items, content validation, pilot study and data collection for evaluation of care and rehabilitation, clinical utility, reliability and construct validity. Qualitative interviews were performed with 12 elderly participants. The qualitative interviews formed the basis for the construction of 45 items. An expert panel performed a content validation of the questionnaire resulting in a revised version. A pilot study comprised 29 participants recently discharged from geriatric wards and the main data collection comprised 221 participants. Inclusion criteria were being able to perform a telephone interview and willingness to participate. Clinical utility was examined through questions to the interviewers, answered in writing. Cronbach's alpha coefficient was 0.79. According to a factor analysis and the evaluation of clinical utility, the underlying dimensions of the final revised questionnaire concern 'Respect and safety', 'Information and participation' and 'Rehabilitation interventions', scored in 18 items. In addition, one global item concerns satisfaction with care, resulting in 19 items in total. The revised questionnaire was named PaPeR, Patient Perspective on care and Rehabilitation. The questionnaire is considered valid, reliable and judged to have good clinical utility. The time consumption for the telephone interview is about 10-20 minutes. The questionnaire is useful in defining areas for potential quality improvement in geriatric wards.

Aged↗

Development of a new seizure severity questionnaire: initial reliability and validity testing.

PURPOSE: This report describes the initial steps for development of a new scale to assess seizure severity as a treatment response. METHODS: Standard methodology was used to develop the test instrument. Item generation was performed by selecting items from other questionnaires, and asking patients and epileptologists about seizure components. Face and content validity were assessed in a pilot study with patients and observers. The questionnaire was formatted as a structured interview for a reliability study. Construct validity was assessed with three existing questionnaires. Inter-rater reliability and test-retest reliability were performed as two independent ratings on one day, and one re-interview. RESULTS: Based on item generation and pilot testing (33 patients, 28 observers), the Seizure Severity Questionnaire (SSQ) was organized into warning, activity-movement, and recovery (cognitive, emotional, and physical aspects) stages of seizures. Questions reviewed duration, severity, bothersomeness and overall ratings, and the most bothersome aspect of seizures. The mean SSQ Summary Score was 5.78+/-3.24, inter-rater reliability was 0.76 (N=91), and test-retest reliability was 0.74 (N=63). Construct validity showed statistically significant correlations with other scales. CONCLUSION: This study has explored the psychometric properties of the SSQ for face and content validity, inter-rater and test-retest reliability, and construct validity. The Summary Score reliably represents the major components of seizures.

Adult↗

Faculty and student perceptions of effective classroom teaching in nursing.

The purpose of this three-stage study was to identify and validate constructs which students use in differentiating among teachers. In stage I, six theoretical constructs thought to be involved in teaching effectiveness were identified; these were revised through a faculty content validity study. In stage II, a known-groups validity study, all items and constructs were found to be used by students in differentiating between good and poor teachers. In stage III, students' ratings of current teachers were collected and factor analyzed. Two factors, individualized prescriptive approach and systematic theoretical presentation, were identified. An analogy was drawn between these factors and elements of nursing process. The category structure which had been derived through the faculty content validity study was not supported.

Connecticut↗

Functional capacity evaluation as a performance measure: evidence for a new approach for clients with chronic back pain.

OBJECTIVES: To report the research and development of a new approach to Functional Capacity Evaluation, the Gibson Approach to Functional Capacity Evaluation (GAPP FCE) for chronic back pain clients. METHODS: Four studies, including pilot and feasibility testing, expert review, and preliminary interrater reliability examination, are described here. Participants included 7 healthy young adults and 19 rehabilitation clients with back pain who underwent assessment using the GAPP FCE. Thirteen therapists were trained in the approach and were silently observed administering the Functional Capacity Evaluations by at least 1 other trained therapists or the first investigator or both. An expert review using 5 expert occupational therapists was also conducted. RESULTS: Study 1, the pilot with healthy individuals, indicated that the GAPP FCE was a feasible approach with good utility. Study 2, a pilot using 2 trained therapists assessing 5 back pain clients, supported the clinical feasibility of the approach. The expert review in Study 3 found support for GAPP FCE. Study 4, a trial of the approach with 14 rehabilitation clients, found support for the interrater reliability of recommendations for return to work based on performance in the GAPP FCE. DISCUSSION: The evidence thus far available supports the GAPP FCE as an approach that provides a sound method for evaluating the performance of the physical demands of work with clients with chronic back pain. The tool has been shown to have good face and content validity, to meet acceptable test standards, and to have reasonable interrater reliability. Further research is occurring to look at a larger interrater reliability study, to further examine content validity, and to examine predictive validity.

Adult↗

A fluidity scale for evaluating the motor strategy of the rise-to-walk task after stroke.

OBJECTIVE: (1) To develop an ordinal scale (content validity) for assessing fluidity of the rise-to-walk task (RTW); (2) to examine the concurrent validity of the fluidity scale; (3) to study the inter-rater reliability of the scale. DESIGN: A group of physical therapists participated in the scale development (content validity); a cross-sectional design was used to study the agreement between the fluidity scale and the fluidity index (criterion measure) obtained with the instrumented method (concurrent validity) and to examine the inter-rater reliability of the scale. SETTING: Rehabilitation centre. SUBJECTS: Nineteen persons with a chronic stroke and 19 age- and gender-matched healthy subjects. MAIN OUTCOME MEASURES: For the validation study: the fluidity index (FI) and the scores from the fluidity scale; for the inter-rater reliability study: duration of the RTW task and fluidity scores. RESULTS: The FI values did not overlap across categories of the scale and the relationship between FI values and the fluidity scores was 0.99. The weighted kappa (kappa(w)) indicated a substantial level of agreement between the new raters (kappa(w) = 0.78) and between the new raters and the expert rater (kappa(w) = 0.71). Corresponding mean intraclass correlation coefficients for the RTW duration were 0.95. CONCLUSION: These results indicate that the descriptors of the scale provided a gradation of fluidity comparable to the gold standard measure (FI) and that trained clinicians can use the fluidity scale with a substantial level of reliability. The RTW task is a simple clinical tool for assessing mobility and motor strategies (locomotor co-ordination) in patients presenting varying degrees of motor recovery after stroke.

Case-Control Studies↗

Assessing the psychometric and language equivalency of the Chinese versions of the Index of Nausea, Vomiting and Retching, and the Prenatal Self-Evaluation Questionnaire.

This study was an initial psychometric test of the Chinese versions of the Index of Nausea, Vomiting and Retching (INVR), and the Prenatal Self-Evaluation Questionnaire (PSEQ) in pregnant Taiwanese women. Although there already is evidence that the English-language versions of the scales are reliable and valid, it is important to verify the proper psychometric characteristics of the Chinese versions. Forward and backward translation, and a multiphase instrumentation study describing internal consistency, test-retest reliability, and content validity of the translated versions were conducted. A convenience sample was recruited from prenatal clinics in the south of Taiwan. Three measurement instruments were used in this study: the demographic inventory (DI), the INVR, and the PSEQ. Thirty pregnant women participated in the study. Both the internal consistency and stability coefficients of the INVR and PSEQ were satisfactory. The indices of content validity (CVI) for the Chinese versions of these two instruments were both 1.0, indicating that they are acceptable for use among Taiwanese pregnant women. This was the first instrumentation study of the INVR and PSEQ applied to Taiwanese pregnant women. Researchers could use this study as a model for future translation and application of psychometric instrumentation.

Adaptation, Psychological↗

Assessing the reliability and validity of the Chinese version of the California Critical Thinking Disposition Inventory.

The purpose of this study was to: (1) translate the California Critical Thinking Disposition Inventory (CCTDI) from English to Chinese; (2) ascertain the reliability and validity of Chinese CCTDI; and (3) assess the psychometric equivalencies across Chinese and English versions of the CCTDI. The CCTDI was designed to measure critical thinking dispositions of truth-seeking, open-mindedness, analyticity, systematicity, inquisitiveness, self-confidence and maturity, which has been approved with a significant difference from prior conceptualizations of critical thinking dispositions. It is the only measurement that has been validated to measure critical thinking disposition and is appropriate for use in nursing. Based on translation theory, the comparative study goal precisely matched with the strategy of decentered translation. The CCTDI was translated in multiple stages and back translated by a panel of bilingual experts. Content validity index (CVI) ranged from 0.50 to 0.80, with an overall CVI of 0.85. Pearson r ranged from 0.33 to 0.79, with an overall correlation of 0.79, indicating that evidence for stability in truth-seeking, open-mindedness and self-confidence existed. To ascertain internal consistency reliability and construct validity, monolingual samples were obtained from 214 and 196 undergraduate nursing students from Taiwan and the USA, respectively. For the Chinese CCTDI, subscale alphas ranged from 0.34 to 0.73, with an overall alpha of 0.71. For the English CCTDI, subscale alphas ranging from 0.52 to 0.73 and an overall alpha of 0.71 were obtained. In terms of a confirmatory factor analysis with LInear Structural RELationships (LISREL), the results indicate that evidence for construct validity existed for truth-seeking, open-mindedness, systematicity, and maturity for the Chinese CCTDI. After allowing some error to exist and deleting three items, evidence for construct validity existed for the remaining subscales. The results of the psychometric equivalencies across Chinese and English CCTDI showed similarity for content validity and reliability for inquisitiveness. In terms of multisample analysis, there were equal forms across all subscales of the two versions. Consequently, although the translation adequacy of the Chinese CCTDI needs to be improved, there is evidence that it is useful for evaluating critical thinking dispositions.

California↗

Expert review of an approach to functional capacity evaluation.

Functional capacity evaluation (FCE) is a widely used tool in work rehabilitation, despite the limited examination of the soundness of its measurement properties. This paper outlines the development of a new approach to FCE, the GAPP FCE, and reports on the findings of an expert review of aspects of its content validity and technical adequacy and how it meets established test criteria. Five expert occupational therapists reviewed the materials of the GAPP FCE then completed a questionnaire related to the content validity, technical adequacy and safety, reliability, validity, practicality and utility of the GAPP FCE. The experts gave support to most aspects of these criteria. The main issue identified by the review was related to interpretation and extrapolation of the FCE results for return to work. This and other issues are discussed in relation to recent developments in FCE and plans for future development of the GAPP FCE.

Humans↗

Use of a virtual reality, real-time, simulation model for the training of urologists in transurethral resection of the prostate.

OBJECTIVE: There is a growing need to develop surgical skills outside the operating theatre. In this study we describe the development of a virtual reality training system for practising transurethral resection of the prostate (TURP). MATERIAL AND METHODS: A face validity study was performed using a questionnaire sent to 28 experienced urologists to find out the ideal characteristics of a simulated TURP. Based on the comments a simulator was constructed and a content validity study was then performed in which nine experienced urologists tested the simulator and answered a second questionnaire. After corrections to the simulator, a basic construct validity test was performed. RESULTS: We have developed a computer-based simulator based on the requirements listed by 17 urologists. It consists of a modified resectoscope connected to a haptic device and supported by a frame. The software provides a virtual view of the prostatic lumen and resectoscope tip, a haptic rendering that generates force feedback and a simulation module that computes the information from the haptic device, resectoscope fluid tap and handle and the foot pedals. The software also simulates bleeding, absorption of irrigation fluid and pressure gradients. Variables are measured and presented in a result file after each "operation". Nine experienced urologists performed a content validity study and changes were made accordingly. A basic construct validity test performed by seven inexperienced students showed a significant improvement in performance after they each performed six simulated procedures. CONCLUSION: We have developed a simulator that may be used to practise TURP and which meets most of the demands raised in a face validity study. A basic construct validity test showed improved performance after repeated practice in the simulated environment.

Computer Simulation↗

Development and preliminary validation of the questionnaire on pediatric gastrointestinal symptoms to assess functional gastrointestinal disorders in children and adolescents.

OBJECTIVE: The aim of this study was to develop a questionnaire assessing symptoms associated with pediatric functional gastrointestinal disorders (FGIDs) and to provide preliminary evidence for its validity and reliability in a tertiary care setting. METHODS: The Questionnaire on Pediatric Gastrointestinal Symptoms (QPGS) was designed as both a parent report and child self-report measure based on the pediatric Rome II criteria for FGIDs. It was constructed in English, translated into French, and pilot tested in both languages. Initial validation was performed using the French version. Participants were 315 consecutive new patients aged 4 to 18, and their parents, presenting to a gastroenterology clinic and classified as having a functional problem. Content validity, item discrimination capacity, and reliability (parent-child concordance and temporal stability) were examined. RESULTS: Analyses of parent and child reports indicated that all items were pertinent and variably distributed. Although children were reliable reporters, up to 42% of parents did not know about their children's gastrointestinal functioning. As many as 60% of parents of children 10 to 18 could not respond to questions about defecation and subjective symptoms. Concordance was generally fair to good, with Kappas and intraclass correlations of 0.40 to 0.70 on most items. Test-retest reliability was moderate to good for the majority of items. CONCLUSION: This study supports the content validity of the QPGS. Form A is a reliable measure for parents of children 4 to 9 years old, but the child self-report Form C appears to be more reliable for 10 to 18 year olds.

Adolescent↗

Validation of the WHO Quality of Life assessment instrument (WHOQOL-100) in a population of Dutch adult psychiatric outpatients.

BACKGROUND: Research concerning the psychometric properties of the WHO Quality of Life Assessment Instrument (WHOQOL-100) in general populations of psychiatric outpatients has not been performed systematically. AIMS: To examine the content validity, construct validity, and reliability of the WHOQOL-100 in a general population of Dutch adult psychiatric outpatients. METHOD: A total of 533 psychiatric outpatients entered the study (438 randomly selected, 85 internally referred). Participants completed self-administered questionnaires for measuring quality of life (WHOQOL-100), psychopathological symptoms (SCL-90), and perceived social support (PSSS). In addition, they underwent two semi-structured interviews in order to obtain Axis-I and Axis-II diagnoses, according to DSM-IV. RESULTS: The drop-out percentage was low (7.1%). Of the 24 facets of the WHOQOL-100, 22 had a good distribution of scores, leaving out the facets physical environment and transport. Exploratory factor analysis revealed a four-factor structure, which was similar to earlier findings in patients with specific somatic diseases and depressive disorders. Various-a priori expected-positive and negative correlations were found between facets and domains of the WHOQOL-100, and dimensions of the SCL-90 and the PSSS-score, indicating good construct validity of the WHOQOL-100. The internal consistency of all facets and the four domains of the WHOQOL-100 was good (Cronbach's alpha's ranging from 0.62 to 0.93 and 0.64 to 0.84, respectively). Sparse and relatively low correlations were found between demographic characteristics (age and sex) and WHOQOL-100 scores. CONCLUSIONS: Content validity, construct validity, and reliability of the WHOQOL-100 in a population of adult Dutch psychiatric outpatients are good. The WHOQOL-100 appears to be a suitable instrument for measuring quality of life in adult psychiatric outpatients.

Adult↗

The community integration measure: development and preliminary validation.

OBJECTIVE: To present a new measure of community integration, the Community Integration Measure (CIM), and to offer preliminary information about its psychometric properties. DESIGN: Validation study. SETTING: Community. PARTICIPANTS: Ninety-two participants placed in 3 subgroups (brain injury survivors, n = 41; significant others, n = 36; college students, n = 15). MAIN OUTCOME MEASURES: The distributional properties, factor structure, internal consistency reliability, content validity, discriminant validity, concurrent validity, and construct validity of the CIM. RESULTS: All items correlated positively with each other and with the total score. Principal components factor analysis confirmed a 1-factor structure, which explained 44.1% of the variance. Internal consistency reliability, using Cronbach's alpha, was.87. Content validity was assured by the development procedure, correspondence with the theoretical model, and direct use of consumer language. Discriminant validity was supported by the CIM's ability to differentiate between subsamples. Criterion validity was supported by using correlations with the Community Integration Questionnaire. Construct validity was supported by correlations with the Interpersonal Support Evaluation List. CONCLUSION: The CIM offers a brief, easily administered measure of community integration that conforms to an empirically derived theoretical model and is psychometrically sound.

Activities of Daily Living↗

Psychometric evaluation of the Demands of Immigration Scale with Taiwanese-Chinese immigrants: a pilot study.

BACKGROUND: Each year thousands of people move across national borders and become immigrants of another country. They face several demands and sources of distress during resettlement. The Demands of Immigration (DI) Scale developed by Aroian et al. (1998), is the only instrument available to nurses (and other clinicians and researchers) to measure immigration-specific distress. This scale, however, is written in English and has only been tested with former Soviet immigrants in the Boston area of United States of America (USA) for psychometrics. AIM: This instrumentation pilot study is designed to evaluate the readability and psychometric properties of the Chinese version of the DI Scale. INSTRUMENT: This selected scale is a 23-item, 6-point Liket type scale. Six dimensions are included: loss, novelty, occupation adjustment, language accommodation, discriminations, and not feeling at home. High scores indicate high levels of distress related to the demands of immigration. METHODS: The study uses a descriptive, cross-sectional design with a multimethod approach. Seventy-three Taiwanese-Chinese immigrants (> or = 18 years) in the USA responded to the scale and a demographic questionnaire. Eighteen of them contributed to the interview data that were collected for assessing content validity of the scale. Observations during the interviews and participants' questions were also documented for the evaluation. Scale format, wording of items, distribution of responses, internal consistency, test-retest reliability, content validity, and construct validity are examined. FINDINGS AND CONCLUSION: Analyses suggest that the Chinese version is easy to read and understand. The internal consistency and test-retest reliability are satisfactory. This scale could be used with Taiwanese-Chinese immigrants as a generic measure of immigration-related distress. Nonetheless, three main problems with its use with Taiwanese-Chinese immigrants and Chinese immigrants at large are revealed in the study. Each problem is discussed. Suggestions for further development of the Chinese DI Scale are addressed.

Adult↗

Bone up on osteoporosis. Development of the Facts on Osteoporosis Quiz.

PURPOSE: To describe the development of an instrument to measure women's knowledge of osteoporosis based on Orem's self-care theory and the latest clinical research on osteoporosis. SAMPLE: One hundred and four women from four groups including graduate and undergraduate nursing students, sociology students, and a community sample, completed the instrument. METHODS: Items for the instrument were developed from three objectives related to osteoporosis risk factors, known facts and preventive behaviors. There were 34 items on the original instrument. It was content validated by experts and subjected to item analysis. The report contains a copy of the instrument with the theoretical classification and item analysis. FINDINGS: The Facts on Osteoporosis Quiz had a content validity index of .92, a reliability of .83 and a reading level of sixth grade. Item difficulty and item discrimination were used to delete items. The final instrument contains 25 items. CONCLUSION: The quiz is a simple, inexpensive measure that can be used in various settings by nurses to assess women's knowledge of self-care in osteoporosis.

Aged↗

The development of a tool to audit the safety policies and practices of community sports clubs.

Despite increased national effort directed at sports injury prevention in Australia since the mid 1990s, there is a lack of information available about the sports safety policies and practices of community sports clubs. The aim of this study was to develop a valid and reliable sports safety audit tool (SSAT) to identify these safety policies and practices. A literature review identified issues to be covered by the SSAT. Consultation with "experts" and piloting the SSAT with 19 community sports clubs in metropolitan Sydney established face and content validity. Test-retest reliability was assessed in six clubs. Inter-rater reliability was assessed using twenty-four independent representatives from eight clubs. Face and content validity studies identified issues to include in the SSAT and improvements to language and layout. Test-retest reliability was 91% (range 68-100%). Inter-rater reliability ranged from 40-65% when missing data and 'don't know' answers were included, and from 62-75% when only 'definitive' answers were included. Club presidents and secretaries provided more definitive information than other informants. A preliminary list of safety issues that clubs addressed well or poorly was identified. The SSAT is a useful tool for gathering baseline data, benchmarking and targeting sports safety interventions with community sports clubs. Club presidents and secretaries are the preferred contact point and a face-to-face interview is the best administration mode. A tool to identify safety policies and practices is now available for use by anyone supporting community sports clubs to improve safety.

Athletic Injuries↗

Assessment of validity of the national public health performance standards: the local public health performance assessment instrument.

The National Public Health Performance Standards Program (NPHPSP) has developed performance standards measurement instruments, based on the 10 "Essential Services of Public Health" that are being tested in several states. This article is a report on the face and content validity of the instrument designed for local public health systems. Judgments about the face validity of the standards were obtained in a survey of local public health systems that had used the instrument in a test state. The validity of each standard was addressed along the following dimensions: the importance of the standard as a measure of the Essential Service; its completeness as a measure; and its reasonableness for achievement. All standards for each Essential Service were then judged in terms of their completeness in measuring performance of that service. Respondents judged the standards to be highly valid measures of local public health system performance. Some respondents had reservations about whether standards related to "enforcing laws and regulations" were achievable. Holding local public health systems accountable for the activities of other agencies was a factor mentioned in conjunction with those standards. The NPHPSP standards have face and content validity for measuring local public health system performance. Further testing of their validity and reliability is continuing.

Analysis of Variance↗

Quality indicators in postoperative pain management: a validation study.

Quality indicators in postoperative pain management: a validation study. In a previous study, strategic and clinical quality indicators were developed from a tentative model to assess high quality in postoperative pain management. The aim of the present study was to investigate the content validity of these 15 indicators. The indicators were compiled in a questionnaire, and two groups of nurses (n=210, n=321) scored each indicator on a 5-point scale (strongly disagree to strongly agree) from three different standpoints: whether it was essential for achieving high quality, whether it was realistic to carry out, and whether it was possible for nurses to influence management. The respondents were also asked to choose the most crucial indicators for the quality of care. The results showed that both groups of nurses judged the 15 indicators to have content validity from all three standpoints. Both groups also found the same six indicators to be the most crucial. These indicators concerned detecting and acting on signs and symptoms, performing prescriptions, informing and educating, acting on behalf of patients, competence/knowledge, and attitudes. The validated indicators should be useful to consider when implementing a strategy for postoperative pain management and when planning to evaluate the quality of care.

Adult↗

Development of the McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey.

BACKGROUND/OBJECTIVES: Coronary heart disease (CHD) is the number one cause of death in women, yet, little is known about women's symptoms. Early symptom recognition of CHD in women is essential but most instruments do not assess both prodromal and acute CHD symptoms. Our aims were to develop an instrument validly describing women's prodromal and acute symptoms of myocardial infarction and to establish reliability of the instrument, the McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey (MAPMISS). METHODS: Four studies contributed to the content validity and reliability of this instrument. Two qualitative studies provided the list of symptoms that were confirmed in study 3. The resulting instrument assesses 37 acute and 33 prodromal symptoms. In study 4, 90 women were retested 7 to 14 days after their initial survey. We used the kappa statistic to assess agreement across administrations. RESULTS: The women added no new symptoms to the MAPMISS. The average kappa of acute symptoms was 0.52 and 0.49 for prodromal. Next we calculated a weighted score. The mean acute score for time 1 was 19.4 (SD = 14.43); time 2 was 12.4 (SD= 8.79) with Pearson correlation indicating stability (r = .84; P < .01). The mean prodromal score at time 1 was 23.80 (SD= 24.24); time 2 was 26.79 (SD = 30.52) with a Pearson correlation of r = .72; P < .01. CONCLUSIONS: The tool is comprehensive, has high content validity, and acceptable test-retest reliability. Low kappas were related to few women having those symptoms. The symptom scores remained stable across administrations.

Adult↗