PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “construct validity”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99Linked to original sources

Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers.

UNLABELLED: This paper describes details of four scales of a questionnaire-- "Computers in Medical Care"--measuring attributes of computer use, self-reported computer knowledge, computer feature demand, and computer optimism of academic physicians. The reliability (i.e., precision, or degree to which the scale's result is reproducible) and validity (i.e., accuracy, or degree to which the scale actually measures what it is supposed to measure) of each scale were examined by analysis of the responses of 771 full-time academic physicians across four departments at five academic medical centers in the United States. The objectives of this paper were to define the psychometric properties of the scales as the basis for a future demonstration study and, pending the results of further validity studies, to provide the questionnaire and scales to the medical informatics community as a tool for measuring the attitudes of health care providers. METHODOLOGY: The dimensionality of each scale and degree of association of each item with the attribute of interest were determined by principal components factor analysis with orthogonal varimax rotation. Weakly associated items (factor loading < .40) were deleted. The reliability of each resultant scale was computed using Cronbach's alpha coefficient. Content validity was addressed during scale construction; construct validity was examined through factor analysis and by correlational analyses. RESULTS: Attributes of computer use, computer knowledge, and computer optimism were unidimensional, with the corresponding scales having reliabilities of .79, .91, and .86, respectively. The computer-feature demand attribute differentiated into two dimensions: the first reflecting demand for high-level functionality with reliability of .81 and the second demand for usability with reliability of .69. There were significant positive correlations between computer use, computer knowledge, and computer optimism scale scores and respondents' hands-on computer use, computer training, and self-reported computer sophistication. In addition, items posited on the computer knowledge scale to be more difficult generated significantly lower scores. CONCLUSION: The four scales of the questionnaire appear to measure with adequate reliability five attributes of academic physicians' attitudes toward computers in medical care: computer use, self-reported computer knowledge, demand for computer functionality, demand for computer usability, and computer optimism. Results of initial validity studies are positive, but further validation of the scales is needed. The URL of a downloadable HTML copy of the questionnaire is provided.

Attitude of Health Personnel↗

The development and preliminary validation of a Preference-Based Stroke Index (PBSI).

BACKGROUND: Health-related quality of life (HRQL) is a key issue in disabling conditions like stroke. Unfortunately, HRQL is often difficult to quantify in a comprehensive measure that can be used in cost analyses. Preference-based HRQL measures meet this challenge. To date, there are no existing preference-based HRQL measure for stroke that could be used as an outcome in clinical and economic studies of stroke. The aim of this study was to develop the first stroke-specific health index, the Preference-based Stroke Index (PBSI). METHODS: The PBSI includes 10 items; walking, climbing stairs, physical activities/sports, recreational activities, work, driving, speech, memory, coping and self-esteem. Each item has a 3-point response scale. Items known to be impacted by a stroke were selected. Scaling properties and preference-weights obtained from individuals with stroke and their caregivers were used to develop a cumulative score. RESULTS: Compared to the EQ-5D, the PBSI showed no ceiling effect in a high-functioning stroke population. Moderately high correlations were found between the physical function (r = 0.78), vitality (r = 0.67), social functioning (r = 0.64) scales of the SF-36 and the PBSI. The lowest correlation was with the role emotional scale of the SF-36 (r = 0.32). Our results indicated that the PBSI can differentiate patients by severity of stroke (p < 0.05) and level of functional independence (p < 0.0001). CONCLUSIONS: Content validity and preliminary evidence of construct validity has been demonstrated. Further work is needed to develop a multiattribute utility function to gather information on psychometric properties of the PBSI.

Aged↗

A biomechanical investigation into the validity of the modified Ashworth Scale as a measure of elbow spasticity.

OBJECTIVE: To investigate the criterion validity of the modified Ashworth Scale. POPULATION: Volunteers from a stroke population admitted to a district general hospital stroke unit diagnosed with a first ever stroke less than 26 weeks previously. OUTCOME MEASURES: Resistance to passive movement about the elbow was simultaneously quantified (biomechanically) and graded (modified Ashworth Scale). Passive range of movement and peak instantaneous velocity during passive movement were also measured. ANALYSIS: Criterion validity was investigated as convergent construct validity (using the Spearman's correlation coefficient) and concurrent validity (using analysis of variance). RESULTS: One hundred measurements were taken on 63 subjects. Correlation between the modified Ashworth Scale and resistance to passive movement was 0.511. Resistance to passive movement and velocity showed significant differences between the modified Ashworth score of '0' and a modified Ashworth score greater than '0' (p < 0.01). There were no significant differences between MAS '1', '1+' and '2'. Resistance to passive movement in the impaired arm was significantly higher than in the nonimpaired arm (p < 0.01). CONCLUSION: The modified Ashworth Scale does not provide a valid measure of spasticity at lower grades but it may provide a measure of resistance to passive movement.

Biomechanical Phenomena↗

Preliminary analysis of the psychometric properties of the Mood, Interest & Pleasure Questionnaire (MIPQ) for adults with severe and profound learning disabilities.

OBJECTIVE: There are few reliable and valid methods for assessing emotional constructs in adults with severe and profound learning disabilities who are unable to self report. The aims of this study were to develop an informant questionnaire on affect for use in relation to adults with severe and profound learning disabilities and to examine its psychometric properties. METHOD: The Mood, Interest & Pleasure Questionnaire (MIPQ) is a 25-item Likert scale questionnaire with two subscales (mood and interest & pleasure). The MIPQ and the Aberrant Behavior Checklist were completed on 53 participants with severe or profound learning disabilities, who were partly or non-verbal. Of these, 23 participants (43%) were included in an examination of test-retest and inter-rater reliability of the MIPQ. RESULTS: Reliability of the MIPQ was good for subscales and total score: test-retest and inter-rater reliability coefficients for the total score were .87 and .76, respectively. Internal consistency was excellent (.94). A significant correlation between the MIPQ total score and the Aberrant Behavior Checklist's 'lethargy, social withdrawal' subscale provided preliminary evidence of construct validity (r (48) = -.59, p < .001). CONCLUSIONS: A preliminary analysis of the psychometric properties of the MIPQ is encouraging and further validation of the measure is warranted. The measure might be used to examine depression in people with severe and profound learning disabilities as well as in investigations of issues such as quality of life.

Adult↗

Revision and further assessments of the Prison Locus of Control Scale.

The report of initial measurements studies conducted on the Prison Locus of Control Scale concluded with suggestions for altering the format and content to improve the psychometric properties of the scale. This paper is a report of structural, reliability, and validity studies conducted on the revised Prison Locus of Control Scale. Assessments included a test of internal consistency, factor analyses, one test each of concurrent and known-groups validity, and four tests of construct validity. The results show strong support for the reliability and validity of the revised scale, which is provided in an appendix.

Adult↗

Development and psychometric testing of the Wilmoth Sexual Behaviors Questionnaire-Female.

The purpose of this study was to develop and test the Wilmoth Sexual Behaviors Questionnaire-Female. As initially developed, the WSBQ-F consisted of 54 items arranged in 8 subscales. Items were rated on a Likert-type scale, with high scores reflecting more consistent use of a sexual behaviour. A convenience sample of 310 women with breast cancer (n = 165) and healthy women (n = 145) participated in the study. An Index of Content Validity of 1.00 was obtained. Construct validity was estimated using exploratory factor analysis and the known groups method. Internal consistency reliability was .94 for the total scale, with coefficients ranging between 0.52 and 0.94 for the subscales. The test-retest correlation coefficient was .81 for the total scale; coefficients were between .58 and .88 for the subscales. Initial testing of the measure suggests that the WSBQ-F is a reliable and valid measure of female sexual behaviours.

Adult↗

Assessment of fecal output in patients receiving enteral tube feeding: validation of a novel chart.

OBJECTIVE: To develop a practical, valid and reliable chart to assist in the accurate visual characterization of fecal output in patients receiving enteral tube feeding (ETF). DESIGN: A chart incorporating verbal and pictorial descriptors of fecal output was developed. Validity and reliability were assessed by a questionnaire survey of health professionals and a clinical study of patients commencing ETF. Content validity was assessed from the results of the questionnaire, construct validity by contrasting groups analysis, concurrent validity by comparison of the chart with actual fecal weight and inter-rater reliability by independent characterization of the same fecal sample by two nurses. SETTING: St George's Hospital, London, UK. SUBJECTS: In all, 35 health professionals completed a questionnaire with respect to the chart. The chart was then used to monitor fecal output in 36 patients commencing ETF for a total of 171 patient-days, during which time nurses used the chart to characterize 269 fecal samples, of which 59 were subsequently weighed. RESULTS: The results of the questionnaire suggested good content validity. The chart demonstrated statistically significant differences in fecal frequency, fecal consistency, fecal score and incidence of diarrhea for contrasting patient groups expected to have different fecal output (P < 0.05). The inter-rater reliability was almost perfect for fecal consistency (95% agreement, kappa = 0.91) and substantial for fecal weight (83%, kappa = 0.75). In all, 83% of fecal samples were assigned to the correct weight category (kappa = 0.75). CONCLUSION: The chart has good content, construct and concurrent validity and inter-rater reliability, and is suitable for both research and clinical use. SPONSORSHIP: This research was jointly supported by King's College London and Nestlé, UK.

Diarrhea↗

Validation of the structured interview for disorders of extreme stress.

There is a dearth of valid instruments to evaluate the primary sequelae of sexual abuse. The present study examined the construct validity of the subscales of the Structured interview for Disorders of Extreme Stress (SIDES), a measures of the associated features of posttraumatic stress disorder (PTSD). Using a clinical sample of 74 survivors of childhood sexual abuse with PTSD, this study demonstrated that the subscales of the SIDES (alterations in regulation of affect and impulses, alterations in attention or consciousness, alterations in self-perception, and somatization) correlated highly with instruments hypothesized to measure similar constructs. Divergent validity was established for each of four subscales of the SIDES. Findings from this study and other research on the psychometrics of the SIDES indicate that it is a valid measure of the associated features of PTSD in survivors of childhood sexual abuse.

Adult↗

Validation of the Chinese version of the satisfaction with the nursing home instrument.

AIM: To assess the psychometric properties of the Chinese version of the Satisfaction with the Nursing Home Instrument. BACKGROUND: Resident's satisfaction has been regarded by the literature as a gold standard for quality of nursing home care. Accurate assessment of resident's satisfaction can provide valuable information for implementation of quality nursing home care. However, there is not a validated Chinese tool to serve the purpose. DESIGN: A cross-sectional descriptive survey design. METHODS: Content validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by the use of expert panel. Construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was determined by assessing the correlation between satisfaction with other theoretically related constructs. Internal consistency and stability of the Chinese version of the Satisfaction with the Nursing Home Instrument were determined by Cronbach's method and two-week test-retest reliability. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by confirmatory factor analysis. Testing was performed on a cluster sample of 330 residents from 16 nursing homes in Hong Kong. RESULTS: The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated good content validity by having content validity index of 0.93. High construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was supported by its significant correlation with depression (r = -0.42, P = 0.000), health-related quality of life (physical component) (r = 0.16, P = 0.042), health-related quality of life (mental component) (r = 0.41, P = 0.000) and global quality of care (r = 0.49, P = 0.000). The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated satisfactory internal consistency and good stability by having Cronbach's alpha of 0.79 and intra-class correlation coefficient of 0.94, respectively. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was not fully supported by confirmatory factor analysis. CONCLUSIONS: The Chinese version of the Satisfaction with the Nursing Home Instrument is a useful instrument for assessing satisfaction of cognitively intact Chinese nursing home residents. Findings provided initial evidence on its validity and reliability. Further empirical testing is recommended to explore its factor structure. RELEVANCE TO CLINICAL PRACTICE: The Chinese version of the Satisfaction with the Nursing Home Instrument can provide guidance to enhance delivery of high-quality nursing home care for the Chinese population.

Aged↗

Culturally competent assessment practice in the United States.

Assessment practice with multicultural populations in the United States requires cultural competence. Culturally competent assessment includes culture-specific styles of service delivery, use of the client's first language, and an evaluation of the client as a cultural being prior to test administration using cultural orientation categories. This information is essential for understanding health/illness beliefs, to indicate the possible presence of culture-specific symptoms, and to select standard or culture-specific tests. Assessment ethics recognize the desirability of alteration or modification of standard tests by translation and development of new norms. Cross-cultural construct validity, response sets, and cultural variables are also research priorities. Culture-specific tests should be constructed and validated for some clients as determined by cultural orientation status. Feedback of test findings to clients and significant others should be consistent with cultural expectations. Professional and societal benefits of cultural competence in assessment are suggested.

Journal Article↗

The quality of a simulation examination using a high-fidelity child manikin.

PURPOSE: Developing quality examinations that measure physicians' clinical performance in simulations is difficult. The goal of this study was to develop a quality simulation examination using a high-fidelity child manikin in evaluating paediatric residents' competence about managing critical cases in a simulated emergency room. Quality was determined by evidence of the reliability, validity and feasibility of the examination. In addition, the participants' responses regarding its realism, effectiveness and value are presented. METHOD: Scenario scripts and rating instruments were carefully developed in this study. Experts were used to validate the case scenarios and provide evidence of construct validity. Eighteen paediatric residents, 'working' as pairs, participated in a manikin-based simulation pre-test, a training session and a post-test. Three independent raters rated the participants' performance on task-specific technical skills, medications used and behaviours displayed. At the end of the simulation, the participants completed an evaluation questionnaire. RESULTS: The manikin-based simulation examination was found to be a realistic, valid and reliable tool. Validity (i.e. face, content and construct) of the test instrument was evident. The level of inter-rater concordance of participants' clinical performance was good to excellent. The item analysis showed good to excellent internal consistency on all the performance scores except the post-test technical score. CONCLUSIONS: With a carefully designed rating instrument and simulation operation, the manikin-based simulation examination was shown to be reliable and valid. However, a further refinement of the test instrument will be required for higher stake examinations.

Adult↗

Ankle stiffness and tissue compliance in stroke survivors: a validation of Myotonometer measurements.

OBJECTIVE: To determine the construct validity of Myotonometer measurements of tissue compliance as being reflective of ankle plantarflexor tone. DESIGN: Cross sectional. SETTING: Motor performance research laboratory. PARTICIPANTS: Twenty-three stroke survivors (67.5+/-10.9y) and 24 control subjects (71.2+/-9.0y) recruited from the community. INTERVENTIONS: Not applicable. Main outcome measures Plantarflexor tone was measured using the Modified Ashworth Scale (MAS), ankle stiffness (total, passive, intrinsic and reflex components) was quantified using a torque motor, and tissue compliance during relaxation and activation of the plantarflexors was measured with the Myotonometer. RESULTS: MAS scores in the stroke group ranged from 1 to 4, whereas all control subjects had normal tone. Mean total ankle stiffness was higher in the stroke group than in the control group (P<.02), mainly due to elevated passive stiffness (P<.03). Compliance did not change as a function of muscle activation in stroke, but it decreased when control subjects contracted their plantarflexors (P<.04). The difference in Myotonometer measurements acquired during active and relaxed states was associated with total ankle stiffness and, specifically, intrinsic stiffness. The relationships were strongest when only stroke data were considered. CONCLUSIONS: Stiffness and compliance measures distinguished between control subjects and persons with hypertonia secondary to stroke. Compliance differences in the relaxed and active gastrocnemius muscle reflected intrinsic stiffness associated with the contractile elements of the plantarflexor group of muscles as a whole.

Aged↗

Electromyographic assessment of back muscle weakness and muscle composition: reliability and validity issues.

OBJECTIVE: To assess the reliability and construct validity of various electromyographic indices developed to assess back muscle weakness and muscle fiber composition. DESIGN: A prospective study with repeated measures performed on 3 days along with comparisons of groups presenting different back strength and/or back muscle fiber composition. SETTING: A biomechanics laboratory within a rehabilitation center. PARTICIPANTS: Forty male volunteers (20 healthy, 20 with chronic low back pain) were assessed on 3 different days to assess reliability and to make group comparisons. Thirteen healthy women were also assessed once to obtain a third group with known lower strength and different back muscle fiber composition. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Surface electromyography was recorded for 4 pairs of homologous back muscles while the subjects performed, on a dynamometer, static trunk extension efforts. Electromyographic parameters were computed to assess muscle weakness and muscle fiber composition. The reliability of the data collected across the 3 sessions and comparisons between groups were determined. RESULTS: Electromyographic parameters generally showed good to excellent reliability, but were insensitive to differences in back muscle strength and did not appear to be related to muscle composition. Some trends were observed in the electromyographic parameters across the force levels, but the large interindividual variability impeded statistical comparisons. CONCLUSIONS: The assessment of muscle weakness and muscle fiber composition through electromyographic analysis does not appear feasible, at least on an individual basis, for the muscles of the back.

Adult↗

Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center.

BACKGROUND: Laparoscopic camera navigation (LCN) training on simulators has demonstrated transferability to actual operations, but no comparative data exist. The objective of this study was to compare the construct and face validity, as well as workload, of two previously validated virtual reality (VR) and videotrainer (VT) systems. METHODS: Attendees (n = 90) of the SAGES 2005 Learning Center performed two repetitions on both VR (EndoTower) and VT (Tulane Trainer) LCN systems using 30 degrees laparoscopes and completed a questionnaire regarding demographics, simulator characteristics, and task workload. Construct validity was determined by comparing the performance scores of subjects with various levels of experience according to five parameters and face validity according to eight. The validated NASA-TLX questionnaire that rates the mental, physical, and temporal demand of a task as well as the performance, effort, and frustration of the subject was used for workload measurement. RESULTS: Construct validity was demonstrated for both simulators according to the number of basic laparoscopic cases (p = 0.005), number of advanced cases (p < 0.001), and frequency of angled scope use (p < 0.001), and only for VT according to training level (p < 0.001) and fellowship training (p = 0.008). Face validity ratings on a 1-20 scale averaged 15.4 +/- 3 for VR vs. 16 +/- 2.6 for VT (p = 0.04). Ninety-six percent of participants rated both simulators as valid educational tools. The NASA-TLX overall workload score was 69.5 +/- 24 for VR vs. 68.8 +/- 20.5 for VT (p = 0.31). CONCLUSIONS: This is the largest study to date that compares two validated LCN simulators. While subtle differences exist, both VR and VT simulators demonstrated excellent construct validity, good face validity, and acceptable workload parameters. These systems thus represent useful training devices and should be widely used to improve surgical performance.

Adult↗

[Internal consistency and validity of the Spanish version of the St. George's respiratory questionnaire for use in patients with clinically stable bronchiectasis].

OBJECTIVE: To analyze the reliability and validity of the St. George's Respiratory Questionnaire (SGRQ) for use in patients with clinically stable bronchiectasis. MATERIAL AND METHODS: The SGRQ (50 items on 3 scales--symptoms, activity, and impact) was administered to 102 patients (mean [SD] age, 69.5 [8.7] years; 63% men) with clinically stable bronchiectasis. Disease severity was classified according parameters such as airflow obstruction (forced expiratory volume in 1 second), colonization by Pseudomonas aeruginosa, extent of bronchiectasis, symptoms, daily quantity of sputum, and number of exacerbations. Internal consistency (Cronbach's alpha and correlation between items and between item and scale), concurrent validity (correlation between items and clinical variables), predictive validity (correlation between items and severity), and construct validity (factorial analysis of main components) were assessed. RESULTS: The internal consistency of the SGRQ was excellent (Cronbach's alpha between 0.81 and 0.87 for the different scales, and 0.90 for the overall score). Concurrent validity was high, as correlations between items and clinical variables were significant and followed the expected distribution. The SGRQ differentiated between degrees of disease severity, regardless of the clinical variable used. The factorial analysis showed a construct of 4 factors that were only moderately similar to the original structure of the questionnaire, due mainly to inclusion of a small number of questions with conditioned response and others with low discriminatory capacity. CONCLUSIONS: The SGRQ shows excellent concurrent and predictive internal consistency and validity, though restructuring of the original construct would be advisable before use in patients with stable bronchiectasis.

Aged↗

Validity of the Sheltered Care Environment Scale: rejoinder to Lemke and Moos (1990).

In a previous article, based on open-ended interviews with residents of 1 facility, questions were raised about the construct validity of 3 of the 7 subscales of the Sheltered Care Environment Scale. Lemke and Moos (1990) criticized the sampling of a single facility as having an inappropriate focus on individual differences. Their criticisms are addressed, and a dialectic approach is recommended for use in qualitative analyses for construction and validation of quantitative measures of geriatric residential settings.

Aged↗

Algorithms for resource allocation of substance abuse prevention funds based on social indicators: a case study on state of Florida--Part 3.

The purpose of Part 3 is to develop an algorithm for an equitable distribution of state prevention funds to its substate jurisdictions based on the need for prevention services. In this series, the need for prevention services is measured in terms of the existing social indicators observed at the county level. In order to establish a conceptual link as well as the empirical relevance of the selected social indicators as proxy measurements of the estimated need for prevention at the county level, we have employed both concurrent and construct validity tests using the following three constructs as the criterion variables in a multiple regressing setting: 1) county-based composite drug use index score (COMDRUG) measured via the statewide drug survey; 2) county-based proportions of prevention target populations using the conceptual definition advanced by the Institute of Medicine (IOM); and 3) the composite risk factor score (COMRISK) assembled from a list of twenty-two risk and protective factors observed for each county. These constructs were identified previously in Parts 1 and 2. While employing eight social indicators to estimate the overall prevention needs observed at the county level, the social indicators thus selected were able to explain 69 percent of the variations in COMDRUG, 68 percent of the variation in the proportions of students in need of prevention services using IOM definition, and 60 percent of the variation in COMRISK. Following successful validations of the social indicators as viable media with which to estimate county-based prevention needs, the ensuing multiple regression equation is, then, used to build a resource allocation model by determining the proportion of each county's share of the total statewide COMDRUG-predicted from the social indicators and, then, by weighting the latter proportion by the population size of each county under age eighteen. In this way, we have devised county-based Prevention Needs Index (PNI) scores based solely on social indicators. Finally, the county's share of PNI score is computed as a proportion of to the total statewide PNI score. Following this line of algorithm for resource allocation, we were able to develop yet another resource allocation model solely based on social indicators without the benefits of survey data. Comparing the funding results originating from four resource allocation models (i.e., COMDRUG, IOM Definition, COMRISK, and Social Indicators), it has been learned that there is a remarkable similarity from one funding level to another. Since all four schedules of county-based prevention funding levels have shown very high intercorrelations with a range from .9862 to .9993, it has been determined that these schedules are measuring essentially either the same domain or latent domains that are functionally equivalent to one another. Accordingly, no preference is made among the resource allocation models suggested, although it is suggested that the final decision on the level of funding must be based on the selection of the schedule for resource allocation rather than the suggested amount or level of funding computed for each county.

Algorithms↗

The validity and reliability of a new examination of the clinical competence of medical students.

In a previous study we described a problem-based criterion-referenced test of the clinical competence of medical students which was felt to offer advantages over the traditional final-year examination. This paper reports the validity and reliability studies on which it is possible to judge the value of this new test when compared to the traditional approach. The results demonstrate a high level of content validity and provide evidence of the construct validity of the test. Efforts to obtain measures of concurrent and predictive validity were thwarted by a failure to attain reliable assessments of ward performance from resident and consultant staff. Satisfactory levels of internal consistency were established for the whole test. Marker reliability was satisfactory in all sections of the test except for those requiring examiners to rate practical clinical skills. This was so despite the use of simulated patients, behavioural check-lists and rater training. Possible solutions to this problem are discussed. It is concluded that this new approach overcomes many of the measurement problems inherent in the traditional final examination. It has been shown to be feasible to construct and administer in the medical school setting without the need for the allocation of additional resources.

Australia↗