SEARCH · PubMed Health

Results for “Internal validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17Linked to original sources

PubMed2004

Relation of emotional intelligence to emotional recognition and mood management.

This study replicated Petrides and Furnham's 2000 test of the multidimensional nature of the Emotional Intelligence Scale by Schutte, et al. A survey of 153 college students (M age=25.0, SD=4.4, 54.2% women) was performed. Four factors which closely resembled previous ones were found although there were some differences in item loadings. The factors were Optimism, Mood Management, Nonverbal, and Empathy. Then, the total and factor scores were examined for their relationship to scores on the Emotional Recognition and Mood Management Inventories developed by Wells and Hakanen in 1991 for the purpose of testing predictive validity and developing measures with high internal validity.

Adult↗

PubMed2003

Validity and reliability of the Cataract TyPE Spec: an instrument for measuring outcomes of cataract extraction.

PURPOSE: To design and validate a survey instrument that measures vision-related functional status, which is appropriate for self-administration in a clinical practice and mail survey setting. DESIGN: Observational, validation study in sequential patients. METHODS: A prototype visual function instrument (the Cataract TyPE Spec) was developed based on focus group input and then validated in an outcomes study conducted among 1,823 patients who underwent cataract extraction performed by 22 surgeons at six centers in the United States. Reliability was determined by calculating Cronbach alpha for different types of administration (self-administration at the site of care and mailed survey) and across race and gender. Criterion validity was determined by correlating scores on the TyPE Spec with baseline measures and changes in visual acuity, overall rating of vision, and general quality of life. RESULTS: The instrument was internally valid (Chronbach alpha = 0.94), both on self-administration in the patient care setting and upon mailed survey administration and across patient race and gender. The TyPE Spec score was highly correlated with overall rating of vision (r =.54, P <.0001) and moderately correlated with Snellen acuity (r =.32, P <.0001), rating of vision in the better eye (r =.42, P <.0001), and quality of life, as measured by the physical component summary score of the SF-36 (r =.27, P <.001). Change in TyPE Spec similarly correlated with change in rating of vision overall, change in best-corrected Snellen acuity, and change in rating of vision in the operated eye. CONCLUSIONS: The cataract TyPE Spec instrument was found to be equally valid and internally consistent when administered in the patient care setting and by mail survey.

Adult↗

PubMed2002

Randomized clinical trial of total vs. subtotal hysterectomy: validity of the trial questionnaire.

BACKGROUND: To ensure the internal validity of a trial it is recommended to undertake a validation study of the method measuring the outcome. AIMS: To validate a self-administered, postal questionnaire (http://www.gyncph.suite.dk/praes/gimbel/gihtm) used for measuring the outcomes of a randomized clinical trial of total vs. subtotal abdominal hysterectomy. METHODS: A study of the content validity (10 patients) and a combined qualitative and quantitative validation study (20 patients) were performed. RESULTS: The median kappa of the 74 questions was 0.71 (range 0.22-1.00) and the median overall agreement was 0.76 (range 0.25-1.00). Five questions (7%) had kappa values below 0.40, 11 questions (15%) between 0.40 and 0.60, and 58 questions (78%) above 0.61. Three questions with a kappa value below 0.40 had an overall agreement of 0.75 or more. Significant logical inconsistencies were found in five questions, where the operation method was expected to be known. The qualitative validation resulted in a total of 80 comments. The number of comments for any given subject ranged from 0 to 12. The comments could be grouped and processed into four categories. CONCLUSIONS: The agreement was high. Inconsistencies regarding questions on the operation methods were found. Potential problems were identified in five questions (7%). The validation studies resulted in some changes to the questionnaire and we became aware of areas in which caution should be taken in the interpretation of the results of the randomized trial.

Female↗

PubMedDate not supplied

Developing a measure of sense of belonging.

The purpose of this study was to develop and test psychometrically a self-report instrument designed to measure sense of belonging in adults. The Sense of Belonging Instrument (SOBI) is a 27-item, self-report instrument consisting of two separately scored scales, SOBI-P (psychological state) and SOBI-A (antecedents). Content validity was assessed by a panel of experts. Construct validity, internal consistency, and retest reliability were examined through a series of studies with three subject groups: community college students, patients in treatment for major depression, and Roman Catholic nuns. Results suggest that SOBI-P is a valid and reliable measure of sense of belonging. SOBI-A appears to reflect an individual's motivation for sense of belonging but requires additional study regarding its construct validity and internal consistency.

Adult↗

PubMed2005

Testing a European set of indicators for the evaluation of the management of primary care practices.

BACKGROUND: Effective practice management is an important prerequisite for offering good clinical care. Internationally valid, reliable and feasible indicators and instruments are needed to describe and compare the management of primary care practices in Europe. OBJECTIVE: This paper describes development and evaluation of the European Practice Assessment instrument and indicators (Engels Y, Campbell S, Dautzenberg M et al. Developing a framework of, and quality indicators for, general practice management in Europe. Fam Pract 2005; 22(2): 215-22). METHODS: The study design was a validation and feasibility study set in 273 general practices in Austria, Belgium, France, Germany, Israel, The Netherlands, Slovenia, Switzerland and the UK. Use was made of a set of 62 valid quality indicators derived previously from an international Delphi procedure. The EPA instrument, based on this set of indicators, was used to collect data in the 273 practices. This instrument consists of self-completed questionnaires for doctors, staff managers and patients. In addition, there is an interview schedule for use by an outreach visitor, to be held with the lead GP or manager, and a visitor checklist. The instrument was analysed using expert review by the project partners, factor and reliability analyses, ANOVA analyses and by determining intraclass correlations. RESULTS: Fifty-seven indicators were found to be valid, feasible, reliable and discriminative in all participating countries. The instrument was able to determine differences in practice management within and between countries. All (but one) practices completed the assessment procedure. The data collection method appeared to be feasible, although some aspects can be improved. CONCLUSION: The EPA instrument provides feedback to practices that facilitates quality improvement and can compare primary care practices on a national and an international level.

Europe↗

PubMed2005

A new questionnaire specifically designed for patients affected by chronic obstructive pulmonary disease; The Italian Health Status Questionnaire.

The aim of this study was to develop a specific and valid questionnaire for Italian COPD patients, living on the north or the south of Italy-which are two culturally distinct areas. The project consisted in three steps: (1) initial item set generation to identify items relevant to both genders, all ages and both regions; (2) item reduction including tests of regional specificity; (3) tests of internal validity using item-response theory using Rasch one-parameter modelling. Ninty-six COPD patients (mean aged 69 yr; 78 Male) completed the original set of 124 items of the Italian Health Status Questionnaire (IHSQ). Item reduction was carried out using an established standardised approach employing classical psychometric test theory. The internal construct validity of the 47 items that survived this process were tested to determine whether they constituted a unidimensional construct "impaired health due to COPD" using Rasch analysis. This showed that the questionnaire had very good psychometric properties, with an excellent Person Separation Index of 0.95 and no evidence of bias due to item-trait interaction (chi104(2)=127.1, P=n.s.). The combination of classical test theory and modern item-response methodology has produced a questionnaire with excellent measurement properties suitable for COPD patients whether from the north or south of Italy.

Adult↗

PubMed1994

Measurement of behavioral, affective, and somatic responses to pediatric bone marrow transplantation: development of the BASES scale.

A new measure to assess behavioral, affective and somatic outcomes in the acute phase of bone marrow transplant is described. The Behavioral Affective and Somatic Experiences Scale (BASES) is a 38 item nurse-report instrument, with five subscales labeled Somatic distress, Compliance, Mood/Behavior, Interactions, and Activity. A series of pilot studies were conducted to refine the content of the BASES scale and to establish its psychometric properties in terms of internal consistency, inter-rater reliability, and validity. Internal consistency (Chronbach's alpha) for the subscales ranged from .742 to .902. Inter-rater reliability was good, with a median correlation between paired nurse observations of .866. A parent report version of the BASES scale has also been developed, and the finding of significant parent-nurse correlations provides preliminary evidence of the validity of the measure. Potential uses of the BASES scale in the pediatric BMT setting are discussed.

Adolescent↗

PubMed2025

Assessing individual genetic susceptibility to metabolic syndrome: interpretable machine learning method.

BACKGROUND: Genome-wide association studies have provided profound insights into the genetic aetiology of metabolic syndrome (MetS). However, there is a lack of machine-learning (ML)-based predictive models to assess individual genetic susceptibility to MetS. This study utilized single-nucleotide polymorphisms (SNPs) as variables and employed ML-based genetic risk score (GRS) models to predict the occurrence of MetS, bringing it closer to clinical application. METHODS: Feature selection was performed using Least Absolute Shrinkage and Selection Operator. Six ML algorithms were employed to construct GRS models. A fivefold cross-validation was utilized to aid in the internal validation of models. The receiver operating characteristic (ROC) curve was used to select the better-performing GRS model. The SHapley Additive exPlanations (SHAP) was then applied to interpret the model. After extracting GRS, stratified analysis of BMI, age and gender was performed. Finally, these conventional risk factors and GRS were integrated through multivariate logistic regression to establish a combined model. RESULTS: A total of 17 SNPs were selected for analysis. Among the GRS models, the extreme gradient boosting (XGBoost) model demonstrated superior discriminative performance (AUC = 0.837). The XGBoost's optimal robustness was also validated through five-fold cross-validation (mean ROC-AUC = 0.706). The XGBoost-based SHAP algorithm not only elucidated the global effects of 17 SNPs across all samples, but also described the interaction between SNPs, providing a visual representation of how SNPs impact the prediction of MetS in an individual. There was a strong correlation between GRS and MetS risk, particularly observed among young individuals, males and overweight individuals. Furthermore, the model combining conventional risk factors and GRS exhibited excellent discriminative performance (AUC = 0.962) and outstanding robustness (mean ROC-AUC = 0.959). CONCLUSION: This study established a reliable XGBoost-based GRS model and a GRS prediction platform (https://metabolicsyndromeapps.shinyapps.io/geneticriskscore/) to assess individual genetic susceptibility to MetS. This model has high interpretability and can provide personalized reference for determining the necessity of primary prevention measures for MetS. Additionally, there may be interactions between traditional risk factors and GRS, and the integration of both in a comprehensive model is useful in the prediction of MetS occurrence.

Humans↗

PubMed2006

Coping with late-life challenges: Development and validation of the care-receiver efficacy scale.

PURPOSE: Measures are lacking that address the challenges that people think they face in their roles as elderly care receivers. However, the development of a sense of efficacy in this role by mentally competent care receivers is critical to successful partnerships between caregivers and care receivers. The purpose of this article is to report the development and psychometric analysis of the Care-Receiver Efficacy Scale (CRES). DESIGN AND METHODS: Content validity, internal consistency reliability, factor structure, and convergent validity were assessed through a pilot study, expert review, and field administration with 177 participants. RESULTS: Results suggest that the CRES comprises five subscales, with strong reliability evidenced for three subscales but marginal reliability for the remaining two. Strong support was found for content validity from expert review and moderate support from the relationship between empirical and expert judgment of item location. Support for validity also was found from correlation with the Geriatric Depression Scale-Short Form and the Philadelphia Geriatric Center Morale Scale. IMPLICATIONS: The CRES may be useful as an outcome measure for psycho-socio-behavioral interventions aimed at increasing the capacity of care receivers to direct and improve their own care. Future measure revision and validation are important to optimize its utility.

Adaptation, Psychological↗

PubMed1993

Measurement validity in physical therapy research.

This article considers the role of measurement validity within physical therapy research. The concept of measurement validity is identified as a component of internal validity, and it is differentiated from the notion of reliability; these concepts are related to systematic and random sources of error, respectively. Using examples from physical therapy and rehabilitation, four main types of validity are reviewed: face validity, criterion-related validity, content validity, and construct validity. The differing implications of these types of validity for quantitative and qualitative research are discussed. Three principal areas of concern are then addressed, based on a critical discussion of selected examples from the literature. First, it is argued that validity is often poorly distinguished from the allied concept of reliability and that purported claims for validity often only demonstrate reliability. Second, it is claimed that validity is too often neglected in favor of reliability, and specific examples relating to gait analysis are put forward to support this argument. Third, some of the methodological difficulties that may occur when attempts are made to demonstrate validity are considered. The article concludes with a plea for a closer focus on the issue of measurement validity within physical therapy research.

Bias↗

PubMed1991

Primary prevention in hypertension. Valid conclusions from observational studies.

Relatively few observational (i.e., nonexperimental) studies have been conducted to examine the role of antihypertensive drug therapy in the primary prevention of coronary heart disease. To draw valid conclusions from experimental or observational studies, internal validity should be ensured. In particular, similarity of "extraneous" effects, of information, and of prognosis between the treatment groups compared in a particular study is needed. Because allocation of participants to antihypertensive drug therapy in observational studies is nonrandomized by definition, special efforts should be made to achieve comparability of prognosis, that is, to avoid "confounding by indication." Follow-up and case-control studies, the two main types of observational studies, also offer certain advantages over randomized clinical trials, particularly when different classes of drugs are compared. Although few valid observational studies on the efficacy of drug therapy for hypertension in the primary prevention of first coronary events have been published, the available data suggest that beta-blockers might confer greater protection than other drug regimens. However, more evidence is needed to confirm these findings. It is concluded that observational studies could play an increasing role in the assessment of the role of antihypertensive therapy in the primary prevention of coronary heart disease when the inherent potentials and pitfalls of these studies are appreciated.

Adrenergic beta-Antagonists↗

PubMed2000

The oral assessment in Down syndrome questionnaire (OADS): development of an instrument to evaluate oral health problems in individuals with Down syndrome.

OBJECTIVE: To develop a French language instrument whose primary aim is the description of oral health status in Down syndrome (DS) individuals. METHOD: Due to the reduced intellectual capacity in DS individuals, the instrument was designed to be completed by their parents. Items were generated through a literature review plus interviews with relevant professionals and DS parents. Following pilot testing, the 31-item questionnaire was divided into seven domains (access, function, development, signs, pain, disability and a global evaluation of oral health status), and subjected to a psychometric evaluation of internal reliability, test-retest reliability and discriminant validity. Internal reliability was assessed through evaluation of Cronbach's alpha or the Kuder-Richardson-20 value where appropriate. Test-retest reliability was assessed through the evaluation of the intra-class correlation coefficient (ICC) for each domain. Discriminant validity was assessed through evaluations of hypothesised differences in domain scores between different groups of DS individuals by age and between DS and non-DS individuals. The theoretical domain categorisation was empirically evaluated through the generation of inter-item correlation coefficients. RESULTS: Internal reliability coefficients ranged from 0.43 for the disability domain to 0.83 for the function domain, while the domain ICCs ranged from 0.56 to 0.77 for the signs and function domains respectively. For discriminant validity, the domains largely performed as hypothesised. Finally, inter-item correlation coefficients largely supported the proposed domain structure of the questionnaire. CONCLUSION: This investigation of the psychometric properties of a proxy. French language, assessment of oral health problems in the DS population has demonstrated an instrument with good preliminary indicators of reliability and validity.

Child↗

PubMed2001

Development of the professional role behaviors survey (PROBES).

BACKGROUND AND PURPOSE: This study examined the content validity, internal consistency, and underlying dimensions of the Professional Role Behaviors Survey (PROBES) for its use in future research. METHODS: Using the 26-item PROBES, 253 clinical managers reported on the direction and magnitude of change in the role behaviors of physical therapists following hospital restructuring. RESULTS: Descriptive and correlational statistics of the responses indicated that the nature of the role behavior changes was consistent with those identified in the literature and that the survey instrument had good internal consistency. A principal component factor analysis yielded 5 underlying role behavior dimensions: "evaluating and planning," "productivity," "interacting," "information sharing," and "administration/clinical." This factor structure was found to provide a good fit with role classification schemes and a clear differentiation of physical therapist role behaviors. In addition, the finding supports viewing the professional role behaviors as a single construct rather than as multiple constructs. DISCUSSION AND CONCLUSION: The PROBES was found to have good content validity and internal consistency. It provides a useful tool for the study of the changing roles of professional practitioners and a link in the study of the effect of organizational change on organizational outcomes such as job satisfaction and organizational commitment.

Behavior↗

PubMed2001

Predictive ability of level A in vitro-in vivo correlation for ringcap controlled-release acetaminophen tablets.

PURPOSE: The goal of this study was to establish and validate an in vitro-in vivo correlation (IVIVC) for two sustained-release formulations (i.e., a matrix tablet and a RingCap banded matrix tablet) containing 750 mg of acetaminophen. METHODS: The in vitro dissolution and in vivo disposition of these formulations were examined by using a USP type III dissolution apparatus and a single-dose, three-way, crossover study that included an immediate-release acetaminophen dosage form, respectively. An IVIVC was established by using the mean fraction dissolved (FD) and mean fraction absorbed (FA) and used to simulate the plasma concentration-time profile of acetaminophen after administration of the matrix tablet (i.e., internal validation) and RingCap banded matrix tablet (i.e., external validation). RESULTS: A statistically significant relationship (r2 = 0.997, P < 0.001) existed between the FD and FA for matrix tablets and was best described by the equation (FA) = 0.984 x (FD) + 0.0133. The percent predictions errors in CMAX and AUCL were <10% when predicting the plasma concentration-time profiles for the two formulations, validating the internal and external predictability of the IVIVC. CONCLUSIONS: The data (i) show that in vitro dissolution data are a good predictor of in vivo fraction absorbed for acetaminophen, (ii) support the general use of in vitro dissolution data for readily soluble and readily absorbed drugs, (iii) suggest that acetaminophen may serve as a model drug for evaluating novel sustained-release delivery systems, and (iv) provide a tangible example of the limitations of current methods for predicting and validating IVIVC.

Acetaminophen↗

PubMed2003

Internal consistency and validity of the Stroke Impact Scale 2.0 (SIS 2.0) and SIS-16 in an Australian sample.

BACKGROUND AND PURPOSE: The impact of stroke is multidimensional however standard stroke measures do not discriminate well when stroke patients are less physically impaired. The Stroke Impact Scale 2.0 (SIS 2.0) is a multidimensional measure of the impact of stroke but its' psychometric properties require further testing. The SIS-16 is a measure of physical functioning designed to be more sensitive to differences in physical functioning than current stroke outcome measures but there is only preliminary information detailing its' reliability and validity. The current study examined the internal consistency and validity of the SIS 2.0 and SIS-16 in an Australian sample of stroke patients. METHODS: The SIS 2.0, SIS-16, World Health Organization Bref-Scale (WHOQOL-BREF) and Zung's Self-Rating Depression Scale (SDS) were completed by 74 stroke patients in rural Victoria, Australia. RESULTS: The item convergent validity index indicated good item convergence of the SIS-16 and SIS 2.0 domains. The item discriminant validity index had only adequate divergence for most SIS 2.0 domains. Internal consistencies of the SIS-16 and SIS 2.0 domains were acceptable (alpha = 0.87-0.95). Correlations between the SIS-16 and SIS 2.0 and the WHOQOL-BREF and SDS supported the convergent and discriminant validity of the SIS-16 and all the dimensions of the SIS 2.0 except 'Participation' which lacked discriminant validity. CONCLUSIONS: The SIS 2.0 and SIS-16 had good psychometric properties with support for the internal consistency and validity of both measures.

Activities of Daily Living↗

PubMedDate not supplied

A review of methodologies for assessing drug effectiveness and a new proposal: randomized database studies.

The need to evaluate the effects of health technologies in clinical practice is increasingly important. In this article, we review the advantages and limitations of naturalistic randomized clinical trials (RCTs) and database analyses, the two primary methods for evaluating treatment effectiveness. Also, we comment on a newer research strategy, cross-design synthesis, which proposes the complementary use of both experimental RCTs and observational database methodologies to avoid the main weaknesses of each: respectively, the lack of external and internal validity. Finally, we propose a new strategy--randomized database studies--capable of generating results with an acceptable balance between internal and external validity. This strategy consists of the simultaneous use of both experimental and observational tools in the assessment of drugs' effectiveness. Randomization is essential to minimize comparison bias, and one possibility for such studies is that randomization modules could be included in computer-based patient records. Although we identify some of the difficulties in implementing the process, the progressive standardization of clinical practice and the development and widespread adoption of improved computer-based patient records could facilitate the use of randomized database studies as a new method of research.

Economics, Pharmaceutical↗

PubMed1999

[Evaluation scale of autistic behavior. Validity and reliability of a scale for autistic behavior detection].

This study aimed to translate, to adapt and to validate the scale of autistic traits (ATA) developed by Ballabriga et al. in Barcelona, by the analysis of 31 patients with mental deficiency and 30 patients with autism, according to the DSM-IV criteria. The "cut off point" found was 15 (p = 0.05); the reliability coefficient was 0.27; the construct validity showed low agreement (kappa = 0.04) and the internal validity was 100%, with all evaluated patients having their clinical diagnosis confirmed through the scale application. The correlation index was 0.42, showing that it is specific for autism. The scale presents discrimination capacity and internal consistency, and the Cronbach's alpha was 0.71. We consider that achieved results show that the scale is reliable to be used in our population.

Adolescent↗

PubMed2003

Inequalities in self-reported health: validation of a new approach to measurement.

This paper assesses the internal validity of using the McMaster 'Health Utility Index Mark III' (HUI) to scale the responses on the typical self-assessed health (SAH) question, "how do you rate your health status in general?" It compares alternative procedures to impose cardinality on the ordinal responses. These include OLS, ordered probit and interval regression approaches. The cardinal measures of health are used to compute and to decompose concentration indices for income-related inequality in health. These results are validated by comparison with the individual variation in the 'benchmark' HUI responses obtained from the Canadian 'National Population Health Survey 1994-1995'. The interval regression approach, which exploits a mapping from the empirical distribution function (EDF) of HUI into SAH, outperforms the other approaches. In addition, we show how the method can be extended to allow for differences in SAH thresholds across different groups of people and to measuring and decomposing 'pure' health inequality.

Bias↗