PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Model performance”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17Linked to original sources

Quality of laboratory performance in testing for human immunodeficiency virus type 1 antibody. Variables associated in multivariate analyses.

In May 1988, the Centers for Disease Control's Model Performance Evaluation Program (Atlanta, Ga) surveyed 1092 laboratories that performed enzyme immunoassays and Western blot tests for human immunodeficiency virus type 1 antibody on mailed plasma samples of known human immunodeficiency virus type 1 antibody reactivity and that described their laboratory characteristics and testing practices. The study objective was to evaluate the quality of laboratory performance in testing for human immunodeficiency virus type 1 antibody. After identifying relevant variables in univariate analyses, multivariate analyses were performed using stepwise logistic models. Human immunodeficiency virus type 1 antibody test performance was independently associated with analytic variables such as commercial test kit used and with nonanalytic variables such as experience, training, and degree requirements of laboratory personnel. These results validate the importance of nonanalytic variables to the quality of outcomes in laboratory testing.

AIDS Serodiagnosis↗

Predicting costs of care using a pharmacy-based measure risk adjustment in a veteran population.

BACKGROUND: Although most widely used risk adjustment systems use diagnosis data to classify patients, there is growing interest in risk adjustment based on computerized pharmacy data. The Veterans Health Administration (VHA) is an ideal environment in which to test the efficacy of a pharmacy-based approach. OBJECTIVE: To examine the ability of RxRisk-V to predict concurrent and prospective costs of care in VHA and compare the performance of RxRisk-V to a simple age/gender model, the original RxRisk, and two leading diagnosis-based risk adjustment approaches: Adjusted Clinical Groups and Diagnostic Cost Groups/Hierarchical Condition Categories. METHODS: The study population consisted of 161,202 users of VHA services in Washington, Oregon, Idaho, and Alaska during fiscal years (FY) 1996 to 1998. We examined both concurrent and predictive model fit for two sequential 12-month periods (FY 98 and FY 99) with the patient-year as the unit of analysis, using split-half validation. RESULTS: Our results show that the Diagnostic Cost Group /Hierarchical Condition Categories model performs best (R2 = 0.45) among concurrent cost models, followed by ADG (0.31), RxRisk-V (0.20), and age/sex model (0.01). However, prospective cost models other than age/sex showed comparable R2: Diagnostic Cost Group /Hierarchical Condition Categories R2 = 0.15, followed by ADG (0.12), RxRisk-V (0.12), and age/sex (0.01). CONCLUSIONS: RxRisk-V is a clinically relevant, open source risk adjustment system that is easily tailored to fit specific questions, populations, or needs. Although it does not perform better than diagnosis-based measures available on the market, it may provide a reasonable alternative to proprietary systems where accurate computerized pharmacy data are available.

Adolescent↗

Meeting the Center for Medicare & Medicaid Services requirements for quality assessment and performance improvement: a model for hospitals.

The Quality Assessment and Performance Improvement (QAPI) model seeks to improve the structures and processes of delivering healthcare to gain better outcomes in patient care. The goal of the model described in this article is to create an integrated approach for hospitals to meet the Center for Medicare & Medicaid Services (CMS) quality requirements. This article describes the results of this data-driven QAPI method via utilization of this model and its processes. The Safety without Restraint task force of Swedish Covenant Hospital was created to evaluate compliance with CMS restraint standards and identify discrepancies that would provide multiple opportunities to improve performance. The use of this model provided nurse leaders an opportunity to improve patient care as well as meet the CMS requirements for QAPI.

Accreditation↗

What Can Studies of Problem-Based Learning Tell Us? Synthesizing and Modeling PBL Effects on National Board of Medical Examination Performance: Hierarchical Linear Modeling Meta-Analytic Approach.

This meta-analytic study 1) examines outcomes from primary research comparing the impact of problem-based learning (PBL) and traditional curricula on medical students' National Board of Medical Examiners (NBME) I and II performance and 2) explores the use of Hierarchical Linear Modeling (HLM) in identifying study and PBL implementation characteristics that predict these outcomes. NBME I and II overall scores were used as dependent variables, with study design (randomized/non-randomized), publication year, and PBL experience (number of years since the adoption of PBL as an instructional method at the time of the reported NBME results) as explanatory variables. Initial unconditional HLM (i.e., without inclusion of potential explanatory variables) results indicated PBL curricula had: 1) a positive, albeit not statistically significant, effect on NBME II, with an average effect size of 0.16; and 2) a negative effect on NBME I, with an average effect size of -0.15. Including explanatory variables in HLM analyses explained additional variability in NBME I effect sizes, and identified study design (gamma^1 = 0.82, p = 0.01) and PBL experience (gamma^3 = 0.07, p = 0.02) as significant predictors of positive PBL effects. Publication year, in contrast, had significant negative effects (gamma^2 = -0.06, p = 0.02). This study explained variability in NBME I effect sizes and clarified the impact of PBL discerned in previous reviews. Implications for future research include the need to examine curriculum features that operationally define PBL, as well as extend the consideration of outcomes on which PBL's impact can be examined.

Journal Article↗

Machine learning-based clinical tool for identifying factors associated with symptomatic knee osteoarthritis: the Nagahama study.

BACKGROUND: A clinical tool that evaluates factors associated with symptomatic knee osteoarthritis (OA) based on modifiable factors is lacking. This study aimed to develop a machine learning-based clinical assessment tool using modifiable factors to identify factors associated with symptomatic knee OA and to determine its accuracy. METHODS: This study included 429 participants (81.8% women; age, 69.0&#xa0;&#xb1;&#xa0;5.3 years) from the Nagahama Study who were &#x2265;60&#xa0;years old and had radiographically confirmed knee OA. A Knee Society Knee Scoring System 2011 symptom score of <23 points defined symptomatic knee OA. Participants were randomly assigned to training (70%) and test (30%) datasets. A machine learning model was developed using Extreme Gradient Boosting with 27 variables, and the SHapley Additive exPlanation (SHAP) values were used to assess feature importance. The top 8 features were translated into a 100-point clinical scoring tool weighted by their SHAP contributions. The cutoff value indicating symptomatic knee OA in the clinical assessment tool was determined using receiver operating characteristic analysis, and model performance was evaluated in both datasets. RESULTS: The clinical assessment tool consisted of low back pain, OA severity, depressive tendencies, knee flexion/extension range of motion, knee extension and hip abduction strength, and lower limb muscle quality. The model showed moderate discriminative performance (AUC 0.771 and 0.773 in the training and test datasets, respectively), with a cutoff point of 47. CONCLUSION: The proposed clinical assessment tool may provide a structured framework for assessing modifiable factors associated with symptomatic knee OA, reflecting their contribution to current symptom status.

Humans↗

Externally validated risk prediction models for gestational diabetes mellitus: A systematic review and meta-analysis.

INTRODUCTION: Risk prediction models for gestational diabetes mellitus (GDM) offer potential for early identification and targeted prevention. External validation is crucial to assess model performance across diverse populations. Despite the availability of numerous GDM prediction models, limited evidence exists on their external validation frequency, methodological quality, and clinical applicability. This systematic review evaluated externally validated GDM prediction models, focusing on methodological rigor, reporting standards, and clinical relevance to inform future research and implementation. MATERIAL AND METHODS: Databases including Ovid MEDLINE, Embase, Scopus, Emcare, and CINAHL were searched up to May 1, 2025. Studies reporting external validation of GDM risk prediction models were included. Two reviewers independently screened studies. Data were extracted using the CHARMS framework, and risk of bias and applicability were assessed using PROBAST+AI. The study protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO; CRD420251125758). RESULTS: Twenty-six studies validated 33 models, with validation sample sizes ranging from 50 to 75&#x2009;161. Over half used the IADPSG criteria to define GDM. Discrimination metrics were commonly reported, but calibration, overall performance, and clinical utility were often lacking. Meta-analysis was feasible for only four models: Teede et&#xa0;al., Nanda et&#xa0;al., Naylor et&#xa0;al., and Van Leeuwen et&#xa0;al., each showing fair discrimination. The Teede et&#xa0;al. model was the most widely validated, with 11 external validations across six continents and a pooled AUC of 0.72 (95% CI: 0.67-0.76). Despite fewer validations, the Nanda et&#xa0;al. model achieved the highest pooled discrimination (5 validations; pooled AUC 0.77, 95% CI: 0.74-0.80). The Naylor et&#xa0;al. and van Leeuwen et&#xa0;al. models also underwent meta-analysis, as sufficient external validation studies were available to support comparative performance assessment. Notably, 69.23% of studies had a high risk of bias. CONCLUSIONS: While many models showed acceptable predictive performance, most validations were methodologically weak. Future studies should follow best-practice guidelines and promote scalable validation strategies, such as algorithm sharing, to enhance clinical utility.

Humans↗

A performance adequate computational model for auditory localization.

A computational model of auditory localization resulting in performance similar to humans is reported. The model incorporates both the monaural and binaural cues available to a human for sound localization. Essential elements used in the simulation of the processes of auditory cue generation and encoding by the nervous system include measured head-related transfer functions (HRTFs), minimum audible field (MAF), and the Patterson-Holdsworth cochlear model. A two-layer feed-forward back-propagation artificial neural network (ANN) was trained to transform the localization cues to a two-dimensional map that gives the direction of the sound source. The model results were compared with (i) the localization performance of the human listener who provided the HRTFs for the model and (ii) the localization performance of a group of 19 other human listeners. The localization accuracy and front-back confusion error rates exhibited by the model were similar to both the single listener and the group results. This suggests that the simulation of the cue generation and extraction processes as well as the model parameters were reasonable approximations to the overall biological processes. The amplitude resolution of the monaural spectral cues was varied and the influence on the model's performance was determined. The model with 128 cochlear channels required an amplitude resolution of approximately 20 discrete levels for encoding the spectral cue to deliver similar localization performance to the group of human listeners.

Humans↗

Toward a metatheoretical model of cognitive development.

Recently Piaget's model of cognitive development has been seriously questioned. This questioning was due partially to the inadequacy of the model in explaining creative, scientific and mature thought in adulthood. Various proposals have suggested the existence of a fifth stage in cognitive to represent adult thought. A second tradition has focused on the Piagetian model as a competence model. This has initiated a search for an appropriate performance model to describe the processes by which knowledge is actively constructed and applied. The present work reviews the theoretical positions and the research relevant to issue and proposes a synthesis through which cognitive development can be viewed as being both product and process, competence and performance, structure and function simultaneously.

Adult↗

Summary of the key features of seven biomathematical models of human fatigue and performance.

BACKGROUND: Biomathematical models that quantify the effects of circadian and sleep/wake processes on the regulation of alertness and performance have been developed in an effort to predict the magnitude and timing of fatigue-related responses in a variety of contexts (e.g., transmeridian travel, sustained operations, shift work). This paper summarizes key features of seven biomathematical models reviewed as part of the Fatigue and Performance Modeling Workshop held in Seattle, WA, on June 13-14, 2002. The Workshop was jointly sponsored by the National Aeronautics and Space Administration, U.S. Department of Defense, U.S. Army Medical Research and Materiel Command, Office of Naval Research, Air Force Office of Scientific Research, and U.S. Department of Transportation. METHODS: An invitation was sent to developers of seven biomathematical models that were commonly cited in scientific literature and/or supported by government funding. On acceptance of the invitation to attend the Workshop, developers were asked to complete a survey of the goals, capabilities, inputs, and outputs of their biomathematical models of alertness and performance. Data from the completed surveys were summarized and juxtaposed to provide a framework for comparing features of the seven models. RESULTS: Survey responses revealed that models varied greatly relative to their reported goals and capabilities. While all modelers reported that circadian factors were key components of their capabilities, they differed markedly with regard to the roles of sleep and work times as input factors for prediction: four of the seven models had work time as their sole input variable(s), while the other three models relied on various aspects of sleep timing for model input. Models also differed relative to outputs: five sought to predict results from laboratory experiments, field, and operational data, while two models were developed without regard to predicting laboratory experimental results. All modelers provided published papers describing their models, with three of the models being proprietary. CONCLUSIONS: Although all models appear to have been fundamentally influenced by the two-process model of sleep regulation by Borbély, there is considerable diversity among them in the number and type of input and output variables, and their stated goals and capabilities.

Aircraft↗

Mean square error of estimates of HIV prevalence and short-term AIDS projections derived by backcalculation.

We simulated multinomial AIDS incidence counts from 27 'representative' AIDS epidemics that spanned a period corresponding to previous applications of backcalculation (1 January 1977 to 1 July 1987) and assessed mean square error for several back-calculated estimators of HIV prevalence and short-term AIDS projections. Estimators were based on flexible model selection procedures that chose the best-fitting non-negatively constrained model of the infection curve from a family of possible step-function models. Selection of the best-fitting model from a family of four-step models each with a long last step of width of 4 or 4.5 years offered a favourable tradeoff between bias and variance when compared with selection from families of models with three steps or from families with a short last step. Five-step models performed as well as four-step models. Three-step models had substantially larger mean square error in some epidemic situations. Percentage root mean square error (PRMSE) for estimates of cumulative HIV prevalence as of 1 January 1985 was less than 14 per cent over a range of hypothetical epidemics of N = 50,000 infected individuals. PRMSE for short-term projections was less than 18 per cent. Estimates of cumulative HIV prevalence as of 1 July 1987 were substantially more uncertain and had a PRMSE of 33 per cent in the unfavourable case of a rapidly rising HIV epidemic. Estimates of cumulative HIV prevalence as of 1 July 1987 were positively biased in HIV epidemics with a rapidly decreasing recent HIV incidence rate and negatively biased in rapidly increasing HIV epidemics. Despite these uncertainties, we obtained useful estimates even for HIV epidemics with as few as 5000 infected individuals.

Acquired Immunodeficiency Syndrome↗

Human sleep and circadian rhythms: a simple model based on two coupled oscillators.

We propose a model of the human circadian system. The sleep-wake and body temperature rhythms are assumed to be driven by a pair of coupled nonlinear oscillators described by phase variables alone. The novel aspect of the model is that its equations may be solved analytically. Computer simulations are used to test the model against sleep-wake data pooled from 15 studies of subjects living for weeks in unscheduled, time-free environments. On these tests the model performs about as well as the existing models, although its mathematical structure is far simpler.

Body Temperature↗

Mould germination: data treatment and modelling.

The objectives of this study were i/ to examine germination data sets over a range of environmental conditions (water activity, temperature) for eight food spoilage moulds, ii/ to compare the ability of the Gompertz equation and logistic function to fit the experimental plots, iii/ to simulate germination by assessing various distributions of the latent period for germination amongst a population of spores. Data sets (percentage germination, P (%), versus time, t) of Aspergillus carbonarius, Aspergillus ochraceus, Fusarium verticillioides, Fusarium proliferatum, Gibberella zeae, Mucor racemosus, Penicillium chrysogenum and Penicillium verrucosum were analysed. No correlation, or relationship between the mean percentage [mean (P)] and the variance [var (P)] was found. Therefore no transformation of the germination data was required. Experimental data were fitted by using the Gompertz equation P = A exp (-exp [mu(m) e/A (delta - t) + 1]) and the logistic function P = Pmax/(1 + exp (k (tau - t))). Based on the residual mean square error (RMSE), no model performed better than the other one. However, model parameters were generally determined more precisely with the logistic model than with the Gompertz one. The time course of fungal spore germination curves was simulated assuming different distributions of the latent period for germination, lag, amongst a population of spores. The growth rate of germ tubes was calculated by means of the relationship: lag x rate = k. For normal Gaussian distributions, germination curves were symmetrical with respect to the inflection point and should be modelled with the logistic function. Skewed distributions were capable of simulating an asymmetric germination curve that was fitted by the Gompertz model. Future studies should be conducted for assessing whether the distributions assumed in this paper are in accordance with the experimental distributions that are still unknown.

Colony Count, Microbial↗

Capability and limitations of first-order and diffusion approaches to describe long-term sorption of chlortoluron in soil.

This paper compares the capability of a first-order and a spherical diffusion model to describe and predict long-term sorption and desorption processes of chlortoluron in two soils. Chlortoluron sorption was investigated at different time scales utilizing one rate experiment (120 days) and two sorption/desorption experiments. Experimental periods for sorption and desorption were set to 1 day (five desorption steps) and 30 days (three desorption steps), respectively. Upon fitting, the two models satisfactorily described the whole set of data. The spherical diffusion model performed better than the first-order model. We then tested the predictive capability of the models by predicting 30-day sorption/desorption data using kinetic parameters fitted on 1-day sorption/desorption data only. While the spherical diffusion model was able to predict the 30-day data set, the first-order model failed completely. Fitting both models to subsets of the data corresponding to different experimental time scales revealed that the rate parameter as well as the Freundlich coefficient of the first-order model are strongly time-dependent--a property that is not shared by parameters of the spherical diffusion model. The apparent stability of the spherical diffusion model with regard to time dependency of its parameters indicates that sorptive uptake may be diffusion-controlled. This also explains the models greater predictive power across different time scales compared to the first-order model. Finally, we investigate the suitability of solute class specific log-linear relationships between the first-order rate parameter and the Freundlich coefficient presented by earlier researchers in the light of the time dependency observed for the parameters of the first-order model.

Absorption↗

The evaluation of road-rail crossing safety with limited accident statistics.

Safety evaluation is an essential issue in ranking road-rail crossings as candidates for grade-separation. Many small countries like Israel do not possess sufficient data to generate statistical models similar to the US DOT accident prediction formula or others. At the same time, it is desirable to provide estimates stemming from local conditions. For these, available Israeli accident data were artificially enlarged using the unification of accident statistics and information from crossings functioning over a six-year period. A hazard index serves as a basic evaluation tool. The datasets on accidents and crossings are split according to several crossing characteristics (category of warning device, volume of vehicle traffic, volume of train traffic, visibility conditions); the obtained values are combined to supply safety estimates for crossing types defined by these characteristics. The validity of model performance is explored. For Israeli conditions the model provides for a safety evaluation of 168 crossing types. This presents a sufficient base from which to estimate the accident potential of any local crossing when the need for its grade separation is discussed.

Accidents, Traffic↗

On the use of the Weibull model to describe thermal inactivation of microbial vegetative cells.

This paper evaluates the applicability of the Weibull model to describe thermal inactivation of microbial vegetative cells as an alternative for the classical Bigelow model of first-order kinetics; spores are excluded in this article because of the complications arising due to the activation of dormant spores. The Weibull model takes biological variation, with respect to thermal inactivation, into account and is basically a statistical model of distribution of inactivation times. The model used has two parameters, the scale parameter alpha (time) and the dimensionless shape parameter beta. The model conveniently accounts for the frequently observed nonlinearity of semilogarithmic survivor curves, and the classical first-order approach is a special case of the Weibull model. The shape parameter accounts for upward concavity of a survival curve (beta < 1), a linear survival curve (beta = 1), and downward concavity (beta > 1). Although the Weibull model is of an empirical nature, a link can be made with physiological effects. Beta < 1 indicates that the remaining cells have the ability to adapt to the applied stress, whereas beta > 1 indicates that the remaining cells become increasingly damaged. Fifty-five case studies taken from the literature were analyzed to study the temperature dependence of the two parameters. The logarithm of the scale parameter alpha depended linearly on temperature, analogous to the classical D value. However, the temperature dependence of the shape parameter beta was not so clear. In only seven cases, the shape parameter seemed to depend on temperature, in a linear way. In all other cases, no statistically significant (linear) relation with temperature could be found. In 39 cases, the shape parameter beta was larger than 1, and in 14 cases, smaller than 1. Only in two cases was the shape parameter beta = 1 over the temperature range studied, indicating that the classical first-order kinetics approach is the exception rather than the rule. The conclusion is that the Weibull model can be used to model nonlinear survival curves, and may be helpful to pinpoint relevant physiological effects caused by heating. Most importantly, process calculations show that large discrepancies can be found between the classical first-order approach and the Weibull model. This case study suggests that the Weibull model performs much better than the classical inactivation model and can be of much value in modelling thermal inactivation more realistically, and therefore, in improving food safety and quality.

Bacteria↗

Kinetic modeling of virus transport at the field scale.

Bacteriophage removal by soil passage in two field studies was re-analyzed with the goal to investigate differences between one- and two-dimensional modeling approaches, differences between one- and two-site kinetic sorption models, and the role of heterogeneities in the soil properties. The first study involved removal of bacteriophages MS2 and PRDI by dune recharge, while the second study represented removal of MS2 by deep well injection. In both studies, removal was higher during the first meters of soil passage than thereafter. The software packages HYDRUS-ID and HYDRUS-2D, which simulate water flow and solute transport in one- and two-dimensional variably saturated porous media, respectively, were used. The two codes were modified by incorporating reversible adsorption to two types of kinetic sites. Tracer concentrations were used first to calibrate flow and transport parameters of both models before analyzing transport of bacteriophages. The one-dimensional one-site model did not fully describe the tails of the measured breakthrough curves of MS2 and PRD1 from the dune recharge study. While the one-dimensional one-site model predicted a sudden decrease in virus concentrations immediately after the peaks, measured data displayed much smoother decline and tailing. The one-dimensional two-site model simulated the overall behavior of the breakthrough curves very well. The two-dimensional one-site model predicted a more gradual decrease in virus concentrations after the peaks than the one-dimensional one-site model, but not as good as the one-dimensional two-site model. The dimensionality of the problem hence can partly explain the smooth decrease in concentration after peak breakthrough. The two-dimensional two-site model provided the best results. Values for k(att2) and k(det2) could not be determined at the last two of four monitoring wells, thus suggesting that either a second type of kinetic sites is present in the first few meters of dune passage and not beyond the second monitoring well, or that effects of soil heterogeneity and dimensionality of the problem overshadowed this process. Variations between single collector efficiencies were relatively small, whereas collision efficiencies varied greatly. This implies that the nonlinear removal of MS2 and PRD1 is mainly caused by variations in interactions between grain and virus surfaces rather than by physical heterogeneity of the porous medium. Similarly, a two-site model performed better than the one-site model in describing MS2 concentrations for the deep well injection study. However, the concentration data were too sparse in this study to have much confidence in the fitted parameters.

Adsorption↗

Evaluation of the current state of mechanistic aquatic biogeochemical modeling: citation analysis and future perspectives.

We examined the factors that determine the citations of 153 mechanistic aquatic biogeochemical modeling papers published from 1990 to 2002. Our analysis provides overwhelming evidence that ocean modeling is a dynamic area of the current modeling practice. Models developed to gain insight into the ocean carbon cycle/marine biogeochemistry are most highly cited, the produced knowledge is exported to other cognitive disciplines, and oceanic modelers are less reluctant to embrace technical advances (e.g., assimilation schemes) and more critically increase model complexity. Contrary to our predictions, model application for environmental management issues on a local scale seems to have languished; the pertinent papers comprise a smaller portion of the published modeling literature and receive lower citations. Given the critical planning information that these models aim to provide, we hypothesize that the latter finding probably stems from conceptual weaknesses, methodological omissions, and an evident lack of haste from modelers to adopt new ideas in their repertoire when addressing environmental management issues. We also highlight the lack of significant association between citation frequency and model complexity, model performance, implementation of conventional methodological steps during model development (e.g., validation, sensitivity analysis), number of authors, and country of affiliation. While these results cast doubt on the rationale of the current modeling practice, the fact that the Fasham et al. (1990) paper has received over 400 citations probably dictates what should be done from the modeling community to meet the practical need for attractive and powerful modeling tools.

Chemistry↗

Psychological stress in nurses' relationships with HIV-infected patients: the risk of burnout syndrome.

To assess the role played by psychological stress and sociodemographic factors as predictors of burnout in nurses, we administered the AIDS Impact Scale (AIS) and the Maslach Burnout Inventory (MBI) to nurses in the AIDS field. The sample was composed of 410 nurses from 19 departments for the treatment of infectious diseases. In these subjects we observed a low level of burnout in the MBI, but a small proportion had a high level of burnout We did not find significant associations between sociodemographic variables and the MBI scales. We found significant correlations between the MBI and three AIS scales that specifically assessed the emotional involvement of nurses in their relationships with patients. The results suggest that an empathic involved relationship seems to be protective towards burnout rather than a frustrating involved relationship. Moreover nurses tolerate stress better if they receive supportive social rewards. We found that the impact of working with HIV-infected patients causes psychological stress (measured with the AIS), but it is a weak predictor of burnout (measured with the MBI). The results indicated the incompatibility between the relational/defensive model of the AIS and the environmental/work performance model of the MBI.

Adult↗