PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Scoring framework”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 recordsLinked to original sources

PRISM-G: an interpretable privacy scoring framework for assessing risk in synthetic human genome data.

MOTIVATION: Synthetic genomic data promises broader data access, but unresolved privacy risks remain a major concern. Existing evaluations often rely on similarity-based metrics that measure proximity between real and synthetic genomes, overlooking additional mechanisms through which genomic information may leak. RESULTS: We introduce PRISM-G, a model-agnostic framework that quantifies privacy exposure in synthetic genomic data across three complementary components: proximity to real genomes in genetic-coordinate space, replay of familial or population-structure patterns, and trait-linked exposure through rare variants and membership-inference signals. These components are normalized and combined through a risk-averse aggregation into a single 0-100 PRISM-G score. By pairing PRISM-G with downstream utility metrics, the framework also enables analysis of privacy-utility trade-offs across generative models. We evaluated PRISM-G on synthetic cohorts generated by a generative adversarial network (GAN), a restricted Boltzmann machine (RBM), and a logic-based SAT solver (Genomator). Our results show that privacy vulnerabilities arise along different axes across models and marker densities, demonstrating that a single similarity-based metric is insufficient to characterize genomic privacy risk. AVAILABILITY AND IMPLEMENTATION: The source code of PRISM-G is available at https://github.com/alejocrojo09/prismg.

Humans↗

Overall quality of outcomes framework scores lower in practices in deprived areas.

BACKGROUND: There has been much debate as to whether quality points allocated through the new general medical services contract are more difficult to achieve for practices in deprived and rural areas. We used multiple regression to assess the relationships between deprivation, rurality and the number of overall quality points achieved by each practice. Multiple deprivation was significantly inversely related to quality points achieved. Practices in villages and towns gained 2% more quality points than urban areas and hamlets.

Family Practice↗

The expected polygenic risk score (ePRS) framework: an equitable metric for quantifying polygenetic risk via modeling of ancestral makeup.

Polygenic risk scores (PRSs) depend on genetic ancestry due to differences in allele frequencies between ancestral populations. This leads to implementation challenges in diverse populations. We propose a framework to calibrate PRS based on ancestral makeup. We define a metric called "expected PRS" (ePRS), the expected value of a PRS based on one's global or local admixture patterns. We further define the "residual PRS" (rPRS), measuring the deviation of the PRS from the ePRS. Simulation studies confirm that it suffices to adjust for ePRS to obtain nearly unbiased estimates of the PRS-outcome association without further adjusting for PCs. Using the TOPMed dataset, the estimated effect size of the rPRS adjusting for the ePRS is similar to the estimated effect of the PRS adjusting for genetic PCs. Similarly, we applied the ePRS framework to six cardiovascular-related traits in the All of Us dataset, and the results are consistent with those from the TOPMed analysis. The ePRS framework can protect from population stratification in association analysis and provide an equitable strategy to quantify genetic risk across diverse populations.

Journal Article↗

Functional Prediction of Epitranscriptome.

N6-methyladenosine (m6A) is one of the most prevalent and well-studied RNA modifications, playing a pivotal role in many biological processes. With the recent advances in high-throughput sequencing technologies, tens of thousands of m6A sites have been reported. However, not all m6A sites are important or functionally significant, highlighting the need to distinguish biologically relevant m6As from non-functional or technically artefactual ones. Here, we describe ConsRM, which is a web-based resource that was designed to evaluate the importance of m6As from an evolutionary perspective. It introduced a novel scoring framework for quantifying the conservation degree of m6As in humans. Its web interface includes a database of 177998 distinct human m6A sites along with their calculated conservation score, and allows users to analyze their own data via the web server. ConsRM is freely accessible at: http://180.208.58.19/conservation/browser.html .

Humans↗

Associations on the Fly, a new feature aiming to facilitate exploration of the Open Targets Platform evidence.

MOTIVATION: The Open Targets Platform (https://platform.opentargets.org) is a unique, comprehensive, open-source resource supporting systematic identification and prioritisation of targets for drug discovery. The Platform combines, harmonizes and integrates data from >20 diverse sources to provide target-disease associations, covering evidence derived from genetic associations, somatic mutations, known drugs, differential expression, animal models, pathways and systems biology. An in-house target identification scoring framework weighs the evidence from each data source and type, contributing to an overall score for each of the 7.8M target-disease associations. However, the old infrastructure did not allow user-led dynamic adjustments in the contribution of different evidence types for target prioritisation, a limitation frequently raised by our user community. Furthermore, the previous Platform user interface did not support navigation and exploration of the underlying target-disease evidence on the same page, occasionally making the user journey counterintuitive. RESULTS: Here, we describe 'Associations on the Fly' (AOTF), a new Platform feature-developed with a user-centred vision-that enables the user to formulate more flexible therapeutic hypotheses through dynamic adjustment of the weight of contributing evidence from each source, altering the prioritisation of targets. AVAILABILITY AND IMPLEMENTATION: The codebases that power the Platform-including our pipelines, GraphQL API, and React UI-are all open source and licensed under the APACHE LICENSE, VERSION 2.0. You can find all of our code repositories on GitHub at https://github.com/opentargets and on Zenodo at https://zenodo.org/records/14392214. This tool was implemented using React v18 and its code is accessible here: (https://github.com/opentargets/ot-ui-apps). The tools are accessible through the Open Targets Platform web interface (https://platform.opentargets.org/) and GraphQL API (https://platform-docs.opentargets.org/data-access/graphql-api). Data is available for download here: (https://platform.opentargets.org/downloads) and from the EMBL-EBI FTP: (https://ftp.ebi.ac.uk/pub/databases/opentargets/platform/).

Software↗

STRING: a database of predicted functional associations between proteins.

Functional links between proteins can often be inferred from genomic associations between the genes that encode them: groups of genes that are required for the same function tend to show similar species coverage, are often located in close proximity on the genome (in prokaryotes), and tend to be involved in gene-fusion events. The database STRING is a precomputed global resource for the exploration and analysis of these associations. Since the three types of evidence differ conceptually, and the number of predicted interactions is very large, it is essential to be able to assess and compare the significance of individual predictions. Thus, STRING contains a unique scoring-framework based on benchmarks of the different types of associations against a common reference set, integrated in a single confidence score per prediction. The graphical representation of the network of inferred, weighted protein interactions provides a high-level view of functional linkage, facilitating the analysis of modularity in biological processes. STRING is updated continuously, and currently contains 261 033 orthologs in 89 fully sequenced genomes. The database predicts functional interactions at an expected level of accuracy of at least 80% for more than half of the genes; it is online at http://www.bork.embl-heidelberg.de/STRING/.

Algorithms↗

ECLIPSE: exploring the dark proteome of ESKAPE pathogens through the sequence similarity network of the Protein Universe Atlas.

MOTIVATION: The accelerating crisis of antimicrobial resistance among the critical so-called ESKAPE pathogens demands the urgent identification of novel molecular targets. However, a substantial fraction of ESKAPE proteomes remains functionally uncharacterized, with many genes annotated as encoding hypothetical proteins. These protein sequences often lack significant similarity to known protein families when conventional homology-based annotation methods are used and thus remain "dark". This limits our ability to explore their roles in pathogenicity, and it is thus crucial to bridge this substantial gap in pathogen biology by developing new strategies to illuminate these "dark" regions of the ESKAPE pan-proteome. RESULTS: We introduce ECLIPSE (ESKAPE Connectome Linkage and Inference for Proteome Sequence Exploration), a network-based computational framework that systematically identifies and prioritizes functionally dark protein families in ESKAPE pan-proteomes. ECLIPSE embeds target ESKAPE pathogen proteomes within the global sequence similarity network of the Protein Universe Atlas. It detects connected components composed entirely of unannotated proteins, called the "dark proteome." As a case study, we applied ECLIPSE to a pan-proteome of 3 460 657 protein sequences from 635 strains of Pseudomonas aeruginosa (PA). ECLIPSE identified 120 985 proteins (4%) residing in completely dark connected components. Furthermore, we have performed a taxonomic diversity analysis using normalized Shannon indices to characterize each dark component by its enrichment in ESKAPE pathogens. The analysis utilized the evenness (E) value (see Methods 2.1), which distinguishes Pseudomonas-specific (target-specific) from ESKAPE-enriched dark components. We then developed the Dark Proteome Prioritization Score (DPPS), a composite multidimensional scoring framework (see Methods 2.5). It ranks these dark components by biological relevance across four orthogonal axes: (i) functional darkness, (ii) P. aeruginosa proportion in the Atlas, (iii) AMR-clade taxonomic restriction, and (iv) conservation across the 635 P. aeruginosa strains. This framework outputs a robust four-tier scoring system; the prioritized Tier I components were validated by weight sensitivity analysis and remained stable across 500 Monte Carlo weight perturbations. Structural characterization of one of the top-ranked ESKAPE-enriched dark components revealed that it belongs to the beta-barrel fold DUF1302 (PF06980) family, for which no experimentally solved three-dimensional structure exists in the PDB. The genomic context analysis indicates that it is co-localized with a LuxR-type transcriptional regulator. Collectively, ECLIPSE identifies evolutionarily conserved, structurally defined, and functionally dark proteins enriched across ESKAPE pathogens; these dark proteins can further be utilized as alternative antimicrobial targets for experimental characterization. AVAILABILITY AND IMPLEMENTATION: The source code and dataset are available for free at: Github: https://github.com/surabhilata/ECLIPSE.git, Zenodo: DOI: 10.5281/zenodo.21064323.

Proteome↗

Cross sectional study of performance indicators for English Primary Care Trusts: testing construct validity and identifying explanatory variables.

BACKGROUND: The performance of Primary Care Trusts in England is assessed and published using a number of different performance indicators. Our study has two broad purposes. Firstly, to find out whether pairs of indicators that purport to measure similar aspects of quality are correlated (as would be expected if they are both valid measures of the same construct). Secondly, we wanted to find out whether broad (global) indicators correlated with any particular features of Primary Care Trusts, such as expenditure per capita. METHODS: Cross sectional quantitative analysis using data from six 2004/05 PCT performance indicators for 303 English Primary Care Trusts from four sources in the public domain: Star Rating, aggregated Quality and Outcomes Framework scores, Dr Foster mortality index, Dr Foster equity index (heart by-pass and hip replacements), NHS Litigation Authority Risk Management standards and Patient Satisfaction scores from the Star Ratings. Forward stepwise multiple regression analysis to determine the effect of Primary Care Trust characteristics on performance. RESULTS: Star Rating and Quality and Outcomes Framework total, both summary measures of global quality, were not correlated with each other (F = 0.66, p = 0.57). There were however positive correlations between Quality and Outcomes Framework total and patient satisfaction (r = 0.61, p < 0.001) and between screening/'additional services' indicators on the Star Ratings and Quality and Outcomes Framework (F = 24, p < 0.001). There was no correlation between different measures of access to services. Likewise we found no relationship between either Star Rating or Litigation Authority Standards and hospital mortality (F = 0.61, p = 0.61; F = 0.31, p = 0.73). CONCLUSION: Performance assessment in healthcare remains on the Government's agenda, with new core and developmental standards set to replace the Star Ratings in 2006. Yet the results of this analysis provide little evidence that the current indicators have sufficient construct validity to measure the underlying concept of quality, except when the specific area of screening is considered.

Catchment Area, Health↗

Developing a prioritisation framework in an English Primary Care Trust.

BACKGROUND: In the English NHS, Primary Care Trusts (PCTs) are required to commission health services, to maximise the well-being of the population, subject to the available budget. There are numerous techniques employed to make decisions, some more rational and transparent than others. A weighted benefit score can be used to rank options but this does not take into account value for money from investments. METHODS: We developed a weighted benefit score framework for use in an English PCT which ranked options in order of 'cost-value' or 'cost per point of benefit'. Our method differs from existing techniques by explicitly combining cost and a composite weighted benefit score into the cost-value ratio. RESULTS: The technique proved readily workable, and was able to accommodate a wide variety of data and competing criteria. Participants felt able to assign scores to proposed services, and generate a ranked list, which provides a solid starting point for the PCT Board to discuss and make funding decisions. Limitations included potential for criteria to be neither exhaustive nor mutually exclusive and the lack of an interval property in the benefit score limiting the usefulness of a cost-value ratio. CONCLUSION: A technical approach to decision making is insufficient for making prioritisation decisions, however our technique provides a very valuable, structured and informed starting point for PCT decision making.

Journal Article↗

Organoids in translation: a bench-to-bedside framework for pancreatic cancer precision medicine.

INTRODUCTION: Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal malignancies with a 5-year survival rate of < 13%. Standard treatments such as FOLFIRINOX or gemcitabine/nab-paclitaxel yield modest response rates, underscoring the urgent need for precision oncology approaches. Patient-derived organoids (PDOs) preserve the genomic, phenotypic, and histopathological features of the source tumor and offer a promising platform for drug screening, biomarker development, and personalized therapy. However, a systematic evaluation of their translational capacities is lacking. METHODS: A systematic review was conducted according to the PRISMA 2020 guidelines (PROSPERO registration pending) using PubMed, EMBASE, and Cochrane CENTRAL (December 10, 2024) to identify English-language PDAC PDO studies that incorporated therapeutic testing. Ninety-five studies met the inclusion criteria. Data extraction captured >75 variables per study, including spanning culture methodology, therapeutic profiling, biomarker integration, and clinical correlation. A 13-domain weighted Translatability Scoring Framework adapted from Wehling et al. assessed predictive validity, biomarker strength, pharmacogenetics, and clinical trial alignment. Scores ranged from 0 to 5 and were categorized as good (>4.0), moderate (3.0-4.0), or low (<3.0) translational potential. RESULTS: Of the 95 studies, 70.5% have been published since 2021, reflecting the rapid growth in this field. The mean PDO generation success rate was 89.7%, with the primary tumor tissue being the predominant source (48.4%). Only 24.8% were directly linked to clinical trials and 5.3% incorporated multi-omic profiling. The median translatability score was 3.13 (range, 1.72-4.59): 45.3% of the studies had low translatability, 50.5% moderate, and only 4.2% had good translational potential. High-scoring studies consistently combine multi-omic biomarker platforms, in vivo validation, clinical outcome correlation, and prospective trial integration. Conversely, the weakest domains were pharmacogenetics, endpoint strategies, and biomarker validation, limiting their overall clinical relevance. CONCLUSIONS: PDOs have demonstrated strong feasibility and in vitro clinical correlation in PDAC; however, their clinical translation remains constrained by limited multi-omic integration, absence of pharmacogenomic modeling, and sparse clinical trial embedding. Standardization of protocols, adoption of harmonized and clinically relevant endpoints, and systematic incorporation of biomarker-driven co-clinical trial frameworks are urgently needed to transition PDOs from promising experimental surrogates to validating precision oncology tools capable of informing therapeutic decision-making in PDAC.

Humans↗

NFS1 activates PI3K/AKT/mTOR signaling to upregulate GPX4 expression and enhance ferroptosis resistance in osteosarcoma.

Osteosarcoma continues to exhibit poor survival outcomes due to chemoresistance and metastasis, with metabolic reprogramming and ferroptosis resistance being key features of tumor heterogeneity, yet their upstream regulators remain poorly defined. NFS1, a cysteine desulfurase essential for iron-sulfur cluster biogenesis, protects multiple cancers from ferroptosis, but its role in osteosarcoma is unknown. In this study, we performed a transcriptomic meta-analysis and found that NFS1 expression was significantly upregulated in osteosarcoma tissues, with further elevation in metastatic lesions, and high NFS1 expression correlated with poor overall survival. Genome&#x2011;wide CRISPR screening data revealed a marked NFS1 dependency in osteosarcoma cell lines. Functionally, NFS1 promoted cell proliferation, migration, and invasion, whereas its knockdown suppressed these phenotypes. Using single&#x2011;cell RNA sequencing data from 27 osteosarcoma specimens, we applied a multi&#x2011;algorithm glycolytic scoring framework and observed NFS1 enrichment in highly glycolytic malignant cells, along with an association with PI3K/AKT/mTOR pathway activation. Mechanistically, NFS1 selectively enhanced PI3K, AKT, and mTOR phosphorylation without altering total protein levels, and upregulated GPX4, a central ferroptosis suppressor, leading to elevated ferroptosis resistance scores in NFS1&#x2011;high malignant cells. Collectively, these findings identify a previously unrecognized NFS1-PI3K/AKT/mTOR-GPX4 regulatory axis in osteosarcoma, linking metabolic reprogramming to ferroptosis resistance, and suggest that NFS1 functions as an oncogenic driver, as well as a promising prognostic biomarker and therapeutic target in osteosarcoma.

Humans↗

CoMR: an integrative scoring pipeline for comprehensive mitochondrial proteome reconstruction across eukaryotes.

Mitochondrial proteome reconstruction from eukaryotic sequence data typically relies on prediction of mitochondrial targeting signals (MTSs). However, MTS predictors are primarily trained on model organisms and may perform poorly in phylogenetically divergent lineages or in organisms with atypical or reduced targeting sequences. Accurate reconstruction therefore requires integration of complementary sources of evidence beyond targeting prediction alone. We developed Comprehensive Mitochondrial Reconstructor (CoMR), an integrative workflow that combines targeting prediction, curated homology searches, large-scale similarity searches, and automated phylogenetic analysis within a unified scoring framework. Benchmarking on the model yeast Saccharomyces cerevisiae yielded strong discriminatory performance [receiver operating characteristic (ROC)-area under the curve (AUC)&#x2009;=&#x2009;0.92], exceeding standalone prediction with TargetP2, a predictor of N-terminal targeting peptides (ROC-AUC&#x2009;=&#x2009;0.72). In the divergent anaerobic protist Paratrimastix pyriformis, CoMR maintained robust performance (ROC-AUC&#x2009;=&#x2009;0.86) validated with an experimental proteome despite extreme class imbalance, achieving a precision-recall AUC of 0.183 (~78-fold enrichment over random expectation and&#x2009;~10-fold improvement over TargetP2). Ablation analyses demonstrate that predictive performance is robust to individual evidence-layer removal, while overlap analyses showed that homology-based searches recovered candidates missed by targeting predictors, particularly in P. pyriformis. Overall, CoMR improves mitochondrial proteome reconstruction over targeting prediction alone and provides a reproducible workflow for predicting mitochondrial and mitochondrion-related organelle protein repertoires across eukaryotes to aid investigations of organelle evolution and proteome reduction.

Proteome↗

PGS-GS: a framework integrating polygenic scores and genomic selection in animal breeding.

Genomic prediction has become a central paradigm in biology, enabling quantitative inference of genetic contributions to complex traits across humans, animals, and plants. Although genomic research in human genetics and animal breeding shares a highly homologous methodological foundation, significant barriers persist in their analytical paradigms and application scenarios. This study aims to promote cross-disciplinary integration by introducing human-derived polygenic scores (PGS) algorithms into animal genomic selection (GS) and proposing a PGS-GS framework with a preliminary weighting-based implementation. We systematically benchmarked the predictive performance and computational efficiency of 20 algorithms, including classical linear models, machine learning, PGS, and PGS-GS using both array and whole-genome sequencing (WGS) data across four major agricultural species: beef cattle, sheep, pigs, and chickens. Our results demonstrate that PGS and PGS-GS algorithms achieve predictive accuracy competitive with genomic best linear unbiased prediction (GBLUP) while offering markedly higher computational efficiency. Moreover, incorporating PGS-derived prior information into weighted linear and non-linear models outperformed conventional weighted GBLUP. The results provide empirical evidence to inform algorithm selection and highlight the potential of integrating human-derived PGS methodologies into animal genomic prediction frameworks.

Animals↗

Item response theory test equating in health sciences education.

In the context of health sciences education, and education in general, the knowledge or ability of one or several subjects in a specific area is frequently compared using different forms of a test, or by means of different instruments aimed at measuring this knowledge or ability. In such cases, test scores must be equated so that they can be properly compared. The present article aims to explain the equating of scores within the framework of item response theory (IRT), special emphasis being placed on its application in the field of health sciences education. Although there are many data collection designs that can be used within the framework of score equating, the three most widely used designs are single group, randomly equivalent groups and non-equivalent groups with anchor test. Likewise, there are different equating procedures within IRT, such as the mean/mean and mean/sigma methods, or methods based on the characteristic curve. The equating of scores must ensure that examinees taking a test do so under the same conditions; however, the procedure is also highly useful in creating a bank of items that can be used subsequently in new tests.

Educational Measurement↗

OMERACT Rheumatoid Arthritis Magnetic Resonance Imaging Studies. Summary of OMERACT 6 MR Imaging Module.

Magnetic resonance image (MRI) scanning is a new method for imaging and quantifying joint inflammation and damage in rheumatoid arthritis (RA). Over the past 4 years, the OMERACT MR Imaging Group has been developing and testing the RA-MRI scoring system (RAMRIS) for use in RA. The OMERACT filter demands that an ideal outcome measure satisfy the elements of truth, discrimination, and feasibility. The RAMRIS as it currently stands incorporates measures of joint inflammation and damage including bone erosion, edema, and synovitis. Tendonitis has not been scored because of feasibility issues; joint space narrowing, reflecting cartilage damage, has also been excluded as reliability was low at the small joints of the hands. Anatomical coverage of the score is currently restricted to the wrists and hands but can provide a basis for a more comprehensive score. The MR measurement of synovitis correlates closely with histological evidence and work continues on validating MR erosions with reference to radiographic techniques. The RAMRIS has demonstrated good reliability for bone erosion and synovitis at the wrists and metacarpophalangeal joints subject to reader training, with slightly lower levels of reader agreement for bone edema. Reliability was less satisfactory in discriminating between 2 time points, and further work is required if the score is to be used to monitor change. Feasibility also needs to be considered for the practical application of the score, including the time taken for scanning and scoring, as well as cost and safety issues. The OMERACT RAMRIS provides a framework for scoring inflammation and damage in RA upon which further modifications can be built. It has been endorsed by the MRI working group and OMERACT 6 participants as useful for inclusion as an outcome measure in clinical trials.

Arthritis, Rheumatoid↗

Development of a body condition scoring system for nonhuman primates using Macaca mulatta as a model.

The nutritional status of individual monkeys in research projects is an important yet sometimes overlooked variable that complicates the interpretation of research findings. The authors offer a framework for scoring fatness and muscularity in a semiquantitative manner without special equipment and in a way that could easily be accomplished during a routine physical examination. Body condition scoring can be used to assess the health of individual animals as well as determine nutritional adequacy within groups of animals.

Animal Nutritional Physiological Phenomena↗

Efficient pairwise RNA structure prediction and alignment using sequence alignment constraints.

BACKGROUND: We are interested in the problem of predicting secondary structure for small sets of homologous RNAs, by incorporating limited comparative sequence information into an RNA folding model. The Sankoff algorithm for simultaneous RNA folding and alignment is a basis for approaches to this problem. There are two open problems in applying a Sankoff algorithm: development of a good unified scoring system for alignment and folding and development of practical heuristics for dealing with the computational complexity of the algorithm. RESULTS: We use probabilistic models (pair stochastic context-free grammars, pairSCFGs) as a unifying framework for scoring pairwise alignment and folding. A constrained version of the pairSCFG structural alignment algorithm was developed which assumes knowledge of a few confidently aligned positions (pins). These pins are selected based on the posterior probabilities of a probabilistic pairwise sequence alignment. CONCLUSION: Pairwise RNA structural alignment improves on structure prediction accuracy relative to single sequence folding. Constraining on alignment is a straightforward method of reducing the runtime and memory requirements of the algorithm. Five practical implementations of the pairwise Sankoff algorithm - this work (Consan), David Mathews' Dynalign, Ian Holmes' Stemloc, Ivo Hofacker's PMcomp, and Jan Gorodkin's FOLDALIGN - have comparable overall performance with different strengths and weaknesses.

Algorithms↗