PubMed HealthSearch

SEARCH · PubMed Health

Results for “multimodal integration”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4Linked to original sources

Multimodal risk assessment for oral potentially malignant disorders: Integrating patient-centered and specimen-derived data.

BACKGROUND: Oral potentially malignant disorders exhibit heterogeneous malignant transformation risk that clinical approaches fail to adequately predict. Histopathologic dysplasia grading, the reference standard of risk assessment, is associated with poor interobserver reliability and limited prognostic discrimination. It is necessary to define other potential patient- and tissue-associated risk modifiers to improve patient-specific disease prediction. TYPES OF STUDIES REVIEWED: PubMed was queried for patient- and specimen-derived factors as they relate to oral cancer and oral potentially malignant disorders, with preference for systematic review and meta-analysis articles published within the past 5 years. When not available, guidelines from the American Cancer Society, National Cancer Institute, or other national organizations or the most recent best articles were referenced to support the data presented. RESULTS: Within patient-associated factors, validated measures of tobacco and alcohol exposure, clinical lesion characteristics, systemic health factors including metabolic syndrome components, comorbidity risk, and dental health indexes were found. Within specimen-derived data, tissue-based analyses encompassing histopathology and advanced molecular profiling (genomic, epigenomic, transcriptomic, spatial approaches), blood-based germline and somatic mutation analysis, and saliva-based microbiome characterization and inflammatory biomarker assessment were addressed. PRACTICAL IMPLICATIONS: Malignant transformation reflects intersecting patient and specimen risk pathways that affect each patient differently; no single modality captures this complexity. Realizing precision prognostication in oral precancer will require coordinated expansion and standardization of data collection across research groups. This review is intended to guide covariate selection for prospective study design, improve reproducibility, and ultimately enable the development of validated multimodal risk prediction tools for clinical deployment.

Humans

AI-Supported, Integrative Prediction of Postoperative Delirium: Protocol for the CONFUSED Study.

BACKGROUND: Postoperative delirium (POD) is a frequent and serious complication in older surgical patients, characterized by acute cognitive dysfunction and fluctuating levels of consciousness. POD is associated with prolonged hospitalization, long-term cognitive decline, reduced quality of life, and increased mortality. Despite its clinical relevance, the underlying pathophysiological mechanisms remain poorly understood, and reliable biomarkers for early prediction and prevention are lacking. OBJECTIVE: The CONFUSED study aims to identify molecular and clinical predictors of POD by integrating clinical data with proteomic, transcriptomic, and epigenetic analyses. The primary objective is to develop predictive models for POD using multimodal data. Secondary objectives include the identification of delirium-associated genes, proteins, and epigenetic signatures, as well as the exploration of patient subgroups at increased risk for POD. METHODS: CONFUSED is a prospective observational cohort study conducted at a German university hospital. Adult patients undergoing major surgery under general anesthesia will be enrolled until 100 cases of POD have been observed, which is expected to require a total sample size of approximately 200 to 300 patients. Blood samples are collected at 4 predefined time points: before premedication, immediately after surgery, and on postoperative days 2 and 5. Samples undergo comprehensive proteomic profiling, transcriptomic analysis using RNA microarrays, DNA methylation analysis, and genotyping of selected polymorphisms. Clinical data, including demographics, comorbidities, perioperative variables, medications, and delirium assessments using the Confusion Assessment Method (CAM) and CAM for the intensive care unit, are systematically recorded. Statistical analyses include univariate and multivariate methods, as well as machine learning approaches such as random forests and support vector machines, to identify relevant biomarkers and develop predictive models. The study protocol follows STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) and TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis) guidelines and was approved by the responsible ethics committees. RESULTS: The study was registered in the German Clinical Trials Register (DRKS00033854) on March 18, 2024. Recruitment started in January 2024 and is ongoing at the time of manuscript submission. As of now, 135 patients have been enrolled. Sample collection and laboratory analyses are ongoing. Data analysis began in January 2026, with first results anticipated in July 2026. Final data lock is anticipated after the completion of recruitment. CONCLUSIONS: By integrating multimodal molecular data with clinical parameters and applying advanced machine learning techniques, the CONFUSED study aims to improve the prediction and understanding of POD. The results are expected to support the development of personalized preventive strategies and contribute to improved perioperative care for patients at risk of POD.

Humans

The role of circulating tumor DNA (ctDNA) to detect minimal residual disease in locally advanced gastroesophageal carcinoma: the BUTTERFLY study.

BACKGROUND: Despite advances in perioperative and neoadjuvant strategies, patients with locally advanced gastroesophageal cancers remain at high risk of recurrence after curative intent treatment. No validated biomarkers are available to detect minimal residual disease (MRD) or to guide post-operative risk-adapted management. Circulating tumor DNA (ctDNA) has emerged as a noninvasive tool for disease monitoring; single-parameter or tumor-informed assays, however, may lack sensitivity in low-tumor burden settings. Multimodal, tumor-agnostic approaches may overcome these limitations. METHODS: The BUTTERFLY study is a prospective, multicenter observational study enrolling patients with stage II-III gastric, gastroesophageal junction, or esophageal cancer treated with perioperative chemotherapy or neoadjuvant chemoradiotherapy followed by surgery. It evaluates the diagnostic performance and prognostic value of an academic, tumor-agnostic, multimodal ctDNA assay for MRD detection and prognostic stratification. Serial plasma samples are collected from baseline through post-operative follow-up and at relapse. Cell-free DNA is analyzed using the Agnostic Liquid Biopsy Multimodal Advancement (ALMA) platform, integrating tumor fraction estimation, somatic copy number alterations, fragmentomic features, single-nucleotide variants, and whole-genome methylation profiling. Multimodal features are combined with clinical variables using machine learning-based models to enhance MRD detection and relapse risk stratification. The primary endpoint includes sensitivity and specificity of ALMA-defined ctDNA/MRD status at the 4-8 weeks after surgery landmark, whereas secondary endpoints assess diagnostic performance at other time points and associations between ctDNA status and dynamics with disease-free survival, overall survival, treatment response, and lead time to recurrence. FUTURE PERSPECTIVES: If validated, this tumor-agnostic, multimodal ctDNA approach may enable earlier molecular relapse detection and support personalized post-operative management strategies.

circulating tumor DNA (ctDNA)

Spectral-Proteomic Integration Analysis (SPIA) Deciphers Molecular Trajectories of Breast Cancer and Enables Multitarget Therapeutic Assessment.

Raman spectroscopy and mass spectrometry-based proteomics offer deeply complementary yet largely disconnected views of cancer biology: the former provides a label-free, real-time biochemical phenotype, while the latter delivers a quantitative inventory of specific protein effectors. Bridging this gap remains a fundamental challenge in analytical biomedicine. Here, we introduce Spectral-Proteomic Integration Analysis (SPIA)─a novel, data-driven integrative framework that systematically links Raman spectroscopic phenotypes with quantitative proteomic profiles through machine learning and statistical correlation. Using a DMBA-induced rat breast cancer model with and without Toremifene (TOR) intervention, SPIA dynamically maps tumor microenvironment remodeling, capturing progressive collagen deposition and lipid metabolic reprogramming. An SVM classifier trained on Raman spectra achieves exceptional diagnostic accuracy (AUC ≥ 99.0%) and successfully predicts TOR therapeutic response. Proteomic analysis identifies 1,350 differentially expressed proteins, with convergent machine learning feature selection (LASSO, Random Forest, XGBoost) pinpointing core regulators including Luc7l2, Nucb1, Cbx3, and Csnk2a1. Crucially, Spearman correlation analysis between key Raman bands and core DEPs reveals strong, statistically robust associations (median ρ ∼ 0.75 in the 1533-1669 cm-1 region), empirically validating SPIA's core integrative logic. Leveraging this multimodal map, we elucidate a multitarget mechanism for TOR involving concurrent suppression of collagen deposition and correction of aberrant lipid metabolism. SPIA establishes a powerful, generalizable paradigm for integrating phenotypic and molecular data, with broad implications for biomarker discovery, drug mechanism elucidation, and precision oncology.

Animals

The effect of delayed feedback on infant learning reexamined.

The study reexamines the effect of delayed reinforcement upon contingency behavior in 6- to 8-month-old infants and attempts to account for the temporal discrepancy between span of integration and contingency memory. A modified delayed-reinforcement scheduling procedure enabled a previous methodological criticism to be discounted. The findings confirmed that whereas infants revealed reliable acquisition under immediate reinforcement, a 3-sec delay (whether reset or nonreset) precluded response acquisition, as did 6-sec and 10-sec delay of reinforcement. The findings are interpreted in terms of an informational-load hypothesis which relates short-term memory to the integration and/or segregation of multimodal input.

Conditioning, Operant

mmContext: an open framework for multimodal contrastive learning of omics and text data.

SUMMARY: Multimodal approaches are increasingly leveraged for integrating omics data with textual biological knowledge. Yet there is still no accessible, standardized framework that enables systematic comparison of omics representations with different text encoders within a unified workflow. We present mmContext, a lightweight and extensible multimodal embedding framework built on top of the open-source Sentence Transformers library. The software allows researchers to train or apply models that jointly embed omics and text data using any numeric representation stored in an AnnData.obsm layer and any text encoder available in Hugging Face. mmContext supports integration of diverse biological text sources and provides pipelines for training, evaluation, and data preparation. We train and evaluate models for a RNA-Seq and text integration task, and demonstrate their utility through zero-shot classification of cell types and diseases across four independent datasets. By releasing all models, datasets, and tutorials openly, mmContext enables reproducible and accessible multimodal learning for omics-text integration. AVAILABILITY AND IMPLEMENTATION: Pretrained checkpoints and full source code for our custom MMContextEncoder are available on Hugging Face huggingface.co/jo-mengr. The Python package github.com/mengerj/mmcontext provides the model implementation and training and evaluation scripts for custom training. The releases for the publication can be accessed via zenodo: adata_hf_datasets: doi.org/10.5281/zenodo.19185217 and mmContext: doi.org/10.5281/zenodo.19185493.

Computational Biology

CRISPR-Enabled functional genomics in hPSCs-derived neural models for autism spectrum disorder.

Autism Spectrum Disorder (ASD) is a genetically heterogeneous neurodevelopmental condition in which hundreds of individually rare risk variants converge on a small number of shared biological pathways, including synaptic scaffolding, chromatin remodeling, excitation-inhibition balance, and cellular energy metabolism. Translating this genetic heterogeneity into mechanistic insight requires experimental systems capable of interrogating individual gene functions in human-relevant neural contexts at scale. CRISPR-enabled functional genomics in human pluripotent stem cell (hPSC)-derived neural models, spanning neural progenitors, cortical and inhibitory neurons, astrocytes, microglia, and brain organoids, provides precisely this capability. By integrating pooled perturbation screens with multimodal readouts including single-cell and spatial transcriptomics, chromatin accessibility profiling, proximity labeling proteomics, multi-electrode array electrophysiology, and metabolic flux analysis, these platforms enable systematic, causal mapping of ASD gene function at system resolution. Early applications have already revealed convergent mechanisms: BAF complex disruption expands the ventral progenitor pool and biases its fate toward oligodendrocyte and interneuron lineages; ADNP loss impairs microglial synaptic pruning through altered endocytic trafficking; and mTOR pathway dysregulation in PTEN- and TSC2-perturbed models links genetic risk directly to metabolic and mitochondrial dysfunction. Computational frameworks including MIMOSCA and SCEPTRE enable causal network reconstruction and pseudotime inference from these datasets, moving the field from gene lists toward pathway-level models of ASD pathobiology. Translational applications leverage isogenic iPSC panels and variant-level base and prime editing to stratify ASD variants by functional impact, informing gene therapy design for haploinsufficient targets such as CHD8 and SCN2A via AAV or antisense oligonucleotide delivery. Remaining challenges, including model developmental immaturity, batch variability, and the difficulty of modeling polygenic risk, are addressed by a roadmap integrating spatial perturbomics, AI-driven causal inference, and population-scale standardized biobanks. This review synthesizes the current state of CRISPR-based functional genomics in human stem cell neural models as a coherent experimental framework for converting ASD genetic associations into mechanistic understanding and therapeutic opportunity.

Humans

Foundation model based multimodal transformer framework for survival analysis in HER2 stratified breast cancer.

Objective. To improve survival prediction for HER2-positive breast cancer by integrating histopathological, molecular, and clinical data using a multimodal transformer framework.Approach. We propose a multimodal transformer framework for breast cancer survival prediction using HER2 stratified (SurvMBC), a foundation model-enhanced architecture that fuses three data modalities: whole-slide images, clinical narratives, and molecular features. Tumor microenvironment features are extracted using a pathology language and image pre-training (PLIP), clinical narratives are processed with BioBERT, and miRNA expression plus DNA methylation data are embedded using Gen2Vec. These representations are integrated through a cross-modal transformer with attention mechanisms for survival prediction.Main results. The model was evaluated on 1,095 HER2-positive breast cancer patients from The Cancer Genome Atlas. SurvMBC achieved a concordance index (C-index) of 0.857 (95% CI: 0.834, 0.880), a low integrated Brier score, and a strong inverse negative binomial log-likelihood. Risk stratification based on model outputs significantly separated high- and low-risk groups (log-rankp< 0.01) and showed strong associations with tumor stage, grade, and hormone receptor status (allp< 0.05).Significance. SurvMBC demonstrates the effectiveness of multimodal fusion in addressing tumor heterogeneity and improving prognostic accuracy. The attention-based integration enables context-aware learning of survival-relevant features across modalities, supporting individualized risk stratification and risk-adaptive treatment planning for HER2 stratified breast cancer patients.

Breast Neoplasms

Multimodal alignment improves generalizability of genomic biomarker prediction in computational pathology.

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision oncology. However, as new genomic biomarkers are discovered or quantified, large, labeled datasets must be prospectively collected to train new models. To address this challenge, we developed multimodal alignment for biomarker learning and generalization (MARBLE), a multimodal contrastive pretraining strategy that integrates structured biomarker knowledge into representation learning of histopathology images. MARBLE aligns histopathology-derived representations with representations of genomic biomarkers generated by a large language model (LLM) and a protein language model (PLM). This biologically informed alignment enables data-efficient generalization to novel, out-of-distribution biomarkers. Using the MSK-IMPACT cohort of over 40,000 patients across multiple biomarker panel versions, we design experiments grounded in real-world data to demonstrate the value of our proposed approach.

CP: computational biology

The new frontier in understanding human and mammalian brain development.

Neurodevelopmental disorders that cause cognitive, behavioural or motor impairments affect around 15% of children and adolescents worldwide1, with diagnoses of profound autism and attention deficit hyperactivity disorder increasing in the USA and contributing to a&#xa0;major economic burden2,3. Yet the origins and mechanisms of these conditions remain poorly understood, limiting progress in therapies. Comprehensive cell atlases of the developing human brain, alongside those of model organisms such as mice and non-human primates, are now providing high-resolution measures of gene expression, cell-type abundance and spatial distribution. In this Perspective, we highlight recent studies that have identified novel developmental cell populations, revealed conserved and divergent patterns of cell genesis, migration and maturation across species, and begun testing hypotheses that link them to processes ranging from transcriptional control of cell fate specification to the emergence of complex behaviours. We present remaining conceptual and technical challenges and provide an outlook on how further studies of human and mammalian brain development can empower a deeper understanding of neurodevelopmental and neuropsychiatric disorders. Future efforts expanding to additional developmental stages, including adolescence, as well as whole-brain, multimodal and cross-species integration, will yield new insights into how development shapes the brain. These atlases promise to serve as essential references for unravelling mechanisms of brain function and disease vulnerability, and for advancing precision medicine.

Humans

Baseline Computed Tomography Coronary Angiography and Polygenic Risk Profiles in Adults With Type 2 Diabetes: A Cross-Sectional Analysis From the VOLTAIRE Study.

AIMS: To characterise baseline clinical, anatomical, and genetic cardiovascular risk profiles in participants enrolled in the VOLTAIRE (Evaluation of Polygenic Scores and CT Imaging in Risk Factor Modification in Patients with Type 2 Diabetes) study and examine concordance across these domains. METHODS: This analysis included adults with T2D who completed baseline computed tomography coronary angiography (CTCA) and polygenic risk score (PRS) assessment prior to randomisation in the VOLTAIRE study. Coronary atherosclerosis was evaluated using coronary artery calcium (CAC) score and CTCA-derived stenosis severity. Clinical risk was assessed using the New Zealand Society for the Study of Diabetes 5-year cardiovascular risk calculator. Polygenic risk for coronary artery disease was assessed using a genome-wide PRS and categorised into tertiles. RESULTS: Among 126 participants with T2D (mean age 57.5&#x2009;&#xb1;&#x2009;8.7&#x2009;years; 62.7% male), coronary atherosclerotic burden was highly heterogeneous: 34.9% had CAC&#x2009;=&#x2009;0, whereas 19.8% had CAC &#x2265;&#x2009;400. Moderate-to-severe coronary stenosis (&#x2265;&#x2009;50%) was present in 40.5% of participants overall, including 20.4% of those classified as low clinical risk. PRS distribution was variable (low 37.3%, intermediate 35.7%, high 27.0%). Overlap between anatomical, genetic, and clinical domains&#xa0;was limited, with only 8.7% of participants classified as high risk across all three. CONCLUSIONS: Substantial heterogeneity and limited overlap&#xa0;exist between anatomical, genetic, and clinical cardiovascular risk measures in T2D. These findings support a multimodal approach to risk assessment integrating imaging and genetic profiling. TRIAL REGISTRATION: https://www. CLINICALTRIALS: gov; ID: NCT07091162.

Aged

Spontaneous multiquantal release at synapses in guinea-pig hypogastric ganglia: evidence that release can occur in bursts.

1. A study was made of some properties of the spontaneous synaptic potentials recorded in cells of the hypogastric ganglia of guinea-pigs. 2. The distribution of the amplitudes of the spontaneous synaptic potentials arising from a single preganglionic fibre was found to be multimodal, with peaks at roughly integral multiples of a unit peak. 3. It was found that the amplitudes of the larger spontaneous potentials were consistent with them being the result of synchronous or near-synchronous release of two or more unit-sized quanta (multiquantal release). 4. The proportion of multiquantal potentials observed was found to be dependent on the extracellular calcium ion concentration. 5. When the stochastic properties of the spontaneous potentials were examined, it was found that the spontaneous release process was not random and independent but appeared to be clustered. Indeed, the probability of occurrence of a unit spontaneous synaptic potential was greatly enhanced during the 40--60 msec immediately following any given spontaneous synaptic potential. 6. When unit spontaneous potentials were excluded from the analysis, the multiquantal potentials were still found to be clustered although the clustering was less marked than that seen in the over-all process. 7. These results suggested that the multiquantal spontaneous potentials arose from the release of unit quanta in short high frequency bursts and it was found that a mathematical model incorporating such a mechanism could describe the spontaneous quantal release process.

Animals

Spatial Mapping of the Precancer-to-Cancer Transition in Breast and Prostate.

UNLABELLED: Breast and prostate cancers are both hormone-driven adenocarcinomas that undergo analogous invasion programs. Using lightsheet microscopy on intact tumors, we identified transitional junctions between precancerous and invasive regions. We then developed a multimodal serial-section workflow integrating volumetric reconstruction with spatial transcriptomics. Analysis of 319 spatial assays from 51 cases revealed gene expression features and novel structural insights defining the shift from precancer to invasive disease. In breast cancer, loss of MGP and PLAT was associated with invasive transition and promoted tumorigenesis in functional assays. In prostate cancer, GDF15, ALDH1A3, ANPEP, and FASN were upregulated along invasive progression, and their knockdown in PC-3 cells suppressed proliferation and migration. Enrichment of tumor-associated macrophages (SPP1+ and MS4A6A+) along non-triple-negative breast cancer breast cancer transitions highlights immune involvement as a potential driver of invasiveness. SIGNIFICANCE: Our method of defining precise spatial locations of invasive transition allows for the direct interrogation of transition drivers, presenting new therapeutic targets for the two most prevalent cancers and providing a framework for studying spatially defined mechanisms of tumor progression. See related commentary by Jing and Li, p. 1720.

Humans

Development and Validation of a Multimodal Clinical, Pathologic, and Genomic Model for Breast Cancer Recurrence.

PURPOSE: To develop and validate a multimodal recurrence-risk model integrating histology, genomic testing, and clinical variables. METHODS: We developed AI-Path, a whole-slide image biomarker for recurrence prediction trained in CALGB 9344, and validated it in three independent cohorts: TAILORx, a multi-site Chicago cohort, and the MDX-BRCA cohort. We then integrated AI-Path with Oncotype DX Recurrence Score (RS), tumor size, and nodal status into a Cox model, PathClinRS, fit using 60% of cases from TAILORx, with the remaining 40% held out for validation. The primary end point was distant recurrence-free interval. Performance was assessed using Harrell's concordance index (C-index) and Kaplan-Meier analyses. RESULTS: A total of 12,418 patients were included. In TAILORx, AI-Path outperformed RS for distant recurrence (C-index, 0.682 vs 0.647; P = .038), driven by superior prediction of late recurrence (0.656 vs 0.567; P < .001). In node-negative disease, PathClinRS outperformed RSClin in the TAILORx fitting (0.72 vs 0.70; P = .016) and validation sets (0.74 vs 0.70; P = .004). In node-positive disease, PathClinRS outperformed RSClinN+ in Chicago (0.94 vs 0.74; P < .001) and MDX-BRCA (0.71 vs 0.66; P = .004) cohorts. Compared with NATALEE eligibility, PathClinRS identified nearly twice as many high-risk node-negative patients while maintaining a comparable 10-year distant recurrence risk (16.7% vs 16.6% per NATALEE eligibility in TAILORx fitting; 21.0% vs 19.4% in TAILORx validation). PathClinRS identified 68% of intermediate risk premenopausal patients as low-risk with no evidence of chemotherapy benefit, compared to only 36% identified as low risk by standard clinicopathologic criteria. CONCLUSION: Digital histopathology provides prognostic information complementary to genomic assays and has the potential to personalize therapy beyond existing clinicogenomic tools.

Journal Article

Livestock Multi-Omics Integration: A Systematic Framework From Statistical Association to Causal Interpretation.

Livestock multi-omics integration is key to unraveling complex trait regulation, yet systematic, livestock-specific strategies remain scarce. This review traces the progression from single-omics accumulation to multi-dimensional integration, highlighting how large-scale genomic, epigenomic, and transcriptomic projects lay the foundation for functional dissection. We identify core impediments: extreme species diversity, marked data heterogeneity, limited sample sizes, and a pervasive reduction of multi-omics data to simplistic differential screens, resulting in low translational efficiency. We critically appraise four common pitfalls-overinterpreting correlation as causation, relegating proteomics to corroborating transcriptomics, incomplete microbiome-host integration lacking environmental context, and systematic neglect of metabolic fluxomics-and show how exposomics and fluxomics add necessary causal and dynamic dimensions. To address these, we propose a livestock-adapted three-tier analytical framework: (1) statistical association of cross-omics covariation patterns; (2) machine learning-driven feature mining and integrative modeling; and (3) causal interpretation encompassing Mendelian randomization, prior-knowledge-guided network inference, and physical causal evidence via fluxomics and metabolic control analysis. We further discuss how multimodal sequencing (single-cell, spatial, temporal) and generative AI can fundamentally mitigate heterogeneity and strengthen causal evidence. Finally, we outline future priorities in database standardization, livestock-specific benchmarking, and translational pipelines, charting a path from correlation-centric reporting to mechanistic causality and precision breeding.

Animals

Geometry driven multimodality matching of brain images.

Clinical diagnosis, as well as therapy planning and evaluation, are increasingly supported by multimodal images. There are many instances desiring integration of the information obtained by various imaging devices. This paper describes a new approach to match images of different modalities. Differential operators are used in combination with Gaussian blurring to extract geometric features from the images that correspond to similar structures. The resulting 'feature' images may be used with existing matching techniques that minimize the distance between the features in the images to be matched. Our first application of this new approach concerns matching of MRI and CT brain images. The so-called L upsilon upsilon operator produces a ridge-like feature image from which in CT and MRI the center curve of the cranium is easily extracted. First results of this operator's performance in matching tasks are shown. Another promising operator is the 'umbilicity' operator, which is presented in combination with SPECT images.

Brain

Efferent projections of the insular and temporal neocortex of the cat.

Anterograde degeneration resulting from small lesions placed in either the insular or temporal cortex were traced with the Fink-Heimer reduced silver procedure. In neocortical regions ipsilateral to the lesion axonal degeneration was present in auditory subdivisions AI, AII, Ep, I, T, in the second somatosensory area (SII), in the anterior and middle suprasylvian gyrus, in the posteromedial suprasylvian and posterior lateral gyri, in the posterior splenial gyrus, in the anterior two-thirds of the cingulate gyrus and in the orbitofrontal regions. With respect to interhemispheric connections, evidence was obtained for a dual pattern of projection. In addition to significant amounts of axonal and terminal degeneration in the corresponding insular or temporal fields, axonal degeneration was also present in posterior AII. In the thalamus degeneration was found in the medial dorsal, suprageniculate, and lateral posterior-pulvinar nuclei. In the posterior nuclear group (Po) and the principal division of the medial geniculate (GMp) evidence was obtained for a topographic pattern of projection; significantly more degeneration occurred in caudal Po following insular lesions whereas with temporal lesions more degeneration occurred in caudal GMp. Degeneration was also found in the dorsal cortex of the ipsilateral inferior colliculus, bilaterally in the deep layers of the superior colliculus and the periventricular central gray region, ipsilaterally in the ventromedial aspects of the head and body of the caudate nucleus, and in the lateral and central nuclei of the amygdala. These findings are discussed in terms of their significance for a possible role for the insular and temporal neocortex (I-T) in both multimodal sensory discrimination and sensory-visceral integrative functions.

Animals

NeuroOmics-Net: An interpretable multimodal deep learning framework for Alzheimer's disease diagnosis and progression prediction using neuroimaging, EEG, and genomic data.

Accurate diagnosis and progression prediction of Alzheimer's disease (AD) remain challenging due to the heterogeneous nature of the disease, which involves structural brain degeneration, electrophysiological dysfunction, and molecular dysregulation. Most existing deep learning approaches rely on a single modality or limited multimodal combinations, thereby failing to capture the complex cross-domain interactions underlying AD progression. Furthermore, the scarcity of large-scale datasets containing synchronized neuroimaging, electrophysiological, and genomic measurements restricts the development of comprehensive multimodal diagnostic systems. To address these challenges, this study proposes NeuroOmics-Net, a multimodal deep learning framework for Alzheimer's disease analysis that integrates structural magnetic resonance imaging (sMRI), electroencephalography (EEG), and gene expression data. The proposed framework combines a Hierarchical Multi-View Encoder (HME) for modality-specific feature extraction, a Cross-Omics Attention Fusion (CAF) module for adaptive integration of complementary biomarkers, and a Disease Progression Graph Learning (DPGL) module for modeling progression-related relationships across biological domains. To facilitate cross-modal integration from independent cohorts, Regularized Canonical Correlation Analysis (RCCA) is employed to align heterogeneous feature representations within a shared latent space. Experiments were conducted using publicly available datasets from ADNI, PhysioNet, and GEO repositories comprising 1120 diagnosis-aligned samples. The proposed framework achieved 94.3% classification accuracy and an AUC of 0.975 for distinguishing normal controls (NC), mild cognitive impairment (MCI), and Alzheimer's disease subjects, while attaining 93.7% accuracy for predicting conversion from stable mild cognitive impairment (sMCI) to progressive mild cognitive impairment (pMCI). However, a fairness sensitivity analysis using stratified demographic reweighting revealed accuracy ranging from 90.8% (low-education, high-comorbidity proxy subgroup) to 96.1% (low-risk, high-reserve proxy subgroup), a demographic parity gap of 5.3 percentage points, indicating that overall accuracy reflects a performance ceiling in a relatively homogeneous research cohort rather than a realistic estimate for demographically diverse clinical populations. Comparative evaluations demonstrated consistent improvements over state-of-the-art unimodal and multimodal deep learning models. Interpretability analysis further identified clinically relevant biomarkers, including hippocampal and entorhinal atrophy, theta-alpha EEG alterations, and APOE-associated molecular pathways. Because sMRI, EEG, and gene expression data were sourced from separate, unpaired cohorts with no subjects possessing all three synchronized measurements, all reported cross-modal associations reflect population-level statistical correspondence across diagnosis-matched groups rather than within-subject physiological coupling; no claim of intra-individual causal cross-modal interaction is made. These findings demonstrate that NeuroOmics-Net provides an effective computer-aided framework for multimodal biomedical data processing and Alzheimer's disease analysis. By integrating neuroimaging, electrophysiological, and genomic information, the proposed approach enables accurate diagnosis, progression prediction, and biologically interpretable decision support for clinical and translational applications.

Humans