SEARCH · PubMed Health

Results for “multimodal integration”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40Linked to original sources

PubMed2026

A multi-modal survival prediction framework with group-based batch training and structural consistency alignment.

OBJECTIVE: Integrating whole-slide images (WSIs) with transcriptomic profiles is pivotal for enhancing cancer survival prediction. However, the intrinsic gigapixel resolution and variable sequence lengths of WSIs create a fundamental trade-off between training efficiency and the preservation of data heterogeneity in existing frameworks. Furthermore, substantial statistical and structural discrepancies between histological and genomic modalities often impede effective cross-modal alignment and fusion, thereby limiting prognostic accuracy. METHODS: We propose PRISM, an efficient multi-modal learning framework for integrating WSIs with transcriptomic profiles. To reconcile training efficiency with full data heterogeneity, PRISM first stochastically partitions variable-length WSI sequences into a main subset and a complementary residual subset, both of which are packed into fixed-length groups for batch training. The main subset is processed in the main branch, utilizing isolation masking to maintain intra-group sequence independence. Simultaneously, the residual subset is consolidated into "hyperslides" within a residual branch that leverages tailored supervision, effectively capturing inter-slide correlations. Furthermore, PRISM integrates an Informative Token Aggregation (ITA) module to reduce redundancy in WSIs and employs Cross-batch Structural Consistency Alignment (CBSCA) mechanism to enhance inter-modal structural connectivity. Finally, efficient cross-modal feature interaction is achieved through a Low-rank Bilinear Gated Fusion (LBGF) module. Code is available at https://github.com/Alisa2080/PRISM. RESULTS: Compared with existing methods, PRISM achieves the best overall C-index across five TCGA cohorts. On the larger TCGA-BRCA dataset, PRISM requires only 6 hours of training time, substantially reducing computational cost relative to strong multimodal baselines. Furthermore, comprehensive evaluations demonstrate that PRISM achieves the best overall IBS ranking and favorable time-dependent AUC performance at 1, 3, and 5 years, thereby delivering a more favorable trade-off between prognostic performance and computational efficiency. CONCLUSION: PRISM provides a favorable balance between predictive performance, calibration quality, and computational efficiency, highlighting its potential for practical deployment in multimodal survival modeling for computational pathology.

Humans↗

PubMed2006

The role of single-photon emission computed tomography/computed tomography in benign and malignant bone disease.

Radiological (plain radiographs, computed tomography [CT], magnetic resonance imaging [MRI]) and nuclear medicine methods (bone scan, leukocyte scan) both provide unique information about the status of the skeleton. Both have typical strengths and weaknesses, which often lead to the sequential use of different procedures in daily routine. This use causes the unnecessary loss of time and sometimes money, if redundant information is obtained without establishing a final diagnosis. Recently, new devices for hybrid imaging (single-photon emission computed tomography/computed tomography [SPECT/CT], positron emission tomography/computed tomography [PET/CT]) were introduced, which allow for direct fusion of morphological (CT) and functional (SPECT, PET) data sets. With regard to skeletal abnormalities, this approach appears to be extremely useful because it combines the advantages of both techniques (high-resolution imaging of bone morphology and high sensitivity imaging of bone metabolism). By the accurate correlation of both, a new quality of bone imaging has now become accessible. Although researchers undertaking the initial studies exclusively used low-dose CT equipment, a new generation of SPECT/CT devices has emerged recently. By integrating high-resolution spiral CT, quality of bone imaging may improve once more. Ongoing prospective studies will have to show whether completely new diagnostic algorithms will come up for classification of bone disease as a consequence of this development. Besides, the role of ultrasonography and MRI for bone and soft-tissue imaging also will have to be re-evaluated. Looking at the final aim of all imaging techniques--to achieve correct diagnosis in a fast, noninvasive, comprehensive, and inexpensive way--we are now on the edge of a new era of multimodality imaging that will probably change the paths and structure of medicine in many ways. Presently, hybrid imaging using SPECT/CT has been proven to increase sensitivity and specificity of bone scintigraphy. This was mainly achieved by identifying benign bone conditions with increased bone turnover. Therefore, SPECT/CT should be applied whenever equivocal findings of planar bone imaging occur. It also helps to improve accuracy of leukocyte scanning to detect/exclude osteomyelitis and to define sites of inflammation. We therefore regard SPECT/CT as a valuable tool to optimize bone imaging, which might become even more important if new radiopharmaceuticals become available to image specific cell functions.

Bone Neoplasms↗

PubMed2006

Quantitative phase imaging with scanning holographic microscopy: an experimental assessment.

This paper demonstrates experimentally how quantitative phase information can be obtained in scanning holographic microscopy. Scanning holography can operate in both coherent and incoherent modes, simultaneously if desired, with different detector geometries. A spatially integrating detector provides an incoherent hologram of the object's intensity distribution (absorption and/or fluorescence, for example), while a point detector in a conjugate plane of the pupil provides a coherent hologram of the object's complex amplitude, from which a quantitative measure of its phase distribution can be extracted. The possibility of capturing simultaneously holograms of three-dimensional specimens, leading to three-dimensional reconstructions with absorption contrast, reflectance contrast, fluorescence contrast, as was previously demonstrated, and quantitative phase contrast, as shown here for the first time, opens up new avenues for multimodal imaging in biological studies.

Holography↗

PubMed2006

First passage time densities in resonate-and-fire models.

Motivated by the dynamics of resonant neurons we discuss the properties of the first passage time (FPT) densities for non-Markovian differentiable random processes. We start from an exact expression for the FPT density in terms of an infinite series of integrals over joint densities of level crossings, and consider different approximations based on truncation or on approximate summation of this series. Thus the first few terms of the series give good approximations for the FPT density on short times. For rapidly decaying correlations the decoupling approximations perform well in the whole time domain. As an example we consider resonate-and-fire neurons representing stochastic underdamped or moderately damped harmonic oscillators driven by white Gaussian or by Ornstein-Uhlenbeck noise. We show that approximations reproduce all qualitatively different structures of the FPT densities: from monomodal to multimodal densities with decaying peaks. The approximations work for the systems of whatever dimension and are especially effective for the processes with narrow spectral density, exactly when Markovian approximations fail.

Action Potentials↗

PubMed1979

Vestibular, auditory, and somatic input to the posterior thalamus of the cat.

The responses of 157 neural units in the magnocellular (mc) and parvocellular (pc) components of the medial geniculate nucleus (MG) and other nuclei of the posterior (PO) thalamic group were recorded and analyzed. Units were tested for a response to electrical stimulation of the vestibular nerve, natural auditory and electrical cochlear nerve stimulation, and natural stimulation of joint, muscle, and cutaneous receptors of the limbs, trunk, and neck (somatic stimulation). Only 45% of the units responded to these stimuli. Twenty-four percent of the responsive units were multimodal, responding to more than one stimulus. All multimodal units were activated by auditory stimuli. More units responding to vestibular stimulation were found in mcMG than in pcMG or other components of the PO group. Potentials evoked by vestibular nerve stimulation were recorded in all 3 regions with latencies of 5--25 msec. No evidence was found for a thalamic relay from vestibular nerve to cortex in the area investigated, since the recorded latency for activity from vestibular nerve stimulation was longer than the latency of responses recorded in the cortex. This region of the thalamus appears to be important for reception of auditory information and integration with vestibular and somatic modalities.

Acoustic Stimulation↗

PubMed2004

Population of linear experts: knowledge partitioning and function learning.

Knowledge partitioning is a theoretical construct holding that knowledge is not always integrated and homogeneous but may be separated into independent parcels containing mutually contradictory information. Knowledge partitioning has been observed in research on expertise, categorization, and function learning. This article presents a theory of function learning (the population of linear experts model--POLE) that assumes people partition their knowledge whenever they are presented with a complex task. The authors show that POLE is a general model of function learning that accommodates both benchmark results and recent data on knowledge partitioning. POLE also makes the counterintuitive prediction that a person's distribution of responses to repeated test stimuli should be multimodal. The authors report 3 experiments that support this prediction.

Analysis of Variance↗

PubMed1997

[The robotization of neurosurgery: state of the art and future outlook].

Neurosurgery is by excellence a field of application for robots, based on multimodal image guidance. Specific motorized tools have been already developed and routinely applied in stereotaxy to position a probe holder or in conventional neurosurgery to hold a microscope oriented towards a given target. The potentialities of these approaches have triggered industrial developments currently commercially available. These systems use data bases, primarily coming from multimodal numerical images from X-ray radiology to magnetic resonance imaging. These spatially encoded data are transferred through digital networks to workstations where images can be processed and surgical procedures are preplanned, then transferred to the robotic systems to which they are connected. We have been using a stereotactic robot since 1989 and a microscope robot since 1995 in various surgical routine procedures. The future of these applications mainly rely on the technical progress in informatics, about image recognition to adapt the preplanning to the actual surgical situation, to correct brain shifts for instance, about image fusion, integrated knowledge such such as brain atlases, as well as virtual reality. The future developments, covering surgical procedure, research and teaching, will sure be far beyond our wildest expectations.

Forecasting↗

PubMed2003

Perioperative chemotherapy in advanced bladder cancer: part I. Neoadjuvant treatment.

Despite local tumor control, patients with locally advanced bladder cancer or lymphogenic metastasized urothelial carcinoma are at risk for systemic progress. Radical cystectomy is the gold standard treatment for muscle-invasive bladder tumors. Pelvic lymphadenectomy remains an integral part of the surgical treatment. However, the extent of the lymph node dissection depends on its diagnostic or curative intent and is more controversial. In addition, further treatment options such as systemic chemotherapy or combined radio-chemotherapy are needed to improve the outcome of locally advanced or metastasized disease. Therefore, administration of additional therapy to surgical treatment is intensively studied. The application of the neoadjuvant concept as well as the definite role of the adjuvant chemotherapy currently are contentious topics and subjects of meta-analyses and prospective randomized trials. In addition, bladder preservation as part of a multimodality treatment is still discussed as an option for selected patients unsuitable for radical cystectomy. This article gives an overview on the current concepts of the use of neoadjuvant systemic chemotherapy in the treatment of advanced urothelial cancer.

Antineoplastic Combined Chemotherapy Protocols↗

PubMed2006

Multimodality therapy for Pancoast tumor.

The management of Pancoast tumors has challenged surgeons and radiation and medical oncologists over several decades. Retrospective studies have raised a greater awareness of the importance of positive N2 lymph nodes in terms of prognosis and treatment decision making. While patients with positive N2 lymph nodes have generally been excluded from trials of preoperative chemoradiation for superior sulcus tumors, the potential of surgery for these patients is still being evaluated. The role of PET for initial staging as well as for assessment of disease response to induction therapy continues to evolve. The use of combined treatment modalities has enhanced the progress in successfully treating Pancoast tumors. The historical data showing improved results with a combination of surgery and radiation compared with surgery alone for patients with positive N2 nodes provides the basis for several important clinical trials that integrate the use of chemotherapy into the treatment paradigm. The Southwest Oncology Group and Japanese Clinical Oncology Group have shown dramatic improvements in complete resection rates following a neoadjuvant course of combined chemotherapy and radiation therapy compared with historical series. We discuss relevant ongoing clinical trials that include consolidative taxane-based chemotherapy and the role of prophylactic cranial irradiation in complete responders. Future potential areas of investigation, including the role of surgery for patients with N2-positive disease and the use of imaging to assess response after induction therapy, are discussed.

Combined Modality Therapy↗

PubMed2006

Noninvasive diagnostic assessment of brain tumors using combined in vivo MR imaging and spectroscopy.

To determine the potential value of multimodal MRI for the presurgical management of patients with brain tumors, we performed combined magnetic resonance imaging (MRI) and proton MR spectroscopy (MRS) in 164 patients who presented with tumors of various histological subtypes confirmed by surgical biopsy. Univariate statistical analysis of metabolic ratios carried out on the first 121 patients demonstrated significant differences in between-group comparisons, but failed to provide sufficiently robust classification of individual cases. However, a multivariate statistical approach correctly classified the tumors using linear discriminant analysis (LDA) of combined MRI and MRS data. After initial separation of contrast-enhancing and non-contrast-enhancing lesions, 91% of the former and 87% of the latter were correctly classified. The results were stable when this diagnostic strategy was tested on the additional 43 patients included for validation after the initial statistical analysis, with over 90% of correct classification. Combined MRI and MRS had superior diagnostic value compared to MRS alone, especially in the contrast-enhancing group. This study shows the clinical value of a multivariate statistical analysis based on multimodal MRI and MRS for the noninvasive evaluation of intracranial tumors.

Artificial Intelligence↗

PubMed2002

Gynecologic brachytherapy I: Proper incorporation of brachytherapy into the current multimodality management of carcinoma of the cervix.

The incidence of carcinoma of the cervix has continuously declined over the past decades because of effective screening. The International Federation of Gynecology and Obstetrics (FIGO) clinical staging, though universally used, is considered inadequate either to determine the type of treatment or to predict treatment outcome. Over the last 10 years, treatment of cervical cancer has become increasingly sophisticated with advances in external beam and brachytherapy in the radiotherapeutic management of this carcinoma. In particular, brachytherapy plays a major role in enhancing both local control and survival. Experience to date suggests that either high-dose-rate (HDR) or low-dose-rate (LDR) brachytherapy, when properly applied, can be effective and give similar rates of local control with minimal complications. This article analyzes the current literature regarding treatment techniques of radiotherapy with special emphasis on brachytherapy integration to optimize radiotherapy treatment outcome.

Brachytherapy↗

PubMed1998

Multimodal treatment strategy for locally advanced breast cancer.

Between 1990 and 1995, 87 patients with locally advanced breast cancer were treated with initial chemotherapy consisting of 3-4 cycles of epirubicin and then with surgery, radiotherapy and chemotherapy. All patients with positive or unknown estrogen receptor status were administered tamoxifen. A complete response was observed in 9 patients and a partial response in 64. At a mean follow-up of 29.22 months, 25 patients had died of metastatic disease, and 48 patients are disease-free. 54% patients are alive at 5 years. Statistical analysis confirmed that neither age, menopausal status, size of the primary tumor nor histology seemed to influence the Disease Free and Overall Survival. Improved survival was observed in patients with negative lymph nodes and positive receptor status. The presence of a positive receptor status may be correlated with conserved integrity of hormone sensitivity and with a good response to the hormone therapy.

Adolescent↗

PubMed1997

Morphology and sensory modality of mushroom body extrinsic neurons in the brain of the cockroach, Periplaneta americana.

Mushroom bodies are paired centers in insect brains that are thought to be crucial in olfactory learning and memory. Early neuroanatomical descriptions suggested that the mushroom bodies comprise rather simple arrangements of nerve cells. Intrinsic neurons within each mushroom body were believed to receive olfactory afferents and to supply long, branched axons to extrinsic neurons that lead from the mushroom body into the protocerebrum. More recent suggestions that the mushroom bodies integrate several sensory modalities find support from intracellular and extracellular recordings of extrinsic neurons in the brains of crickets, honey bees, and cockroaches. Here, we describe two major classes of extrinsic neurons, simple and complex cells, in the mushroom bodies of the cockroach Periplaneta americana. Each class is defined by its pattern of branching in the brain. Simple neurons correspond to extrinsic neurons described from other species that have one set of dendrites only within the mushroom bodies. Complex extrinsic neurons possess dendrite-like branches within and outside the mushroom bodies. This arrangement may account in part for their observed multimodality, as might newly identified afferent neurons that terminate in the mushroom body lobes among the dendrites of extrinsic neurons and that respond to multimodal stimuli. Organizational complexity within the mushroom bodies is suggested by the grouping of intrinsic cell axons into discrete laminae. These are intersected by the block-like arrangements of dendritic fields of extrinsic neurons in a manner reminiscent of Purkinje cell dendrites intersecting parallel fibers in the cerebellum. The present results demonstrate that the cockroach mushroom body processes multimodal sensory information and that its neural arrangements contribute to a precise architecture consisting of discrete longitudinal and transverse subdivisions.

Animals↗

PubMed1998

[Robotics in neurosurgery: current status and future prospects].

Neurosurgery is in essence a field of application development for robots, based on multimodal image guidance. Specific motorized tools have already been developed and routinely applied in stereotaxy to position a probe holder or in conventional neurosurgery to hold a microscope oriented towards a given target. The potentialities of these approaches have triggered industrial developments which are now commercially available. These systems use databases, primarily coming from multimodal numerical images from X-ray radiology to magnetic resonance imaging. These spatially encoded data are transferred through digital networks to workstations where images can be processed and surgical procedures are pre-planned, then transferred to the robotic systems to which they are connected. We have been using a stereotaxic robot since 1989 and a microscope robot since 1995 in various surgical routine procedures. The future of these applications rely mainly on the technical progress in informatics, about image recognition to adapt the pre-planning to the actual surgical situation, to correct brain shifts (for instance), about image fusion, integrated knowledge such as brain atlases, as well as virtual reality. The future developments, covering surgical procedure, research and teaching, are sure to be far beyond our wildest expectations.

Forecasting↗

PubMed1998

Intersensory experience and early perceptual development: postnatal experience with multimodal maternal cues affects intersensory responsiveness in bobwhite quail chicks.

Unlike the other sensory modalities of precocial infants, the visual modality does not normally become functional until after birth or hatching. Despite this unique developmental status, the role of emerging visual experience on postnatal perceptual organization remains unclear. In this study, bobwhite quail hatchlings were reared in conditions that manipulated postnatal experience with maternal visual cues, either alone or in conjunction with maternal auditory cues. Results revealed that bobwhite chicks require postnatal exposure to both maternal auditory and visual cues following hatching to demonstrate species-specific perceptual preferences. Chicks that received temporally disparate maternal auditory and visual cues or experience with only maternal visual or maternal auditory cues failed to show species-typical perceptual responsiveness. These results suggest that developmental mechanisms involving both visual and auditory sensory experience underlie the emergence of early intersensory integration.

Animals↗

PubMed2006

Radiation oncology research in the cancer and leukemia group B.

Radiation oncology initiatives have been an integral component in the evolution of multidisciplinary research in the Cancer and Leukemia Group B. Although early studies in the Group primarily focused on chemotherapy for hematologic and pediatric malignancies, the Radiation Oncology Committee was established in 1972, reflecting the broadening scope of clinical investigation with an increased emphasis on solid tumor research. A major early contribution of the Radiation Oncology Committee was the recognition of the importance of formalized radiation quality review, which led to the development of the Quality Assurance Review Center. The committee has been instrumental in designing trials, in conjunction with our medical oncology and surgical oncology colleagues, to assess multimodality therapy. The results of many of these studies have had important implications for clinical practice. Recent efforts have explored our major research theme of treatment intensification via radiotherapy dose modulation and novel combinations of radiotherapy with sensitizing agents, with an emphasis on safely implementing advanced technologies in the cooperative group setting.

Adult↗

PubMed2003

Temporal processing of visuotactile and tactile stimuli in writer's cramp.

Neurophysiological studies in animals show that basal ganglia are involved not only in motor and nonmotor timing functions but also in integrating tactile and visual signals delivered in the peripersonal space. We tested temporal discrimination of cross-modal and unimodal stimuli in 13 controls and 14 patients with writer's cramp, a disorder supposedly linked to dysfunction of basal ganglia. Subjects were asked to discriminate whether pairs of visual, tactile, or visuotactile stimuli were simultaneous or sequential (temporal discrimination threshold) and which stimulus preceded the other (temporal order judgment). Patients were impaired in temporal processing of tactile and cross-modal stimuli. A significant positive correlation between temporal deficits and the severity of disability was detected for both affected and unaffected sides. Findings suggest that multimodal and not only modality-specific temporal processing is defective in focal hand dystonia. Deficits of temporal processing of stimuli delivered to the unaffected side may represent a behavioral index of the susceptibility to develop dystonia and thus have remarkable practical and theoretical implications.

Adult↗

PubMedDate not supplied

Functional multimodality of axonal tree in invertebrate neurons.

This review, based on invertebrate neuron examples, aims at highlighting the functional consequences of axonal tree organization. The axonal organization of invertebrate neurons is very complex both morphologically and physiologically. The first part shows how the transfer of information along sensory axons is modified by presynaptic inhibition mechanisms. In primary afferents, presynaptic inhibition is involved in: 1) increasing the dynamic range of the sensory response; 2) processing the sensory information such as increasing spatial and/or temporal selectivity; 3) discriminating environmental information from sensory activities generated by the animal's own movement; and 4) modulating the gain of negative feedback (resistance reflex) during active rhythmic movements such as locomotion. In a second part, the whole organization of other types of neurons is considered, and evidence is given that a neuron may not work as a unit, but rather as a mosaic of disconnected 'integrate-and-fire' units. Examples of invertebrate neurons are presented in which several spike initiating zones exist, such as in some stomatogastric neurons. The separation of a neuron into two functionally distinct entities may be almost total with distinct arborizations existing in different ganglia. However, this functional separation is not definitive and depends on the state of the neuron. In conclusion, the classical integrate-and-fire representation of the neuron, with its dendritic arborization, its spike initiating zone, its axon and axonal tree seems to be no more applicable to invertebrate neurons. A better knowledge of the function of vertebrate neurons would probably demonstrate that it is the case for a large number of them, as suggested by the complex architecture of some reticular interneurons in vertebrates.

Animals↗