SEARCH · PubMed Health

Results for “multimodal integration”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6Linked to original sources

PubMed2005

Analyzing a complex visuomotor tracking task with brain-electrical event related potentials.

Non-invasive techniques such as neuroimaging and event-related potential (ERP) methods have dramatically enhanced our understanding of the human brain. According to the requirements of the applied method, it is useful to simplify tasks for methodological reasons. In the present study we tested whether ERP measures are also suitable for analyzing complex tasks. In order to do this, we developed an analysis strategy based on the post hoc analysis of the behavioural data. We applied this method to a pursuit-tracking task of 25 s trial duration, consisting of repeated and non-repeated waveforms, where subjects had to track a target cross with a mouse-controlled cursor cross. An EEG was recorded from 62 channels. Response-locked ERPs were computed for two types of error correction: the correction of errors induced externally by the change of target direction and of internal errors generated by the subject itself. We found several ERP components that could be assigned to different feedback and feedforward controlled processing steps in the frontoparietal circuitry underlying visuomotor control, such as movement planning, movement execution (motor potential), reafferent activity, visuospatial analysis, and attentional (P300) processes. Our results support newer models that propose a role for the posterior parietal cortex in integrating multimodal sensory information. In addition, fast (about 180 ms and probably facilitated by anticipation) and slow (about 230-260 ms) error corrections could be differentiated by the time course of ERP activity. Our results show that complex (motor) tasks can be investigated with ERPs. This opens fruitful perspectives for future research on motor control in an ecological setting.

Adult↗

PubMed2026

Artificial intelligence (AI) uses in stereotactic radiosurgery (SRS): diagnosis with brain metastasis (BM) - A systematic review.

BACKGROUND: Brain metastases (BM) are the most common intracranial tumors in adults, and stereotactic radiosurgery (SRS) has become a mainstay of management. However, several diagnostic challenges persist in the SRS pathway, particularly the differentiation of radiation necrosis (RN) from true tumor progression, which conventional MRI and even advanced imaging techniques often cannot reliably resolve. Recent advances in artificial intelligence (AI) offer the potential to address these diagnostic limitations. This systematic review synthesizes current literature on AI applications for MRI-based diagnostic decision support in BM patients undergoing SRS, with a focus on radiomics and deep learning tools for distinguishing RN from progression, classifying molecular and histologic subtypes, and predicting treatment response. METHODS: A systematic review was performed in accordance with PRISMA guidelines. PubMed, Web of Science, and Scopus were searched using a targeted query combining terms related to AI, brain metastasis, diagnosis or imaging, and SRS. After screening 483 records and applying strict inclusion and exclusion criteria, 18 studies published between 2015 and 2025 were included. Data were extracted on study design, cohort characteristics, imaging modality, AI methodology, validation strategy, and reported diagnostic performance. RESULTS: Among the 18 included studies, AI models demonstrated strong performance across diagnostic tasks in the BM-SRS pathway. The differentiation of RN from true tumor progression was the most extensively studied application, addressed by 14 of 18 studies, with reported AUCs ranging from 0.71 to 0.94. Support vector machines, random-forest ensembles, convolutional neural networks, and transformer-based multimodal architectures were widely used. The literature evolved from single-sequence radiomic classifiers in 2018 to multimodal deep learning frameworks fusing imaging with clinical and genomic data in 2025. Contrast-enhanced T1-weighted MRI was the dominant imaging input, and texture-based radiomic features (GLCM, GLSZM, GLDM, and wavelet-derived features) were the most consistently predictive. The highest-performing models reached AUCs of 0.85-0.91 through multimodal integration of imaging with clinical and genomic features, and consistently outperformed expert neuroradiologist read on matched cases. Remaining studies addressed longitudinal segmentation-based detection of local failure and adverse radiation effects, BRAF mutation status in melanoma BM, early Gamma Knife treatment response, and primary tumor histology classification, with more variable performance. CONCLUSION: AI models, particularly those integrating MRI-derived radiomic features with clinical and genomic data, show high accuracy in supporting diagnostic decisions for BM patients treated with SRS. The post-SRS differentiation of radiation necrosis from true tumor progression has reached the greatest level of maturity and is closest to clinical translation, with potential to reduce unnecessary biopsies, personalize surveillance intervals, and rationalize treatment-pathway decisions. Other diagnostic applications, including molecular subtyping and primary tumor histology classification, remain exploratory and require further multicenter validation. Integration of AI tools into multidisciplinary tumor-board workflows, combined with prospective validation and standardized reporting, will be essential to realize the full clinical benefits of AI in SRS for brain metastases.

Humans↗

PubMedDate not supplied

Magnetoencephalography and its Achilles' heel.

Magnetoencephalography (MEG) has practically unlimited temporal resolution. Fundamental physical reasons, however, restrict the capability of MEG to separate simultaneously active sources. After a brief tutorial introduction into MEG, various aspects of spatial resolution are reviewed with the help of examples. First the estimation of a single current dipole is examined. A consideration of the resolution field shows that the spatial selectivity of the estimated dipole moment is highly dependent on methodological issues. A subsequent consideration of various two-dipole configurations illustrates how the topography of the magnetic field depends on the distance between the two dipoles and their relative orientations. The resolution fields associated with the estimation of the dipole moments reveal a strong interference for closely spaced dipoles. A simple model suggests that the standard deviations of the estimated moments are inversely proportional to the distance of the dipoles. Spatial information provided by techniques like functional magnetic resonance imaging (fMRI) could help to overcome problems resulting from the limited spatial resolution of MEG (multimodal integration). But a straightforward synthesis, according to the principle that fMRI provides the spatial structure of the sources and MEG adds the temporal information, is probably doomed to failure in many situations. A serious dilemma, among other problems, is that the fMRI signal generally represents a temporal integral over several seconds: The knowledge that a certain brain region was active sometime or other is not necessarily helpful for disentangling the MEG activity within a specified short time window. An intriguing fact is that the spatio-temporal pattern of the MEG signals can be considered as a signature of the brain which is suitable for hypothesis testing with high temporal and spatial resolution.

Brain↗

PubMed2006

Effects of the gravitational vertical on the visual perception of reversible figures.

We examined the effects of the gravitational vertical on the perception of reversible figures. Each reversible figure had two interpretations depending on whether it was viewed vertically in one orientation or upside down. When it was presented horizontally, the two interpretations alternated. Subjects were required to indicate which interpretation was perceived after briefly viewing the horizontal presentation on a head-mounted display. When the subject was upright, each interpretation occurred by chance. When the subject was lying on one side, the horizontal figure was generally perceived as if it was presented vertically with the side down. The results suggest that the perception of reversible figures is influenced by the gravitational vertical, which might be reconstructed by multimodal integration of vestibular, proprioceptive, and tactile inputs.

Female↗

PubMed2004

Human medial intraparietal cortex subserves visuomotor coordinate transformation.

In the macaque, the posterior parietal cortex (PPC) integrates multimodal sensory information for planning and coordinating complex movements. In particular, the areas around the intraparietal sulcus (IPS) serve as an interface between the sensory and motor systems to allow for coordinated movements in space. Because recent imaging studies suggest a comparable functional and anatomical organization of human and monkey IPS, we hypothesized that in humans, as in macaques, the medial intraparietal cortex (area MIP) subserves visuomotor transformations. To test this hypothesis, changes of neural activity were measured using functional magnetic resonance imaging (fMRI) while healthy subjects performed a joystick paradigm similar to the ones previously employed in macaques for studying area MIP. As hypothesized, visuomotor coordinate transformation subserving goal-directed hand movements activated superior parietal cortex with the local maximum of increased neural activity lying in the medial wall of IPS. Compared to the respective visuomotor control conditions, goal-directed hand movements under predominantly proprioceptive control activated a more anterior part of medial IPS, whereas posterior medial IPS was more responsive to visually guided hand movements. Contrasting the two coordinate transformation conditions, changing the modality of movement guidance (visual/proprioceptive) did not significantly alter the BOLD signal within IPS but demonstrated differential recruitment of modality specific areas such as V5/MT and sensorimotor cortex/area 5, respectively. The data suggest that the human medial intraparietal cortex subserves visuomotor transformation processes to control goal-directed hand movements independently from the modality-specific processing of visual or proprioceptive information.

Adult↗

PubMed1998

Role of electron microscopy and other special techniques in the diagnosis of childhood round cell tumors.

A series of case presentations show unique challenges associated with childhood round cell tumors and the role of ancillary techniques in diagnosis. Electron microscopy is shown to be the most powerful individual technique. Immunohistochemistry is less effective but also essential. Other ancillary techniques may provide needed additional diagnostic information. Because this is an area where it is of great importance to secure the most rapid, accurate, and specific diagnosis possible, an integrated multimodal approach is recommended--incorporating light microscopic, electron microscopic, and immunohistochemical studies as a matter of routine, and providing for cytogenetic and/or molecular diagnostic studies as indicated.

Adolescent↗

PubMed1995

Primary extranodal non-Hodgkin lymphomas of the uterus and the breast: report of three cases.

The authors describe one case of a rare primitive non-Hodgkin lymphoma of the uterus, and two cases of primary non-Hodgkin lymphoma of the breast. Histologically, the uterine lymphoma, although clinically confined to the uterus, was a diffuse large cell lymphoma, group G according to the Working formulation for Clinical Usage. The two cases of breast lymphoma were a centrocytic-centroblastic and a lymphoplasmocytoid non-Hodgkin lymphoma, respectively. All cases were initially treated with radical surgery plus radiotherapy, but the first patient showed an early recurrence at distant sites, which required systemic cytotoxic chemotherapy. The patient with uterine non-Hodgkin lymphoma received a very intense regimen--i.e. the ProMACE-Cytabom--because of the unfavourable histology, while the two patients with primary breast non-Hodgkin lymphoma received less aggressive CHOP and CVP chemotherapy. All patients are still alive and free of disease 3 to 6 years after initial diagnosis. These cases stress the systemic nature of non-Hodgkin lymphomas even if apparently localized to a single extranodal organ. Thus, although a definitive therapeutic strategy cannot be drawn from the rare and occasional reports in the medical literature, primary extranodal lymphomas require integrated multimodality therapy with radiotherapy and/or chemotherapy.

Antineoplastic Combined Chemotherapy Protocols↗

PubMed1999

[A network capable of reading the temporal codes in the olfactory discrimination of insects].

Recent work on the insect olfactory system has shown that its mushroom bodies (one of its major components) are involved in the fine discrimination of odours and that the temporal organisation of spike discharges plays a fundamental role. We propose here a model of a network that is able to decode the temporal patterns which characterise an odour. This model has three fundamental properties that seem to exist in all mushroom bodies of insects studied so far: a) long lasting inhibitions with rebounds, able to facilitate delayed spike generation; b) synaptic plasticity, which allows the network to learn to recognise temporal patterns; c) above all a large interconnection, which allows this network to recognise intervals of various duration. This model thus appears suited to identify combinations of temporal patterns in the dendrites of Kenyon cells (the principal cells in the calyces of the mushroom bodies). Moreover, the mushroom bodies integrate multimodal inputs, suggesting that the detection of temporal patterns may be extended to the detection of a complex environment, combining in particular olfactive and visual inputs.

Animal Structures↗

PubMed2001

Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study.

In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.

Adult↗

PubMed2000

Relating unilateral neglect to the neural coding of space.

Neuropsychological findings on the human neglect syndrome after parietal damage may relate to the physiological properties of single cells that have been studied in monkey parietal cortex and in related brain areas. Human neglect may reflect partial loss or dysfunction of similar cell populations, producing a pathological gradient in the numbers of cells representing particular lateral positions in space, for particular functions. This can explain the graded deficits seen in patients. We relate the patient deficits to cellular properties for several current issues: spatial frames-of-reference; multimodal integration; effective treatments for neglect; motor components to parietal function; and residual unconscious processing. A neural perspective may resolve traditional debates in the neglect literature and outline directions for future research.

Animals↗

PubMed2002

Role of functional magnetic resonance imaging in the evaluation of patients with malformations caused by cortical development.

As functional MR imaging (fMRI) continues to offer unparalleled advantages in probing neural activity, diagnostic applications continue to flourish. The evaluation of malformations caused by abnormalities of cortical development is an area in which fMRI has an emerging role and potential to provide new insights into epileptogenesis through multimodal integration with electroencephalagraphy. The clinical impact, however, is just beginning to be felt as new data emerge.

Brain Mapping↗

PubMed2003

A multivariate, spatiotemporal analysis of electromagnetic time-frequency data of recognition memory.

Electromagnetic indices of "fast" (above 12 Hz) oscillating brain activity are much more likely to be considerably attenuated by time-averaging across multiple trials than "slow" (below 12 Hz) oscillating brain activity. To the extent that both types of oscillations represent the activity of temporally and topographically separable neural populations, time averaging can cause a loss of brain activity information that is important both conceptually and for multimodal integration with hemodynamic techniques. To address this issue for recognition memory, simultaneous electroencephalography (EEG) and whole-head magnetoencephalography (MEG) recordings of explicit word recognition from 11 healthy subjects were analyzed in two different ways. First, the time course of neural oscillations ranging from theta (4.5 Hz) to gamma (42 Hz) frequencies were identified using single-trial continuous wavelet transforms. Second, traditional analyses of amplitude variations of time-averaged EEG and MEG signals, event-related potentials (ERPs), and fields (ERFs) were performed and submitted to distributed source analyses. To identify data patterns that covaried with the difference between correctly recognized studied (old) words and correctly rejected nonstudied (new) words, a multivariate statistical tool, partial least squares (PLS), was applied to both types of analyses. The results show that ERPs and ERFs are mainly displaying those neural indices of recognition memory that oscillate in the theta (4.5-7.5 Hz), alpha (8-11.5), and to some extent in the beta1 (12-19.5 Hz) frequency range. The sources of the ERPs/ERFs were in good agreement with the topography of theta/alpha/beta 1 oscillations in being confined to the anterior temporal lobe at 400 ms and being distributed across temporal, parietal, and occipital areas between 500 and 700 ms. Gamma oscillations covaried either positively or negatively with theta/alpha/beta1 oscillations. A positive covariance, for instance, was detected over left anterior temporal sensors as early as 200-350 ms and is compatible with studies in rodents showing that gamma and theta oscillations emerge together out of the interaction of the hippocampus and the entorhinal and perirhinal cortices. Fast beta oscillations (20-29.5 Hz), on the other hand, did not strongly covary with slow oscillations and were likely to arise from neural populations not adequately represented in ERPs/ERFs. In summary, by providing a more comprehensive description of electromagnetic signals, time-frequency data are of potential benefit for integrating electrophysiological and hemodynamic indices of brain activity and also for integrating human and animal electrophysiology.

Adolescent↗

PubMed2003

Neurological disorders and the structure of human consciousness.

Recent studies that identify distinct neural correlates of perceptual awareness offer a promising step towards improved understanding of the neurological underpinnings of conscious experience. Such studies indicate that perceptual awareness is modular in nature, with neural correlates of awareness consisting of the specialized structures involved in perceptual processing. However, the integrative, multimodal nature of conscious experience appears to require a functional architecture that overcomes this modular segregation of function. We propose a model in which experience emerges from the dynamic interactions of specialized component processes via a distributed neural network. Such a model offers a mechanism to explain several empirical observations of the neural correlates of perceptual awareness, cognitive function, and symptoms of neurological damage.

Journal Article↗

PubMed2005

Chemotherapy and anaesthetic drugs: too little is known.

A growing number of patients undergo surgical procedures with general anaesthesia soon after receiving chemotherapy; occasionally such treatment can be given during surgery. Therefore, it is worthwhile and prudent to consider the pharmacological interactions between anticancer and anaesthetic drugs. We review published data on the pharmacological interactions between antineoplastic and anaesthetic drugs, despite the fact that this specific topic is poorly represented in published work. This low coverage seems to be due more to a lack of knowledge and understanding rather than an absence of interactions between the two drug types. Since the number of individuals receiving chemotherapy in the perioperative period is rising, patients who might have potentially dangerous and unwanted effects are also due to increase in number. Thus, we should be vigilant in the careful surveillance of these interactions as well as broaden our knowledge of in-vivo and in-vitro findings and investigations. Classic cytostatic compounds and modern drugs should be extensively studied, and new anticancer therapies closely interacting with immunological responses need to be better understood, since their clinical effectiveness might be modified by anaesthetics that are currently used. More frequently, tumours are being managed in a multimodal integrated approach with medical, surgical, and radiotherapeutic aspects.

Analgesics↗

PubMed2003

[Cocaine and opiate related disorders].

Cocaine and the opiates are--together with alcohol--involved in the genesis of the "three great addictions". The medical conceptualisation of the dependence phenomenon has evolved on the grounds of a critical observation of different ways of use and treatment endeavours, mainly during the last three centuries. Whereas the prohibitionists favoured (and still favour) total abstinence from all psychotropic drugs, defect theoreticians emphasise analytically-oriented psychotherapeutic procedures aiming at healing a supposed underlying self-defect. Contrarily, proponents of the "Metabolic Theory" of the addictions suggest a mainly medication-based approach in order to normalise a--in their eyes causal--still in some aspects hypothetical metabolic defect. Based on a short survey of recently emerging trends of consumption patterns (speed-balling, chasing, multi-substance-use) in Europe, the most important newer treatment types and forms are presented. Finally, a multimodal, integrated, and individualized approach is recommended.

Cocaine↗

PubMed1999

Filial imprinting in domestic chicks is associated with spine pruning in the associative area, dorsocaudal neostriatum.

Juvenile emotionally modulated learning events are fundamental for the normal development of socio-emotional competence and intellectual capabilities. Filial imprinting in the domestic chick provides a suitable model to investigate the neural mechanisms underlying such juvenile learning events. The forebrain area dorsocaudal neostriatum (Ndc), a multimodal integration area and presumed equivalent to mammalian parietotemporal association cortices, has been shown to be critically involved in this learning process. We investigated whether filial imprinting is associated with changes of synaptic connectivity in the Ndc. Quantitative measurements of spine densities of a large neuron type in the Ndc revealed a massive pruning of spine synapses after filial imprinting. Compared with 7-day-old naive control chicks, imprinted chicks displayed significantly lower spine frequencies on all dendritic segments. Since the average length of the dendritic segments did not change during imprinting, these results can be interpreted as a reduction of the absolute number of spine synapses on this neuron type. In a control region, the primary sensory forebrain area ectostriatum, spine density and dendritic length remained unchanged. These results indicate that synaptic pruning may represent a mechanism of selective synaptic reorganization in higher associative forebrain areas as a fundamental feature of juvenile learning events.

Animals↗

PubMed2002

Interaction of linear vestibular and visual stimulation in the macaque ventral intraparietal area (VIP).

Navigation in space requires the brain to combine information arising from different sensory modalities with the appropriate motor commands. Sensory information about self-motion in particular is provided by the visual and the vestibular system. The macaque ventral intraparietal area (VIP) has recently been shown to be involved in the processing of self-motion information provided by optical flow, to contain multimodal neurons and to receive input from areas involved in the analysis of vestibular information. By studying responses to linear vestibular, visual and bimodal stimulation we aimed at gaining more insight into the mechanisms involved in multimodal integration and self-motion processing. A large proportion of cells (77%) revealed a significant response to passive linear translation of the monkey. Of these cells, 59% encoded information about the direction of self-motion. The phase relationship between vestibular stimulation and neuronal responses covered a broad spectrum, demonstrating the complexity of the spatio-temporal pattern of vestibular information encoded by neurons in area VIP. For 53% of the direction-selective neurons the preferred directions for stimuli of both modalities were the same; they were opposite for the remaining 47% of the neurons. During bimodal stimulation the responses of neurons with opposite direction selectivity in the two modalities were determined either by the visual (53%) or the vestibular (47%) modality. These heterogeneous responses to unimodal and bimodal stimulation might be used to prevent misjudgements about self- and/or object-motion, which could be caused by relying on information of one sensory modality alone.

Animals↗

PubMed2000

Improvements in chronic diseases with a comprehensive natural medicine approach: a review and case series.

Approximately 40% of the US population report using complementary and alternative medicine, including Maharishi Vedic Medicine (MVM), a traditional, comprehensive system of natural medicine, for relief from chronic and other disorders. Although many reports suggest health benefits from individual MVM techniques, reports on integrated holistic approaches are rare. This case series, designed to investigate the effectiveness of an integrated, multimodality MVM program in an ideal clinical setting, describes the outcomes in four patients: one with sarcoidosis; one with Parkinson's disease; a third with renal hypertension; and a fourth with diabetes/essential hypertension/anxiety disorder. Standard symptom reports and objective markers of disease were evaluated before, during, and after the treatment period. Results suggested substantial improvements as indicated by reductions in major signs, symptoms, and use of conventional medications in the four patients during the 3-week in-residence treatment phase and continuing through the home follow-up program.

Chronic Disease↗