SEARCH · PubMed Health

Results for “Multimodal learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15Linked to original sources

PubMed1985

Prerequisites for lack of age differences in memory performance.

Free recall performance of young and old adults was examined in three memory tasks: acts carried out by the subjects (subject-performed tasks or SPTs), sentences with imagery instructions, and sentences. The subjects were presented with the same verbal information in all three tasks. No age differences were observed on free recall of SPTs, whereas typical aging effects were obtained on free recall of the other tasks. This way the data from a previous study of no age effects on SPT recall were replicated. A hypothesis about imagery as a critical factor for the lack of age differences on SPT recall gained no support. Two main concepts were proposed to account for the data: Compensation among the elderly by means of the multimodal and rich properties of SPTs, and a superior ability for a spontaneous recoding of verbal information among young adults. The results were also discussed in relation to a presumption of memory tasks as varying in attentional demands.

Adolescent↗

PubMed2006

Combination of multimodal imaging and molecular genetic information to investigate complex psychiatric disorders.

Multimodal imaging, the combination of several brain imaging techniques in one subject, provides a wealth of parameters and favours the interpretation of complex models in schizophrenia research. Moreover, new imaging tools allow the investigation of distinct neurotransmitter systems and their modulation by pharmacological intervention. An important feature of multimodal imaging is the possibility to characterize the activation dependencies of different neurotransmitters and provide the experimental tool to test system models of brain function and dysfunction. The combination of measurement techniques with high temporal resolution (e. g. MEG, EEG) and high spatial resolution (e. g. fMRI) facilitate the understanding of local and global systems as well as time characteristics. Moreover, the association of imaging parameters with genetic variations of neurotransmitter systems allows the investigation of neurotransmitter activity and its role in the pathophysiology of schizophrenia. To overcome the limitations of standard statistical methods, new approaches in machine learning have to be adapted to handle multiple parameters obtained from brain imaging and genetic measurements.

Brain↗

PubMed1998

Capacity for plasticity in the adult owl auditory system expanded by juvenile experience.

In the process of creating a multimodal map of space, auditory-visual neurons in the optic tectum establish associations between particular values of auditory spatial cues and locations in the visual field. In the barn owl, tectal neurons reveal these associations in the match between their tuning for interaural time differences (ITDs) and the locations of their visual receptive fields (VRFs). In young owls ITD-VRF associations can be adjusted by experience over a wide range, but the range of adjustment normally becomes quite restricted in adults. This normal range of adjustment in adults was greatly expanded in owls that had previously learned abnormal ITD-VRF associations as juveniles. Thus, the act of learning abnormal associations early in life leaves an enduring trace in this pathway that enables unusual functional connections to be reestablished, as needed, in adulthood, even when the associations represented by these connections have not been used for an extended period of time.

Adaptation, Physiological↗

PubMed2005

Transmodal sensorimotor networks during action observation in professional pianists.

Audiovisual perception and imitation are essential for musical learning and skill acquisition. We compared professional pianists to musically naive controls with fMRI while observing piano playing finger-hand movements and serial finger-thumb opposition movements both with and without synchronous piano sound. Pianists showed stronger activations within a fronto-parieto-temporal network while observing piano playing compared to controls and contrasted to perception of serial finger-thumb opposition movements. Observation of silent piano playing additionally recruited auditory areas in pianists. Perception of piano sounds coupled with serial finger-thumb opposition movements evoked increased activation within the sensorimotor network. This indicates specialization of multimodal auditory-sensorimotor systems within a fronto-parieto-temporal network by professional musical training. Musical ''language,'' which is acquired by observation and imitation, seems to be tightly coupled to this network in accord with an observation-execution system linking visual and auditory perception to motor performance.

Adult↗

PubMed1989

How and what do autistic children see? Emotional, perceptive and social peculiarities reflected in more recent examinations of the visual perception and the process of observation in autistic children.

Autistic symptoms become apparent at the earliest during the 2nd-3rd month of life when the spontaneous registration of the meaning of specific-visual stimuli (eyes, configuration of the mother's face) do not occur and also learning experiences by reason of mimic and gestures repeatedly shown by the interaction partner can neither evoke a social smile nor stimulate anticipational behaviour. Even with increasing age an empathetic perception of feelings in the corresponding mimical gesticular formation is very difficult and they themselves are only insufficiently able to express their own feelings intelligibly to everyone. As mimic and gestures are, however, visually perceived, the autistic perceptive child's competence is of great importance. On the basis of the examinations of visual perception (retinal pathology, tunnel vision) perceptual processing (recognition of feelings, sex and age) and the disintegration of multimodal stimuli it can be presumed that social and emotional deficits are to be seen in connection with a deviant perceptive interpretation of the world and irregular processing on the basis of a neuro-biological handicap (the absence of a genetic determined reference-system for emotionally significant stimuli), which can have various causes (comp. Gillberg 1988) and also impede the adequate expression of feelings in mimic, gestures and voice. Autistic people see, experience and understand the world in a specific way in which and by which they differ from non-handicapped people.(ABSTRACT TRUNCATED AT 250 WORDS)

Affective Symptoms↗

PubMed2004

Neoadjuvant therapy for pancreatic cancer: the Duke experience.

The advantages of neoadjuvant (preoperative) chemoradiation therapy for pancreatic cancer include the assurance that all resected patients receive multimodality therapy; the opportunity for patients with occult metastatic disease to manifest themselves; and the potential to improve resectability. Since 1994, Duke University Medical Center has treated over 180 patients with localized pancreatic cancer using neoadjuvant 5-fluorouracil (5FU)-based chemoradiation therapy (CRT). Approximately 20% of patients demonstrate distant disease progression during CRT and avoid the morbidity of laparotomy. Almost 20% of locally advanced tumors on initial-staging CT can be resected following CRT. Patients who have successfully undergone resection have experienced favorable survival with an estimated 5-year survival rate of 36%. This article reviews the authors' experience and the lessons learned from it.

Adult↗

PubMed1991

Development of intersensory function: age-related differences in stimulus selection of multimodal compounds in rats as revealed by Pavlovian conditioning.

Preweanling and adult rats were exposed to Pavlovian stimulus pairings with lights, tones, and light-tone compounds as conditional stimuli (CSs). Tone intensity was varied. As was found in previous studies using flavor CSs, odor CSs, or both, in which significant overshadowing or potentiation occurred to an element of a compound, overshadowing was less likely and potentiation more likely for preweanlings than for adults. Several experiments supported the view that these effects reflect an age-related difference in the controlling properties of stimuli: Young rats are more disposed to encode multimodal compounds on the basis of amodal intensity, whereas their elders are more likely to encode modality-specific properties of light and sound. Differential reinforcement in the presence of lights, tones, and light-tone compounds made preweanlings' stimulus selection appear more adultlike and may be a cause of development of intersensory function.

Aging↗

PubMed2006

Synaptic depression and short-term habituation are located in the sensory part of the mammalian startle pathway.

BACKGROUND: Short-term habituation of the startle response represents an elementary form of learning in mammals. The underlying mechanism is located within the primary startle pathway, presumably at sensory synapses on giant neurons in the caudal pontine reticular nucleus (PnC). Short trains of action potentials in sensory afferent fibers induce depression of synaptic responses in PnC giant neurons, a phenomenon that has been proposed to be the cellular correlate for short-term habituation. We address here the question whether both this synaptic depression and the short-term habituation of the startle response are localized at the presynaptic terminals of sensory afferents. If this is confirmed, it would imply that these processes take place prior to multimodal signal integration, rather than occurring at postsynaptic sites on PnC giant neurons that directly drive motor neurons. RESULTS: Patch-clamp recordings in vitro were combined with behavioral experiments; synaptic depression was specific for the input pathway stimulated and did not affect signals elicited by other sensory afferents. Concordant with this, short-term habituation of the acoustic startle response in behavioral experiments did not influence tactile startle response amplitudes and vice versa. Further electrophysiological analysis showed that the passive properties of the postsynaptic neuron were unchanged but revealed some alterations in short-term plasticity during depression. Moreover, depression was induced only by trains of presynaptic action potentials and not by single pulses. There was no evidence for transmitter receptor desensitization. In summary, the data indicates that the synaptic depression mechanism is located presynaptically. CONCLUSION: Our electrophysiological and behavioral data strongly indicate that synaptic depression in the PnC as well as short-term habituation are located in the sensory part of the startle pathway, namely at the axon terminals of sensory afferents in the PnC. Our results further corroborate the link between synaptic depression and short-term habituation of the startle response.

Acoustic Stimulation↗

PubMed1999

Enhancing community participation in intervention research: farmworkers and agricultural chemicals in North Carolina.

The participation of affected communities in the development of public health intervention research improves project sustainability and effectiveness by making projects more relevant and acceptable to the communities. This article presents a multimode, multidomain model approach for community participation in different project components, which ensures the benefits of participation without requiring the same level of participation in every activity or by every community sector. A case study is used to illustrate the model, describing procedures for establishing and maintaining farmworker participation in developing an intervention to reduce exposure to chemicals. Farmworkers are a poor and underserved population for which the empowering and culturally appropriate benefits of community participation are especially needed. However, this population presents challenges for participatory health projects: geographic dispersion, ethnic diversity, lack of organization, sense of powerlessness, and communication and transportation difficulties. The lessons learned in this case extend the method and theory of community participation.

Adult↗

PubMed1988

Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance.

Among other deficits, amygdalectomy impairs the ability of the animal to recognize the affective significance of a stimulus. In the present study, neuronal activity in the amygdala (AM) was recorded from alert monkeys while they performed tasks leading to the presentation of rewarding or aversive stimuli. Of 585 AM neurons tested, 312 (53.3%) responded to at least one stimulus in one or more of 5 major groups: 40 vision related, 26 audition related, 41 ingestion related, 117 multimodal, and 14 selective. Ingestion-related neurons were subdivided according to their responses to other stimuli: oral sensory, oral sensory plus vision, and oral sensory plus audition. Depending upon their responsiveness to the affective significance of the stimuli, neurons in the vision- and audition-related categories were divided into 2 subclasses: vis-I (26/40), vis-II (14/40), aud-I (8/26), and aud-II (18/26). All 4 subtypes usually responded to unfamiliar stimuli but seldom responded to neutral familiar stimuli. Types vis-I and aud-I responded to both positive and negative familiar stimuli. Types vis-II and aud-II responded to certain familiar negative stimuli but not to familiar positive stimuli. In vis-I neurons, responses were stronger for palatable foods than for less palatable foods. No neurons within vision-related, audition-related, and multimodal categories responded solely to positive or to negative stimuli. Of the 27 oral sensory neurons 9 were tested with saline or salted food, and 8 responded to normally aversive oral sensory stimuli in the same manner as they did to normal food or liquid (water or juice). In contrast to oral sensory neurons, all responses of 4 oral sensory-plus-vision and all of 4 selective neurons tested, as well as bar pressing behavior, were modulated by altering the affective significance of the food. These results suggest that the AM is one of the candidates for stimulus-affective association based on associative learning and memory.

Acoustic Stimulation↗

PubMed1994

Pain rehabilitation. 3. Cancer pain, pelvic pain, and age-related considerations.

This self-directed learning module highlights assessment and therapeutic options in the management of cancer pain, pelvic pain, and the pain problems of the elderly and children. It is part of the chapter on pain rehabilitation in the Self-Directed Medical Knowledge Program for practitioners and trainees in physical medicine and rehabilitation. This article delineates causes of cancer pain, discusses strategies for approaching each specialized population, and provides specific clinical examples to illustrate management issues, with emphasis on prevention. New advances include understanding the pain experience in children and elderly adults; investigation of psychosocial aspects of pelvic pain; and use of patient-controlled analgesia, opioids, and multimodality techniques for acute, perioperative, and chronic pain in these age groups.

Adult↗

PubMed2003

A multimodal brain-based feedback and communication system.

The Thought Translation Device (TTD) is a brain-computer interface based on the self-regulation of slow cortical potentials (SCPs) and enables completely paralyzed patients to communicate using their brain potentials. Here, an extended version of the TTD is presented that has an auditory and a combined visual and auditory feedback modality added to the standard visual feedback. This feature is necessary for locked-in patients who are no longer able to focus their gaze. In order to test performance of physiological regulation with auditory feedback 54 healthy participants were randomly assigned to visual, auditory or combined visual-auditory feedback of slow cortical potentials. The training consisted of three sessions with 500 trials per session with random assignment of required cortical positivity or negativity in half of the trials. The data show that physiological regulation of SCPs can be learned with auditory and combined auditory and visual feedback although the performance of auditory feedback alone was significantly worse than with visual feedback alone.

Acoustic Stimulation↗

PubMed1996

The Singapore naltrexone community-based project for heroin addicts compared with drugfree community-based program: the first cohort.

The cornerstone of heroin rehabilitation in Singapore from 1991 to 1993 was the Three Phase Program (3PP). This was a multimodal approach embracing job placement, individual and family counselling, home placement and restriction of movement by electronic monitoring. Opioid addicts in Singapore are detained by executive order. Inmates volunteer to be on the community program. The completion rate (i.e. the number of inmates presumptively drug-free after 1 year) was 24%. In August 1993, naltrexone, an opiate antagonist without euphorigenic properties was added to the 3PP creating the Naltrexone Pilot Project (NPP). Sufficient similarity existed between the 3PP and NPP for some comparison between the two. The missing link was the chemical blockade offered by naltrexone to provide a deconditioning experience for the decay of learned responses to heroin. The subject can confidently be exposed to drug cues without fear of relapse. Subjects on naltrexone for the first year had a completion rate of 76.3%. In the second year without naltrexone, electronic tagging and counselling, 32.2% were still drug-free. The subject type who was successful was married, older and better educated with late onset in heroin abuse.

Journal Article↗

PubMed2006

The multi-component model of working memory: explorations in experimental cognitive psychology.

There are a number of ways one can hope to describe and explain cognitive abilities, each of them contributing a unique and valuable perspective. Cognitive psychology tries to develop and test functional accounts of cognitive systems that explain the capacities and properties of cognitive abilities as revealed by empirical data gathered by a range of behavioral experimental paradigms. Much of the research in the cognitive psychology of working memory has been strongly influenced by the multi-component model of working memory [Baddeley AD, Hitch GJ (1974) Working memory. In: Recent advances in learning and motivation, Vol. 8 (Bower GA, ed), pp 47-90. New York: Academic Press; Baddeley AD (1986) Working memory. Oxford, UK: Clarendon Press; Baddeley A. Working memory: Thought and action. Oxford: Oxford University Press, in press]. By expanding the notion of a passive short-term memory to an active system that provides the basis for complex cognitive abilities, the model has opened up numerous questions and new lines of research. In this paper we present the current revision of the multi-component model that encompasses a central executive, two unimodal storage systems: a phonological loop and a visuospatial sketchpad, and a further component, a multimodal store capable of integrating information into unitary episodic representations, termed episodic buffer. We review recent empirical data within experimental cognitive psychology that has shaped the development of the multicomponent model and the understanding of the capacities and properties of working memory. Research based largely on dual-task experimental designs and on neuropsychological evidence has yielded valuable information about the fractionation of working memory into independent stores and processes, the nature of representations in individual stores, the mechanisms of their maintenance and manipulation, the way the components of working memory relate to each other, and the role they play in other cognitive abilities. With many questions still open and new issues emerging, we believe that the multicomponent model will continue to stimulate research while providing a comprehensive functional description of working memory.

Brain↗

PubMed2025

Integrating Imaging-Derived Clinical Endotypes with Plasma Proteomics and External Polygenic Risk Scores Enhances Coronary Microvascular Disease Risk Prediction.

Coronary microvascular disease (CMVD) is an underdiagnosed but significant contributor to the burden of ischemic heart disease, characterized by angina and myocardial infarction. The development of risk prediction models such as polygenic risk scores (PRS) for CMVD has been limited by a lack of large-scale genome-wide association studies (GWAS). However, there is significant overlap between CMVD and enrollment criteria for coronary artery disease (CAD) GWAS. In this study, we developed CMVD PRS models by selecting variants identified in a CMVD GWAS and applying weights from an external CAD GWAS, using CMVD-associated loci as proxies for the genetic risk. We integrated plasma proteomics, clinical measures from perfusion PET imaging, and PRS to evaluate their contributions to CMVD risk prediction in comprehensive machine and deep learning models. We then developed a novel unsupervised endotyping framework for CMVD from perfusion PET-derived myocardial blood flow data, revealing distinct patient subgroups beyond traditional case-control definitions. This imaging-based stratification substantially improved classification performance alongside plasma proteomics and PRS, achieving AUROCs between 0.65 and 0.73 per class, significantly outperforming binary classifiers and existing clinical models, highlighting the potential of this stratification approach to enable more precise and personalized diagnosis by capturing the underlying heterogeneity of CMVD. This work represents the first application of imaging-based endotyping and the integration of genetic and proteomic data for CMVD risk prediction, establishing a framework for multimodal modeling in complex diseases.

Cardiovascular Disease↗

PubMed2003

Development of multimedia learning modules for teaching human anatomy: application to osteology and functional anatomy.

Computer-assisted learning (CAL) is growing quickly within academic programs. Although the anatomical commercial packages that are available for this learning have attractive advantages, they also have drawbacks: they are frequently not in the local language of the students, they do not perfectly answer the needs of the local academic program, and their cost is frequently more than students can afford. This study describes a relatively inexpensive method to create CAL tutorials, whose content can be fully customized to local academic needs in terms of both program and language. The study describes its use in creating multimedia learning modules (MLMs) about Osteology and joint kinematics. The pedagogical content in these modules was collected from objective experiments to give students the opportunity to access new scientific knowledge during their education. It can be replaced, as desired, by almost any content due to the flexibility of the production method. Each MLM consists of two complementary subelements: a multimedia theoretical lecture and a three-dimensional interactive laboratory. Such MLMs are in use at both the University of Brussels (ULB) and the National University of Rwanda (NUR). The development of this work was part of the VAKHUM project, and the pedagogical validation is currently being performed as part of the MULTIMOD project.

Anatomy↗

PubMed2026

shinyDeepGxP: a user-friendly R shiny app for predicting surface protein abundance from scRNA-seq expression using deep learning in blood cells.

MOTIVATION: Understanding accurate immune cell heterogeneity and function in single-cell datasets requires access to protein-level information, which is often unavailable due to experimental limitations. RESULTS: We present shinyDeepGxP, an interactive web application featuring our deep learning model, DeepGxP, for predicting surface protein abundance from single-cell RNA-sequencing (scRNA-seq) data. This platform makes DeepGxP accessible to researchers without programming skills. Users can upload scRNA-seq count matrices and use "Predict Protein" to predict the abundance of 224 biologically relevant surface proteins. shinyDeepGxP provides visualizations to help identify distinct cell populations based on predicted protein profiles. Moreover, users can choose "Explore Model" to reveal key RNA predictors and their associated biological pathways for each protein. Overall, shinyDeepGxP is a user-friendly, freely available web tool that provides protein-level detail for RNA-only single-cell datasets, enabling multimodal discovery without additional experiments. AVAILABILITY AND IMPLEMENTATION: shinyDeepGxP can be launched on https://shiny.crc.pitt.edu/deepgxp/.

Journal Article↗

PubMedDate not supplied

Multimodal sensory integration in weakly electric fish: a behavioral account.

The ability to integrate multisensory information is a fundamental characteristic of the brain serving to enhance the detection and identification of external stimuli. Weakly electric fish employ multiple senses in their interactions with one another and with their inanimate environment (electric, visual, acoustic, mechanical, chemical, thermal, and hydrostatic pressure) and also generate signals using some of the same stimulus energies (electric, acoustic, visual, mechanical). A brief overview provides background on the sensory and motor channels available to the fish followed by an examination of how weakly electric fish 'benefit' from integrating various stimulus modalities that assist in prey detection, schooling, foraging, courtship, and object location. Depending on environmental conditions, multiple sensory inputs can act synergistically and improve the task at hand, can be redundant or contradictory, and can substitute for one another. Over time, in repeated encounters with familiar surrounds, loss of one modality can be compensated for through learning. Studies of neuronal substrates and an understanding of the computational algorithms that underlie multisensory integration ought to expose the physiological corollaries to widely published concepts such as internal representation, sensory expectation, sensory generalization, and sensory transfer.

Animals↗