PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “multimodal learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6Linked to original sources

Multimodal inputs to the granule cell domain of the cochlear nucleus.

There is growing evidence that hearing involves the integration of many brain functions, including vision, balance, somatic sensation, learning and memory, and emotional state. Some of these integrative processes begin at the earliest stages of the central auditory system. In this review, we will discuss evidence that reveals multimodal projections into the granule cell domain of the cochlear nucleus.

Animals↗

A joint physics-based statistical deformable model for multimodal brain image analysis.

A probabilistic deformable model for the representation of multiple brain structures is described. The statistically learned deformable model represents the relative location of different anatomical surfaces in brain magnetic resonance images (MRIs) and accommodates their significant variability across different individuals. The surfaces of each anatomical structure are parameterized by the amplitudes of the vibration modes of a deformable spherical mesh. For a given MRI in the training set, a vector containing the largest vibration modes describing the different deformable surfaces is created. This random vector is statistically constrained by retaining the most significant variation modes of its Karhunen-Loève expansion on the training population. By these means, the conjunction of surfaces are deformed according to the anatomical variability observed in the training set. Two applications of the joint probabilistic deformable model are presented: isolation of the brain from MRI using the probabilistic constraints embedded in the model and deformable model-based registration of three-dimensional multimodal (magnetic resonance/single photon emission computed tomography) brain images without removing nonbrain structures. The multi-object deformable model may be considered as a first step toward the development of a general purpose probabilistic anatomical atlas of the brain.

Anatomy, Cross-Sectional↗

12. Assessment of developmental learning and behavioural problems in children and young people.

Brain development from late pregnancy to 3 years of age affects a child's learning, behaviour and health throughout life. Behavioural difficulties in children are usually symptoms of underlying problems. Observing a child's appearance and performance, and taking a detailed history (considering factors in the child, the home, the school and the wider environment) provide most of the information needed for diagnosing behavioural problems. It is important to know what is "normal" for all stages of a child's development, but equally important not to confuse behavioural difficulties with normal variations and behaviours associated with developmental stages. Assessment and early intervention for behavioural and learning difficulties in children require a multidisciplinary team approach. As well as the recommended "multimodal" approach for managing attention deficit hyperactivity disorder, shared care with a general practitioner is available in some states, but medication is likely to be the trigger for a positive outcome.

Adolescent↗

Emergence of neural integration in the head-direction system by visual supervision.

Head-direction (HD) cells in subcortical areas of the mammalian brain are tuned to a particular head direction in space; a population of such neurons forms a neural compass that may be relevant for spatial navigation. The development of neural circuits constituting the head-direction system is poorly understood. Inspired by electrophysiological experiments about the role of recurrent synaptic connections, we investigate a learning rule that teaches neurons to amplify feed-forward inputs. We simulate random head movements of a rat, during which neurons receive both visual and vestibular (head-velocity) inputs. Remarkably, as recurrent connections learn to amplify exclusively the visual inputs, a neural network emerges that performs spatio-temporal integration. That is, during head movements in darkness, neurons resemble HD cells by maintaining a fixed tuning to head direction. The proposed learning rule exhibits similarities with known forms of anti-Hebbian synaptic plasticity. We conclude that selective amplification could serve as a general principle for the synaptic development of multimodal feedback circuits in the brain.

Algorithms↗

Learning dialogue with and without movement.

In two experiments, we investigated the contribution of physical movement to the processing and eventual retrieval of dramatic dialogue by untrained nonactors after they had received only brief procedural coaching. It was found that participants who processed a script by reading the text aloud while simultaneously moving in accordance with a director's instructions retained more material than did those who used verbal communication only or controls who deliberately memorized the same material. Furthermore, when the recall of the participants in the moving condition was analyzed on a speech-by-speech basis, the results showed significantly greater memory for speeches that had been accompanied by movement than for speeches during which the same participant had remained in one place. These findings are discussed in the contexts of embodied cognition and multimodal memory models.

Adult↗

CrossAttOmics: multiomics data integration with cross-attention.

MOTIVATION: Advances in high throughput technologies enabled large access to various types of omics. Each omics provides a partial view of the underlying biological process. Integrating multiple omics layers would help have a more accurate diagnosis. However, the complexity of omics data requires approaches that can capture complex relationships. One way to accomplish this is by exploiting the known regulatory links between the different omics, which could help in constructing a better multimodal representation. RESULTS: In this article, we propose CrossAttOmics, a new deep-learning architecture based on the cross-attention mechanism for multiomics integration. Each modality is projected in a lower dimensional space with its specific encoder. Interactions between modalities with known regulatory links are computed in the feature representation space with cross-attention. The results of different experiments carried out in this article show that our model can accurately predict the types of cancer by exploiting the interactions between multiple modalities. CrossAttOmics outperforms other methods when there are few paired training examples. Our approach can be combined with attribution methods like LRP to identify which interactions are the most important. AVAILABILITY AND IMPLEMENTATION: The code is available at https://github.com/Sanofi-Public/CrossAttOmics and https://doi.org/10.5281/zenodo.15065928. TCGA data can be downloaded from the Genomic Data Commons Data Portal. CCLE data can be downloaded from the depmap portal.

Humans↗

Addiction in adolescents.

Some symptoms seen in adolescents with the disease of chemical dependence are similar to those seen in adults. Because of their age, lack of personality development, dependent family role, immaturity, and acting out of age-related behavioral tendencies, however, symptoms specific to this population occur. These may become exacerbated and telescope--intensify and shorten--the progression of the disease. A plan to solve the problem of adolescent chemical dependence must focus on education, demonstration, cooperation, prevention, intervention, habilitation, treatment, and recovery. The phenomenon of denial in a chemically dependent adolescent yields a more complex delusional system that dictates age-specific intervention approaches. Habilitation is necessary for successful adolescent treatment and recovery because what is needed is an initial process of learning, not relearning or rehabilitation. If specific adolescent issues are addressed through comprehensive, multimodality treatment approaches, then treatment and recovery outcomes for chemically dependent adolescents and their families are substantially improved. Primary care physicians must be alert to the possibility of drug use in their young patients and aware of treatment options.

Adolescent↗

Surgical treatment of advanced-stage carcinoid tumors: lessons learned.

OBJECTIVE: To evaluate clinical outcomes in a large group of advanced-stage carcinoid patients (stage IV) following multimodal surgical therapy. SUMMARY BACKGROUND DATA: Patients with advanced-stage carcinoid have traditionally experienced poor 5-year survival (18%-30%). Few recent series have evaluated a large number of patients treated with aggressive surgical rescue therapy. METHODS: This single-center retrospective review analyzes the records of 82 consecutive carcinoid patients treated by the same 2 surgeons, from August 1998 through August 2004 with a 3- to 72-month follow-up. RESULTS: Surprisingly, one third of 26 (32%) patients were found to have intestinal obstructions; 10 being moribund at presentation. Mesenteric encasement with intestinal ischemia was successfully relieved in 10 of 12 cases. Five of eighty-two "terminal" patients were rendered free of macroscopic disease. Karnofsky performance scores improved from 65 to 85 (P < 0.0001). Two- and four-year survival for patients with no or unilateral liver metastases (n = 23) was 89%, while 2- and 4-year survival for patients with bilateral liver disease (n = 59) was 68% and 52% (P = 0.072), respectively. CONCLUSION: We think that all patients with advanced-stage carcinoid should be evaluated for possible multimodal surgical therapy. Primary tumors should be resected, even in the presence of distant metastases to prevent future intestinal obstruction. The "wait and see" method of management of this slow-growing cancer no longer has merit. We offer an algorithm for the surgical evaluation and management of these patients.

Adolescent↗

Design and rationale of controlled study of long-term methylphenidate and multimodal psychosocial treatment in children with ADHD.

OBJECTIVE: To describe the rationale, methodology, and sample characteristics of a dual-site treatment study (New York and Montreal) of children with attention-deficit/hyperactivity disorder (ADHD) conducted between 1990 and 1995. The hypotheses were that (1) methylphenidate combined with comprehensive multimodal psychosocial treatment was superior to methylphenidate alone in improving multiple functions and (2) the efficacy of the psychosocial intervention resulted from its specific components and not from nonspecific treatment effects. METHOD: One hundred three children with ADHD (ages 7-9), free of conduct and learning disorders, who responded to methylphenidate, were randomized for 2 years to (1) methylphenidate treatment alone; (2) methylphenidate combined with multimodal psychosocial treatment that included parent training and counseling, academic assistance, psychotherapy, and social skills training; or (3) methylphenidate plus attention control treatment that excluded specific aspects of the psychosocial intervention. Children were switched to single-blind placebo after 12 months; methylphenidate was reinstituted when clinically indicated. Assessments included ratings by parents, teachers, children, and psychiatrists; school observations in academic and gym classes; and academic performance tests. Almost 80% of families completed the 2-year study. Companion papers present treatment effects. CONCLUSIONS: A comprehensive 2-year psychosocial treatment was delivered successfully to children with ADHD and their families.

Attention Deficit Disorder with Hyperactivity↗

Biofeedback-assisted relaxation training for the aging chronic pain patient.

The older segments of the U.S. population are expanding rapidly and account for a disproportionate amount of health care, including treatment for pain-related musculoskeletal disorders. In a prospective study with objective measures and one-year follow-up, Middaugh et al. (1988) found that older patients (55-78 yr; N = 17, 76% success) treated in a multidisciplinary chronic pain rehabilitation program enjoyed a success rate equal to that of younger patients (29-48 yr, N = 20, 70% success). The current study presents additional data on these two groups of patients to compare their ability to learn the physiological self-regulation skills taught in the biofeedback/relaxation component of the multimodal program. This component included progressive muscle relaxation training, diaphragmatic breathing instruction, and EMG biofeedback. Repeated measures ANOVA showed significant increases in digital skin temperature (peripheral vasodilation) and decreases in respiration rate both within and across training sessions (p values = .04 to .0001) with no differences between age groups (p greater than .05). EMG measures for the upper trapezius ms in patients with cervical pain showed similar deficits in muscle control at evaluation and similar improvements with biofeedback training for the two age groups. These findings indicate that older pain patients responded well to the biofeedback/relaxation training component of the multimodal pain program.

Adult↗

Cortical contributions to olfaction: plasticity and perception.

In most sensory systems, the sensory cortex is the place where sensation approaches perception. As described in this review, olfaction is no different. The olfactory system includes both primary and higher order cortical regions. These cortical structures perform computations that take highly analytical afferent input and synthesize it into configural odor objects. Cortical plasticity plays an important role in this synthesis and may underlie olfactory perceptual learning. Olfactory cortex is also involved in odor memory and association of odors with multimodal input and contexts. Finally, the olfactory cortex serves as an important sensory gate, modulating information throughput based on recent experience and behavioral state.

Animals↗

Affiliative processes and vocal development.

Affiliative behavior is often expressed through communication, and the nature of affiliative interactions affects the ontogeny of communication. I presented three phenomena that demonstrate the importance of affiliation in vocal development in marmosets and tamarins, but the results have parallels in many other species including birds, dolphins, and humans. Pygmy marmosets use trill-like vocalizations to maintain contact with other group members. Individuals change subtle aspects of call structure when they encounter new social groups or acquire a new mate. This process of vocal accommodation is common in many other species. Infant pygmy marmosets go through a stage of "babbling." producing long sequences of vocalizations that have several similarities to the babbling of human infants. Babbling infants receive more social attention than nonbabbling infants, and these social interactions may shape vocalizations towards more adult forms. In adult cotton-top tamarins, food-associated vocalizations communicate the presence and quality of food. However, reproductively inhibited juveniles and subadults use many other types of calls in feeding situations and display a high proportion of imperfect forms of adult food-associated calls. When subadult monkeys are paired with new mates and change their reproductive status, they rapidly (within 3-6 weeks) display both adult structure and adult usage of food-associated calls, suggesting that affiliative processes can both facilitate and inhibit vocal ontogeny. Three mechanisms of how social interactions affect communication (multimodal stimulation, attentional focus, and reinforcement) were proposed and illustrated through examples of parrots learning English labels for objects and attributes and infant cotton-top tamarins acquiring food-associated vocalizations.

Animals↗

Machine learning for detection and diagnosis of disease.

Machine learning offers a principled approach for developing sophisticated, automatic, and objective algorithms for analysis of high-dimensional and multimodal biomedical data. This review focuses on several advances in the state of the art that have shown promise in improving detection, diagnosis, and therapeutic monitoring of disease. Key in the advancement has been the development of a more in-depth understanding and theoretical analysis of critical issues related to algorithmic construction and learning theory. These include trade-offs for maximizing generalization performance, use of physically realistic constraints, and incorporation of prior knowledge and uncertainty. The review describes recent developments in machine learning, focusing on supervised and unsupervised linear methods and Bayesian inference, which have made significant impacts in the detection and diagnosis of disease in biomedicine. We describe the different methodologies and, for each, provide examples of their application to specific domains in biomedical diagnostics.

Algorithms↗

Social functioning in children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment.

OBJECTIVE: To test that methylphenidate combined with intensive multimodal psychosocial intervention, which includes social skills training, significantly enhances social functioning in children with attention-deficit/hyperactivity disorder (ADHD) compared with methylphenidate alone and methylphenidate plus nonspecific psychosocial treatment (attention control). METHOD: One hundred three children with ADHD (ages 7-9), free of conduct and learning disorders, who responded to short-term methylphenidate were randomized for 2 years to receive (1) methylphenidate alone, (2) methylphenidate plus multimodal psychosocial treatment that included social skills training, or (3) methylphenidate plus attention control treatment. Assessments included parent, child, and teacher ratings of social function and direct school observations in gym. RESULTS: No advantage was found on any measure of social functioning for the combination treatment over methylphenidate alone or methylphenidate plus attention control. Significant improvement occurred across all treatments and continued over 2 years. CONCLUSIONS: In young children with ADHD, there is no support for clinic-based social skills training as part of a long-term psychosocial intervention to improve social behavior. Significant benefits from methylphenidate were stable over 2 years.

Attention Deficit Disorder with Hyperactivity↗

On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness.

Examined how pitch and loudness correspond to brightness. In the Experiment 1, 16 Ss identified which of 2 lights more resembled each of 16 tones; in Experiment 2, 8 of the same 16 Ss rated the similarity of lights to lights, tones to tones, and lights to tones. (1) Pitch and loudness both contributed to cross-modal similarity, but for most Ss pitch contributed more. (2) Individuals differed as to whether pitch or loudness contributed more; these differences were consistent across matching and similarity scaling. (3) Cross-modal similarity depended largely on relative stimulus values. (4) Multidimensional scaling revealed 2 perceptual dimensions, loudness and pitch, with brightness common to both. A simple quantitative model can describe the cross-modal comparisons, compatible with the view that perceptual similarity may be characterized through a malleable spatial representation that is multimodal as well as multidimensional.

Attention↗

Unit responses in the frog's caudal thalamus.

Single unit microelectrode recordings were made in the caudal thalamic region of the frog, Rana pipiens, from a sample of multimodal sensory units which included monocular, binocular, tactile, and spontaneous types, and which showed a wide variety of receptive field sizes, response rates, preferred stimulus sizes habituation rates, and velocity and tactile sensitivities. A number of special response properties were occasionally observed, including directional sensitivity, stationary object sensitivity, afterdischarges, and visual and tactile inhibitory fields. Computer analysis of spontaneously active units revealed four types: regular, exponential, bursting, and multimodal.

Animals↗

Augmentative and alternative communication.

With the help of a knowledgeable interdisciplinary team, individuals can find the best AAC system to meet their needs and enrich their quality of life. A new-found ability to communicate often significantly improves a person's overall prognosis and may prevent serious problems in the areas of behavior, learning, reading, and social development. However, because an AAC system is just one component of multimodal communication, it should not inhibit the use of speech by individuals who have some usable or functional speech. It is important to understand that AAC is a process and that an AAC system will evolve over time to meet the changing preferences, dislikes, and abilities of the user as that individual strives to accomplish communication goals.

Articulation Disorders↗

Perception of serial order in infants.

Serial order is fundamental to perception, cognition and behavioral action. Three experiments investigated infants' perception, learning and discrimination of serial order. Four- and 8-month-old infants were habituated to three sequentially moving objects making visible and audible impacts and then were tested on separate test trials for their ability to detect auditory, visual or auditory-visual changes in their ordering. The 4-month-old infants did not respond to any order changes and instead appeared to attend to the 'local' audio-visual synchrony part of the event. When this local part of the event was blocked from view, the 4-month-olds did perceive the serial order feature of the event but only when it was specified multimodally. In contrast, the 8-month-old infants perceived all three kinds of order changes regardless of whether the synchrony part of the event was visible or not. The findings show that perception of spatiotemporal serial order emerges early in infancy and that its perception is initially facilitated by multimodal specification.

Acoustic Stimulation↗