PubMed Health⌕ Search

Biomedical subjects

Gilles Pourtois

Publications and source records attributed to Gilles Pourtois.

18 recordsLinked to original sources

Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging.

Brain imaging studies in humans have shown that face processing in several areas is modulated by the affective significance of faces, particularly with fearful expressions, but also with other social signals such gaze direction. Here we review haemodynamic and electrical neuroimaging results indicating that activity in the face-selective fusiform cortex may be enhanced by emotional (fearful) expressions, without explicit voluntary control, and presumably through direct feedback connections from the amygdala. fMRI studies show that these increased responses in fusiform cortex to fearful faces are abolished by amygdala damage in the ipsilateral hemisphere, despite preserved effects of voluntary attention on fusiform; whereas emotional increases can still arise despite deficits in attention or awareness following parietal damage, and appear relatively unaffected by pharmacological increases in cholinergic stimulation. Fear-related modulations of face processing driven by amygdala signals may implicate not only fusiform cortex, but also earlier visual areas in occipital cortex (e.g., V1) and other distant regions involved in social, cognitive, or somatic responses (e.g., superior temporal sulcus, cingulate, or parietal areas). In the temporal domain, evoked-potentials show a widespread time-course of emotional face perception, with some increases in the amplitude of responses recorded over both occipital and frontal regions for fearful relative to neutral faces (as well as in the amygdala and orbitofrontal cortex, when using intracranial recordings), but with different latencies post-stimulus onset. Early emotional responses may arise around 120ms, prior to a full visual categorization stage indexed by the face-selective N170 component, possibly reflecting rapid emotion processing based on crude visual cues in faces. Other electrical components arise at later latencies and involve more sustained activities, probably generated in associative or supramodal brain areas, and resulting in part from the modulatory signals received from amygdala. Altogether, these fMRI and ERP results demonstrate that emotion face perception is a complex process that cannot be related to a single neural event taking place in a single brain regions, but rather implicates an interactive network with distributed activity in time and space. Moreover, although traditional models in cognitive neuropsychology have often considered that facial expression and facial identity are processed along two separate pathways, evidence from fMRI and ERPs suggests instead that emotional processing can strongly affect brain systems responsible for face recognition and memory. The functional implications of these interactions remain to be fully explored, but might play an important role in the normal development of face processing skills and in some neuropsychiatric disorders.

Animals↗

Neural systems for orienting attention to the location of threat signals: an event-related fMRI study.

Attention may reflexively shift towards the location of perceived threats, but it is still unclear how these spatial biases recruit the distributed fronto-parietal cortical networks involved in other aspects of selective attention. We used event-related fMRI to determine how brain responses to a neutral visual target are influenced by the emotional expression of faces appearing at the same location during a covert orienting task. On each trial, two faces were briefly presented, one in each upper visual field (one neutral and one emotional, fearful or happy), followed by a unilateral target (a small horizontal or vertical bar) replacing one of the faces. Participants had to discriminate the target orientation, shown on the same (valid) or opposite (invalid) side as the emotional face. Trials with faces but no subsequent target (cue-only trials) were included to disentangle activation due to emotional cues from their effects on target detection. We found increased responses in bilateral temporo-parietal areas and right occipito-parietal cortex for fearful faces relative to happy faces, unrelated to the subsequent target and cueing validity. More critically, we found a selective modulation of intraparietal and orbitofrontal cortex for targets following an invalid fearful face, as well as an increased visual response in right lateral occipital cortex for targets following a valid fearful face. No such effects were observed with happy faces. These results demonstrate that fearful faces can act as exogenous cues by increasing sensory processing in extrastriate cortex for a subsequent target presented at the same location, but also produce a cost in disengaging towards another location by altering the response of IPS to invalidly cued targets. Neural mechanisms responsible for orienting attention towards emotional vs. non-emotional stimuli are thus partly shared in parietal and visual areas, but also partly distinct.

Adult↗

Dynamics of emotional effects on spatial attention in the human visual cortex.

An efficient detection of threat is crucial for survival and requires an appropriate allocation of attentional resources toward the location of potential danger. Recent neuroimaging studies have begun to uncover the brain machinery underlying the reflexive prioritization of spatial attention to locations of threat-related stimuli. Here, we review functional brain imaging experiments using event-related potentials (ERPs) and functional magnetic resonance imaging (fMRI) in a dot-probe paradigm with emotional face cues, in which we investigated the spatio-temporal dynamics of attentional orienting to a visual target when the latter is preceded by either a fearful or happy face, at the same (valid) location or at a different (invalid) location in visual periphery. ERP results indicate that fearful faces can bias spatial attention toward threat-related location, and enhance the amplitude of the early exogenous visual P1 activity generated within the extrastriate cortex in response to a target following a valid rather than invalid fearful face. Furthermore, this gain control mechanism in extrastriate cortex (at 130-150 ms) is preceded by an earlier modulation of activity in posterior parietal regions (at 40-80 ms) that may provide a critical source of top-down signals on visual cortex. Happy faces produced no modulation of ERPs in extrastriate and parietal cortex. fMRI data also show increased responses in the occipital visual cortex for valid relative to invalid targets following fearful faces, but in addition reveal significant decreases in intraparietal cortex and increases in orbitofrontal cortex when targets are preceded by an invalid fearful face, suggesting that negative emotional stimuli may not only draw but also hold spatial attention more strongly than neutral or positive stimuli. These data confirm that threat may act as a powerful exogenous cue and trigger reflexive shifts in spatial attention toward its location, through a rapid temporal sequence of neural events in parietal and temporo-occipital areas, with dissociable neural substrates for engagement benefits in attention affecting activity in extrastriate occipital areas and increased disengagement costs affecting intraparietal cortex. These brain-imaging results reveal how emotional signals related to threat can play an important role in modulating spatial attention to afford flexible perception and action.

Attention↗

Investigating audiovisual integration of emotional signals in the human brain.

Humans can communicate their emotional state via facial expression and affective prosody. This chapter reviews behavioural, neuroanatomical, electrophysiological and neuroimaging studies pertaining to audiovisual integration of emotional communicative signals. Particular emphasis will be given to neuroimaging studies using positron emission tomography (PET) or functional magnetic resonance imaging (fMRI). Conjunction analyses, interaction analyses, correlation analyses between haemodynamic responses and behavioural effects and connectivity analyses have been employed to analyse neuroimaging data. There is no general agreement as to which of these approaches can be considered "optimal" to classify brain regions as multisensory. We argue that these approaches provide complementing information as they assess different aspects of multisensory integration of emotional information. Assets and drawbacks of the different analysis types are discussed and demonstrated on the basis of one fMRI data set.

Brain↗

Time course of brain activity during change blindness and change awareness: performance is predicted by neural events before change onset.

People often remain "blind" to visual changes occurring during a brief interruption of the display. The processing stages responsible for such failure remain unresolved. We used event-related potentials to determine the time course of brain activity during conscious change detection versus change blindness. Participants saw two successive visual displays, each with two faces, and reported whether one of the faces changed between the first and second displays. Relative to blindness, change detection was associated with a distinct pattern of neural activity at several successive processing stages, including an enhanced occipital P1 response and a sustained frontal activity (CNV-like potential) after the first display, before the change itself. The amplitude of the N170 and P3 responses after the second visual display were also modulated by awareness of the face change. Furthermore, a unique topography of event-related potential activity was observed during correct change and correct no-change reports, but not during blindness, with a recurrent time course in the stimulus sequence and simultaneous sources in the parietal and temporo-occipital cortex. These results indicate that awareness of visual changes may depend on the attentional state subserved by coordinated neural activity in a distributed network, before the onset of the change itself.

Adult↗

Emotion and attention interactions in social cognition: brain regions involved in processing anger prosody.

Multiple levels of processing are thought to be involved in the appraisal of emotionally relevant events, with some processes being engaged relatively independently of attention, whereas other processes may depend on attention and current task goals or context. We conducted an event-related fMRI experiment to examine how processing angry voice prosody, an affectively and socially salient signal, is modulated by voluntary attention. To manipulate attention orthogonally to emotional prosody, we used a dichotic listening paradigm in which meaningless utterances, pronounced with either angry or neutral prosody, were presented simultaneously to both ears on each trial. In two successive blocks, participants selectively attended to either the left or right ear and performed a gender-decision on the voice heard on the target side. Our results revealed a functional dissociation between different brain areas. Whereas the right amygdala and bilateral superior temporal sulcus responded to anger prosody irrespective of whether it was heard from a to-be-attended or to-be-ignored voice, the orbitofrontal cortex and the cuneus in medial occipital cortex showed greater activation to the same emotional stimuli when the angry voice was to-be-attended rather than to-be-ignored. Furthermore, regression analyses revealed a strong correlation between orbitofrontal regions and sensitivity on a behavioral inhibition scale measuring proneness to anxiety reactions. Our results underscore the importance of emotion and attention interactions in social cognition by demonstrating that multiple levels of processing are involved in the appraisal of emotionally relevant cues in voices, and by showing a modulation of some emotional responses by both the current task-demands and individual differences.

Acoustic Stimulation↗

Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex.

Visuo-spatial attention tends to be prioritized towards emotionally negative stimuli such as fearful faces, as opposed to neutral or positive stimuli. Using a covert orienting task, we previously showed that a lateral occipital P1 component, with extrastriate neural sources, was selectively enhanced to lateralized visual targets replacing a fearful face (fear-valid trial) than the same targets replacing a neutral face (fear-invalid trial), providing evidence for exogenous spatial orienting of attention towards threat cues. Here, we describe a new analysis of these data, using topographic evoked potentials mapping methods combined with a distributed source localization technique. We show that an early field topography (40-80 ms post-target onset) with a centro-parietal negativity and a left posterior parietal source distinguished fear-valid from fear-invalid trials, whereas a distinct activity with anterior cingulate sources was selectively evoked during fear-invalid trials. At the same latency, or later, no difference in field topography was found for valid compared to invalid trials with happy faces. The early parietal map preceded a modulation in amplitude of the field strength (approximately 130 ms), corresponding to the enhanced lateral occipital P1 during valid trials in the fear condition. Furthermore, this early topography at 40-80 ms was positively correlated with the subsequent amplitude modulation of P1 at 130-160 ms in the fear condition, suggesting a possible functional coupling between these two successive events. These data have important implications for models of spatial attention and interactions with emotion. They suggest two successive stages of neural activity during exogenous orienting of attention towards visual targets following fearful faces, including an early posterior parietal negativity, followed by gain control mechanisms enhancing visual responses in extrastriate occipital cortex.

Adult↗

The voices of wrath: brain responses to angry prosody in meaningless speech.

We report two functional magnetic resonance imaging experiments showing enhanced responses in human middle superior temporal sulcus for angry relative to neutral prosody. This emotional enhancement was voice specific, unrelated to isolated acoustic amplitude or frequency cues in angry prosody, and distinct from any concomitant task-related attentional modulation. Attention and emotion seem to have separate effects on stimulus processing, reflecting a fundamental principle of human brain organization shared by voice and face perception.

Acoustic Stimulation↗

Enhanced extrastriate visual response to bandpass spatial frequency filtered fearful faces: time course and topographic evoked-potentials mapping.

We compared electrical brain responses to fearful vs. neutral facial expressions in healthy volunteers while they performed an orthogonal gender decision task. Face stimuli either had a broadband spatial-frequency content, or were filtered to create either low spatial-frequency (LSF) or high spatial-frequency (HSF) faces, always overlapped with their complementary SF content in upside-down orientation to preserve the total stimulus energy. We tested the hypothesis that the coarse LSF content of faces might be responsible for an early modulation of event-related potentials (ERPs) to fearful expressions. Consistent with previous findings, we show that broadband images of fearful faces, relative to neutral faces, elicit a higher global field power of approximately 130 ms poststimulus onset, corresponding to an increased P1 component over lateral occipital electrodes, with neural sources located within the extrastriate visual cortex. Bandpass filtering of faces strongly affected the latency and amplitude of ERPs, with a suppression of the normal N170 response for both LSF and HSF faces, irrespective of expression. Critically, we found that LSF information from fearful faces, unlike HSF information, produced a right-lateralized enhancement of the lateral occipital P1, without any change in the scalp topography, relative to unfiltered (broadband) fearful faces. These results demonstrate that an early P1 response to fear expression depends on a visual pathway preferentially tuned to coarse-magnocellular inputs, and can persist unchanged even when the N170 generators are disrupted by SF filtering.

Adult↗

Perception of facial expressions and voices and of their combination in the human brain.

Using positron emission tomography we explored brain regions activated during the perception of face expressions, emotional voices and combined audio-visual pairs. A convergence region situated in the left lateral temporal cortex was more activated by bimodal stimuli than by either visual only or auditory only stimuli. Separate analyses for the emotions happiness and fear revealed supplementary convergence areas situated mainly anteriorly in the left hemisphere for happy pairings and in the right hemisphere for fear pairings indicating different neuro-anatomical substrates for multisensory integration of positive versus negative emotions. Activation in the right extended amygdala was obtained for fearful faces and fearful audio-visual pairs but not for fearful voices only. These results suggest that during the multisensory perception of emotion, affective information from face and voice converge in heteromodal regions of the human brain.

Adult↗

Portraits or people? Distinct representations of face identity in the human visual cortex.

Humans can identify individual faces under different viewpoints, even after a single encounter. We determined brain regions responsible for processing face identity across view changes after variable delays with several intervening stimuli, using event-related functional magnetic resonance imaging during a long-term repetition priming paradigm. Unfamiliar faces were presented sequentially either in a frontal or three-quarter view. Each face identity was repeated once after an unpredictable lag, with either the same or another viewpoint. Behavioral data showed significant priming in response time, irrespective of view changes. Brain imaging results revealed a reduced response in the lateral occipital and fusiform cortex with face repetition. Bilateral face-selective fusiform areas showed view-sensitive repetition effects, generalizing only from three-quarter to front-views. More medial regions in the left (but not in the right) fusiform showed repetition effects across all types of viewpoint changes. These results reveal that distinct regions within the fusiform cortex hold view-sensitive or view-invariant traces of novel faces, and that face identity is represented in a view-sensitive manner in the functionally defined face-selective areas of both hemispheres. In addition, our finding of a better generalization after exposure to a 3/4-view than to a front-view demonstrates for the first time a neural substrate in the fusiform cortex for the common recognition advantage of three-quarter faces. This pattern provides new insights into the nature of face representation in the human visual system.

Adult↗

View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study.

Face recognition is a unique visual skill enabling us to recognize a large number of person identities, despite many differences in the visual image from one exposure to another due to changes in viewpoint, illumination, or simply passage of time. Previous familiarity with a face may facilitate recognition when visual changes are important. Using event-related fMRI in 13 healthy observers, we studied the brain systems involved in extracting face identity independent of modifications in visual appearance during a repetition priming paradigm in which two different photographs of the same face (either famous or unfamiliar) were repeated at varying delays. We found that functionally defined face-selective areas in the lateral fusiform cortex showed no repetition effects for faces across changes in image views, irrespective of pre-existing familiarity, suggesting that face representations formed in this region do not generalize across different visual images, even for well-known faces. Repetition of different but easily recognizable views of an unfamiliar face produced selective repetition decreases in a medial portion of the right fusiform gyrus, whereas distinct views of a famous face produced repetition decreases in left middle temporal and left inferior frontal cortex selectively, but no decreases in fusiform cortex. These findings reveal that different views of the same familiar face may not be integrated within a single representation at initial perceptual stages subserved by the fusiform face areas, but rather involve later processing stages where more abstract identity information is accessed.

Adult↗

Electrophysiological correlates of rapid spatial orienting towards fearful faces.

We investigated the spatio-temporal dynamic of attentional bias towards fearful faces. Twelve participants performed a covert spatial orienting task while recording visual event-related brain potentials (VEPs). Each trial consisted of a pair of faces (one emotional and one neutral) briefly presented in the upper visual field, followed by a unilateral bar presented at the location of one of the faces. Participants had to judge the orientation of the bar. Comparing VEPs to bars shown at the location of an emotional (valid) versus neutral (invalid) face revealed an early effect of spatial validity: the lateral occipital P1 component (approximately 130 ms post-stimulus) was selectively increased when a bar replaced a fearful face compared to when the same bar replaced a neutral face. This effect was not found with upright happy faces or inverted fearful faces. A similar amplification of P1 has previously been observed in electrophysiological studies of spatial attention using non-emotional cues. In a behavioural control experiment, participants were also better at discriminating the orientation of the bar when it replaced a fearful rather than a neutral face. In addition, VEPs time-locked to the face-pair onset revealed a C1 component (approximately 90 ms) that was greater for fearful than happy faces. Source localization (LORETA) confirmed an extrastriate origin of the P1 response showing a spatial validity effect, and a striate origin of the C1 response showing an emotional valence effect. These data suggest that activity in primary visual cortex might be enhanced by fear cues as early as 90 ms post-stimulus, and that such effects might result in a subsequent facilitation of sensory processing for a stimulus appearing at the same location. These results provide evidence for neural mechanisms allowing rapid, exogenous spatial orienting of attention towards fear stimuli.

Adult↗

Revisiting Snodgrass and Vanderwart's object pictorial set: the role of surface detail in basic-level object recognition.

Theories of object recognition differ to the extent that they consider object representations as being mediated only by the shape of the object, or shape and surface details, if surface details are part of the representation. In particular, it has been suggested that color information may be helpful at recognizing objects only in very special cases, but not during basic-level object recognition in good viewing conditions. In this study, we collected normative data (naming agreement, familiarity, complexity, and imagery judgments) for Snodgrass and Vanderwart's object database of 260 black-and-white line drawings, and then compared the data to exactly the same shapes but with added gray-level texture and surface details (set 2), and color (set 3). Naming latencies were also recorded. Whereas the addition of texture and shading without color only slightly improved naming agreement scores for the objects, the addition of color information unambiguously improved naming accuracy and speeded correct response times. As shown in previous studies, the advantage provided by color was larger for objects with a diagnostic color, and structurally similar shapes, such as fruits and vegetables, but was also observed for man-made objects with and without a single diagnostic color. These observations show that basic-level 'everyday' object recognition in normal conditions is facilitated by the presence of color information, and support a 'shape + surface' model of object recognition, for which color is an integral part of the object representation. In addition, the new stimuli (sets 2 and 3) and the corresponding normative data provide valuable materials for a wide range of experimental and clinical studies of object recognition.

Adolescent↗

Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals.

Faces are multi-dimensional stimuli bearing important social signals, such as gaze direction and emotion expression. To test whether perception of these two facial attributes recruits distinct cortical areas within the right hemisphere, we used single-pulse transcranial magnetic stimulation (TMS) in healthy volunteers while they performed two different tasks on the same face stimuli. In each task, two successive faces were presented with varying eye-gaze directions and emotional expressions, separated by a short interval of random duration. TMS was applied over either the right somatosensory cortex or the right superior lateral temporal cortex, 100 or 200 ms after presentation of the second face stimulus. Participants performed a speeded matching task on the second face during one of two possible conditions, requiring judgements about either gaze direction or emotion expression (same/different as the first face). Our results reveal a significant task-stimulation site interaction, indicating a selective TMS-related interference following stimulations of somatosensory cortex during the emotional expression task. Conversely, TMS of the superior lateral temporal cortex selectively interfered with the gaze direction task. We also found that the interference effect was specific to the stimulus content in each condition, affecting judgements of gaze shifts (not static eye positions) with TMS over the right superior temporal cortex, and judgements of fearful expressions (not happy expressions) with TMS over the right somatosensory cortex. These results provide for the first time a double dissociation in normal subjects during social face recognition, due to transient disruption of non-overlapping brain regions. The present study supports a critical role of the somatosensory and superior lateral temporal regions in the perception of fear expression and gaze shift in seen faces, respectively.

Adult↗

Semantic factors influence multisensory pairing: a transcranial magnetic stimulation study.

It is traditionally assumed that temporal and spatial factors determine whether information provided by different sensory modalities is combined in a single percept. However, neuropsychological reports of selective damage to audio-visual integration and recent neurophysiological results suggest that semantic factors related to the content of the stimuli could also play a role. As a means of extending evidence provided by neuropsychological dissociations we set up a direct comparison of two kinds of audio-visual pairs with different semantic properties and used transcranial magnetic stimulation (TMS). We investigated the selective impact of TMS on two kinds of audio-visual pairings presented under identical spatio-temporal conditions (face-voice and tone-shape pairings). Our results show that TMS applied over the left posterior parietal cortex at 200 ms disrupted audio-visual integration for the tone-shape pairings but not for the face-voice ones. Our data are consistent with neuropsychological findings and indicate that besides the well-known dimensions of spatial and temporal contiguity, content is an important determinant of audio-visual integration. Our study also illustrates the usefulness of TMS for addressing the role of semantic factors in multi-sensory perception

Acoustic Stimulation↗

Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures.

Multisensory integration is a powerful mechanism for increasing adaptive responses, as illustrated by binding of fear expressed in a face with fear present in a voice. To understand the role of awareness in intersensory integration of affective information we studied multisensory integration under conditions of conscious and nonconscious processing of the visual component of an audiovisual stimulus pair. Auditory-event-related potentials were measured in two patients (GY and DB) who were unable to perceive visual stimuli consciously because of striate cortex damage. To explore the role of conscious vision of audiovisual pairing, we also compared audiovisual integration in either naturalistic pairings (a facial expression paired with an emotional voice) or semantic pairings (an emotional picture paired with the same voice). We studied the hypothesis that semantic pairings, unlike naturalistic pairings, might require mediation by intact visual cortex and possibly by feedback to primary cortex from higher cognitive processes. Our results indicate that presenting incongruent visual affective information together with the voice translates as an amplitude decrease of auditory-event-related potentials. This effect obtains for both naturalistic and semantic pairings in the intact field, but is restricted to the naturalistic pairings in the blind field.

Acoustic Stimulation↗

Facial expressions modulate the time course of long latency auditory brain potentials.

Long latency auditory brain potentials were recorded while subjects listened to bi-syllabic words spoken with an emotional expression and concurrently viewed congruent or incongruent facial expressions. Analysis of the auditory waveforms suggests the existence of a positive deflection around 240 ms post-stimulus with a clear posterior topography (the P2b component). This potential is subsequent upon the modality-specific auditory N1-P2 components and precedes the amodal N2-P3 complex. Congruent face-voice trials elicited an earlier P2b component than incongruent trials suggesting that auditory processing is delayed in the presence of an incongruent facial context. These electrophysiological results are consistent with previous behavioural studies showing an acceleration of reaction times for rating voice expressions that are part of congruent bimodal stimulus pairs. A source localisation analysis performed on the scalp EEG during the time-window corresponding to the P2b component disclosed a single dipole solution in the anterior cingulate cortex.

Acoustic Stimulation↗