Understanding the recognition of facial identity and facial expression

“Is multimodal analysis involved? The co-occurrence of impairments in the recognition of facial and vocal expression is not restricted to cases that show disproportionate impairments for one emotion; in fact, the relationship is if anything more striking in patients who have general problems in recognizing facial expre…”

“Whether identity and emotion information are processed by entirely separate neural structures is still open to debate [17].”

“This finding is consistent with many previous findings from behavioural and imaging research that suggests the ability to identify facial displays, as investigated by traditional facial expression recognition tasks, is an emotion-specific skill (see Calder & Young, 2005 ; Vuilleumier & Pourtois, 2007 , for reviews).”

“predicted by the model of Calder and Young [47], and how this compares in size to the correlation with the emotion-labelling.”

“Calder and Young (2005) have applied this type of explanation to argue that a single multidimensional space can account for commonalities and dissociability in the coding of face identity and expression.”

“…of the individual user and is not to be disseminated broadly. seems reasonable to assume that faces are visually prevalent throughout life (e.g., Calder & Young, 2005; Cohen & Cashon, 2001; Cohen Kadosh & Johnson, 2007; Haxby et al., 2000; Kanwisher & Yovel, 2006; McKone et al., 2007; Nelson,…”

“identity and expression processing are at least partially independent in the visual stream [11,12] (see [13] for recent review).”

“A face conveys socially important cues such as gender, identity, and expression [31].”

“Many functional models of face processing propose that the neural pathways involved in face identification are separate from the pathways that are involved in recognizing emotional expressions (Haxby et al., 2000; O’Toole et al., 2002; for a detailed review see, Calder and Young, 2005).”

“…number of dimensions is greater than two; this indicates that the coding of expressions are best described in terms of a higher-order, multidimensional framework (Calder et al., 2000; Calder, Burton, Miller, Young, & Akamatsu, 2001; Calder & Young, 2005; Dailey, Cottrell, Padgett, & Adolphs, 2002).”

“Modulation of ERBP by expressive face motion was seen in 23 (R: 19/48, L: 4/52; p = .0002, Fisherʼs exact test) of 100 contacts in six subjects.”

“…with the first factor representing the task condition (emotional T2 and neutral T2) and the second representing the behavioral performance of each subject on a trial by trial basis (during the AB task in the scanner correctly reported T2 (Correct-T2) and incorrectly reported T2 (Incorrect-T2).”

“Both areas are commonly co-activated during face perception (Calder and Young, 2005; Sabatinelli et al., 2011), and studies of brain connectivity show that activity of the FFA and STS is functionally correlated not only during face processing (Nummenmaa et al.”

“On the other hand, perception in one of these domains of face recognition (e.g., affective face recognition) has the ability to influence perception in the other domain (e.g., non-affective face recognition) (Calder & Young, 2005; Schyns & Oliva, 1999).”

“These two processes are interacted in the core system of the brain [5, 11].”

“All reported t-tests are 2-tailed.”

“Facial motion—in particular in the form of facial expressions—has been studied extensively in the cognitive sciences over the last few decades (for two recent reviews, see [Adolphs 2002; Calder and Young 2005]).”

“Subsequently, Blanz and Vetter (1999, 2003) framework that can account for variations in face identity and facial expressions (Calder & Young, 2005).”

“OFAwas defined by the peak voxel of activity in the inferior occipital gyrus (Calder and Young, 2005; Gauthier et al., 2000; Haxby et al., 2000; Puce et al., 1996), inferior and more medially located than the activity for LO.”

“However, it is an ongoing question to what degree the neural basis of expression processing is restricted to STS, amygdala and insula (Calder & Young, 2005).”

“In the LPP time window, over a large parietal sensor group, we found only a main effect of stylization (F(5,160) = 12.”

“An alternative position is that fusiform and STS areas both contribute to facial expression processing but contribute to encoding structural forms and dynamic features, respectively (Calder and Young, 2005; Calder, 2011).”

“However, Calder and Young (2005) questioned the strong dissociation between the recognition of facial identity and facial expressions.”

“However, suggesting that the rOFA and rpSTS begin to process facial expressions at the same time is seemingly inconsistent with existing cortical models of face perception (Haxby et al., 2000; Calder and Young, 2005; Pitcher et al., 2011b).”

“Readers are referred to Calder and Young (2005) for a review on the topic.”

“Indeed a number of recent studies have identified a significant role for the FG in coding facial expressions (Ganel et al. 2005; Fairhall and Ishai 2007; Tsuchiya et al. 2008; Fox et al. 2009); for a review, see Calder and Young (2005).”

“…question of whether face expression and identity are processed by a common mechanism or separate mechanisms has been debated in the cognitive (Ganel and Goshen-Gottstein, 2004), neuropsychological (Bruce and Young, 1986) and neuroimaging literature (Calder and Young, 2005; Gobbini and Haxby, 2007).”

“Although the literature is mixed on whether prosopagnosic patients are also impaired on aspects of face perception like expression and lip-reading (see (33) for a review), there is some evidence for a double dissociation between identity and expression processing (34).”

“Many of the principals and predictions derived from PCA models generalize well to other data reduction algorithms, notably Architecture II Independent Components Analysis (ICA; Bartlett, Movellan, & Sejnowski, 2002; Calder & Young, 2005; Nestor, Plaut, & Behrmann, 2013).”

“Young A, Perrett D, Calder A, Sprengelmeyer R, Ekman P (2002) Facial expressions of emotion: Stimuli and tests (FEEST).”

“The cross-modal hypotheses entails that selective deficits for emotion recognition reflect processes impacting not just the recognition of facial expressions, but also the processing of signals of the equivalent emotion from other modalities (Calder, Lawrence, & Young, 2001; Calder & Young, 2005).”

“Selectivity for facial motion A similar division of labor between dorsal and ventral faceprocessing areas, proposed early on [60,61], is suggested by studies of facial motion.”

“According to recent theories of face recognition (Calder and Young, 2005; Haxby et al., 2002) an initial “core” visual analysis of faces is performed by several occipitotemporal areas with different degrees of position invariance.”

“…2004; Seitz, Nickel, & Azari, 2006; Vollm et al., 2006), and social perception of emotions from prosody, facial expressions, and bodily gestures (Calder & Young, 2005; Ethofer et al., 2006; Heikkinen et al., 2010; Ross, Thompson, & Yenkosky, 1997; Wheaton, Thompson, Syngeniotis, Abbott, & Puce,…”

“In accordance with this hypothesis (Bruce & Young, 1986; Calder & Young, 2005), it was shown that negative adaptation to facial expressions is stronger when adaptor and test stimuli are from the same identity (Campbell & Burke, 2009; Ellamil, Susskind, & Anderson, 2008; Fox & Barton, 2007).”

“…Society, Inc. 398 The processing of emotional facial expressions has attracted considerable behavioral and neurophysiological research (see reviews in Calder & Young, 2005; Eimer & Holmes, 2007; Frischen, Eastwood, & Smilek, 2008; Palermo & Rhodes, 2007; and Vuilleumier & Pourtois, 2007).”

“…of invariant facial attributes (such as the identity or the gender of a face) and the processing of changeable facial attributes (such as facial expression) take place on specialized, to some extent independent processing subroutines (Calder & Young, 2005; Haxby, Hoffman, & Gobbini, 2000).”

“…temporal and anatomical segregation with evidence from MEG and EEG studies in which the early (È90 ms from stimulus onset) and late (È170 ms) signatures in the time course of face processing were located in inferior occipital and temporal cortices, respectively (Liu, Harris, & Kanwisher, 2002;…”

“What information is accessed when perception of a physically salient facial feature (eg, the mouth) leads to facilitated processing of a happy face outside the focus of overt attention? Does the salient physical cue serve as a short-cut for efficient matching of the perceptual input and the stored long-term visual rep…”

“Crucially, aberrant limbic functionality may leave observers unable to interpret emotion per se (Calder & Young, 2005).”

“Given that the ability of people to recognize these facial expressions appears to be instinc-tive, it can be reasoned that humans may use these same AU features to recognize emotions in facial expressions of other people [29,47].”

“Faces and facial expressions convey delicate and meaningful information about emotional states to conspecifics in humans (for reviews, Adolphs 2002, Calder & Young 2005, Hari & Kujala 2009, Leppänen & Nelson 2009) as well as in many non-human species (for reviews, Tate et al. 2006; Leopold & Rhodes…”

“…provides direct evidence supporting the influential model on face recognition in which the FFA presumably plays a central role in face recognition, with the coordinated participation of more regions in the core and extended FN (Haxby et al., 2000; Calder and Young, 2005; Gobbini and Haxby, 2007).”

“In addition, Calder and Young (2005) recently used principle component analysis to investigate the degree of separation between these two pathways and found that facial expressions and identity can be coded within a single multidimensional framework rather than relying on separate independent codes.”

“may be that expression processing relies more on integrative mechanisms than identity processing ( Calder and Young, 2005 ).”

“…the ventral face perception route may also significantly contribute to the processing of changeable facial cues (see reviews in Calder et al., 2011; Calder and Young, 2005) By contrast, AQ did not correlate with the change in BOLD response in the head condition in which the eyes were closed, thus…”

“…little sensitivity to variations in feature spacing, given that it codes emotional expression, gaze direction, and other changeable social cues, which may depend less on spatial relations than individual recognition (Haxby et al., 2000, 2002; Calder & Young, 2005) [but see Calder et al. (2000)].”

“Some theories further assert a role for motion representations in the human STS (O’Toole et al., 2002; Calder and Young, 2005).”

“Furthermore, it is also advantageous to investigate distinct emotions, as emotion recognition impairments appear to reflect damage to emotional systems (Calder and Young 2005).”

“, face-selective areas), with right hemispheric dominance (e.g., Allison et al., 1994; Calder and Young, 2005; Haxby et al., 2000; Rossion et al., 2012a; Sergent et al., 1992; Weiner and Grill-Spector, 2010).”

“For example, face space may contain race-selective “Chinese” and “Caucasian” dimensions in addition to shared face dimensions that code both Chinese and Caucasian faces (see Calder & Young, 2005, for a similar model of face identity and expression coding).”

“More recent psychological and neuropsychological evidence has prompted modifications [4] or rebuttals [5] of the model, including a substantial revision [6], but the original version has guided ERP research on face recognition over recent decades.”

“…past decade has provided many important insights on the neural substrates of both face perception and emotion processing (Bullmore & Sporns, 2009; Calder & Young, 2005; Haxby et al., 2000; Kanwisher & Yovel, 2006; Kober et al., 2008; Lindquist, Wager, Kober, BlissMoreau, & Barrett, 2012; Meaux &…”

“This could ultimately elucidate how the myriad signals conveyed by faces are given meaning by the brain [38, 39] at neuron and network levels.”

“An individual assessment allows one to identify a specific individual or emotional expression, and depends on configural processing strategies that operate on distances between specific facial features (Calder and Young, 2005; Calder et al., 2000; Maurer et al., 2002).”

“…incorporating the midlateral fusiform gyrus (FFA) involved in processing facial identity, and the other incorporating the posterior superior temporal sulcus involved in processing facial expression—although see Calder and Young (2005) and Calder (2011) for evidence against such a clear distinction.”

“A functional connection between the pSTS and the FFA is predicted in face processing models (Haxby et al., 2000; Calder and Young, 2005), but the evidence for this connection is inconsistent.”

“However, the results of imaging studies have not been uniform in their support of this dual system idea (Calder and Young, 2005).”

“…that at a preconscious level information about faces of acquaintances that were not consciously recognized was available, similar to the effects seen in covert recognition of faces using psychophysiological measures such as skin conductance (Tranel and Damasio, 1985; Calder and Young, 2005).”

“com) is initiated by stimulus processing and feature extraction in visual areas.(11,16) These regions feed into core limbic circuitry, including the amygdala,(17-19) projections of which to ventral, medial, and dorsal prefrontal regions may be essential to transmitting affective information to the higher-order heterom…”

“Reflecting these difficulties, an extensive network of subcortical and cortical areas has been allocated to face processing in the human brain (Figure 1; for reviews, see Rapcsak, 2019; Duchaine & Yovel, 2015; Gobbini & Haxby, 2007; Calder & Young, 2005; Haxby, Hoffman, & Gobbini, 2000).”

“The broader network includes structures involved in social-emotional processing more generally, such as the fusiform gyrus, MPFC, and striatum (Calder and Young, 2005; Heberlein et al., 2008).”

“…that emotional and other types of face processing require a series of interactions between visual areas (occipital face area, fusiform face area, superior temporal sulcus), that feedforward to central and frontal regions (Haxby et al., 2000; Calder and Young, 2005; Fairhall and Ishai, 2007).”