Understanding the recognition of facial identity and facial expression

“Is multimodal analysis involved? The co-occurrence of impairments in the recognition of facial and vocal expression is not restricted to cases that show disproportionate impairments for one emotion; in fact, the relationship is if anything more striking in patients who have general problems in recognizing facial expre…”

“We thank Job van der Schalk for his help as a FACS specialist. recognition, and robotics (e.g., Calder & Young, 2005; Grossmann & Johnson, 2007; Rule, Ambady, Adams & Macrae, 2008; Schwaninger, Wallraven, Cunningham, & Chiller-Glaus, 2006).”

“…separate systems to those that involve analysis of invariant features (e.g., identity and gender; Andrews & Ewbank, 2004; Bruce & Young, 1986; Haxby et al., 2002; Hoffman & Haxby, 2000; but see Calder & Young, 2005, for arguments that suggest that the issue is not by any means settled).”

“The face-responsive region in the STS is nvolved more in the representation of dynamic features of faces but see also Calder & Young, 2005).”

“A recent review has challenged the Bruce and Young model, arguing that changeable aspects and invariant identity may instead be processed together and rely on partially overlapping visual representations (Calder & Young 2005).”

“On the other hand, Calder and Young [ 12 ] point out that although there seems to be a significant amount of dissociation between identity and expression, most studies do leave some room for overlap, perhaps at the representational stage.”

“One is the dual process model that differentiates mechanisms for the perception of identity versus the perception of emotion and other changeable facial qualities (Bruce & Young, 1986; Haxby, Hoffman, & Gobbini, 2002; but see Calder & Young, 2005).”

“Research suggests that face identity recognition and facial expression recognition are partially subserved by overlapping neural systems (Calder & Young, 2005; Haxby, Hoffman, & Gobbini, 2000) and facial expressions have been found to impact on the perception of gender (Hess, Adams, Grammer, &…”

“Such a conclusion is in keeping with two influential models of the face-processing network [8, 9] that claim that the OFA generates an initial representation of a face before subsequent processing of other features such as identity and emotional expression.”

“Evidence that these two routes are indeed parallel comes from the study of patients who have acquired the inability to recognize faces (prosopagnosia) as the result of brain injury, usually to the right temporal lobe (Calder & Young 2005).”

“…pathways, this has been called into question by recent findings (for 1 Please, note that differences in the distributions of the reported ERP effects migh be due to differences in reference electrode placement (cf. Junghöfer, Peyk, Flaisch, & Schupp, 2006). t review see Calder & Young, 2005).”

“First, the clear distinction between the family members’ deficits with facial identity perception and normal performance with emotion recognition support models proposing that facial identity and facial emotion are processed by separate mechanisms (Bruce & Young, 1986; Haxby et al., 2000) and are inconsistent with uni…”

“We found a main effect of category (F (1, 10) = 136, p b 0.001) demonstrating a larger overall response to faces than to objects.”

“In addition, demonstrating that particular face-selective areas are functionally active at multiple times will address whether the predicted feedback mechanisms are operating in the network (Haxby et al. 2000; Calder and Young 2005; Fairhall and Ishai 2007).”

“It is interesting to note that Calder and Young (2005) have also proposed a PCA account of face perception, with particular relation to the processing of identity and expression information.”

“, 2000) and is the first stage in hierarchical faceprocessing models (Haxby et al., 2000; Calder and Young, 2005; Fairhall and Ishai, 2007).”

“, neutral expression) of the same subject [4] [5] [10].”

“…processing of relatively invariant facial features essential for recognizing identity and gender and changeable facial features essential for recognizing emotions and gaze direction (Bruce & Young 1986; Haxby et al. 2000; Perrett et al. 1992; but see Calder & Young 2005 for an alternative view).”

“…et al. 1999; Tsao et al. 2003; Young and Yamane 1992) and in the amygdala (Leonard et al. 1985; Nakamura et al. 1992; Sanghera et al. 1979), yet little evidence has been available for either clearly separate or joint processing of facial identity and facial expressions (Calder and Young 2005).”

“(Tranel, Damasio, & Damasio, 1988; Calder, Young, Rowland, Perrett, Hodges, & Etcoff, 1996; Humphreys, Donnell, & Riddoch, 1993;Calder & Young, 2005).”

“Furthermore , people's tendencies to overvalue losses in comparison to gains, apparent in loss aversion, has been suggested to be related to the dominance of automatic responses to losses (Camerer , 2005; Trepel et al., 2005).”

“Different circuits in the brain support the perception of different kinds of information, a principle that is evident in both brain damaged patients and functional imaging studies (Adolphs, Tranel, & Damasio, 1998; Calder & Young, 2005; Hoffman & Haxby, 2000; Humphreys, Donnelly, & Riddoch, 1993).”

“Functional scans were slice scan time corrected, motion corrected, coregistered to the same anatomical image, and normalized to percentage of signal change using AFNI (11).”

“…role as a general-purpose emotion processing unit, assigning affective significance to sensory events (LeDoux & Phelps, 2008; Vuilleumier, 2009), whereas the posterior areas of the STS (pSTS) play a critical role in encoding changeable aspects of faces (Calder & Young, 2005; Engell & Haxby, 2007).”

“A similar model has been proposed to handle the dissociable coding of facial identity and expression (Calder & Young, 2005) and the dissociable coding of faces of different races (Rhodes & Jaquet, 2010).”

“We explored how the distinct responses to faces and other object categories were, in fact, organized, leading to the development of multivariate pattern (MVP) analysis and understanding the response to faces in ventral temporal cortex as a distributed population code (Haxby et al., 2001 ).”

“…and recognition (Fang & He 2005, Grill-Spector et al. 2004, Moutoussis & Zeki 2002, Tong et al. 1998) and the latter are associated with dynamic aspects of face perception (Andrews & Ewbank 2004, Calder & Young 2005, Calder et al. 2007, Pitcher et al. 2011a, Puce et al. 1998, Winston et al. 2004).”

“Revisions of the current model of face processing may be required if further evidence against independent processing accumulates (Calder and Young, 2005).”

“However, as this data can also be modelled within a single multi-dimensional system, there may not be an absolute dissociation between the composite effect for expression and identity (Calder and Young, 2005).”

“Among these, there is growing evidence that the STS is involved in the perception of facial expressions (Adolphs, 2002; Calder & Young, 2005; Engell & Haxby, 2007; Furl, van Rijsbergen, Treves, Friston, & Dolan, 2007; Haxby, Hoffman, & Gobbini, 2000; Ishai, 2008; Narumoto, Okada, Sadato, Fukui, &…”

“Consistent with this line of reasoning, the posterior STS part of Haxby et al.’s (2000, 2002) core system that deals with changeable aspects of faces is either very close to or itself a multimodal region capable of integrating information from vision and hearing (Calder & Young, 2005).”

“…on whether anatomically separable or functionally independent pathways subserve identity versus expression processing, potentially favoring the alternative proposal that form-based representations of identities and expressions may share some common visual representations (Calder & Young, 2005).”

“People can rapidly identify the faces of a large number of individuals, can categorize (known and unknown) faces by age, gender, and race, and can read the intentions and goals of others from their facial gestures [1–5].”

“…perception of facial expressions showed explicitly that different facial areas are responsible for the recognition of different facial expressions (for an overview, see Adolphs, 2002; Calder & Young, 2005; Russell & Fernandez-Dols, 1997; Schwaninger, Wallraven, Cunningham, & Chiller-Glaus, 2006).”

“Neuropsychological models of face processing in typical development have proposed that the structural encoding of facial identity and facial expressions use a shared specialised cognitive strategy (Bruce & Young, 1986 ; Calder & Young, 2005 ; Haxby, Hoffman, & Gobbini, 2000 ).”

“This theory seems unlikely given that examination of the null events did not reveal temporal pole activity (Table 4) and therefore supports a role for the temporal pole in face processing (Haxby et al., 2000; Calder and Young, 2005).”

“While it seems the identity of faces is encoded and retrieved in FFA (Haxby et al., 2000; Lehmann et al., 2004; Winston et al., 2004; Calder and Young, 2005; Loffler et al., 2005; but see Rotshtein et al., 2005; Kriegeskorte et al., 2007; Nestor et al., 2008), we have recently shown that the utilization of chess knowl…”

“Nevertheless, we note that the fusiform gyrus is a key part of the neural systems involved in processing facial identity and expressions (Calder and Young, 2005), two social signals at the basis of all human relationships.”

“…et al., 1996; Eimer, 2000), this finding suggests that perceptual emotion encoding as reflected in the EPN (Schupp et al., 2006) may proceed in parallel with structural encoding of faces, which is in line with traditional models of face recognition (Bruce & Young, 1986; Calder & Young, 2005).”

“Mechanisms for the processing of expression and identity may overlap in common neural systems (Bernstein & Yovel 2015, Calder & Young 2005).”

“In fact, Calder and Young (2005), in a recent review, have challenged the claim that some prosopagnosic individuals show preserved facial expression recognition and suggest that the dissociability of identity and expression processing is less well supported by patient-based research than has been…”

“…al., 2004a; Pelphrey et al., 2006) and facial expressions (static: Haxby et al., 2000; Hoffman and Haxby, 2000; Adolphs, 2002; LaBar et al., 2003; Calder and Young, 2005; by guest on M ay 23, 2016 http://scan.oxfordjournals.org/ D ow nloaded from Engell and Haxby, 2007; Ishai, 2008; dynamic:…”

“Influential models of face perception [6–8] propose that two functionally distinct cortical pathways process different facial aspects.”

“In consequence a strikingly different type of functional organisation arises for emotion recognition, where it has become evident that comprehension of facial and vocal cues is closely integrated [13,79,80] in a way that is not captured adequately by Box 1.”

“As the upper part plays a more important role for expressions of anger, fear and sadness, but not for disgust and happiness (Calder et al., 2000), this may explain why older observers are especially impaired in decoding these emotions.”

“…two face-selective regions in the occipitotemporal cortex that are primarily involved in recognition of individual identity (Haxby et al., 2000; Calder and Young, 2005; Ishai, 2008)—the occipital face area (OFA) (Gauthier et al., 2000) and the fusiform face area (FFA) (Kanwisher et al.,…”

“The dorsal and ventral streams of face processing One similarity between our data and previous reports of faceselective responses in macaques and humans is the apparent division between dorsal and ventral face patches (Calder and Young, 2005; Pinsk et al., 2009; Yovel and Freiwald, 2013).”

“These models posit different neural pathways for processing of relatively invariant facial features essential for recognizing identity and gender and changeable facial features essential for recognizing emotions and gaze direction (but see Calder & Young, 2005, for an alternative view).”

“One potential basis for integration occurs at the level of regional dysfunction, with both emotion recognition (Calder & Young, 2005; Atkinson & Adolphs, 2011; Said et al. 2011) and verbal communication (Rama et al. 2012; Ozyurek, 2014) depending heavily on structures within the superior temporal…”

“This model is supported by behavioral (eg, Calder, Young, Keane, & Dean, 2000 ) and neuropsychological studies (Young, Newcombe, de Haan, Small, & Hay, 1993 , but see Calder & Young, 2005 ), and served as the basis for an important distinction introduced by Haxby et al.”

“The authors were able to isolate two segregated sub-populations of FFA voxels showing either RS or RE, suggesting that prediction and prediction error are indeed the functions of distinct neuron populations.”

“To investigate this possibility, we extracted the data in the OFA from our previous neuroimaging study (Jiang and He, 2006), since the OFA is believed to be the first stage in face processing models (Calder and Young, 2005; Haxby et al., 2000).”

“Apart from the identiWcation of familiar persons, conveying emotional information via facial expression is the second major function of faces (see Calder & Young, 2005, for a recent discussion of both functions).”

“In particular, the majority of prior research on emotion perception has focused solely on the face without taking into account the contributions of the affective body context (e.g., Ambady & Weisbuch, 2011; Calder & Young, 2005; Ekman, 1993; Smith, Cottrell, Gosselin, & Schyns, 2005).”

“It has been proposed that, in adults, the processing of facial affect and identity is subserved by overlapping (Calder & Young, 2005) and mutually interacting (Vuilleumier & Pourtois, 2007) networks.”

“For example, proper facial recognition needs the more basic processes of vision and memory (Calder & Young, 2005; Young, Hugenberg, Bernstein, & Sacco, 2012).”