Understanding the recognition of facial identity and facial expression

“Is multimodal analysis involved? The co-occurrence of impairments in the recognition of facial and vocal expression is not restricted to cases that show disproportionate impairments for one emotion; in fact, the relationship is if anything more striking in patients who have general problems in recognizing facial expre…”

“…(1990), have provided an important theoretical framework for the understanding of person recognition and, bar some recent enhancements (e.g., Burton, Bruce, & Hancock, 1999; Calder & Young, 2005; Young & Bruce, 2011), the fundamental assumptions made in the model have mainly stood the test of time.”

“…April 2016 Owing to the great importance of human faces for our social lives, there has been extensive research on the cognitive and neural processing of information conveyed by faces, such as identity, emotional state, age, gender and intention (for reviews see Adolphs 2002; Calder & Young 2005).”

“Although these observations have suggested the independence of the identity and expression-processing systems, the completeness of this separation has been questioned in recent years [11].”

“…between our results for facial expression and these previous findings for facial identity processing is consistent with the idea that the underlying processing of facial expression and identity may be different (Bruce & Young, 1986; Calder & Young, 2005; Haxby, Hoffman, & Gobbini, 2000).”

“This chapter categorizes the studies according to the facial feature extraction method used in each study as this has been argued to be the most important factor affecting the recognition accuracy [14, 77].”

“Previous work has shown that while sources of expression and identity information are separable from one another to some extent, they are not entirely independent (Calder et al., 2001; Calder & Young, 2005; Young, 2018).”

“Recent fMRI studies also showed that the cognitive and neural mechanisms involved in the perceptual analyses of faces and attractive faces were considerably overlapping (Calder and Young 2005; Fisher et al.”

“…accordance with previous studies, our findings verify that the right FFA not only gets engaged in general facial recognition, but also modulates perception on facial expression features such as the intensity of pain expressions (Calder & Young, 2005; Eichmann et al., 2008; Loughead et al., 2008).”

“Some studies have demonstrated that the pSTS was involved in the processing of movements, postures, and emotions of faces and bodies (Grezes et al., 2007; Candidi et al., 2011; Zhu et al., 2013; Baseler et al., 2014).”

“Mainly three important primitive soft biometric could be acquired by face moralities, such as ocular region, which are ethnicity, gender, and age [2].”

“Although a face is a single object, it conveys many socially important dimensions (such as identity, age, gender, emotion, and gaze), and people can extract these dimension accurately and effortlessly (Calder and Young, 2005).”

“…extract a wealth of socially relevant information from a single face, such as identity, emotional expression (reviewed in Bruce and Young, 1986; Calder and Young, 2005), gender (e.g., O’Toole et al., 1998), and even personality traits, such as trustworthiness (e.g., Oosterhof and Todorov,…”

“…(e.g., Burton, White, & McNeill, 2010; Clutterbuck & Johnston, 2002; Johnston & Bindemann, 2013), emotion recognition (e.g., Calder et al., 2001; Calder & Young, 2005), or gaze perception (e.g., Bayliss, Pellegrino, & Tripper, 2004; Driver et al., 1999; Jenkins, 2007), face detection has been…”

“The source data and code used for generating the plots are available at https://osf.io/ez9dp/. expressions 2,3,7,16,20,27,29,30 .”

“Although previous literature suggested that the OFA has a crucial role in face recognition only [64], more recent evidence has shown that different emotional expressions engage distinct activity patterns in OFA and other face-related areas of the ventral pathway (i.”

“…al., 1991; Grossmann & Johnson, 2007), and neurophysiological studies have provided evidence for the existence of specialized brain areas and pathways for processing faces (Kanwisher et al., 1997; Vuilleumier & Pourtois, 2007; Schindler & Bublatzky, 2020; Calder & Young, 2005; Morris et al, 1998).”

“the confusion resulting from facial expression of disgust could be a consequence of culture-specifc [10].”

“…perception becomes less influenced by image-specific information (see also Balas & Pearson, 2017; Baker, Laurence & Mondloch, 2017; Bruce, 1982; Bruce & Young, 1986; Burton, Jenkins, Hancock, & White, 2005; Burton, Kramer, Ritchie, & Jenkins, 2016; Calder & Young, 2005; Johnston & Edmonds, 2009).”

“Rather, our data suggest that, like the discrimination of emotional expressions (e.g. Calder and Young 2005), trait inference based upon facial characteristics depends upon dissociable mechanisms.”

“The right OFA and the right FFA are the core regions of face processing network (Calder and Young, 2005; Haxby et al., 2000).”

“According to the Gobbini and Haxby (2007) distributed face-processing model, the OFA and the FFA are involved in invariant facial trait extraction, and thus in facial identity processing (Calder & Young, 2005; Haxby, Hoffman, & Gobbini, 2000; Hoffman & Haxby, 2000).”

“A number of lines of evidence suggest that the variant and invariant properties of the face are represented in processing streams that are at least partially separable (Haxby et al., 2000; Andrews and Ewbank, 2004; Calder and Young, 2005; Said et al., 2011).”

“Second, we decided to examine whether analyses of emotional expression and facial structure are independent (eg Bruce and Young 1986) or interrelated (eg Calder and Young 2005; Haxby et al 2002; Karnadewi and Lipp 2011).”

“Not only faces provide information about the identity of people, but also on their membership in broad demographic categories of humans (including sex, race, and age), and about their current emotional state [3,4,5,6,7].”

“The human face is also known to convey a rich amount of ST-related information [55].”

“As such, the dual process model obtained converging evidence from the neuroimaging studies and has been widely accepted (Calder and Young, 2005).”

“…the functional routes for processing of facial expression and processing of social category are not complete separated and that some of the functions required for these two processing may be subserved by overlapping and interacting systems (for reviews, see Calder & Young, 2005; Hess et al., 2009).”

“Insofar as facial structure and facial expression are largely independent sources of facial variation [48,49], perceptual predictions derived from structure and expression cues may also be relatively independent [5].”

“These observations are rather in linewith the notion that an absolute separation between facial identity and expression representations is unlikely to be implemented in the human visual system (Calder and Young, 2005).”

“Moreover, as was mentioned in [3], the position of the systems for recognition of facial expression and identity are separated in the brain but their routes are not independent.”

“Gender is information about identity that, like facial identity, is an invariant attribute over short time scales (Calder & Young, 2005; Haxby et al., 2000) and requires no further monitoring after an initial identification is accomplished.”

“More recent views propose that this separation between identityand expression-related processing may be relative rather than absolute (Calder & Young, 2005; De Gelder, Frissen, Barton, & Hadjikhani, 2003), and that the ability to recognise a person depends on the successful integration of…”

“face recognition [17, 20, 50] which posit a separate processing stream for “change-”

“An increasing number of studies have revealed that facial identity and expression processing depend on one another (Adolphs, 2003; Calder, 2011; Calder & Young, 2005).”

“…selectivity of ventral areas to changeable dimensions of faces like gaze direction or facial expression and to facial dynamics, it is clear that the functional dissociation between pathways is different to the one originally proposed—or more quantitative than qualitative in nature (3–5, 25, 46).”

“…perception and memory of facial identity (Duchaine and Nakayama 2006; Farah et al. 1998; Kanwisher 2000; Wilhelm et al. 2010; Young et al. 1987) and facially expressed emotions (Calder et al. 2000; Calder and Young 2005; Hildebrandt et al. 2015a, 2015b; Neta and Whalen 2011; Olderbak et al. 2019).”

“…contributions of such a widespread swath of cortex might in principle square with the concept of a face space that has many diverse dimensions, they are more difficult to reconcile with the still-popular “Haxby model” and its more recent variants (Calder and Young, 2005; Haxby and Gobini, 2011).”

“The evidence for double dissociations in recognition of face identity versus face emotion in prosopagnosia may be less convincing than generally assumed, hitherto (Calder & Young, 2005).”

“Much information is expressed on human faces, and they convey a wealth of social signals (Calder & Young, 2005).”

“…Nijmegen, The Netherlands Beatrice L. de Gelder # $ Cognitive and Affective Neuroscience Laboratory, Tilburg University, Tilburg, The Netherlands Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands Face…”

“…though some new arguments have been put forward about the integral nature of these two groups of facial cues that may not be so easy to distinguish (Calder & Young, 2005), we still believe that one of the urgent tasks should be to conduct new experiments where morphological and expressive cues…”

“The former are associated with face perception and recognition [35, 50, 97, 150] and the latter are associated with dynamic aspects of face perception [4, 17, 18, 110, 115, 175].”

“For example, in the field of HCI, user emotional states can draw new possibilities to make interaction more personal and natural, thereby improving the final experience [1].”

“The N-back task has also been used to identify neuroanatomical networks, respectively, related to changeable facial features (e.g., emotional expression) and invariant facial features (e.g., identity) (e.g., Haxby et al., 2000; Calder and Young, 2005).”

“…early components can capture not only superficial image noise, but also gross characteristics of faces that are independent of identity, such as expression (Calder & Young, 2005), gender (O ’ Toole et al 1993), race (O ’ Toole et al 1994), age (Burt & Perrett, 1995) and pose (Burton et al, 2016).”

“For instance, they offer salient cues to a person’s identity [1], allow the inference of key social traits [2], and provide critical information about an individual’s emotional state [3,4].”

“Additionally, some groups question the neuropsychological dissociation between identity processing and expression processing in individuals with face recognition deficits [16].”

“Such cases of dissociation of face identification and recognition of facial expressions have repeatedly arisen (Calder & Young, 2005), indicating that independent processing mechanisms underlie the two visual capacities.”

“Indeed, Calder and Young (2005) argued that the apparent dissociation between identity and expression processing in prosopagnosia may arise due to the fact that both tasks are not equated for task difficulty.”