Test-retest reliability of the facial expression labeling task
Open accessAbstract
Recognizing others' emotional expressions is vital for socioemotional development; impairments in this ability occur in several psychiatric disorders. Further study is needed to map the development of this ability and to evaluate its components as potential transdiagnostic endophenotypes. Before doing so, however, research is required to substantiate the test-retest reliability of scores of the face emotion identification tasks linked to developmental psychopathology. The current study estimated test-retest reliability of scores of one such task, the facial expression labeling task (FELT) among a sample of twin children (N = 157; ages 9-14). Participants completed the FELT at two visits two to five weeks apart. Participants discerned the emotion presented of faces depicting six emotions (i.e., happiness, anger, sadness, fear, surprise, and disgust) morphed with a neutral face to provide 10 levels of increasing emotional expressivity. The present study found strong test-retest reliability (Pearson r) of the FELT scores across all emotions. Results suggested that data from this task may be effectively analyzed using a latent growth curve model to estimate overall ability (i.e., intercept; r's = 0.76-0.85) and improvement as emotions become clearer (i.e., linear slope; r's = 0.69-0.83). Evidence of high test-retest reliability of this task's scores informs future developmental research and the potential identification of transdiagnostic endophenotypes for child psychopathology. (PsycINFO Database Record
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Mice can discriminate emotions in others in a way that is distinct from sociability.
“our data provide some indication that, similar to human emotion recognition tasks [70,90,92,121], mice can discriminate emotions in others in a way that is distinct from sociability.”
From Oxytocin Signaling in the Central Amygdala Modulates Emotion Discrimination in Mice (2019) · cites this paper as [121]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067 · see citing works
Self-citationThe Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions
Gottesman, I. I., & Gould, T. D. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.4.636 · Cited by 5,615 · see citing works
Fusar‐Poli, P., Placentino, A., Carletti, F., Landi, P., Allen, P., Surguladze, S., Benedetti, F., Abbamonte, M., Gasparotti, R., Barale, F., et al. (2009) · Journal of Psychiatry and Neuroscience · doi:10.1139/jpn.0953 · Cited by 1,292 · see citing works
Deficits in facial affect recognition among antisocial populations: A meta-analysis
Marsh, A. A., & Blair, J. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.08.003 · Cited by 849 · see citing works
Blair, J., Colledge, E., Murray, L. K., & Mitchell, D. G. V. (2001) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1012225108281 · Cited by 713 · see citing works
Processing of facial emotion expression in major depression: a review
Bourke, C., Douglas, K., & Porter, R. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2010.496359 · Cited by 557 · see citing works
Trentacosta, C. J., & Fine, S. E. (2009) · Social Development · doi:10.1111/j.1467-9507.2009.00543.x · Cited by 457 · see citing works
Endophenotypes in the Genetic Analyses of Mental Disorders
Cannon, T. D., & Keller, M. C. (2006) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.2.022305.095232 · Cited by 399 · see citing works
Age, gender, and puberty influence the development of facial emotion recognition
Lawrence, K., Campbell, R., & Skuse, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00761 · Cited by 342 · see citing works
Oxytocin improves specific recognition of positive facial expressions
Marsh, A. A., Yu, H. H., Pine, D. S., & Blair, R. J. R. (2010) · Psychopharmacology · doi:10.1007/s00213-010-1780-4 · Cited by 321 · see citing works
Self-citationInterpersonal Emotion Regulation Model of Mood and Anxiety Disorders
Hofmann, S. G. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9620-1 · Cited by 320 · see citing works
Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study
Pinkham, A. E., Penn, D. L., Green, M. F., & Harvey, P. D. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv056 · Cited by 303 · see citing works
Specificity of facial expression labeling deficits in childhood psychopathology
Guyer, A. E., Tone, E. B., Adler, A., Brotman, M. A., Rich, B. A., Kimes, A. S., Pine, D. S., Monique Ernst, D., & Leibenluft, E. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01758.x · Cited by 250 · see citing works
Self-citationKasriel, J., & Eaves, L. J. (1976) · Journal of Biosocial Science · doi:10.1017/s0021932000010737 · Cited by 225 · see citing works
Facial Emotion Labeling Deficits in Children and Adolescents at Risk for Bipolar Disorder
Brotman, M. A., Guyer, A. E., Lawson, E. S., Horsey, S. E., Rich, B. A., Dickstein, D. P., Pine, D. S., & Leibenluft, E. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.06122050 · Cited by 164 · see citing works
Self-citationTryptophan depletion decreases the recognition of fear in female volunteers
Harmer, C. J., Rogers, R. D., Tunbridge, E. M., Cowen, P. J., & Goodwin, G. M. (2003) · Psychopharmacology · doi:10.1007/s00213-003-1401-6 · Cited by 162 · see citing works
Emotion recognition and oxytocin in patients with schizophrenia
Averbeck, B. B., Bobin, T., Evans, S., & Shergill, S. S. (2011) · Psychological Medicine · doi:10.1017/s0033291711001413 · Cited by 144 · see citing works
Effects of MDMA and intranasal oxytocin on social and emotional processing
Kirkpatrick, M. G., Lee, R., Wardle, M. C., Jacob, S., & de Wit, H. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.12 · Cited by 143 · see citing works
Determination of Twin Zygosity: A Comparison of DNA with Various Questionnaire Indices
Jackson, R. W., Snieder, H., Davis, H., & Treiber, F. A. (2001) · Twin Research · doi:10.1375/1369052012092 · Cited by 106 · see citing works
Violent video game play impacts facial emotion recognition
Kirsh, S. J., & Mounts, J. R. W. (2007) · Aggressive Behavior · doi:10.1002/ab.20191 · Cited by 95 · see citing works
Emotion Recognition Deficits in Pediatric Anxiety Disorders: Implications for Amygdala Research
Easter, J., Tone, E. B., Monk, C. S., Dhanani, M., Hodgdon, H., Leibenluft, E., Charney, D. S., Pine, D. S., & Monique Ernst, D. (2005) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2005.15.563 · Cited by 76 · see citing works
Self-citationEmotion Dysregulation in Attention Deficit Hyperactivity Disorder
Shaw, P., Stringaris, A. K., Nigg, J. T., & Leibenluft, E. (2016) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.140102 · Cited by 51 · see citing works
Self-citationThe Mid-Atlantic Twin Registry, Revisited
Lilley, E. C. H., & Silberg, J. (2012) · Twin Research and Human Genetics · doi:10.1017/thg.2012.125 · Cited by 36 · see citing works
Test–retest reliability and task order effects of emotional cognitive tests in healthy subjects
Adams, T., Pounder, Z., Preston, S., Hanson, A., Gallagher, P., Harmer, C. J., & McAllister-Williams, H. (2015) · Cognition & Emotion · doi:10.1080/02699931.2015.1055713 · Cited by 26 · see citing works
The Twin Study of Negative Valence Emotional Constructs
Carney, D. M., Moroney, E., Machlin, L., Hahn, S., Savage, J. E., Lee, M., Towbin, K. A., Brotman, M. A., Pine, D. S., Leibenluft, E., et al. (2016) · Twin Research and Human Genetics · doi:10.1017/thg.2016.59 · Cited by 25 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 4
- Ekman P Friesen WV 1976 Pictures of facial affect Consulting Psychologists Press
- Nowicki S Duke MP 1994 Individual differences in the nonverbal communication of affect: The Diagnostic Analysis of Nonverbal Accuracy Scale Journal of Nonverbal Behavior 18 1 9 35
- Steinberg L Morris AS 2001 Adolescent development Journal of Cognitive Education and Psychology 2 1 55 87
- Wagner HL 1993 On measuring performance in category judgment studies of nonverbal behavior Journal of Nonverbal Behavior 17 1 3 28
Cited by
Sorted by citations
Oxytocin Signaling in the Central Amygdala Modulates Emotion Discrimination in Mice
Ferretti, V., Maltese, F., Contarini, G., Nigro, M., Bonavia, A., Huang, H., Gigliucci, V., Morelli, G., Scheggia, D., Managò, F., et al. (2019) · Current Biology · doi:10.1016/j.cub.2019.04.070 · Cited by 212 · see citing works
- Authors
- Cecilione, J. L., Rappaport, L. M., Verhulst, B., Carney, D. M., Blair, R. J. R., Brotman, M. A., Leibenluft, E., Pine, D. S., Roberson-Nay, R., & Hettema, J. M.
- Affiliations
- Virginia Commonwealth University (US)
- National Institutes of Health (US)
- ORCID
- Venue
- Psychological Assessment
- Published
- 2017-12
- Volume
- 29
- Issue
- 12
- Pages
- 1537-1542
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- PMC
- PMC5568997
- OpenAlex
- W2589859767
- Cited by
- 20
- References
- 25
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 4 · 2022: 2 · 2021: 2 · 2020: 3 · 2019: 3 · 2018: 3
- FWCI
- 3.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (R01MH098055, T32MH020030, IRP-ziamh002781)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- test-retest reliability, emotion recognition, developmental psychopathology, twins, latent growth curve models, morphed faces, social-emotional development
- MeSH terms
- Adolescent, Adult, Child, Emotions, Facial Expression, Female, Humans, Male, Personality Assessment, Psychometrics, Twins, Reproducibility of Results, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
