Test-retest reliability of the ‘Reading the Mind in the Eyes’ test: a one-year follow-up study
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background: The ‘Reading the Mind in the Eyes’ (Eyes) test is an advanced test of theory of mind. It is widely used to assess individual differences in social cognition and emotion recognition across different groups and cultures. The present study examined distributions of responses and scores on a Spanish version of the test in a non-clinical Spanish adult population, and assessed test-retest reliability over a 1-year interval. Methods: A total of 358 undergraduates of both sexes, age 18 to 65 years, completed the Spanish version of the test twice over an interval of 1 year. The Bland-Altman method was used to calculate test-retest reliability. Results: Distributions of responses and scores were optimal. Test-retest reliability for total score on the Eyes test was .63 (P <.01), based on the intraclass correlation coefficient. Test-retest reliability using the Bland-Altman method was fairly good. Conclusions: This is the first study providing evidence that the Eyes test is reliable and stable over a 1-year period, in a non-clinical sample of adults.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It has been adapted to Spanish population with a good test-retest reliability (ICC = 0.76) [52].”
From Mindfulness-based social cognition training (SocialMIND) versus psychoeducational multicomponent intervention for people with a first episode of psychosis: A study protocol for a randomised controlled trial (2019) · cites this paper as [52]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The test has good internal consistency and test-retest reliability [60, 61].”
From A 'choice', an 'addiction', a way 'out of the lost': Exploring self-injury in autistic people without intellectual disability (2019) · cites this paper as [61]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,856
Baron‐Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00715 · Cited by 4,555 · cited 6×
“Measures The revised Eyes test [1] was used to generate a Spanish version of the Eyes test.”
BackgroundMethodInfluentialSelf-citationBaron‐Cohen, S., Wheelwright, S. J., Hill, J., Raste, Y., & Plumb, I. (2001) · PubMed · Cited by 4,313
Self-citationMindblindness: An Essay on Autism and Theory of Mind
(1995) · Choice Reviews Online · doi:10.5860/choice.33-2412 · Cited by 3,670
Frith, C., & Frith, U. (2005) · Current Biology · doi:10.1016/j.cub.2005.08.041 · Cited by 3,481
Mindblindness: An Essay on Autism and Theory of Mind
Baron-Cohen, S. (1995) · doi:10.7551/mitpress/4635.001.0001 · Cited by 3,428
Self-citationBaron‐Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01599.x · Cited by 1,970 · cited 3×
“developed the ‘Reading the Mind in the Eyes’ test, an advanced test of theory of mind [23].”
BackgroundInfluentialSelf-citationSocial Cognition: From Brains to Culture
Fiske, S. T., & Taylor, S. E. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781529681451 · Cited by 1,741
Social Cognition: Making Sense of People
Howard, J. A., & Kunda, Z. (2000) · Contemporary Sociology · doi:10.2307/2654104 · Cited by 1,072
Autism: The Empathizing–Systemizing (E‐S) Theory
Baron‐Cohen, S. (2009) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.04467.x · Cited by 830
Self-citationSocial Cognition: Making Sense of People
Kunda, Z. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/6291.001.0001 · Cited by 771
Fiske, S. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781446286395 · Cited by 765
The Essential Difference: Men, Women and the Extreme Male Brain
McClure, I. (2003) · BMJ · doi:10.1136/bmj.327.7405.57 · Cited by 470
Green, M. F. (2005) · Schizophrenia Bulletin · doi:10.1093/schbul/sbi049 · Cited by 453
Implications for the Neural Basis of Social Cognition for the Study of Schizophrenia
Pinkham, A. E., Penn, D. L., Perkins, D. O., & Lieberman, J. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.5.815 · Cited by 451
The Essential Difference: Men, Women and the Extreme Male Brain
Baron‐Cohen, S. (2007) · Cited by 445
Self-citationCross-cultural Reading the Mind in the Eyes: An fMRI Investigation
Adams, R. B., Rule, N. O., Franklin, R. G., Wang, E., Stevenson, M. T., Yoshikawa, S., Nomura, M., Sato, W., Kveraga, K., & Ambady, N. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21187 · Cited by 416
Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1015497629971 · Cited by 411
Self-citationVellante, M., Baron-Cohen, S., Melis, M., Marrone, M., Petretto, D. R., Masala, C., & Preti, A. (2013) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2012.721728 · Cited by 406 · cited 7×
“Intergroup comparisons are also important for cross-cultural studies, which aim to test if cultures differ more in how they identify complex mental states than simpler mental states [26].”
BackgroundInfluentialSelf-citationRevisiting the Strange Stories: Revealing Mentalizing Impairments in Autism
White, S., Hill, E., Happé, F., & Frith, U. (2009) · Child Development · doi:10.1111/j.1467-8624.2009.01319.x · Cited by 393
Evidence for theory of mind deficits in euthymic patients with bipolar disorder
Bora, E., Vahip, S., Gonul, A. S., Akdeniz, F., Alkan, M., Ogut, M., & Eryavuz, A. (2005) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2005.00570.x · Cited by 291 · cited 1×
“The Eyes test has also proven useful for assessing social intelligence and its subtle impairment in different cultures, as shown in studies using translations of the Eyes test into Turkish, Hungarian, Japanese, French, German, and Argentinian Spanish [7,27-31].”
Attentional Bias, Emotion Recognition, and Emotion Regulation in Anorexia: State or Trait?
Harrison, A., Tchanturia, K., & Treasure, J. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.04.037 · Cited by 216
The neural basis of primate social communication
Brothers, L. (1990) · Motivation and Emotion · doi:10.1007/bf00991637 · Cited by 216
Voracek, M., & Dressler, S. G. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2006.06.009 · Cited by 164
Kunihira, Y., Senju, A., Dairoku, H., Wakabayashi, A., & Hasegawa, T. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0094-1 · Cited by 158
Is synaesthesia more common in autism?
Baron-Cohen, S., Johnson, D., Asher, J., Wheelwright, S., Fisher, S. E., Gregersen, P. K., & Allison, C. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-40 · Cited by 143
Self-citationHypersensitivity in Borderline Personality Disorder during Mindreading
Frick, C., Lang, S., Kotchoubey, B., Sieswerda, S., Dinu-Biringer, R., Berger, M., Veser, S., Essig, M., & Barnow, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041650 · Cited by 142
de Achával, D., Costanzo, E. Y., Villarreal, M., Jáuregui, I. O., Chiodi, A., Castro, M. N., Fahrer, R. D., Leiguarda, R. C., Chu, E. M., & Guinjoan, S. M. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.12.019 · Cited by 135
Social perception and social skill in schizophrenia
Ihnen, G. H., Penn, D. L., Corrigan, P. W., & Martin, J. A. (1998) · Psychiatry Research · doi:10.1016/s0165-1781(98)00079-1 · Cited by 130
Do girls with anorexia nervosa have elevated autistic traits?
Baron-Cohen, S., Jaffa, T., Davies, S., Auyeung, B., Allison, C., & Wheelwright, S. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-24 · Cited by 128
Self-citationWhat about theory of mind after severe brain injury?
Havet-Thomassin, V., Allain, P., Etcharry-Bouyx, F., & Le Gall, D. (2006) · Brain Injury · doi:10.1080/02699050500340655 · Cited by 118
Facial emotion recognition in patients with bipolar I and bipolar II disorder
Derntl, B., Seidel, E., Kryspin‐Exner, I., Hasmann, A., & Dobmeier, M. (2009) · British Journal of Clinical Psychology · doi:10.1348/014466509x404845 · Cited by 117
Investigation of the reliability of the "reading the mind in the eyes test" in a Turkish population.
Yıldırım, E. A., Kaşar, M., Güdük, M., Ateş, E. A., Küçükparlak, İ., & Ozalmete, O. (2011) · PubMed · Cited by 99
Kelemen, O., Kéri, S., Must, A., Benedek, G., & Janka, Z. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0047.2004.00357.x · Cited by 94
The reading the mind in the eyes test: test-retest reliability of a Swedish version
Hallerbäck, M. U., Lugnegård, T., Hjärthag, F., & Gillberg, C. (2009) · Cognitive Neuropsychiatry · doi:10.1080/13546800902901518 · Cited by 90
Bänziger, T., Scherer, K. R., Hall, J. A., & Rosenthal, R. (2011) · Journal of Nonverbal Behavior · doi:10.1007/s10919-011-0108-3 · Cited by 86
Adenzato, M., Todisco, P., & Ardito, R. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044414 · Cited by 84
Facial affect processing in social anxiety: tasks and stimuli
Machado-de-Sousa, J. P., Arrais, K. C., Alves, N. T., Chagas, M. H. N., de Meneses-Gaya, C., Crippa, J. A. D. S., & Hallak, J. E. C. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.08.013 · Cited by 75
Emotional theory of mind in eating disorders
Medina-Pradas, C., Navarro, J. B., Álvarez‐Moya, E. M., Grau, A., & Obiols, J. E. (2012) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 46
Recognition of facial expressions of mixed emotions in school-age children exposed to terrorism.
Scrimin, S., Moscardino, U., Capello, F., Altoè, G., & Axia, G. (2009) · Developmental Psychology · doi:10.1037/a0016689 · Cited by 36
Investigating reliability of Reading Mind in the Eyes Test in a Turkish population
Yildirim, E. A., Kasar, M., Guduk, M., Ozalmete, O., Ates, E., & Kucukparlak, I. (2011) · Turkish Journal of Psychiatry · doi:10.5080/u6500 · Cited by 36
Ryu, V., An, S. K., Jo, H.-H., & Cho, H. S. (2010) · Neuroscience Letters · doi:10.1016/j.neulet.2010.06.059 · Cited by 30
Self-referential and social cognition in a case of autism and agenesis of the corpus callosum
Lombardo, M. V., Chakrabarti, B., Lai, M., & Baron‐Cohen, S. (2012) · Molecular Autism · doi:10.1186/2040-2392-3-14 · Cited by 24
Self-citation
Cited by
Baron-Cohen, S., Bowen, D. C., Holt, R. J., Allison, C., Auyeung, B., Lombardo, M. V., Smith, P., & Lai, M.-C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136521 · Cited by 238
Self-citationOlderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01503 · Cited by 228
“…(child version; Vogindroukas et al., 2014), Italian (Vellante et al., 2012), Japanese (Kunihira et al., 2006; Adams et al., 2009), Persian (Khorashad et al., 2015), Romanian (Miu et al., 2012), Spanish (Fernández-Abascal et al., 2013), Swedish (Hallerbäck et al., 2009), and Turkish (Girli, 2014).”
BackgroundBuilding Social Cohesion in Ethnically Mixed Schools: An Intervention on Perspective Taking
Alan, Ş., Baysan, C., Gümren, M., & Kubilay, E. (2021) · The Quarterly Journal of Economics · doi:10.1093/qje/qjab009 · Cited by 198
Warrier, V, Grasby, K. L., Uzefovsky, F., Toro, R., Smith, P., Chakrabarti, B., Khadake, J., Mawbey-Adamson, E., Litterman, N., Hottenga, J.-J., et al. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.122 · Cited by 140
Self-citationLindeman, M., Svedholm‐Häkkinen, A. M., & Lipsanen, J. O. (2014) · Cognition · doi:10.1016/j.cognition.2014.09.008 · Cited by 151
Metadata
- Authors
- Fernández-Abascal, E. G., Cabello, R., Fernández-Berrocal, P., & Baron-Cohen, S.
- Affiliations
- Universidad Nacional de Educación a Distancia (ES)
- Universidad de Huelva (ES)
- Venue
- Molecular Autism
- Published
- 2013-09-11
- Volume
- 4
- Issue
- 1
- Pages
- 33-33
- ISSN
- 2040-2392 (ISSN-L)
- PMC
- PMC3848772
- OpenAlex
- W2115827003
- Cited by
- 187
- References
- 44
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 19 · 2023: 15 · 2022: 21 · 2021: 18 · 2020: 16 · 2019: 25 · 2018: 15 · 2017: 16 · 2016: 13 · 2015: 11 · 2014: 3
- FWCI
- 18.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Molecular Autism (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Repositorio Institucional de la Universidad de Huelva (Universidad de Huelva) (submittedVersion)
- Hispana (submittedVersion, cc-by-nc-nd)
- Repositorio Institucional de la Universidad de Huelva (Universidad de Huelva) (submittedVersion, cc-by-nc-nd)
- Funders
- Wellcome Trust
- National Institute for Health and Care Research
- Medical Research Council
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- Reading the Mind in the Eyes Test, theory of mind, test-retest reliability, social cognition, emotion recognition, Spanish translation, non-clinical adults, Bland-Altman analysis, intraclass correlation coefficient
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
