The Social Cognition Psychometric Evaluation Study: Results of the Expert Survey and RAND Panel
Open accessThe DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Abstract
BACKGROUND: In schizophrenia, social cognition is strongly linked to functional outcome and is increasingly seen as a viable treatment target. The goal of the Social Cognition Psychometric Evaluation (SCOPE) study is to identify and improve the best existing measures of social cognition so they can be suitably applied in large-scale treatment studies. Initial phases of this project sought to (1) develop consensus on critical domains of social cognition and (2) identify the best existing measures of social cognition for use in treatment studies. METHODS: Experts in social cognition were invited to nominate key domains of social cognition and the best measures of those domains. Nominations for measures were reduced according to set criteria, and all available psychometric information about these measures was summarized and provided to RAND panelists. Panelists rated the quality of each measure on multiple criteria, and diverging ratings were discussed at the in-person meeting to obtain consensus. RESULTS: Expert surveys identified 4 core domains of social cognition-emotion processing, social perception, theory of mind/mental state attribution, and attributional style/bias. Using RAND panel consensus ratings, the following measures were selected for further evaluation: Ambiguous Intentions Hostility Questionnaire, Bell Lysaker Emotion Recognition Task, Penn Emotion Recognition Test, Relationships Across Domains, Reading the Mind in the Eyes Test, The Awareness of Social Inferences Test, Hinting Task, and Trustworthiness Task. DISCUSSION: While it was possible to establish consensus, only a limited amount of psychometric information is currently available for the candidate measures, which underscores the need for well-validated and standardized measures in this area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron‐Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00715 · Cited by 4,555
Baron‐Cohen, S., Wheelwright, S. J., Hill, J., Raste, Y., & Plumb, I. (2001) · PubMed · Cited by 4,313
Frith, C., & Frith, U. (2005) · Current Biology · doi:10.1016/j.cub.2005.08.041 · Cited by 3,481
Individual differences in need for cognitive closure.
Webster, D. M., & Kruglanski, A. W. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.67.6.1049 · Cited by 2,494
Happé, F. G. E. (1994) · Journal of Autism and Developmental Disorders · doi:10.1007/bf02172093 · Cited by 2,352
The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity
Nuechterlein, K. H., Green, M. F., Kern, R. S., Baade, L. E., Barch, D. M., Cohen, J. D., Essock, S., Fenton, W. S., Frese, F. J., Gold, J. M., et al. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07010042 · Cited by 2,342
Self-citation(2001) · Defense Technical Information Center (DTIC) · Cited by 2,158
The cognitive neuropsychology of schizophrenia
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0601 · Cited by 1,901
Fett, A.-K. J., Viechtbauer, W., Dominguez, M.-D.-G., Penn, D. L., van Os, J., & Krabbendam, L. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.07.001 · Cited by 1,833
Self-citationFrontal Lobe Contributions to Theory of Mind
Stone, V. E., Baron-Cohen, S., & Knight, R. T. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998562942 · Cited by 1,524
Castelli, F. (2002) · Brain · doi:10.1093/brain/awf189 · Cited by 1,377
An inkblot for attitudes: Affect misattribution as implicit measurement.
Payne, B. K., Cheng, C. M., Govorun, O., & Stewart, B. D. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.3.277 · Cited by 1,371
Corcoran, R., Mercer, G., & Frith, C. D. (1995) · Schizophrenia Research · doi:10.1016/0920-9964(95)00024-g · Cited by 1,340
The Functional Significance of Social Cognition in Schizophrenia: A Review
Couture, S. M. (2006) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl029 · Cited by 1,276
The human amygdala in social judgment
Adolphs, R., Tranel, D., & Damasio, A. R. (1998) · Nature · doi:10.1038/30982 · Cited by 1,125
Shamay-Tsoory, S. G. (2011) · The Neuroscientist · doi:10.1177/1073858410379268 · Cited by 1,059
Green, M. F., Penn, D. L., Bentall, R., Carpenter, W. T., Gaebel, W., Gur, R. C., Kring, A. M., Park, S., Silverstein, S. M., & Heinssen, R. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbm145 · Cited by 1,003
Self-citationMayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) Users Manual
Mayer, J. D., Salovey, P., & Caruso, D. R. (2002) · University of New Hampshire Scholars Repository (University of New Hampshire at Manchester) · Cited by 959
Facial Emotion Perception in Schizophrenia: A Meta-analytic Review
Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., & Moberg, P. J. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn192 · Cited by 930
Self-citationIntroducing MASC: A Movie for the Assessment of Social Cognition
Dziobek, I., Fleck, S., Kalbe, E., Rogers, K., Hassenstab, J., Brand, M., Kessler, J., Woike, J. K., Wolf, O. T., & Convit, A. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0107-0 · Cited by 926
PERSECUTORY DELUSIONS: A REVIEW AND THEORETICAL INTEGRATION
Bentall, R. P., Corcoran, R., Howard, R., Blackwood, N., & Kinderman, P. (2001) · Clinical Psychology Review · doi:10.1016/s0272-7358(01)00106-4 · Cited by 876
The Human Amygdala in Social Judgment
Adolphs, R., Tranel, D., & Damasio, A. R. (2002) · Foundations in Social Neuroscience · doi:10.7551/mitpress/3077.003.0027 · Cited by 875
The cognitive neuropsychology of schizophrenia
Garety, P. (1993) · Personality and Individual Differences · doi:10.1016/0191-8869(93)90350-c · Cited by 831
Theory of mind impairment in schizophrenia: meta-analysis
Bora, E., Yucel, M., & Pantelis, C. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2008.12.020 · Cited by 797 · cited 1×
“tion or sensitivity to intervention associated change, (4) convergent and discriminant validity—relationship to social cognitive measures relative to other abilities and constructs, (5) criterion validity—correlations with realworld social outcomes, (6) practicality for administration, and (7) tolerability for patient…”
BackgroundCognitive approaches to delusions: a critical review of theories and evidence.
Garety, P. A., & Freeman, D. (1999) · British Journal of Clinical Psychology · doi:10.1348/014466599162700 · Cited by 794 · cited 1×
“tion or sensitivity to intervention associated change, (4) convergent and discriminant validity—relationship to social cognitive measures relative to other abilities and constructs, (5) criterion validity—correlations with realworld social outcomes, (6) practicality for administration, and (7) tolerability for patient…”
BackgroundNowicki, S., & Duke, M. P. (1994) · Journal of Nonverbal Behavior · doi:10.1007/bf02169077 · Cited by 783
Facial Emotion Recognition in Schizophrenia: Intensity Effects and Error Pattern
Kohler, C. G., Turner, T. H., Bilker, W. B., Brensinger, C. M., Siegel, S. J., Kanes, S. J., Gur, R. E., & Gur, R. C. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.10.1768 · Cited by 781
Mcdonald (2003) · doi:10.1097/00001199-200305000-00001 · Cited by 657
Kerr, S. L., & Neale, J. M. (1993) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.102.2.312 · Cited by 584
Social cognition in schizophrenia: an overview
Penn, D. L., Sanna, L. J., & Roberts, D. L. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn014 · Cited by 574
Self-citationPutting together phylogenetic and ontogenetic perspectives on empathy
Decety, J., & Svetlova, M. (2012) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.05.003 · Cited by 508
Green, M. F. (2005) · Schizophrenia Bulletin · doi:10.1093/schbul/sbi049 · Cited by 453
Self-citationSocial cognitive training for schizophrenia: a meta-analytic investigation of controlled research
Kurtz, M. M., & Richardson, C. L. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr036 · Cited by 446
Marder, S. R., & Fenton, W. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.09.010 · Cited by 421
Biosocial pathways to functional outcome in schizophrenia
Brekke, J., Kay, D. D., Lee, K. S., & Green, M. F. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.07.008 · Cited by 418
Self-citationReciprocal Social Behavior in Children With and Without Pervasive Developmental Disorders
CONSTANTINO, J. N., PRZYBECK, T., FRIESEN, D., & TODD, R. D. (2000) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/00004703-200002000-00002 · Cited by 398
On judging and being judged accurately in zero-acquaintance situations.
Ambady, N., Hallahan, M., & Rosenthal, R. (1995) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.69.3.518 · Cited by 367
Combs, D. R., Penn, D. L., Wicher, M., & Waldheter, E. (2007) · Cognitive Neuropsychiatry · doi:10.1080/13546800600787854 · Cited by 360
Self-citationFacial affect recognition: A mediator between cognitive and social functioning in psychosis?
ADDINGTON, J., SAEEDI, H., & ADDINGTON, D. (2006) · Schizophrenia Research · doi:10.1016/j.schres.2006.03.028 · Cited by 348
Combs, D. R., Adams, S. D., Penn, D. L., Roberts, D., Tiegreen, J., & Stem, P. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2006.12.010 · Cited by 340
Self-citationSergi, M. J., Rassovsky, Y., Nuechterlein, K. H., & Green, M. F. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.3.448 · Cited by 335
Self-citationAffect recognition in schizophrenia: a function of global impairment or a specific cognitive deficit
Bryson, G., Bell, M., & Lysaker, P. (1997) · Psychiatry Research · doi:10.1016/s0165-1781(97)00050-4 · Cited by 308
Neurocognitive and social cognitive predictors of interpersonal skill in schizophrenia
Pinkham, A. E., & Penn, D. L. (2006) · Psychiatry Research · doi:10.1016/j.psychres.2005.09.005 · Cited by 301
Self-citationRoberts, D. L., & Penn, D. L. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.02.007 · Cited by 291
Self-citationMancuso, F., Horan, W. P., Kern, R. S., & Green, M. F. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.11.007 · Cited by 272
Self-citationInterperting the expressive behavior of others: The Interpersonal Perception Task
Costanzo, M., & Archer, D. (1989) · Journal of Nonverbal Behavior · doi:10.1007/bf00990295 · Cited by 269
A new measure of causal locus: the internal, personal and situational attributions questionnaire
Kinderman, P., & Bentall, R. P. (1996) · Personality and Individual Differences · doi:10.1016/0191-8869(95)00186-7 · Cited by 263
Theory of mind and the role of IQ in chronic disorganized schizophrenia
Brüne, M. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(02)00162-7 · Cited by 256
Roncone, R., Falloon, I. R. H., Mazza, M., De Risio, A., Pollice, R., Necozione, S., Morosini, P., & Casacchia, M. (2002) · Psychopathology · doi:10.1159/000067062 · Cited by 255
Vauth, R., Rüsch, N., Wirtz, M., & Corrigan, P. W. (2004) · Psychiatry Research · doi:10.1016/j.psychres.2004.05.018 · Cited by 255
Impaired recognition and expression of emotional prosody in schizophrenia: Review and meta-analysis
HOEKERT, M., KAHN, R., PIJNENBORG, M., & ALEMAN, A. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.07.023 · Cited by 247
Lysaker, P. H., Dimaggio, G., Carcione, A., Procacci, M., Buck, K. D., Davis, L. W., & Nicolò, G. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2009.04.024 · Cited by 233
Social Cognition in Schizophrenia
Green, M. F., & Leitman, D. I. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn045 · Cited by 214
Self-citationThe relationship of social cognition to ward behavior in chronic schizophrenia
Penn, D. L., Spaulding, W., Reed, D., & Sullivan, M. (1996) · Schizophrenia Research · doi:10.1016/0920-9964(96)00010-2 · Cited by 193
Self-citationValidating Measures of Real-World Outcome: The Results of the VALERO Expert Survey and RAND Panel
Leifker, F. R., Patterson, T. L., Heaton, R. K., & Harvey, P. D. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp044 · Cited by 192
Self-citationLangdon, R. A., & Coltheart, M. (2001) · Cognition · doi:10.1016/s0010-0277(01)00139-1 · Cited by 189
Deficit of theory of mind in individuals at ultra-high-risk for schizophrenia
Chung, Y. S., Kang, D.-H., Shin, N. Y., Yoo, S. Y., & Kwon, J. S. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.11.012 · Cited by 187
The functional relevance of affect recognition errors in schizophrenia
POOLE, J. H., TOBIAS, F. C., & VINOGRADOV, S. (2000) · Journal of the International Neuropsychological Society · doi:10.1017/s135561770066602x · Cited by 185
Facial affect recognition in individuals at clinical high risk for psychosis
Addington, J., Penn, D., Woods, S. W., Addington, D., & Perkins, D. O. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.039784 · Cited by 185
Self-citationEmotion Processing in Persons at Risk for Schizophrenia
Phillips, L. K., & Seidman, L. J. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn085 · Cited by 181
Schizophrenic patients' sensitivity to social cues: the role of abstraction
(1993) · American Journal of Psychiatry · doi:10.1176/ajp.150.4.589 · Cited by 170
Addington, J., Saeedi, H., & Addington, D. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.021022 · Cited by 168
Social perception in schizophrenia: the role of context
Penn, D. L., Ritchie, M., Francis, J., Combs, D., & Martin, J. (2002) · Psychiatry Research · doi:10.1016/s0165-1781(02)00004-5 · Cited by 165
Self-citationSocial cognitive impairments in first episode psychosis
Bertrand, M.-C., Sutton, H., Achim, A. M., MALLA, A. K., & Lepage, M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.05.033 · Cited by 155
Eack, S. M., Greeno, C. G., Pogue-Geile, M. F., Newhill, C. E., Hogarty, G. E., & Keshavan, M. S. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn091 · Cited by 141
The American Psychiatric Publishing Textbook of Schizophrenia
(2007) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e318033a46f · Cited by 138
Eack, S. M., Greenwald, D. P., Hogarty, S. S., & Keshavan, M. S. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.03.042 · Cited by 136
Social perception and early visual processing in schizophrenia.
Sergi, M. J., & Green, M. F. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(01)00405-4 · Cited by 135
Self-citationKettle, J. W. L., O'Brien-Simpson, L., & Allen, N. B. (2008) · Schizophrenia Research · doi:10.1016/j.schres.2007.11.011 · Cited by 134
Lindenmayer, J.-P., McGurk, S. R., Khan, A., Kaushik, S., Thanju, A., Hoffman, L., Valdez, G., Wance, D., & Herrmann, E. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs120 · Cited by 134
Mazza, M., Lucci, G., Pacitti, F., Pino, M. C., Mariano, M., Casacchia, M., & Roncone, R. (2010) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2010.486284 · Cited by 127
Untangling Social Function and Social Cognition: A Review of Concepts and Measurement
Yager, J. A., & Ehmann, T. S. (2006) · Psychiatry: Interpersonal and Biological Processes · doi:10.1521/psyc.2006.69.1.47 · Cited by 117
Development of a measure of relationship perception in schizophrenia
Sergi, M. J., Fiske, A. P., Horan, W. P., Kern, R. S., Kee, K. S., Subotnik, K. L., Nuechterlein, K. H., & Green, M. F. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.03.010 · Cited by 104
Self-citationTraining of affect recognition (TAR) in schizophrenia—Impact on functional outcome
Sachs, G., Winklbaur, B., Jagsch, R., Lasser, I., Kryspin‐Exner, I., Frommann, N., & Wölwer, W. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.03.005 · Cited by 102
Taş, C., Danacı, A. E., Çubukçuoğlu, Z., & Brüne, M. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.07.031 · Cited by 101
Emotion-Discrimination Deficits in Mild Alzheimer Disease
Kohler, C. G., Anselmo-Gallagher, G., Bilker, W. B., Karlawish, J. H., Gur, R. E., & Clark, C. M. (2005) · American Journal of Geriatric Psychiatry · doi:10.1176/appi.ajgp.13.11.926 · Cited by 99
Nonverbal social perception and symptomatology in schizophrenia
Toomey, R., Schuldberg, D., Corrigan, P. W., & Green, M. F. (2002) · Schizophrenia Research · doi:10.1016/s0920-9964(01)00177-3 · Cited by 92
Self-citationLeifker, F. R., Patterson, T. L., Bowie, C. R., Mausbach, B. T., & Harvey, P. D. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.03.021 · Cited by 81
Self-citationVaskinn, A., Sundet, K. S., Friis, S., Simonsen, C., Birkenaes, A. B., Jónsdóttir, H., Ringen, P. A., & Andreassen, O. A. (2008) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617708080314 · Cited by 74
Penn, D. L., Addington, J., & Pinkham, A. E. (2006) · Cited by 67
Self-citationAakre, J. M., Seghers, J. P., St-Hilaire, A., & Docherty, N. M. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn033 · Cited by 59
The Interpersonal Perception Task (IPT-15)
Archer, D., & Costanzo, M. A. (1993) · PsycEXTRA Dataset · doi:10.1037/e546732004-001 · Cited by 38
Factor structure of emotional intelligence in schizophrenia
Lin, Y.-C., Wynn, J. K., Hellemann, G., & Green, M. F. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.04.013 · Cited by 15
Self-citationInternal, Personal, and Situational Attributions Questionnaire
Kinderman, P., & Bentall, R. P. (1996) · PsycTESTS Dataset · doi:10.1037/t64178-000 · Cited by 9
Cited by
Virtual Reality Job Interview Training in Adults with Autism Spectrum Disorder
Smith, M. J., Ginger, E. J., Wright, K., Wright, M. A., Taylor, J. L., Humm, L. B., Olsen, D. E., Bell, M. D., & Fleming, M. F. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2113-y · Cited by 401
Cognitive deficits in individuals with methamphetamine use disorder: A meta-analysis
Potvin, S., Pelletier, J., Grot, S., Hébert, C., Barr, A. M., & Lecomte, T. (2018) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.01.021 · Cited by 334
Engel, D., Woolley, A. W., Jing, L. X., Chabris, C. F., & Malone, T. W. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115212 · Cited by 309
Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study
Pinkham, A. E., Penn, D. L., Green, M. F., & Harvey, P. D. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv056 · Cited by 303
Self-citationSocial Cognition Psychometric Evaluation: Results of the Final Validation Study
Pinkham, A. E., Harvey, P. D., & Penn, D. L. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx117 · Cited by 290
Self-citation
Metadata
- Authors
- Pinkham, A. E., Penn, D. L., Green, M. F., Buck, B., Healey, K., & Harvey, P. D.
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-05-31
- Volume
- 40
- Issue
- 4
- Pages
- 813-823
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- OpenAlex
- W2150916403
- Cited by
- 504
- References
- 84
- FWCI
- 21.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.