Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Measurement of social cognition in treatment trials remains problematic due to poor and limited psychometric data for many tasks. As part of the Social Cognition Psychometric Evaluation (SCOPE) study, the psychometric properties of 8 tasks were assessed. One hundred and seventy-nine stable outpatients with schizophrenia and 104 healthy controls completed the battery at baseline and a 2-4-week retest period at 2 sites. Tasks included the Ambiguous Intentions Hostility Questionnaire (AIHQ), Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Relationships Across Domains (RAD), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, and Trustworthiness Task. Tasks were evaluated on: (i) test-retest reliability, (ii) utility as a repeated measure, (iii) relationship to functional outcome, (iv) practicality and tolerability, (v) sensitivity to group differences, and (vi) internal consistency. The BLERT and Hinting task showed the strongest psychometric properties across all evaluation criteria and are recommended for use in clinical trials. The ER-40, Eyes Task, and TASIT showed somewhat weaker psychometric properties and require further study. The AIHQ, RAD, and Trustworthiness Task showed poorer psychometric properties that suggest caution for their use in clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
(1998) · PubMed · Cited by 10,216
Baron‐Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00715 · Cited by 4,555
Baron‐Cohen, S., Wheelwright, S. J., Hill, J., Raste, Y., & Plumb, I. (2001) · PubMed · Cited by 4,313
The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity
Nuechterlein, K. H., Green, M. F., Kern, R. S., Baade, L. E., Barch, D. M., Cohen, J. D., Essock, S., Fenton, W. S., Frese, F. J., Gold, J. M., et al. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07010042 · Cited by 2,342
Self-citationFett, A.-K. J., Viechtbauer, W., Dominguez, M.-D.-G., Penn, D. L., van Os, J., & Krabbendam, L. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.07.001 · Cited by 1,833
Self-citationCorcoran, R., Mercer, G., & Frith, C. D. (1995) · Schizophrenia Research · doi:10.1016/0920-9964(95)00024-g · Cited by 1,340
The Functional Significance of Social Cognition in Schizophrenia: A Review
Couture, S. M. (2006) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl029 · Cited by 1,276
The human amygdala in social judgment
Adolphs, R., Tranel, D., & Damasio, A. R. (1998) · Nature · doi:10.1038/30982 · Cited by 1,125
Green, M. F., Nuechterlein, K. H., Gold, J. M., Barch, D. M., Cohen, J., Essock, S., Fenton, W. S., Frese, F., Goldberg, T. E., Heaton, R. K., et al. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.06.023 · Cited by 919
Self-citationThe Human Amygdala in Social Judgment
Adolphs, R., Tranel, D., & Damasio, A. R. (2002) · Foundations in Social Neuroscience · doi:10.7551/mitpress/3077.003.0027 · Cited by 875
Facial Emotion Recognition in Schizophrenia: Intensity Effects and Error Pattern
Kohler, C. G., Turner, T. H., Bilker, W. B., Brensinger, C. M., Siegel, S. J., Kanes, S. J., Gur, R. E., & Gur, R. C. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.10.1768 · Cited by 781
Mcdonald (2003) · doi:10.1097/00001199-200305000-00001 · Cited by 657
Cognitive Impairments in Patients With Schizophrenia Displaying Preserved and Compromised Intellect
Weickert, T. W., Goldberg, T. E., Gold, J. M., Bigelow, L. B., Egan, M. F., & Weinberger, D. R. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.9.907 · Cited by 538
The Social Cognition Psychometric Evaluation Study: Results of the Expert Survey and RAND Panel
Pinkham, A. E., Penn, D. L., Green, M. F., Buck, B., Healey, K., & Harvey, P. D. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt081 · Cited by 504
Self-citationBaseline Neurocognitive Deficits in the CATIE Schizophrenia Trial
Keefe, R. S. E., Bilder, R. M., Harvey, P. D., Davis, S. M., Palmer, B. W., Gold, J. M., Meltzer, H. Y., Green, M. F., Miller, D. D., Canive, J. M., et al. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301072 · Cited by 472
Self-citationSocial cognitive training for schizophrenia: a meta-analytic investigation of controlled research
Kurtz, M. M., & Richardson, C. L. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr036 · Cited by 446
SLOF: a behavioral rating scale for assessing the mentally ill
Schneider, L. C., & Struening, E. L. (1983) · Social Work Research and Abstracts · doi:10.1093/swra/19.3.9 · Cited by 425
Development of a Brief Scale of Everyday Functioning in Persons with Serious Mental Illness
Mausbach, B. T., Harvey, P. D., Goldman, S. R., Jeste, D. V., & Patterson, T. L. (2006) · Schizophrenia Bulletin · doi:10.1093/schbul/sbm014 · Cited by 379
Self-citationNeural bases for impaired social cognition in schizophrenia and autism spectrum disorders
Pinkham, A. E., Hopfinger, J. B., Pelphrey, K. A., Piven, J., & Penn, D. L. (2008) · Schizophrenia Research · doi:10.1016/j.schres.2007.10.024 · Cited by 375
Self-citationCombs, D. R., Penn, D. L., Wicher, M., & Waldheter, E. (2007) · Cognitive Neuropsychiatry · doi:10.1080/13546800600787854 · Cited by 360
Self-citationSocial skills performance assessment among older patients with schizophrenia
Patterson, T. L., Moscona, S., McKibbin, C. L., Davidson, K., & Jeste, D. V. (2001) · Schizophrenia Research · doi:10.1016/s0920-9964(00)00109-2 · Cited by 341
Affect recognition in schizophrenia: a function of global impairment or a specific cognitive deficit
Bryson, G., Bell, M., & Lysaker, P. (1997) · Psychiatry Research · doi:10.1016/s0165-1781(97)00050-4 · Cited by 308
Couture, S. M., Penn, D. L., Losh, M., Adolphs, R., Hurley, R., & Piven, J. (2010) · Psychological Medicine · doi:10.1017/s003329170999078x · Cited by 231
Self-citationDSM-5: How Reliable Is Reliable Enough?
Kraemer, H. C., Kupfer, D. J., Clarke, D. E., Narrow, W. E., & Regier, D. A. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11010050 · Cited by 180
Buchanan, R. W., Keefe, R. S. E., Umbricht, D., Green, M. F., Laughren, T., & Marder, S. R. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbq038 · Cited by 154
Self-citationAssessing everyday functioning in schizophrenia: Not all informants seem equally informative
Sabbag, S., Twamley, E. M., Vella, L., Heaton, R. K., Patterson, T. L., & Harvey, P. D. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2011.05.003 · Cited by 154
Self-citationRoberts, D. L., Combs, D. R., Willoughby, M., Mintz, J., Gibson, C., Rupp, B., & Penn, D. L. (2014) · British Journal of Clinical Psychology · doi:10.1111/bjc.12044 · Cited by 141
Self-citationLindenmayer, J.-P., McGurk, S. R., Khan, A., Kaushik, S., Thanju, A., Hoffman, L., Valdez, G., Wance, D., & Herrmann, E. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs120 · Cited by 134
Positive and Negative Syndrome Scale
Kay, S. R., Opler, L. A., & Fiszbein, A. (2012) · PsycTESTS Dataset · doi:10.1037/t05056-000 · Cited by 130
The eyes test as a measure of individual differences: how much of the variance reflects verbal IQ?
Peterson, E., & Miller, S. F. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00220 · Cited by 129
Development of a measure of relationship perception in schizophrenia
Sergi, M. J., Fiske, A. P., Horan, W. P., Kern, R. S., Kee, K. S., Subotnik, K. L., Nuechterlein, K. H., & Green, M. F. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.03.010 · Cited by 104
Self-citationKern, R. S., Penn, D. L., Lee, J., Horan, W. P., Reise, S. P., Ochsner, K. N., Marder, S. R., & Green, M. F. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt127 · Cited by 95
Self-citationOlbert, C. M., Penn, D. L., Kern, R. S., Lee, J., Horan, W. P., Reise, S. P., Ochsner, K. N., Marder, S. R., & Green, M. F. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt130 · Cited by 56
Self-citationHarris, S. T., Oakley, Ç., & Picchioni, M. (2014) · Aggression and Violent Behavior · doi:10.1016/j.avb.2014.04.009 · Cited by 40
Going From Social Neuroscience to Schizophrenia Clinical Trials
Green, M. F., & Penn, D. L. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt128 · Cited by 8
Self-citationToward Sound Objective Evaluation of Clinical Measures
KRAEMER, H. C. (2013) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2013.03.011 · Cited by 6
Research works printed but not linked: 4
- First MB Spitzer RL Gibbon M Williams JBW. Structured Clinical Interview for DSM-IV-TR Axis I disorders, research version, patient edition with psychotic screen (SCID-I/P W/PSY SCREEN). New York, NY: Biometrics Research, New York State Psychiatric Institute; 2002.
- 10.1017/S0021963001006643 · doi:10.1017/s0021963001006643 · Paper page
- Nunnally JC. Psychometric Theory. New York, NY: McGraw-Hill; 1967.
- Roberts DL Pinkham AE . The future of social cognition in schizophrenia: Implications for the normative literature. In: Roberts DL Penn DL , eds. Social Cognition in Schizophrenia. New York, NY: Oxford University Press; 2013:401–414. · doi:10.1093/med:psych/9780199777587.003.0018
Cited by
Cotter, J., Granger, K., Backx, R., Hobbs, M., Looi, C. Y., & Barnett, J. H. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.014 · Cited by 369
“An important limitation in this area is the poor or unknown psychometric properties of many social cognitive tests, though efforts are currently underway to establish how these measures compare (Pinkham et al., 2016).”
Social Cognition Psychometric Evaluation: Results of the Final Validation Study
Pinkham, A. E., Harvey, P. D., & Penn, D. L. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx117 · Cited by 290
Self-citationHalverson, T. F., Orleans-Pobee, M., Merritt, C., Sheeran, P., Fett, A.-K., & Penn, D. L. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.020 · Cited by 287
Self-citationMaj, M., van Os, J., De Hert, M., Gaebel, W., Galderisi, S., Green, M. F., Guloksuz, S., Harvey, P. D., Jones, P. B., Malaspina, D., et al. (2021) · World Psychiatry · doi:10.1002/wps.20809 · Cited by 285
Self-citationFiction reading has a small positive impact on social cognition: A meta-analysis.
Dodell-Feder, D., & Tamir, D. I. (2018) · Journal of Experimental Psychology: General · doi:10.1037/xge0000395 · Cited by 223
Metadata
- Authors
- Pinkham, A. E., Penn, D. L., Green, M. F., & Harvey, P. D.
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-05-04
- Volume
- 42
- Issue
- 2
- Pages
- 494-504
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- OpenAlex
- W2264776797
- Cited by
- 303
- References
- 38
- FWCI
- 19.54
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.