Using Brain Imaging Measures in Studies of Procognitive Pharmacologic Agents in Schizophrenia: Psychometric and Quality Assurance Considerations
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The first phase of the CNTRICs initiative focused on the identification of cognitive constructs from human and animal neuroscience that were relevant to understanding cognitive deficits in schizophrenia, as well as promising task paradigms that could be used to assess these constructs behaviorally. The current phase of CNTRICs has the goal of expanding this initial work by including measures of brain function that can augment these behavioral tasks as biomarkers to be used in the drug development processing. Here we review many of the psychometric issues that need to be addressed in regards to the development and inclusion of such methods in the drug development process. In addition, we review quality assurance concerns, issues associated with multi-center trials, concerns associated with potential pharmacological confounds on imaging measures, as well as power and analysis considerations. Although review is couched in the context of the use of biomarkers for treatment studies in schizophrenia, we believe the issues and suggestions included are relevant to the entire range of neuropsychiatric disorders as well as to a wide range of imaging modalities (i.e., fMRI, PET, ERP, EEG, TMS, NIR, etc.), and are relevant to both pharmacological and psychological intervention approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Type I and Type II error concerns in fMRI research: re-balancing the scale
Lieberman, M. D., & Cunningham, W. A. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp052 · Cited by 1,342
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737
Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716
Measuring fMRI reliability with the intra-class correlation coefficient
Caceres, A., Hall, D. L., Zelaya, F. O., Williams, S. C. R., & Mehta, M. A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.035 · Cited by 255
Mumford, J. A., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.061 · Cited by 252
Cited by
Building a Science of Individual Differences from fMRI
Dubois, J., & Adolphs, R. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.014 · Cited by 628
Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias.
Rodebaugh, T. L., Scullin, R. B., Langer, J. K., Dixon, D. J., Huppert, J. D., Bernstein, A., Zvielli, A., & Lenze, E. J. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000184 · Cited by 312
“…one might hope that moving directly to neuroimaging tasks might side-step reliability issues in behavioral tasks, but, instead, imaging experts assert that reliability is just as essential to the validity of imaging task data as any other measure (Barch & Mathalon, 2011; Barch & Yarkoni, 2013).”
BackgroundTest-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery.
Plichta, M. M., Schwarz, A. J., Grimm, O., Morgen, K., Mier, D., Haddad, L., Gerdes, A. B. M., Sauer, C., Tost, H., Esslinger, C., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.129 · Cited by 287
Reliability and plasticity of response inhibition and interference control
Wöstmann, N. M., Aichert, D. S., Costa, A., Rubia, K., Möller, H.-J., & Ettinger, U. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2012.09.010 · Cited by 217
Aligning physiology with psychology: Translational neuroscience in neuropsychiatric drug discovery
McArthur, R. A. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.004 · Cited by 42
Metadata
- Authors
- Barch, D. M., & Mathalon, D. H.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2011-07
- Volume
- 70
- Issue
- 1
- Pages
- 13-18
- ISSN
- 0006-3223 (ISSN-L)
- OpenAlex
- W2070005519
- Cited by
- 41
- References
- 6
- FWCI
- 4.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Brain Imaging Measures in Studies of Procognitive Pharmacologic Agents in Schizophrenia: Psychometric and Quality Assurance Considerations. https://app.cochat.ai/papers/10.1016/j.biopsych.2011.01.004
- The paper
- Barch, D. M., & Mathalon, D. H. (2011). Using Brain Imaging Measures in Studies of Procognitive Pharmacologic Agents in Schizophrenia: Psychometric and Quality Assurance Considerations. Biological Psychiatry. https://doi.org/10.1016/j.biopsych.2011.01.004
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.