Establishing construct validity evidence for regional measures of explicit and implicit racial bias.
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Large-scale data collection has enabled social scientists to examine psychological constructs at broad, regional levels. However, because constructs and their measures initially operationalized at the individual level may have qualitatively and quantitatively different properties at other levels of analysis, the validity of constructs must be established when they are operationalized at new levels. To this end, the current research presents evidence of construct validity for explicit and implicit racial bias at region levels. Following classic measurement theory, we examine the substantive, structural, and external evidence of construct validity for regional biases. We do so with responses from ∼2 million Black and White North Americans collected over 13 years. Though implicit measures typically demonstrate low retest reliability at the individual level, our analyses reveal conventionally acceptable levels of retest reliability at the highest levels of regional aggregation. Additionally, whereas previous meta-analyses find relatively low explicit-implicit correlations at the individual level, the present research uncovered strong explicit-implicit correlations at regional levels. The findings have implications for how we interpret measures of racial bias at regional levels. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A meta-analytic test of intergroup contact theory.
Pettigrew, T. F., & Tropp, L. R. (2006) · Journal of personality and social psychology · doi:10.1037/0022-3514.90.5.751 · Cited by 9,708
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
Liberals and conservatives rely on different sets of moral foundations.
Graham, J., Haidt, J., & Nosek, B. A. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015141 · Cited by 4,560
Reflective and Impulsive Determinants of Social Behavior
Strack, F., & Deutsch, R. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0803_1 · Cited by 3,984
Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015575 · Cited by 3,257
The psychology of social impact
Latané, B. (1981) · American Psychologist · doi:10.1037/0003-066x.36.4.343 · Cited by 2,864 · cited 1×
“For example, social impact theory (Latané, 1981) posits that local clustering of attitudes and beliefs can occur when individuals engage in repeated social interactions.”
BackgroundSears, D. O. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.3.515 · Cited by 2,119
Wilson, T. D., Lindsey, S., & Schooler, T. Y. (2000) · Psychological Review · doi:10.1037/0033-295x.107.1.101 · Cited by 2,112 · cited 1×
“This interpretation is consistent with some theoretical models of individual bias which postulate that biases are a result of associations learned over a lifetime, and fairly immutable to change (e.g., Baron & Banaji, 2006; Wilson et al., 2000).”
Result
Cited by
Implicit bias reflects systemic racism
Payne, B. K., & Hannay, J. W. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.08.001 · Cited by 188
Price, M. A., Weisz, J. R., McKetta, S., Hollinsaid, N. L., Lattanner, M. R., Reid, A. E., & Hatzenbuehler, M. L. (2022) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2021.07.808 · Cited by 115
Price, M. A., Hollinsaid, N. L., McKetta, S., Mellen, E. J., & Rakhilin, M. (2024) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-023-02482-4 · Cited by 81
“These analyses also represented steps in the external phase of construct validation [47, 48], as the outcomes are theoretically related to the structural transphobia measure.”
Cultural sexism moderates efficacy of psychotherapy: Results from a spatial meta-analysis.
Price, M. A., McKetta, S., Weisz, J. R., Ford, J. V., Lattanner, M. R., Skov, H., Wolock, E., & Hatzenbuehler, M. L. (2021) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000031 · Cited by 29
Gravelle, C. D., Brooks, P. J., & Sawyer, J. E. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.104746 · Cited by 2
Metadata
- Authors
- Hehman, E., Calanchini, J., Flake, J. K., & Leitner, J. B.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2019-06
- Volume
- 148
- Issue
- 6
- Pages
- 1022-1040
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2949820313
- Cited by
- 135
- References
- 22
- FWCI
- 35.34
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Establishing construct validity evidence for regional measures of explicit and implicit racial bias. https://app.cochat.ai/papers/10.1037/xge0000623
- The paper
- Hehman, E., Calanchini, J., Flake, J. K., & Leitner, J. B. (2019). Establishing construct validity evidence for regional measures of explicit and implicit racial bias. Journal of Experimental Psychology: General. https://doi.org/10.1037/xge0000623
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.