The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Asking People to Explain Complex Policies Does Not Increase Political Moderation: Three Preregistered Failures to Closely Replicate Fernbach, Rogers, Fox, and Sloman’s (2013) Findings
Abstract
Fernbach et al. (2013) found that political extremism and partisan in-group favoritism can be reduced by asking people to provide mechanistic explanations for complex policies, thus making their lack of procedural-policy knowledge salient. Given the practical importance of these findings, we conducted two preregistered close replications of Fernbach et al.’s Experiment 2 (Replication 1a: N = 306; Replication 1b: N = 405) and preregistered close and conceptual replications of Fernbach et al.’s Experiment 3 (Replication 2: N = 343). None of the key effects were statistically significant, and only one survived a small-telescopes analysis. Although participants reported less policy understanding after providing mechanistic policy explanations, policy-position extremity and in-group favoritism were unaffected. That said, well-established findings that providing justifications for prior beliefs strengthens those beliefs, and well-established findings of in-group favoritism, were replicated. These findings suggest that providing mechanistic explanations increases people’s recognition of their ignorance but is unlikely to increase their political moderation, at least under these conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · cited 1×
“People generally possess low political knowledge (Carpini & Keeter, 1996) and often lack insight into their own ignorance (Kruger & Dunning, 1999).”
Iyengar, S., Sood, G., & Lelkes, Y. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs038 · Cited by 2,996 · cited 4×
“Americans are increasingly politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center,…”
BackgroundInfluentialWhat Americans know about politics and why it matters
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0582 · Cited by 2,050
Uncivil Agreement: How Politics Became Our Identity
Mason, L. (2018) · doi:10.7208/chicago/9780226524689.001.0001 · Cited by 1,985
Exposure to opposing views on social media can increase political polarization
Bail, C. A., Argyle, L. P., Brown, T. W., Bumpus, J. P., Chen, H., Hunzaker, M. B. F., Lee, J., Mann, M., Merhout, F., & Volfovsky, A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804840115 · Cited by 1,863 · cited 1×
“Unfortunately, some efforts to decrease polarization have even been counterproductive (e.g., exposure to counterattitudinal information on social media; Bail et al., 2018).”
BackgroundDemocracy for Realists: Why Elections Do Not Produce Responsive Government
Achen, C. H., & Bartels, L. M. (2016) · Princeton University Press eBooks · doi:10.1515/9781400882731 · Cited by 1,729
The Partisan Sort: How Liberals Became Democrats and Conservatives Became Republicans
Levendusky, M. (2009) · doi:10.7208/chicago/9780226473673.001.0001 · Cited by 1,698
The rise of negative partisanship and the nationalization of U.S. elections in the 21st century
Abramowitz, A. I., & Webster, S. (2016) · Electoral Studies · doi:10.1016/j.electstud.2015.11.001 · Cited by 978 · cited 2×
“…politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center, 2018).”
BackgroundSmall Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
The demographic and political composition of Mechanical Turk samples
Levay, K. E., Freese, J., & Druckman, J. N. (2016) · Sage Open · doi:10.1177/2158244016636433 · Cited by 676 · cited 1×
“That said, the political composition of Experiment 3 is unknown, and the estimates provided in the original and replication experiments do not deviate much from estimates from MTurk and nationally representative samples (Levay et al., 2016).”
Background
Research works printed but not linked: 4
- Pew Research Center. (2017). The shift in the American public’s political values: Political polarization, 1994-2017. http://www.people-press.org/interactives/political-polarization-1994-2017/
- Pew Research Center. (2018). Little partisan agreement on the pressing problems facing the U.S. http://www.people-press.org/2018/10/15/little-partisan-agreement-on-the-pressing-problems-facing-the-u-s/
- 10.1037/0022-3514.35.11.817 · doi:10.1037/0022-3514.35.11.817 · Paper page
- Tesser A., 1995, Attitude strength: Antecedents and consequences, 73
Cited by
Predictors and consequences of intellectual humility
Porter, T., Elnakouri, A., Meyers, E. A., Shibayama, T., Jayawickreme, E., & Grossmann, I. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00081-9 · Cited by 248
Interventions to reduce partisan animosity
Hartman, R., Blakey, W., Womick, J., Bail, C., Finkel, E. J., Han, H., Sarrouf, J., Schroeder, J., Sheeran, P., Van Bavel, J. J., et al. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01442-3 · Cited by 171
Fonseca, C., Pettitt, J., Woollard, A. C. S., Rutherford, A. D., Bickmore, W. A., Ferguson‐Smith, A. C., & Hurst, L. D. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3001915 · Cited by 30
“The claim [33] that this can lead to moderation of position could not, however, be replicated [34], although other evidence suggests that people are more likely to change their attitudes when their confidence in their knowledge underpinning the attitude is reduced [12].”
BackgroundResultLevy, N. L. (2023) · Philosophical Studies · doi:10.1007/s11098-023-02031-4 · Cited by 19
“Why, then, did Crawford and Ruscio (2021) fail to decrease support for the very same policies selected by Fernbach et al. (2013)?”
BackgroundResultIs political extremism supported by an illusion of understanding?
Sloman, S. A., & Vives, M. (2022) · Cognition · doi:10.1016/j.cognition.2022.105146 · Cited by 25
Sloman, S. A. (2021) · Topics in Cognitive Science · doi:10.1111/tops.12580 · Cited by 13
Testing the Magnitude of Correlations Across Experimental Conditions
Plinio, S. D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.860213 · Cited by 18
On the Statistical Analysis of Studies With Attention Checks
Mathur, M. B. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251338041 · Cited by 14
“In the political-polarization experiments, some participants assigned to explain policies might have provided responses that were irrelevant or plagiarized, as was the case in a replication study (Crawford, 2020; Crawford & Ruscio, 2021).”
Meyers, E. A., Gretton, J. D., Budge, J. R. C., Fugelsang, J. A., & Koehler, D. J. (2023) · Judgment and Decision Making · doi:10.1017/jdm.2023.24 · Cited by 10
“…with the illusion failing to apply to all domains of knowledge (Mills & Keil, 2004; Rozenblit & Keil, 2002) as well as the usually null effects produced by various control conditions previously (Crawford & Ruscio, 2021; Fernbach et al., 2013; Kleinberg & Marsh, 2020; Zeveney & Marsh, 2016).”
Conservation, uncertainty and intellectual humility
Michaels, S., Auld, G. A., Cooke, S. J., Young, N., Bennett, J., & Vermaire, J. C. (2023) · Environmental Conservation · doi:10.1017/s0376892923000176 · Cited by 6
“This main finding has been replicated by Crawford and Ruscio (2021).”
BackgroundMeyer, M., Enders, A. M., Klofstad, C., Stoler, J. B., & Uscinski, J. E. (2024) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-164 · Cited by 10
Explaining contentious political issues promotes open-minded thinking
Elnakouri, A., Huynh, A. C., & Grossmann, I. (2024) · Cognition · doi:10.1016/j.cognition.2024.105769 · Cited by 9
Walker, R. M., Jia-sheng, Z., & Cheng, E. W. (2023) · Political Psychology · doi:10.1111/pops.12938 · Cited by 7
DeVries, J. M., Orona, G. A., & Arum, R. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2571223 · Cited by 6
“Meanwhile, interventions focusing on increasing understanding of topical issues have not been shown to reduce extreme views (Fernbach et al. 2013; Crawford and Ruscio 2021).”
Knöchelmann, L., Janßen, A., Dörbaum, J., Heck, D. W., & Cohrs, J. C. (2025) · European Journal of Social Psychology · doi:10.1002/ejsp.3177 · Cited by 2
On holding specific beliefs, opinions, and assumptions with humility
Hoyle, R. H., & Davisson, E. K. (2026) · Advances in experimental social psychology · doi:10.1016/bs.aesp.2026.03.005 · Cited by 2
People underestimate how receptive other people are to different political opinions
Mata, A., Nilsson, T., Erlandsson, A., & Ferreira, R. (2026) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2026.104942 · Cited by 2
Arifin, H. H., Milla, M. N., Muluk, H., Lamuri, A., Narindra, S. K., Wulandari, R., Pambudi, L. T., & Nurmala, S. (2024) · International Conference on ICT for Smart Society (ICISS) · doi:10.1109/iciss62896.2024.10751182 · Cited by 1
On the statistical analysis of studies with attention checksPreprint
Mathur, M. B. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/r9vdp · Cited by 1
Open-Mindedness Interventions: An Integrative ReviewPreprint
Lieberman, M. D., Dieffenbach, M. C., & Dolbier, S. Y. (2023) · doi:10.31234/osf.io/rg46s
Metadata
- Authors
- Crawford, J. T., & Ruscio, J.
- Affiliations
- The College of New Jersey (US)
- Corresponding author
- Crawford, Jarret T.
- ORCID
- Crawford, Jarret T.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-03-05
- Volume
- 32
- Issue
- 4
- Pages
- 611-621
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W3133829275
- Cited by
- 20
- References
- 20
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 6 · 2022: 4 · 2021: 1
- FWCI
- 5.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- political moderation, political extremism, in-group favoritism, policy explanation, mechanistic explanation, policy understanding, epistemic justification, replication failure
- MeSH terms
- Humans, Politics, Knowledge, Comprehension, Policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.