Asking People to Explain Complex Policies Does Not Increase Political Moderation: Three Preregistered Failures to Closely Replicate Fernbach, Rogers, Fox, and Sloman’s (2013) Findings
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Fernbach et al. (2013) found that political extremism and partisan in-group favoritism can be reduced by asking people to provide mechanistic explanations for complex policies, thus making their lack of procedural-policy knowledge salient. Given the practical importance of these findings, we conducted two preregistered close replications of Fernbach et al.’s Experiment 2 (Replication 1a: N = 306; Replication 1b: N = 405) and preregistered close and conceptual replications of Fernbach et al.’s Experiment 3 (Replication 2: N = 343). None of the key effects were statistically significant, and only one survived a small-telescopes analysis. Although participants reported less policy understanding after providing mechanistic policy explanations, policy-position extremity and in-group favoritism were unaffected. That said, well-established findings that providing justifications for prior beliefs strengthens those beliefs, and well-established findings of in-group favoritism, were replicated. These findings suggest that providing mechanistic explanations increases people’s recognition of their ignorance but is unlikely to increase their political moderation, at least under these conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · cited 1×
“People generally possess low political knowledge (Carpini & Keeter, 1996) and often lack insight into their own ignorance (Kruger & Dunning, 1999).”
Iyengar, S., Sood, G., & Lelkes, Y. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs038 · Cited by 2,996 · cited 4×
“Americans are increasingly politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center,…”
BackgroundInfluentialWhat Americans know about politics and why it matters
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0582 · Cited by 2,050
Uncivil Agreement: How Politics Became Our Identity
Mason, L. (2018) · doi:10.7208/chicago/9780226524689.001.0001 · Cited by 1,985
Exposure to opposing views on social media can increase political polarization
Bail, C. A., Argyle, L. P., Brown, T. W., Bumpus, J. P., Chen, H., Hunzaker, M. B. F., Lee, J., Mann, M., Merhout, F., & Volfovsky, A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804840115 · Cited by 1,863 · cited 1×
“Unfortunately, some efforts to decrease polarization have even been counterproductive (e.g., exposure to counterattitudinal information on social media; Bail et al., 2018).”
BackgroundDemocracy for Realists: Why Elections Do Not Produce Responsive Government
Achen, C. H., & Bartels, L. M. (2016) · Princeton University Press eBooks · doi:10.1515/9781400882731 · Cited by 1,729
The Partisan Sort: How Liberals Became Democrats and Conservatives Became Republicans
Levendusky, M. (2009) · doi:10.7208/chicago/9780226473673.001.0001 · Cited by 1,698
The rise of negative partisanship and the nationalization of U.S. elections in the 21st century
Abramowitz, A. I., & Webster, S. (2016) · Electoral Studies · doi:10.1016/j.electstud.2015.11.001 · Cited by 978 · cited 2×
“…politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center, 2018).”
BackgroundSmall Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
The demographic and political composition of Mechanical Turk samples
Levay, K. E., Freese, J., & Druckman, J. N. (2016) · Sage Open · doi:10.1177/2158244016636433 · Cited by 676 · cited 1×
“That said, the political composition of Experiment 3 is unknown, and the estimates provided in the original and replication experiments do not deviate much from estimates from MTurk and nationally representative samples (Levay et al., 2016).”
Background
Research works printed but not linked: 4
- Pew Research Center. (2017). The shift in the American public’s political values: Political polarization, 1994-2017. http://www.people-press.org/interactives/political-polarization-1994-2017/
- Pew Research Center. (2018). Little partisan agreement on the pressing problems facing the U.S. http://www.people-press.org/2018/10/15/little-partisan-agreement-on-the-pressing-problems-facing-the-u-s/
- 10.1037/0022-3514.35.11.817 · doi:10.1037/0022-3514.35.11.817 · Paper page
- Tesser A., 1995, Attitude strength: Antecedents and consequences, 73
Cited by
Predictors and consequences of intellectual humility
Porter, T., Elnakouri, A., Meyers, E. A., Shibayama, T., Jayawickreme, E., & Grossmann, I. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00081-9 · Cited by 248
Interventions to reduce partisan animosity
Hartman, R., Blakey, W., Womick, J., Bail, C., Finkel, E. J., Han, H., Sarrouf, J., Schroeder, J., Sheeran, P., Van Bavel, J. J., et al. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01442-3 · Cited by 171
Fonseca, C., Pettitt, J., Woollard, A. C. S., Rutherford, A. D., Bickmore, W. A., Ferguson‐Smith, A. C., & Hurst, L. D. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3001915 · Cited by 30
“The claim [33] that this can lead to moderation of position could not, however, be replicated [34], although other evidence suggests that people are more likely to change their attitudes when their confidence in their knowledge underpinning the attitude is reduced [12].”
BackgroundResultLevy, N. L. (2023) · Philosophical Studies · doi:10.1007/s11098-023-02031-4 · Cited by 19
“Why, then, did Crawford and Ruscio (2021) fail to decrease support for the very same policies selected by Fernbach et al. (2013)?”
BackgroundResultIs political extremism supported by an illusion of understanding?
Sloman, S. A., & Vives, M. (2022) · Cognition · doi:10.1016/j.cognition.2022.105146 · Cited by 25
Metadata
- Authors
- Crawford, J. T., & Ruscio, J.
- Affiliations
- The College of New Jersey (US)
- Corresponding author
- Crawford, Jarret T.
- ORCID
- Crawford, Jarret T.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-03-05
- Volume
- 32
- Issue
- 4
- Pages
- 611-621
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W3133829275
- Cited by
- 20
- References
- 20
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 6 · 2022: 4 · 2021: 1
- FWCI
- 5.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- political moderation, political extremism, in-group favoritism, policy explanation, mechanistic explanation, policy understanding, epistemic justification, replication failure
- MeSH terms
- Humans, Politics, Knowledge, Comprehension, Policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Asking People to Explain Complex Policies Does Not Increase Political Moderation: Three Preregistered Failures to Closely Replicate Fernbach, Rogers, Fox, and Sloman’s (2013) Findings. https://app.cochat.ai/papers/10.1177/0956797620972367
- The paper
- Crawford, J. T., & Ruscio, J. (2021). Asking People to Explain Complex Policies Does Not Increase Political Moderation: Three Preregistered Failures to Closely Replicate Fernbach, Rogers, Fox, and Sloman’s (2013) Findings. Psychological Science. https://doi.org/10.1177/0956797620972367
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.