The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Asking People to Explain Complex Policies Does Not Increase Political Moderation: Three Preregistered Failures to Closely Replicate Fernbach, Rogers, Fox, and Sloman’s (2013) Findings
Abstract
Fernbach et al. (2013) found that political extremism and partisan in-group favoritism can be reduced by asking people to provide mechanistic explanations for complex policies, thus making their lack of procedural-policy knowledge salient. Given the practical importance of these findings, we conducted two preregistered close replications of Fernbach et al.’s Experiment 2 (Replication 1a: N = 306; Replication 1b: N = 405) and preregistered close and conceptual replications of Fernbach et al.’s Experiment 3 (Replication 2: N = 343). None of the key effects were statistically significant, and only one survived a small-telescopes analysis. Although participants reported less policy understanding after providing mechanistic policy explanations, policy-position extremity and in-group favoritism were unaffected. That said, well-established findings that providing justifications for prior beliefs strengthens those beliefs, and well-established findings of in-group favoritism, were replicated. These findings suggest that providing mechanistic explanations increases people’s recognition of their ignorance but is unlikely to increase their political moderation, at least under these conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · cited 1×
“People generally possess low political knowledge (Carpini & Keeter, 1996) and often lack insight into their own ignorance (Kruger & Dunning, 1999).”
Iyengar, S., Sood, G., & Lelkes, Y. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs038 · Cited by 2,996 · cited 4×
“Americans are increasingly politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center,…”
BackgroundInfluentialWhat Americans know about politics and why it matters
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0582 · Cited by 2,050
Uncivil Agreement: How Politics Became Our Identity
Mason, L. (2018) · doi:10.7208/chicago/9780226524689.001.0001 · Cited by 1,985
Exposure to opposing views on social media can increase political polarization
Bail, C. A., Argyle, L. P., Brown, T. W., Bumpus, J. P., Chen, H., Hunzaker, M. B. F., Lee, J., Mann, M., Merhout, F., & Volfovsky, A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804840115 · Cited by 1,863 · cited 1×
“Unfortunately, some efforts to decrease polarization have even been counterproductive (e.g., exposure to counterattitudinal information on social media; Bail et al., 2018).”
BackgroundDemocracy for Realists: Why Elections Do Not Produce Responsive Government
Achen, C. H., & Bartels, L. M. (2016) · Princeton University Press eBooks · doi:10.1515/9781400882731 · Cited by 1,729
The Partisan Sort: How Liberals Became Democrats and Conservatives Became Republicans
Levendusky, M. (2009) · doi:10.7208/chicago/9780226473673.001.0001 · Cited by 1,698
The rise of negative partisanship and the nationalization of U.S. elections in the 21st century
Abramowitz, A. I., & Webster, S. (2016) · Electoral Studies · doi:10.1016/j.electstud.2015.11.001 · Cited by 978 · cited 2×
“…politically polarized (Iyengar et al., 2012; Pew Research Center, 2017), are more motivated by negative views of the opposing party than positive views of their own (Abramowitz & Webster, 2016), and cannot agree on which issues facing the country are the most important (Pew Research Center, 2018).”
BackgroundSmall Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
The demographic and political composition of Mechanical Turk samples
Levay, K. E., Freese, J., & Druckman, J. N. (2016) · Sage Open · doi:10.1177/2158244016636433 · Cited by 676 · cited 1×
“That said, the political composition of Experiment 3 is unknown, and the estimates provided in the original and replication experiments do not deviate much from estimates from MTurk and nationally representative samples (Levay et al., 2016).”
BackgroundNelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548 · cited 1×
“It is therefore prudent to determine their repli-cability, especially in light of wider replicability concerns (Nelson et al., 2018) and low post hoc power estimates for the effect of mechanistic explanations on reducing extremity in the original article (.28 and .61 for Experiments 2 and 3,…”
BackgroundContextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398 · cited 1×
“That said, given that contextual sensitivity is associated with lower rep-licability rates (Van Bavel et al., 2016), we cannot rule out the possibility that changing social contexts may partly explain these replication failures.”
BackgroundPolitical Extremism Is Supported by an Illusion of Understanding
Fernbach, P. M., Rogers, T., Fox, C. R., & Sloman, S. A. (2013) · Psychological Science · doi:10.1177/0956797612464058 · Cited by 396 · cited 2×
“Recognizing this, Fernbach et al. (2013) reasoned that confronting people with their lack of procedural-policy knowledge would increase political moderation and decrease partisan out-group bias.”
BackgroundMethodWhen the People Speak: Deliberative Democracy and Public Consultation
Fishkin, J. S. (2011) · doi:10.1093/acprof:osobl/9780199604432.001.0001 · Cited by 368
Ross, L. D., Lepper, M. R., Strack, F., & Steinmetz, J. (1977) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.35.11.817 · Cited by 319 · cited 2×
“Whereas this finding is inconsistent with Fernbach et al.’s data, it is consistent with other research demonstrating that extremism increases following opportunities to justify one’s prior beliefs (Ross et al., 1977; Tesser et al., 1995).”
ResultMeasuring Prejudice, Stereotypes and Discrimination
Correll, J., Judd, C. M., Park, B., & Wittenbrink, B. (2010) · SAGE Publications Ltd eBooks · doi:10.4135/9781446200919.n3 · Cited by 114 · cited 1×
“4 Feeling-thermometer and social-distance ratings are the two most common measures of prejudice (Correll et al., 2010).”
BackgroundStudying a Heterogeneous Array of Target Groups Can Help Us Understand Prejudice
Brandt, M. J., & Crawford, J. T. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721419830382 · Cited by 66 · cited 2×
“People donated to and expressed more positive attitudes toward like-minded over opposite-minded groups, consistent with evidence of partisan animosity (Brandt & Crawford, 2019).”
BackgroundSelf-citationPennycook, G., McPhetres, J., Bagó, B., & Rand, D. (2020) · doi:10.31234/osf.io/zhjkp · Cited by 47 · cited 1×
“The original and replication experiments were conducted in the United States, but political polarization is not strictly an American phenomenon (Pennycook et al., 2021).”
BackgroundReflecting on explanatory ability: A mechanism for detecting gaps in causal knowledge.
Johnson, D. R., Murphy, M. P., & Messer, R. M. (2016) · Journal of Experimental Psychology: General · doi:10.1037/xge0000161 · Cited by 30 · cited 1×
“In another sample ( n = 224), Johnson et al. (2016) reported effects of explanatory ability on understanding ( d = 0.52) and extremity ( d = 0.33), albeit with a very different manipulation than that used in the original experiments by Fernbach et al. We therefore conducted two close replications…”
MethodInfluentialVoelkel, J. G., Brandt, M. J., & Colombo, M. (2018) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2018.1464881 · Cited by 30 · cited 1×
“In one sample ( n = 296), Voelkel et al. (2018, supplemental materials, p. 8) replicated the effect of mechanistic explanations on understanding ( b = − 0.38, p < .001) but not on policy extremity ( b = 0.04, p = .675); however, because there were intervening materials between the independent and…”
BackgroundInfluential
Research works printed but not linked: 4
- Pew Research Center. (2017). The shift in the American public’s political values: Political polarization, 1994-2017. http://www.people-press.org/interactives/political-polarization-1994-2017/
- Pew Research Center. (2018). Little partisan agreement on the pressing problems facing the U.S. http://www.people-press.org/2018/10/15/little-partisan-agreement-on-the-pressing-problems-facing-the-u-s/
- 10.1037/0022-3514.35.11.817 · doi:10.1037/0022-3514.35.11.817 · Paper page
- Tesser A., 1995, Attitude strength: Antecedents and consequences, 73
Cited by
Predictors and consequences of intellectual humility
Porter, T., Elnakouri, A., Meyers, E. A., Shibayama, T., Jayawickreme, E., & Grossmann, I. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00081-9 · Cited by 248
Interventions to reduce partisan animosity
Hartman, R., Blakey, W., Womick, J., Bail, C., Finkel, E. J., Han, H., Sarrouf, J., Schroeder, J., Sheeran, P., Van Bavel, J. J., et al. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01442-3 · Cited by 171
Fonseca, C., Pettitt, J., Woollard, A. C. S., Rutherford, A. D., Bickmore, W. A., Ferguson‐Smith, A. C., & Hurst, L. D. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3001915 · Cited by 30
“The claim [33] that this can lead to moderation of position could not, however, be replicated [34], although other evidence suggests that people are more likely to change their attitudes when their confidence in their knowledge underpinning the attitude is reduced [12].”
BackgroundResultLevy, N. L. (2023) · Philosophical Studies · doi:10.1007/s11098-023-02031-4 · Cited by 19
“Why, then, did Crawford and Ruscio (2021) fail to decrease support for the very same policies selected by Fernbach et al. (2013)?”
BackgroundResultIs political extremism supported by an illusion of understanding?
Sloman, S. A., & Vives, M. (2022) · Cognition · doi:10.1016/j.cognition.2022.105146 · Cited by 25
Metadata
- Authors
- Crawford, J. T., & Ruscio, J.
- Affiliations
- The College of New Jersey (US)
- Corresponding author
- Crawford, Jarret T.
- ORCID
- Crawford, Jarret T.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-03-05
- Volume
- 32
- Issue
- 4
- Pages
- 611-621
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W3133829275
- Cited by
- 20
- References
- 20
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 6 · 2022: 4 · 2021: 1
- FWCI
- 5.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- political moderation, political extremism, in-group favoritism, policy explanation, mechanistic explanation, policy understanding, epistemic justification, replication failure
- MeSH terms
- Humans, Politics, Knowledge, Comprehension, Policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.