Factual knowledge can reduce attitude polarization
Open accessAbstract
It is commonly argued that factual knowledge about a political issue increases attitude polarization due to politically motivated reasoning. By this account, individuals ignore counter-attitudinal facts and direct their attention to pro-attitudinal facts; reject counter-attitudinal facts when directly confronted with them; and use pro-attitudinal facts to counterargue, all making them more polarized. The observation that more knowledgeable partisans are often more polarized is widely taken as support for this account. Yet these data are only correlational. Here, we directly test the causal effect of increasing issue-relevant knowledge on attitude polarization. Specifically, we randomize whether N = 1,011 participants receive a large, credible set of both pro- and counter-attitudinal facts on a contentious political issue – gun control – and provide a modest incentive for them to learn this information. We find evidence that people are willing to engage with and learn policy-relevant facts both for and against their initial attitudes; and that this increased factual knowledge shifts individuals towards more moderate policy attitudes, a durable effect that is still visible after one month. Our results suggest that the impact of directionally motivated reasoning on the processing of political information might be more limited than previously thought. Prominent theories suggest people use political facts to bolster their political attitudes, yet previous work relies on observational data. Here, the authors present experimental evidence that learning facts on a politically contentious topic can lead people to adopt more moderate policy attitudes.
AI snapshot
Written from the paper’s full text.
TL;DR
A pre-registered two-wave experiment randomized 1,011 US participants to learn a large, credible set of pro- and counter-attitudinal facts about gun control or a nonpolitical control topic. Increasing factual knowledge moved policy attitudes toward moderation, durably after one month, without reducing affective polarization.
Key findings
- Participants engaged with both pro- and counter-attitudinal facts: time spent on counter-attitudinal modules (M = 4.19, SD = 1.12) did not differ significantly from pro-attitudinal modules (M = 4.17, SD = 1.09), β = 0.008, p = 0.541; 82% rated counter-attitudinal modules and 86.5% rated pro-attitudinal modules as helpful or very helpful.
- The treatment increased gun-control knowledge: Wave 1 β = .402, p < .001, d = .878; Wave 2 β = .15, p < .001, d = .304. Pro-gun-control participants learned anti-gun-control facts more than pro-gun-control facts (β = −0.211, p < .001), while anti-gun-control participants learned pro-gun-control facts more, though not significantly (β = 0.103, p = 0.096).
- Factual knowledge shifted policy attitudes in the opposing direction from initial attitudes: gun-control attitudes significantly in Wave 2 (β = 0.093, p = 0.008) but not Wave 1 (p = 0.086); evidence-alignment significantly in Wave 1 (b = .437, p < 0.001) but not Wave 2 (p = 0.072); evidence-implies-policy significantly in Wave 1 (b = 0.346, p = 0.004) but not Wave 2 (p = .22). No significant Wave × treatment interactions were reported.
- The treatment had no significant effect on affective polarization in Wave 1 (β = −0.001, p = 0.985) or Wave 2 (β = −0.015, p = 0.651).
Methods
- Pre-registered two-wave experiment (Aspredicted #73660): N = 1,011 quota-matched US participants from Bovitz, Inc., randomized to gun-control training modules or a dog-training control; Wave 2 recontacted 881 participants (87% retention).
- Treatment exposed participants to neutral, pro-gun-control, and anti-gun-control facts in self-paced modules, with $0.10 per correct answer on an 11-item knowledge battery; outcomes included three policy-attitude measures recoded as movement opposing one’s initial gun-control attitude and a five-item social-distance affective polarization measure.
- Main analyses were intent-to-treat models without controls, two-tailed; robustness checks included controls, instrumental variables, alternative “folded” extremity coding, and ordinal logistic regressions for ordinal outcomes.
Limitations
- Paper-stated: participants were incentivized to learn, which may not reflect daily life; they could not choose which facts to see, whereas outside the lab people can avoid uncongenial political information; the study used one issue (gun control) and only US respondents.
- Paper-stated: mediation analyses testing learning as a mechanism were non-pre-registered and did not experimentally manipulate mediators, so they should be interpreted cautiously.
- Text-evident, not framed as a limitation by the authors: some attitudinal outcomes were statistically significant in only one wave, although the paper reports no significant Wave × treatment interactions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
8 of 19 cited sources checked · 6 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Prior work utilizes observational data to examine the relationship between domain-specific knowledge and attitude polarization.
“Despite the causal nature of the arguments described above, prior work utilizes observational data to examine the relationship between domain-specific knowledge and attitude polarization.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [16] Kahan, D. M. et al. The polarizing impact of science literacy and numeracy on perceived climate change risks. Nat. Clim. Change 2, 732–735 (2012). source
- cites [19] Drummond, C. & Fischhoff, B. Individuals with greater science literacy and education have more polarized beliefs on controversial science topics. Proc. Natl. Acad. Sci. USA 114, 9587–9592 (2017). source
- cites [17] Taber, C. S. & Lodge, M. Motivated skepticism in the evaluation of political beliefs. Am. J. Political Sci. 50, 755–769 (2006). source
- Premisecitation
Prior experiments on political information use thin informational treatments consisting of a single piece of information or one argument.
“However, these experiments use thin informational treatments consisting of a single piece of information. Researchers typically present to participants a single fact relevant to a topic (e.g., ref. 4) or one argument either supporting or opposing a policy proposal (e.g., ref. 23).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [4] van der Linden, S., Leiserowitz, A. & Maibach, E. Scientific agreement can neutralize politicization of facts. Nat. Hum. Behav. 2, 2–3 (2018). source
- cites [23] Guess, A. & Coppock, A. Does counter-attitudinal information cause backlash? Results from three large survey experiments. Br. J. Polit. Sci. 50, 1497–1515 (2020). source
- Premisecitation
A growing number of empirical studies have uncovered evidence that people update their political attitudes and beliefs in line with evidence and arguments presented to them.
“Consistent with this view, a growing number of empirical studies have uncovered evidence that people update their political attitudes and beliefs in line with evidence (e.g., refs. 4,13,27–29) and arguments23,30,31 presented to them.”
Quote in the paperSubstantial claim3 of 5 sources checked- cites [4] van der Linden, S., Leiserowitz, A. & Maibach, E. Scientific agreement can neutralize politicization of facts. Nat. Hum. Behav. 2, 2–3 (2018). source
- cites [13] Bolsen, T., Druckman, J. N. & Cook, F. L. The influence of partisan motivated reasoning on public opinion. Political Behav. 36, 235–262 (2014). source
- cites [27] Bullock, J. G. Elite influence on public opinion in an informed electorate. Am. Political Sci. Rev. 105, 496–515 (2011). source
- cites [28] Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G. & Rand, D. G. Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychol. Sci. 31, 770–780 (2020). source
Study 1 Results compare judgments of COVID-19 headline accuracy with willingness to share; Study 2 Results report that an accuracy reminder changed sharing intentions. Neither section reports people updating political attitudes or beliefs in response to evidence or arguments. Our copy provides no page numbers for these passages. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [29] Swire-Thompson, B., DeGutis, J. & Lazer, D. Searching for the backfire effect: Measurement and design considerations. J. Appl. Res. Mem. Cogn. 9, 286–299 (2020). source
- Findingown data
Under an alternative coding that folds each response scale at the midpoint, people in the treatment group tend to report less extreme attitudes than people in the control group.
“In short, people in the treatment group tend to report less extreme (i.e., closer to the midpoint) attitudes than people in the control group.”
Quote in the paperNot a substantial claim- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Findingown data
Individuals initially identifying as pro-gun control showed a significantly larger learning effect for anti-gun control facts than pro-gun control facts.
“Results show that individuals initially identifying as pro-gun control show a significantly larger learning effect for anti-gun control facts than pro-gun control facts (β = − 0.211 [df = 588], p < .001, d = − 0.356, 95% CI [− 0.47, − 0.24]);”
Quote in the paperSubstantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
- Findingown data
There was no significant interaction between Wave and treatment on gun control attitudes.
“Even though we found a significant effect only in Wave 2, there was no significant interaction between Wave and the treatment on this outcome, b = 0.058 (df = 803), p = 0.557, 95% CI (− 0.14, 0.25).”
Quote in the paperNot a substantial claim - Findingown data
The improvement in topic-relevant knowledge was still evident at the one-month follow-up, though attenuated in magnitude.
“This improvement in topic-relevant knowledge was still evident in the one-month follow-up, = .15 (df = 879), p < .001, d = .304, 95% CI (.44, .17), although attenuated in magnitude.”
Quote in the paperNot a substantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
- Findingown data
There was no significant interaction between Wave and treatment on perceptions of which side is aligned with the evidence.
“As above, there was no significant interaction between Wave and treatment, b = − 0.227 (df = 796), p = .125, 95% CI (− 0.52, 0.06).”
Quote in the paperNot a substantial claim - Findingown data
Participants spent significantly more time on valenced (politicized) modules than on neutral modules when comparing medians.
“Using medians from the raw scores and a Wilcoxon rank-sum test, clustered on participant IDs, shows a significant difference in medians, where politicized modules had larger medians (Med = 78.26) than neutral modules (Med = 68.89), b = 0.025 (df = 456), p = 0.005, 95% CI (0.01, 0.04). This indicates participants spent significantly more time on valenced (or politicized) modules.”
Quote in the paperNot a substantial claim - Findingown data
There was no significant interaction between treatment and pre-treatment gun control attitudes on gun control attitudes.
“Further, we found no significant interaction between the treatment and pre-treatment gun control attitudes (Supplementary Note 5), and our results become even stronger when including control variables (Supplementary Table 1F).”
Quote in the paperSubstantial claim - Findingown data
There was no significant interaction between treatment and initial gun-control attitude on perceptions of what the evidence implies for policy.
“As before, an interaction of the treatment with initial gun-control attitude is not significant (Supplementary Note 5), and the effects are similar when adding controls (Supplementary Table 1H).”
Quote in the paperSubstantial claim - Findingown data
There was no significant effect of the knowledge treatment on affective polarization in Wave 1 or Wave 2.
“In contrast to the moderating effect on attitudes observed above, we find no significant effect of the knowledge treatment on affective polarization (Wave 1, β = − 0.001 [df = 1006], p = 0.985, d = .001, 95% CI [-0.12, 0.13]; Wave 2 follow-up, β = − 0.015 [df = 879], p = 0.651, d = 0.031, 95% CI [− 0.10, .16]).”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
- Findingown data
There was no significant interaction between treatment and initial gun control attitude on perceptions of which side is aligned with the evidence.
“An interaction of the treatment with initial gun control attitude is again insignificant (Supplementary Note 5), and the effects are similar when adding controls (Supplementary Table 1G).”
Quote in the paperNot a substantial claim - Findingown data
Individuals initially identifying as anti-gun control showed a larger learning effect for pro-gun control facts than anti-gun control facts, though this interaction was not statistically significant.
“and individuals initially identifying as anti-gun control show a larger learning effect for pro-gun control facts than anti-gun control facts, though this interaction was not statistically significant (β = 0.103 [df = 334], p = 0.096, d = − 0.635, 95% CI [− 0.79, − 0.48]).”
Quote in the paperNot a substantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
- Findingown data
There was no significant interaction between Wave and treatment on perceptions of what the evidence implies for policy.
“Again, there was no significant interaction between Wave and treatment, b = − 0.149 (df = 799), p = .298, 95% CI (− 0.43, 0.13).”
Quote in the paperNot a substantial claim - Findingown data
Participants in the treatment group performed significantly better than participants in the control group on gun-control knowledge items immediately after training.
“As expected, participants in the treatment group performed significantly better than participants in the control group, β = .402 (df = 1,009), p < .001, d = .878, 95% CI (1.01, .75) (see Fig. 3).”
Quote in the paperSubstantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
- Findingown data
The fact-based treatment reduces attitude polarization (the extremity of people's policy attitudes).
“our fact-based treatment reduces attitude polarization (i.e., the extremity of people’s policy attitudes) but has no statistically significant effect on levels of affective polarization (i.e., people’s feelings of hostility toward the political outgroup).”
Quote in the paperSubstantial claim- Rests on an assumption: The attitude measures validly capture policy attitude extremity and depolarization.
- Findingown data
The control group did not depolarize.
“individuals in this group were in the same mindset as those in the experimental group – that is, they also received a bonus for each correct answer – yet their attitudes did not depolarize.”
Quote in the paperSubstantial claim - Findingown data
Increased factual knowledge leads people to adopt less extreme political attitudes.
“More importantly, this increased factual knowledge leads people to adopt less extreme attitudes.”
- Also stated in: § Discussion · plain
“we find that upon learning relevant facts about both sides of an issue, participants adopt, on average, less extreme political attitudes.”
Quote in the paperSubstantial claim- Rests on an assumption: The 11-item gun-control knowledge battery validly measures factual knowledge about gun control.
- Rests on an assumption: The attitude measures validly capture policy attitude extremity and depolarization.
- Also stated in: § Discussion · plain
- Findingown data
The fact-based treatment has no statistically significant effect on levels of affective polarization (feelings of hostility toward the political outgroup).
“our fact-based treatment reduces attitude polarization (i.e., the extremity of people’s policy attitudes) but has no statistically significant effect on levels of affective polarization (i.e., people’s feelings of hostility toward the political outgroup).”
Quote in the paperSubstantial claim - Findingown data
People on both sides of the gun control debate gained a substantial amount of counter-attitudinal knowledge following the experimental treatment.
“people on both sides of the gun control debate have gained a substantial amount of counter-attitudinal knowledge following the experimental treatment (see Fig. 4)”
Quote in the paperSubstantial claim- Rests on an assumption: The 11-item gun-control knowledge battery validly measures factual knowledge about gun control.
- Findingown data
Given a modest incentive, individuals are willing to learn all types of facts, including a substantial amount of counter-attitudinal content.
“In contrast to this claim, we find that, given a modest incentive, individuals are willing to learn all types of facts, including a substantial amount of counter-attitudinal content.”
Quote in the paperSubstantial claim - Study design and conductown data
Results for gun control attitudes become even stronger when including control variables.
“and our results become even stronger when including control variables (Supplementary Table 1F).”
Quote in the paperNot a substantial claim - Interpretationown data
The impact of directionally motivated reasoning on the processing of political information might be more limited than previously thought.
“Our results suggest that the impact of directionally motivated reasoning on the processing of political information might be more limited than previously thought.”
Quote in the paperSubstantial claim - Interpretationown data§ Factual knowledge can reduce attitude polarization
Factual knowledge can reduce attitude polarization.
“Factual knowledge can reduce attitude polarization”
- Also stated in: § Abstract · hedged
“Our results suggest that the impact of directionally motivated reasoning on the processing of political information might be more limited than previously thought.”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
- Also stated in: § Abstract · hedged
- Interpretationown data
Mediation analyses are mostly consistent with the claim that the depolarizing effect of the treatment might be driven by learning counter-attitudinal facts.
“These models are mostly consistent with our claim that the depolarizing effect of our treatment might be driven by learning counter-attitudinal facts.”
Quote in the paperNot a substantial claim- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Interpretationown data
The treatment helped close the knowledge gap between the two sides of the gun control debate.
“Critically, the treatment seems to have helped close the knowledge gap between the two sides of the gun control debate. As Fig. 4 shows, pro-gun-control individuals have become more knowledgeable about anti-gun-control facts after treatment, and anti-gun-control individuals have become more knowledgeable about pro-gun-control facts after treatment.”
Quote in the paperSubstantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
- Interpretationreasoning
The impact of directional motivations on the processing of political information may be more limited than previously thought.
“Our findings suggest that the impact of directional motivations on the processing of political information may be more limited than previously thought”
Quote in the paperSubstantial claim - Interpretationreasoning
Observational approaches do not allow researchers to separate the impact of obtaining factual knowledge from the effect of other variables that are typically correlated with both domain-specific political knowledge and attitude polarization.
“These observational approaches raise a critical inferential challenge, as they do not allow researchers to separate the impact of obtaining factual knowledge from the effect of other variables that are typically correlated with both domain-specific political knowledge and attitude polarization, such as the intensity of one’s political group identity11, one’s pre-existing factual beliefs21, or one’”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [11] Kahan, D. M. in Emerging trends in social and behavioral sciences. (New York: Wiley, 2016).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [21] Tappin, B. M., Pennycook, G. & Rand, D. G. Rethinking the link between cognitive sophistication and politically motivated reasoning. J. Exp. Psychol. Gen. 150, 1095–1114 (2021). source
- cites [22] Iyengar, S., Sood, G. & Lelkes, Y. Affect, not ideology: A social identity perspective on polarization. Public Opin. Q. 76, 405–431 (2012). source
- Interpretationown data
When PMR is defined as politically biased information processing, it is less prevalent than the catch-all term implies.
“Hence, when PMR is defined as politically biased information processing, it is less prevalent than the catch-all term implies.”
Quote in the paperSubstantial claim - Interpretationown data
If citizens who disagree on policy had the same factual knowledge, their attitudes may converge.
“Our study thus suggests that if citizens who disagree on policy had the same factual knowledge, their attitudes may converge.”
Quote in the paperSubstantial claim- Rests on an assumption: The sample of American respondents is sufficiently representative to generalize the depolarization effect to the broader American public.
- Interpretationown data
Closing the knowledge gap between the two sides of the gun control debate can result in attitude moderation.
“we demonstrate that closing the knowledge gap between the two sides of the gun control debate can result in attitude moderation.”
Quote in the paperSubstantial claim - Study design and conductown data
All results are qualitatively equivalent when controlling for participants' age, gender, race, education, party identification, political ideology, and the amount of political news they consume.
“In Supplementary Tables 1A–I, we show that all results are qualitatively equivalent when controlling for participants’ age, gender, race, education, party identification, political ideology, and the amount of political news they consume.”
Quote in the paperNot a substantial claim - Interpretationown data
Experimental results suggest that factual knowledge is unlikely to causally increase attitude polarization.
“our experimental results suggest that factual knowledge is unlikely to causally increase attitude polarization.”
Quote in the paperSubstantial claim - Interpretationown data
Individuals in the study used facts not to bolster their prior beliefs, but to revise them.
“Individuals in our study used facts not to bolster their prior beliefs, but to revise them.”
Quote in the paperSubstantial claim - Study design and conductown data
All results reported above persist when examining only those who showed no cheating behavior.
“All results reported above persist when examining only those who showed no cheating behavior (Supplementary Note 12).”
Quote in the paperNot a substantial claim - Interpretationown data
Polarization can be countered with accurate, balanced, and credible factual information.
“and that polarization can be countered with accurate, balanced, and credible factual information.”
Quote in the paperSubstantial claim - Interpretationown data
Their attitudes depolarized as a result of gaining counter-attitudinal knowledge.
“and their attitudes have depolarized as a result.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The only difference between the experimental and control groups is the information people were incentivized to learn.
“Since the only difference between the experimental and control groups is the information people were incentivized to learn”
Quote in the paperSubstantial claim - Study design and conductown data
The results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.
“In Supplementary Note 2, we also show that the results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.”
Quote in the paperNot a substantial claim - Study design and conductown data
Wave 1 results subsetting just on those who returned in Wave 2 are substantively identical.
“Further, looking at the Wave 1 results while subsetting just on those who returned in Wave 2 yields substantively identical results (see Supplementary Note 14).”
Quote in the paperNot a substantial claim - Interpretationreasoning
The depolarization effect is not driven by an increased motivation to be accurate independent of content.
“we can rule out that the depolarization effect is driven by an increased motivation to be accurate independent of content.”
Quote in the paperSubstantial claim- Rests on an assumption: The control condition (dog training) is a valid counterfactual that does not itself affect gun control attitudes or knowledge.
- Premisecitation
Individuals act as Bayesian learners who incorporate new information into their evaluations of the political and social environment.
“and that individuals act as Bayesian learners who incorporate new information into their evaluations of the political and social environment25,26.”
Quote in the paperSubstantial claim0 of 2 sources checked
- Classified as probably not a substantial claim. 18
- May combine two claims. 18
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe sample was a nationally representative, quota-matched sample of N = 1011 participants from Bovitz, Inc.
“In Wave 1 of the study, we recruited a nationally representative, quota-matched sample of N = 1011 participants from Bovitz, Inc.32.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [32] Stagnaro, M. N. et al. Representativeness versus attentiveness: A comparison across nine online survey samples. Preprint at https://doi.org/10.31234/osf.io/h9j2d (2024). source
The Breakdown of the samples section describes Bovitz-Forthright as a source of samples quota-matched to national distributions for age, gender, ethnicity, and region. The Representativeness section says its sample was more representative than convenience samples, not that it was nationally representative. The cited paper reports 1,115 Bovitz participants; it does not verify the citing authors’ Wave 1 count of 1,011. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
PremisecitationRecent research suggests human reasoning is meaningfully directed toward the formation of accurate, rather than merely identity-confirming, beliefs.
“Recent research suggests that human reasoning is “meaningfully directed toward the formation of accurate, rather than merely identity-confirming, beliefs” (ref. 24 p. 2525)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [24] Pennycook, G. & Rand, D. G. Fighting misinformation on social media using crowdsourced judgments of news source quality. Proc. Natl. Acad. Sci. USA 116, 2521–2526 (2019). source
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe mediation results should be interpreted cautiously because the mediators were not experimentally manipulated.
“The mediation results should be interpreted cautiously, however, because we did not experimentally manipulate the mediators35,36.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [35] Bullock, J. G., Green, D. P. & Ha, S. E. Yes, but what’s the mechanism? (Don’t expect an easy answer). J. Pers. Soc. Psychol. 98, 550–558 (2010). source
- cites [36] Imai, K., Tingley, D. & Yamamoto, T. Experimental designs for identifying causal mechanisms. J. R. Stat. Soc. A 176, 5–51 (2013). source
May combine two claims.
Findingown dataParticipants did not avoid but attended to and indicated value in the factual information presented to them, both when it confirmed and when it contradicted their prior beliefs.
“In sum, when examining participants’ willingness to engage with factual information, we find a result quite contrary to what the PMR theory would predict. Participants did not avoid but attended to and indicated value in the factual information presented to them. Importantly, this was the case both when the information confirmed people’s previously held beliefs and when it contradicted their prior”
- Also stated in: § Abstract · plain
“We find evidence that people are willing to engage with and learn policy-relevant facts both for and against their initial attitudes”
Quote in the paperSubstantial claim- Also stated in: § Abstract · plain
May combine two claims.
Findingown dataExposure to facts about gun control results in attitudes closer to the other side of the policy debate, and this effect occurs for those predisposed to support gun control as well as those predisposed to oppose it.
“Exposure to facts about gun control results in attitudes that are closer to the other side of the policy debate, and this effect occurs for those who are predisposed to support gun control as well as those who are predisposed to oppose it.”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
May combine two claims.
Findingown dataGiven a modest incentive, individuals learn all three types of gun-control facts (neutral, pro-gun control, anti-gun control), but especially counter-attitudinal facts.
“In sum, given a modest incentive, individuals learn all three types of gun-control facts, but especially counter-attitudinal facts.”
Quote in the paperSubstantial claim- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
May combine two claims.
Findingown dataThe depolarizing effect of domain-specific knowledge is found for different indicators of attitude, and it is still visible one month after the treatment.
“The depolarizing effect of domain-specific knowledge is found for different indicators of attitude, and it is still visible one month after the treatment.”
Quote in the paperSubstantial claim- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
May combine two claims.
Findingown dataParticipants rated both pro-attitudinal and counter-attitudinal modules as valuable, with ratings significantly and substantially above the scale midpoint.
“However, as above, both categories were rated significantly and substantially above the scale midpoint (counter-attitudinal: β = 0.769 [df = 420], p < 0.001, d = − 2.41, 95% CI [-2.59, − 2.23]; pro-attitudinal: β = 0.803 [df = 420], p < 0.001, d = − 2.7, 95% CI [− 2.88, − 2.51]).”
- Also stated in: § Engagement with Factual Information · plain
“Further, 86.5% of participants gave the pro-attitudinal modules an average rating of helpful or very helpful, as did 82% of participants for counter-attitudinal modules.”
Quote in the paperNot a substantial claim- Also stated in: § Engagement with Factual Information · plain
May combine two claims.
Findingown dataParticipants rated both neutral and valenced information modules as valuable, with ratings significantly and substantially above the scale midpoint.
“However, the difference is small and dependent on model parameters. What is more, both valenced (β = 0.806 [df = 456], p < 0.001, d = − 2.718, 95% CI [− 2.9, − 2.54]) and neutral modules (β = 0.794 [df = 456], p < 0.001, d = − 2.61 95% CI [− 2.78, − 2.43]) are significantly and substantially above the midpoint of the rating scale (“Neither helpful nor unhelpful”).”
- Also stated in: § Engagement with Factual Information · plain
“Moreover, 74.4% of participants gave the neutral modules an average rating of helpful or very helpful, and 80.1% of participants gave the valenced modules an average rating of helpful or very helpful.”
Quote in the paperNot a substantial claim- Also stated in: § Engagement with Factual Information · plain
May combine two claims.
Findingown dataParticipants in the treatment condition spent a substantial amount of time on both politically neutral and politically valenced gun-control modules, with no statistically significant difference in mean log time between neutral and valenced modules.
“Here, we find first that participants spent a substantial amount of time in both information categories, with the mean log time in a politically neutral module being M = 4.17 (SD = 0.89), and the mean log time in a valenced (or politicized) module being only slightly longer at M = 4.18 (SD = 1.09), a statistically insignificant difference, β = 0.006 (df = 456), p = 0.670 d = − 0.013, 95% CI (− 0.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe gun control attitudes of participants in the treatment group moved further from their initial attitude than the attitudes of participants in the control group, insignificantly in Wave 1 and significantly in Wave 2.
“As predicted, the gun control attitudes of participants in the treatment group moved further from their initial attitude than the attitudes of participants in the control group, insignificantly in Wave 1, β = 0.057 (df = 922), p = 0.086, d = − 0.113, 95% CI (− 0.24, 0.02); significantly in Wave 2, β = 0.093 (df = 806), p = 0.008, d = − 0.187, 95% CI (− 0.33, − 0.05).”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
May combine two claims.
Findingown dataParticipants in the treatment group moved further from their initial attitude than those in the control group on perceptions of which side in the gun control debate is more aligned with the evidence, significantly in Wave 1 and insignificantly in Wave 2.
“Here we again see those in the treatment group move further from their initial attitude than those in the control group (significantly in Wave 1, b = .437 [df = 916], p < 0.001, d = − 0.185, 95% CI [− 0.32, − 0.06]; insignificantly in Wave 2, b = 0.226 [df = 806], p = 0.072, d = − 0.101, 95% CI [− 0.24, .04]).”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
May combine two claims.
Findingown dataParticipants in the treatment group moved further from their initial attitude than those in the control group on perceptions of what the current evidence on gun control implies for policy, significantly in Wave 1 but not in Wave 2.
“We again see that those in the treatment group moved further from their initial attitude than those in the control group in Wave 1 (b = 0.346 [df = 919], p = 0.004, d = − 0.14, 95% CI [− 0.27, − 0.01]), though this effect was not significant in Wave 2 (b = .157 [df = 806], p = .22, d = − 0.02, 95% CI [− 0.16, .11]).”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
May combine two claims.
Findingown dataThe depolarizing effect of policy facts is found for different attitude measures and is still detectable one month after the treatment.
“The depolarizing effect of policy facts is found for different attitude measures and is still detectable one month after the treatment.”
Quote in the paperSubstantial claim- Rests on an assumption: The one-month follow-up effect is not due to repeated testing or demand characteristics.
May combine two claims.
Findingown dataOnce individuals have been exposed to both pro- and counter-attitudinal information, they attend to, internalize, and update on both types of facts.
“We show that once individuals have been exposed to both pro- and counter-attitudinal information, they attend to, internalize, and update on both types of facts.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingown dataGun control is a highly contentious political issue.
“We also confirmed in a pilot study (reported in Supplementary Note 11) that gun control is a highly contentious political issue.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataEffects on perceptions of which side is aligned with the evidence are similar when adding controls.
“and the effects are similar when adding controls (Supplementary Table 1G).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataEffects on perceptions of what the evidence implies for policy are similar when adding controls.
“and the effects are similar when adding controls (Supplementary Table 1H).”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe depolarization effect appears to be specific to policy attitudes and does not generalize to feelings toward people who hold an opposing view.
“The depolarization effect appears to be specific to policy attitudes and does not generalize to feelings toward people who hold an opposing view.”
Quote in the paperSubstantial claim- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
May combine two claims.
Interpretationown dataLearning issue-relevant facts causes people to adopt more moderate policy attitudes, without changing their feelings towards people with opposing views.
“We find that learning issue-relevant facts causes people to adopt more moderate policy attitudes, without changing their feelings towards people with opposing views.”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The attitude items validly measure the intended policy attitude constructs.
- Rests on an assumption: The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
Classified as probably not a substantial claim.
Study design and conductown dataParticipants were randomized to learn about either gun control or a nonpolitical control topic.
“Participants were randomized to learn about either gun control or a nonpolitical control topic via a series of training modules that educated them on a variety of facts relevant to the issue.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisereasoningThe data on the relationship between knowledge and polarization are only correlational.
“Yet these data are only correlational.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataAccurate political information, along with sufficient incentives for learning, can truly reduce partisan gaps in factual beliefs.
“This finding suggests that accurate political information, along with sufficient incentives for learning, can truly reduce partisan gaps in factual beliefs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataIn Wave 2, 881 (87%) of the initial sample participated.
“Of the initial sample, 881 (87%) participated in Wave 2.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningParticipants were given several opportunities to exit the main sections of the study (at a cost) to prevent attrition issues.
“Critically, to prevent attrition issues, participants were given several opportunities to exit the main sections of the study (at a cost) if they felt they no longer wanted to continue.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe Wave 1 sample was quota-matched for age, gender, race, education, and region.
“The sample was quota-matched for age, gender, race, education, and region.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe three attitudinal outcomes were analyzed separately in line with the pre-registered protocol.
“In line with the pre-registered protocol, the three outcomes were analyzed separately, and all three were recoded such that higher scores indicate greater movement in the opposing direction from one’s initial gun control attitude.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study was pre-registered.
“Building on this line of work, we test the pre-registered hypothesis that learning facts about a contentious political issue has a causal depolarizing effect on political attitudes.”
- Also stated in: § Introduction · plain
“In line with the pre-registered protocol, the three outcomes were analyzed separately, and all three were recoded such that higher scores indicate greater movement in the opposing direction from one’s initial gun control attitude.”
- Also stated in: § Incorporation of factual information · plain
“Our pre-registered coding method for the three attitudinal outcomes examines how much participants’ attitudes moved in the opposing direction from the side they started on.”
Quote in the paperNot a substantial claim- Also stated in: § Introduction · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThere was no difference in trust in content between the experimental and control groups (p = .895).
“there was no difference in trust in content between the experimental and control groups (p = .895).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe final Wave 1 sample was N = 1011 after 30 (2.96%) complete attrition.
“Of the remaining 1041 individuals who continued into the study, 30 (2.96%) completely attrited the study, giving us a final sample of N = 1011”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThe labels pro- vs. anti-gun control were only used for analyses; no module used such language when presenting information to participants.
“Note that the above labels (i.e., pro- vs. anti-gun control) were only used for our analyses; at no point did any module use such language when presenting information to participants.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study was pre-registered (design, measures, hypothesis, and analysis plan) at Aspredicted.org on August 30, 2021, as study #73660.
“We pre-registered our design, measures, hypothesis, and analysis plan at Aspredicted.org on August 30, 2021, as study #73660”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe Wave 2 retention rate was 87% (N = 881).
“In Wave 2 of the study, we recontacted all participants a month later with a retention rate of 87% (N = 881).”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataWave 2 participants were comparable to Wave 1 participants on political ideology, party identification, gender, and condition.
“The Wave 2 participants were comparable to those from Wave 1 on political ideology, party identification, gender, and condition (see Supplementary Note 13).”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe informational treatment was powerful and worked as intended.
“Questions 1 and 2 can be interpreted as a manipulation check; our main goal with these analyses is to show that the informational treatment was powerful and worked as intended.”
Quote in the paperSubstantial claim- Rests on an assumption: The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
- Rests on an assumption: The gun-control knowledge items validly measure issue-relevant factual knowledge.
The paper relies on this without support.
The nonpolitical control training topic does not influence gun-control attitudes or knowledge.
“Participants were randomized to learn about either gun control or a nonpolitical control topic via a series of training modules that educated them on a variety of facts relevant to the issue.”
The paper relies on this without support.
The gun-control knowledge items validly measure issue-relevant factual knowledge.
“After the training, participants’ knowledge of gun control facts was measured to see if we had successfully manipulated topic-relevant knowledge.”
The paper relies on this without support.
The attitude items validly measure the intended policy attitude constructs.
“Participants then proceeded to answer a series of questions measuring three aspects of their policy attitudes: (a) their position on increasing gun control, (b) their opinion about which side in the gun control debate is most aligned with the evidence, and (c) their view of what the evidence on gun control implies for policy.”
The paper relies on this without support.
The one-month follow-up sample is not differentially selected in a way that biases the estimated treatment effects.
“In Wave 2 of the study, we recontacted all participants a month later with a retention rate of 87% (N = 881).”
The paper relies on this without support.
The facts presented in the training modules are objective, verifiable, and credible.
“Our informational treatment consists of a training session that exposes participants to a high volume of issue-relevant information, covers diverse aspects of the issue, uses objective, verifiable facts; and, critically, includes a mix of facts both for and against people’s initial policy attitudes.”
The paper relies on this without support.
Gun control is a representative contentious political issue for testing the effect of factual knowledge on attitude polarization.
“Specifically, we randomize whether N = 1,011 participants receive a large, credible set of both pro- and counter-attitudinal facts on a contentious political issue – gun control – and provide a modest incentive for them to learn this information.”
The paper relies on this without support.
The control condition (dog training) is a valid counterfactual that does not itself affect gun control attitudes or knowledge.
“Next, participants were presented with a topic – gun control in the experimental condition and dog training in the control condition”
The paper relies on this without support.
The 11-item gun-control knowledge battery validly measures factual knowledge about gun control.
“we measured participants’ topic knowledge using an 11-item gun-control knowledge battery.”
The paper relies on this without support.
The attitude measures validly capture policy attitude extremity and depolarization.
“the three attitude items described above were recoded into variables indicating depolarization, that is, attitude change in the opposing direction from one’s pre-treatment gun control attitude”
The paper relies on this without support.
The sample of American respondents is sufficiently representative to generalize the depolarization effect to the broader American public.
“since our study only included American respondents”
The paper relies on this without support.
The one-month follow-up effect is not due to repeated testing or demand characteristics.
“The depolarizing effect of policy facts is found for different attitude measures and is still detectable one month after the treatment.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Helpfulness comparison has a significant p-value but a CI spanning zero
MajorThe reported p-value indicates a significant difference, but the accompanying 95% confidence interval for the reported effect size includes zero.
“p = 0.004, d = 0.113”
“95% CI (− 0.02, 0.24)”
Learning comparison has a nonsignificant p-value but a CI excluding zero
MajorThe comparison is described as not statistically significant, with p = 0.096, yet its accompanying 95% confidence interval lies entirely below zero.
“though this interaction was not statistically significant (β = 0.103 [df = 334], p = 0.096”
“95% CI [− 0.79, − 0.48]”
Attrition percentage uses the wrong denominator
MinorOf the 1,041 people who continued into the study, 30 attrited. That is 2.88%, not 2.96%.
Reported 2.96 · recomputed 2.881844
“Of the remaining 1041 individuals who continued into the study, 30 (2.96%) completely attrited the study”
Cites
Motivated Skepticism in the Evaluation of Political Beliefs
Taber, C. S., & Lodge, M. (2006) · American Journal of Political Science · doi:10.1111/j.1540-5907.2006.00214.x · Cited by 4,344 · cited 4× · see citing works
“17 , p. 757).”
InfluentialEvaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008 · see citing works
Iyengar, S., Sood, G., & Lelkes, Y. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs038 · Cited by 2,748 · cited 2× · see citing works
“Perhaps previous observational studies have not accounted for the possibility that as one becomes more politically engaged, both knowledge and polarization increase independent from one another 22 .”
The Polarizing Impact of Science Literacy and Numeracy on Perceived Climate Change Risks
Braman, D., Kahan, D. M., Peters, E. M., Wittlin, M., Slovic, P., Ouellette, L. L., & Mandel, G. N. (2012) · Scholarly Commons - George Washington University Law School (George Washington University) · Cited by 2,299 · see citing works
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715 · see citing works
How Elite Partisan Polarization Affects Public Opinion Formation
DRUCKMAN, J. N., PETERSON, E., & SLOTHUUS, R. (2013) · American Political Science Review · doi:10.1017/s0003055412000500 · Cited by 1,569 · cited 1× · see citing works
“…example, polarized policy attitudes have been shown to exacerbate people ’ s feelings of hostility and dis-like toward out-partisans 6 , diminish the likelihood of inter-party interaction 7 , and increase individuals ’ tendency to evaluate policies based on group loyalties rather than evidence 8 .”
Mason, L. (2015) · American Journal of Political Science · doi:10.1111/ajps.12089 · Cited by 1,367 · see citing works
Polarization and Partisan Selective Exposure
Stroud, N. J. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2010.01497.x · Cited by 1,346 · cited 1× · see citing works
“…(and less counter-attitudinal) political information in their daily lives (where incentives to attend to and learn counter-attitudinal information, such as those we employed here, are often absent), this may explain why observational studies fi nd that their attitudes are more polarized 41 .”
Ditto, P. H., & Lopez, D. F. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.4.568 · Cited by 1,329 · see citing works
The Nature and Origins of Misperceptions: Understanding False and Unsupported Beliefs About Politics
Flynn, D. J., Nyhan, B., & Reifler, J. (2017) · Political Psychology · doi:10.1111/pops.12394 · Cited by 1,183 · see citing works
Yes, but what’s the mechanism? (don’t expect an easy answer).
Bullock, J. G., Green, D. P., & Ha, S. E. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018933 · Cited by 1,063 · see citing works
Redlawsk, D. P. (2002) · The Journal of Politics · doi:10.1111/1468-2508.00161 · Cited by 978 · cited 11× · see citing works
“In Supplementary Note 2, we also show that the results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.”
InfluentialFighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · see citing works
The Influence of Partisan Motivated Reasoning on Public Opinion
Bolsen, T., Druckman, J. N., & Cook, F. L. (2014) · Political Behavior · doi:10.1007/s11109-013-9238-0 · Cited by 891 · cited 13× · see citing works
“In Supplementary Note 2, we also show that the results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.”
InfluentialMotivated numeracy and enlightened self-government
KAHAN, D. M., PETERS, E., DAWSON, E. C., & SLOVIC, P. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.2 · Cited by 883 · cited 2× · see citing works
“21,44), it remains an open question whether the same results would be obtained for other issues.”
Elite Influence on Public Opinion in an Informed Electorate
BULLOCK, J. G. (2011) · American Political Science Review · doi:10.1017/s0003055411000165 · Cited by 777 · cited 1× · see citing works
“4,13,27 – 29)andarguments 23,30,31 presentedtothem.”
The evidence for motivated reasoning in climate change preference formation
Druckman, J. N., & McGrath, M. C. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0360-1 · Cited by 733 · cited 11× · see citing works
“In Supplementary Note 2, we also show that the results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.”
InfluentialPolitical Parties, Motivated Reasoning, and Public Opinion Formation
Leeper, T. J., & Slothuus, R. (2014) · Political Psychology · doi:10.1111/pops.12164 · Cited by 722 · cited 14× · see citing works
“In Supplementary Note 2, we also show that the results hold when using instrumental variables to estimate the complier average treatment effects, which take into account non-compliance.”
InfluentialPartisan bias in factual beliefs about politics
Bullock, J. G., Gerber, A. S., Hill, S. J., & Huber, G. A. (2015) · Quarterly Journal of Political Science · doi:10.1561/100.00014074 · Cited by 686 · cited 1× · see citing works
“There is an active debate in the literature about whether partisans ’ tendency to provide politically favorable responses to factual questions re fl ects genuine differences in beliefs or insincere survey responding 38 – 40 .”
Drummond, C., & Fischhoff, B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1704882114 · Cited by 607 · cited 1× · see citing works
“16,19) or take part in an experiment that manipulates some other aspect and uses factual knowledge as an observed moderator that is measured prior to the experimental treatment (e.g., ref.”
The Ideological Foundations of Affective Polarization in the U.S. Electorate
Webster, S. W., & Abramowitz, A. I. (2017) · American Politics Research · doi:10.1177/1532673x17703132 · Cited by 557 · cited 1× · see citing works
“A wealth of evidence indicates that Americans strongly disagree on a wide range of policy issues – such as gun control, abortion, healthcare, immigration, and many more – and hold increasingly extreme or “ sorted ” attitudes on those topics 1 – 5 .”
Changing Minds or Changing Channels?: Partisan News in an Age of Choice
Arceneaux, K., & Johnson, M. (2013) · doi:10.7208/chicago/9780226047447.001.0001 · Cited by 450 · cited 1× · see citing works
“43).”
Prior, M., Sood, G., & Khanna, K. (2015) · Quarterly Journal of Political Science · doi:10.1561/100.00014127 · Cited by 418 · see citing works
Experimental Designs for Identifying Causal Mechanisms
Imai, K., Tingley, D., & Yamamoto, T. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01032.x · Cited by 408 · cited 1× · see citing works
“The mediation results should be interpreted cautiously, however, because we did not experimentally manipulate the mediators 35,36 .”
Does Counter-Attitudinal Information Cause Backlash? Results from Three Large Survey Experiments
Guess, A., & Coppock, A. (2020) · British Journal of Political Science · doi:10.1017/s0007123418000327 · Cited by 372 · cited 3× · see citing works
“4,13,27 – 29)andarguments 23,30,31 presentedtothem.”
Searching for the backfire effect: Measurement and design considerations.
Swire-Thompson, B., DeGutis, J., & Lazer, D. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.06.006 · Cited by 360 · see citing works
The polarizing impact of science literacy and numeracy on perceived climate change risks
Kahan, D. M., Peters, E., Wittlin, M., Slovic, P., Ouellette, L. L., Braman, D., & Mandel, G. (2012) · Nature Climate Change · doi:10.1038/nclimate1547 · Cited by 352 · cited 2× · see citing works
“16,19) or take part in an experiment that manipulates some other aspect and uses factual knowledge as an observed moderator that is measured prior to the experimental treatment (e.g., ref.”
The Nature of Affective Polarization: Disentangling Policy Disagreement from Partisan Identity
Dias, N., & Lelkes, Y. (2022) · American Journal of Political Science · doi:10.1111/ajps.12628 · Cited by 338 · see citing works
Peterson, E., & Iyengar, S. (2019) · doi:10.31235/osf.io/pmn7h · Cited by 241 · cited 1× · see citing works
“…different things, including people ’ s tendency to actively seek pro-attitudinal information and avoid counter-attitudinal information (i.e., selective exposure 42 ) and the way people engage with pro-and counter-attitudinal information once they encounter it (i.e., information processing 17 ).”
The Policy Basis of Measured Partisan Animosity in the United States
Orr, L., & Huber, G. A. (2019) · American Journal of Political Science · doi:10.1111/ajps.12498 · Cited by 208 · cited 1× · see citing works
“For example, polarized policy attitudes have been shown to exacerbate people ’ s feelings of hostility and dis-like toward out-partisans 6 , diminish the likelihood of inter-party interaction 7 , and increase individuals ’ tendency to evaluate policies based on group loyalties rather than evidence…”
Misinformation or Expressive Responding?
Schaffner, B. F., & Luks, S. (2017) · Public Opinion Quarterly · doi:10.1093/poq/nfx042 · Cited by 188 · see citing works
The Correlates of Discord: Identity, Issue Alignment, and Political Hostility in Polarized America
Bougher, L. D. (2017) · Political Behavior · doi:10.1007/s11109-016-9377-1 · Cited by 179 · cited 1× · see citing works
“A wealth of evidence indicates that Americans strongly disagree on a wide range of policy issues – such as gun control, abortion, healthcare, immigration, and many more – and hold increasingly extreme or “ sorted ” attitudes on those topics 1 – 5 .”
Learning Together Slowly: Bayesian Learning about Political Facts
Hill, S. J. (2017) · The Journal of Politics · doi:10.1086/692739 · Cited by 159 · see citing works
Rethinking the link between cognitive sophistication and politically motivated reasoning.
Tappin, B. M., Pennycook, G., & Rand, D. G. (2021) · Journal of Experimental Psychology: General · doi:10.1037/xge0000974 · Cited by 154 · cited 3× · see citing works
“21,44), it remains an open question whether the same results would be obtained for other issues.”
Citizens’, Scientists’, and Policy Advisors’ Beliefs about Global Warming
Bolsen, T., Druckman, J. N., & Cook, F. L. (2015) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716214558393 · Cited by 141 · cited 1× · see citing works
“18 – 20).”
Scientific agreement can neutralize politicization of facts
Linden, S. V. D., Leiserowitz, A., & Maibach, E. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0259-2 · Cited by 136 · see citing works
Bayesian or biased? Analytic thinking and political belief updating
Tappin, B. M., Pennycook, G., & Rand, D. G. (2020) · Cognition · doi:10.1016/j.cognition.2020.104375 · Cited by 127 · see citing works
Opting Out of Political Discussions
Settle, J. E., & Carlson, T. N. (2019) · Political Communication · doi:10.1080/10584609.2018.1561563 · Cited by 122 · see citing works
Public knowledge and concern about polar-region warming
Hamilton, L. C., Cutler, M., & Schaefer, A. (2012) · Polar Geography · doi:10.1080/1088937x.2012.684155 · Cited by 102 · cited 1× · see citing works
“18 – 20).”
Representativeness and Response Validity Across Nine Opt-In Online Samples
Stagnaro, M. N., Druckman, J., Berinsky, A. J., Arechar, A. A., Willer, R., & Rand, D. G. (2024) · doi:10.31234/osf.io/h9j2d · Cited by 68 · see citing works
Self-citationBroockman, D., & Kalla, J. (2022) · American Journal of Political Science · doi:10.1111/ajps.12724 · Cited by 65 · see citing works
Resistance to Position Change, Motivated Reasoning, and Polarization
Stanley, M. L., Henne, P., Yang, B. W., & De Brigard, F. (2020) · Political Behavior · doi:10.1007/s11109-019-09526-z · Cited by 58 · cited 1× · see citing works
“The theory posits that when individuals aredriven by partisanmotivations,they often ignore, downplay, or outright reject information that runs counter to their preexisting beliefs 13 – 15 .”
Broockman, D., & Kalla, J. (2020) · doi:10.31219/osf.io/m7326 · Cited by 36 · see citing works
Flagged first, then by citations
1 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Kahan, D. M. in Emerging trends in social and behavioral sciences. (New York: Wiley, 2016).
- Coppock, A. Persuasion in parallel. (Chicago: University of Chicago Press, 2021).
- Greene, J. Moral tribes: Emotion, Reason, And The Gap Between Us and Them. (London, UK: Penguin, 2014).
Cited by
Sorted by citations
Polarized public agenda in times of crisis
Cavari, A., & Efrat, A. (2025) · Journal of European Public Policy · doi:10.1080/13501763.2025.2552418 · Cited by 3 · see citing works
“Partisan motivations, therefore, signi fi cantly in fl uence how people process political information and the subsequent e ff ects of that information on their attitudes toward government (Alon-Barkat, Cavari & Shvarts, 2025; Bolsen et al., 2014; Stagnaro & Amsalem, 2025).”
CEO Activism and Corporate Reputation: How Authenticity and CSR Mitigate Stakeholder Misalignment
Li, L. Z., & Soule, S. A. (2026) · Journal of Management Studies · doi:10.1111/joms.70060 · Cited by 2 · see citing works
Local news, partisanship, and perceptions about election administration
Abus, M., Bai, K., & Dunaway, J. (2025) · Electoral Studies · doi:10.1016/j.electstud.2025.102970 · Cited by 1 · see citing works
Depolarization in the coevolutionary dynamics of opinion and cooperation
Li, J., Xu, H., Huang, F., et al. (2026) · Applied Mathematics and Computation · doi:10.1016/j.amc.2026.129955 · Cited by 1 · see citing works
Cure or curse? The role of deliberation in shaping willful ignorance
Hutmacher, F., Altenmüller, M. S., & Winter, K. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102082
Leippold, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5406124
Negative Campaigns, Negative Votes? Meanings of Voting and Political Campaigns
Boyer, M., le Gall, C., & Plescia, C. (2025) · The International Journal of Press/Politics · doi:10.1177/19401612251376808
Beyond Dewey’s Uncertainty: Banausic Knowledge as Democratic Foundation
Cortial, C. (2026) · Episteme · doi:10.1017/epi.2026.10105
Erickson, B. D., Jones, M. S., & Biedenweg, K. A. (2026) · North American Journal of Fisheries Management · doi:10.1093/najfmt/vqag016
Status quo bias drives public support for drug policy in the USA
Hamrak, B., & Simonovits, G. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02471-y
“…is a rich literature showing that citizens update their beliefs, political and policy preferences and attitudes upon receiving nudges for accurate thinking, arguments or factual information, even despite their initial beliefs 33–36 , even in the case of polarizing issues such as gun control 37 .”
Does Listening to Trustworthy News Affect Political Attitudes and Trust?
Barberá, P., Guess, A. M., Munzert, S., & Yang, J. (2026) · Political Behavior · doi:10.1007/s11109-026-10193-0
- Authors
- Stagnaro, M. N., & Amsalem, E.
- Affiliations
- Massachusetts Institute of Technology (US)
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Stagnaro, Michael Nicholas
- Venue
- Nature Communications
- Published
- 2025-04-23
- Volume
- 16
- Issue
- 1
- Pages
- 3809-3809
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC12019190
- OpenAlex
- W4409696447
- Cited by
- 11
- References
- 44
- Citations by year
- 2026: 6 · 2025: 5
- FWCI
- 46.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Nature Communications (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (submittedVersion, cc-by-nc-nd)
- PubMed Central (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- United States Department of Defense | United States Navy | ONR | Office of Naval Research Global (N00014-21-1-2573)
- Topics
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Sociology and Political Science › Media Influence and Politics
- Keywords
- attitude polarization, factual knowledge, gun control, political attitudes, political information processing
- MeSH terms
- Adult, Attitude, Female, Humans, Male, Middle Aged, Motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review