Cited by 98Social Media and PoliticsComplex Network Analysis TechniquesOpinion Dynamics and Social Influence

No echo in the chambers of political interactions on Reddit

Open access
De Francisci Morales, Gianmarco, Monti, Corrado, Starnini, Michele·2021·Scientific Reports

Abstract

Echo chambers in online social networks, whereby users’ beliefs are reinforced by interactions with like-minded peers and insulation from others’ points of view, have been decried as a cause of political polarization. Here, we investigate their role in the debate around the 2016 US elections on Reddit, a fundamental platform for the success of Donald Trump. We identify Trump vs Clinton supporters and reconstruct their political interaction network. We observe a preference for cross-cutting political interactions between the two communities rather than within-group interactions, thus contradicting the echo chamber narrative. Furthermore, these interactions are asymmetrical: Clinton supporters are particularly eager to answer comments by Trump supporters. Beside asymmetric heterophily, users show assortative behavior for activity, and disassortative, asymmetric behavior for popularity. Our findings are tested against a null model of random interactions, by using two different approaches: a network rewiring which preserves the activity of nodes, and a logit regression which takes into account possible confounding factors. Finally, we explore possible socio-demographic implications. Users show a tendency for geographical homophily and a small positive correlation between cross-interactions and voter abstention. Our findings shed light on public opinion formation on social media, calling for a better understanding of the social dynamics at play in this context.

AI snapshot

Written from the paper’s full text.

TL;DR

Analyzing Reddit interactions around the 2016 US presidential election, the paper finds no evidence of echo chambers in r/politics: Trump and Clinton supporters interacted across political lines more than expected by chance. These cross-cutting interactions were asymmetric, with Clinton supporters especially likely to reply to Trump supporters, and were modulated by activity, popularity, and state-level factors.

Key findings

  • Cross-cutting political interactions were more frequent than within-group interactions, contradicting the echo chamber narrative: the odds ratio for cross-group interaction was 1.195 against a random null model. Clinton supporters directed 72% of interactions to Trump supporters versus 28% within their own group; Trump supporters directed 38% to Clinton supporters versus 62% within their own group.
  • The heterophily was asymmetric: Clinton supporters were more likely than Trump supporters to answer the opposing group, with a 6.2% increase over the random null model on one side and 3.3% on the other; the logit model gave an odds ratio of 1.064 for the Clinton-support × cross-group interaction.
  • Users showed assortative behavior by activity and disassortative, slightly asymmetric behavior by popularity/score. In the logit models, higher average score for author and target increased interaction likelihood (odds ratios 1.166 and 1.151 in the first confounding model), and a larger difference in average score also increased it (1.213).
  • State-level analysis found geographical homophily: same-state interactions had odds ratio 1.245, while same-state cross-group interactions had odds ratio 0.811. Cross-group interactions correlated positively with non-vote share (odds ratio 1.057) and negatively with living in a swing state (odds ratio 0.965).

Methods

  • Data came from Reddit via Pushshift for 2016. Political leaning was inferred from posting in r/The_Donald for Trump supporters and r/hillaryclinton/r/HillaryForAmerica for Clinton supporters; dual posters were disambiguated by average comment score. Final labels: 10,240 Clinton supporters and 110,806 Trump supporters. The r/politics interaction network contained 31,218 users (27,012 Trump, 4,206 Clinton), 500,030 links, and 716,765 interactions.
  • The weighted, directed reply network was compared with a random network null model that preserves each node’s in- and out-strength (configuration model). Logistic regression modeled link probability using community features, popularity/confounding Reddit features, and environmental features, with negative sampling matching the null model. Sentiment was measured with VADER, and geolocation used Balsamo et al.’s state-level inference, covering 37% of users.

Limitations

  • The paper states that Reddit users are not representative of the US population, with strong socio-demographic biases (e.g., more likely to be young males and urban), and that their political leaning and interests may differ from the general population.
  • The paper states that state-level aggregation is coarse-grained and does not capture within-state differences such as urban versus rural, and that environmental results are observational and cannot prove causal effects.
  • Evident from the text: political labels rely on subreddit participation and comment-score proxies, which may misclassify users; the sociodemographic analysis is restricted to the 37% of users who could be geo-localized, and findings are specific to r/politics during the 2016 election.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41598-021-81531-x

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

8 of 24 cited sources checked · 2 supported · 0 flagged · accuracy not yet measured

  • Study design and conductreasoning

    Participation in r/The_Donald is a valid proxy to study Donald Trump support.

    “Participation in this subreddit is a valid proxy to study Donald Trump support, as the rules of this subreddit explicitly state that the community is for “Trump Supporters Only”, and that dissenting users will be removed.”
    • Also stated in: § Political leaning of Reddit users · plain
      “As such, it has been previously used in literature to analyze the behavior of Trump supporters34,35.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [34] Flores-Saviaga, C. I., Keegan, B. C. & Savage, S. Mobilizing the trump train: Understanding collective action in a political trolling community. In Twelfth International AAAI Conference on Web and Social Media (2018). source

      The Introduction describes r/The_Donald as a community whose members circulated pro-Trump material, supporting its relevance to studying Trump supporters. But the Limitations and Future Work section says the authors do not know much about participants’ identities and motivations. Our copy does not establish that participation is a valid proxy for Trump support or state the claimed rules about supporters and removal of dissenters. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites [35] Massachs, J., Monti, C., De Francisci Morales, G. & Bonchi, F. Roots of trumpism: Homophily and social feedback in donald trump support on reddit. In Proceedings of the 12th ACM Conference on Web Science (2020). source
  • Findingown data

    The r/politics interaction network exhibits heterophily: users are more likely to interact across political groups (supporting different candidates) than within them.

    “comments on r/politics are heterophilic: the likelihood of u answering to v increases when u and v support different candidates (odds ratio 1.195)”
    • Also stated in: § Discussion · plain
      “these groups tend to interact more across than among themselves, that is, the network exhibits heterophily rather than homophily.”
    • Also stated in: § Discussion · plain
      “here we observe the reversed phenomenon: polarization is associated to increased interactions between groups holding opposite opinions.”
    Quote in the paperSubstantial claim
  • Findingown data

    Cross-interactions are suppressed in swing states.

    “We obtain a similar result, although in the negative direction, for living in a swing state: cross-interactions are suppressed in this case.”
    Quote in the paperSubstantial claim
  • Findingown data

    Interactions within Trump supporters are more negative than interactions within Clinton supporters (average sentiment 0.0575 vs 0.0126).

    “we observe that interactions within Trump supporters are more negative than interactions within Clinton supporters (average sentiment of 0.0575 vs 0.0126).”
    Quote in the paperNot a substantial claim
  • Findingown data

    In the Politics network, 31,218 users authored a message on r/politics in 2016 and appear as nodes.

    “Among these users, 31,218 authored a message on r/politics in 2016 and thus appear as nodes V in the graph”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 21
  • May combine two claims. 23
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Reddit users are not representative of the US population and have strong socio-demographic biases.

    “Reddit users are not representative of the US population, and instead have strong socio-demographic biases.”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [44] Duggan, M. & Smith, A. 6% of online adults are reddit users. Pew Internet Am. Life Project 3, 1–10 (2013).
    • cites [45] Finlay, C. Age and gender in reddit commenting and success. J. Inf. Sci. Theory Pract. 2, 18–28. https://doi.org/10.1633/JISTaP.2014.2.3.2 (2014). source

      The Results (§5) describe the surveyed r/atheism respondents as predominantly young and male, supporting a demographic skew in that group. But the survey was confined to one subreddit (§4), and the paper does not compare its respondents with the US population or establish that the findings apply to Reddit users generally. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
    • cites [46] Singer, P., Flöck, F., Meinhart, C., Zeitfogel, E. & Strohmaier, M. Evolution of reddit: From the front page of the internet to a self-referential community? In Proceedings of the 23rd International Conference on World Wide Web, 517–522, https://doi.org/10.1145/2567948.2576943 (New York, NY, USA, 2014). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Dubois and Blank found that many users check news sources different from their usual ones, often offline, arguing against generalizing single-media studies to describe the complexity of a high-choice multiple media environment.

    “The authors found that many users check news sources different from their usual ones, often offline. They thus argue against generalizing single-media studies to describe the complexity of a high-choice multiple media environment.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [20] Dubois, E. & Blank, G. The echo chamber is overstated: The moderating effect of political interest and diverse media. Inf. Commun. Soc. 21, 729–745 (2018). source

      The Variables and measurement section asks respondents whether they check a news source different from their usual one and whether they confirm information through a major offline news medium. The Broader implications section argues that single-medium studies cannot capture how people use other online and offline media. The passages found do not establish that many respondents checked different sources or that they often did so offline. (LLM, conf=0.77)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Similar results are known for other communities (e.g., the Brexit leave campaign).

    “Similar results are known for other communities (for instance, the Brexit leave campaign40).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [40] Bastos, M., Mercea, D. & Baronchelli, A. The geographic embedding of online echo chambers: Evidence from the brexit campaign. PLoS One 13, 20 (2018). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Garimella et al. found that users with different opinions tend not to follow each other, but only when the topic is controversial.

    “they confirm the presence of echo chambers (i.e., users with different opinions tend not to follow each other), but only when the topic is controversial.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [9] Garimella, K., De Francisci Morales, G., Gionis, A. & Mathioudakis, M. Quantifying controversy on social media. TSC ACM Trans. Soc. Comput. 1, 3 (2018). source

      The ‘Follow graph’ section expects users to agree more often with people they follow and predicts well-separated groups for controversial topics. Section 5 reports such separation in follow graphs, and Section 8.1 finds higher median controversy scores for controversial than non-controversial topics. These findings support the association, but do not establish the claim’s ‘only when’ condition: the paper does not show that cross-opinion following is avoided exclusively for controversial topics. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Reddit users are more likely to be young males.

    “Reddit users are more likely to be young males44”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [44] Duggan, M. & Smith, A. 6% of online adults are reddit users. Pew Internet Am. Life Project 3, 1–10 (2013).
    • cites [45] Finlay, C. Age and gender in reddit commenting and success. J. Inf. Sci. Theory Pract. 2, 18–28. https://doi.org/10.1633/JISTaP.2014.2.3.2 (2014). source

      The Results section describes the average surveyed r/atheism user as a male in his late teens to mid-20s. The Methodology section says the data came from an informal survey in that subreddit, so the finding does not establish the demographics of Reddit users generally. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Face-to-face interactions within families decrease when there is political disagreement, which is exacerbated by massive political ads campaigns in swing states.

    “face-to-face interactions within families decrease when there is political disagreement, which is exacerbated by massive political ads campaigns in swing states41.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [41] Chen, M. K. & Rohla, R. The effect of partisanship and political advertising on close family ties. Science 360, 1020–1024 (2018). source

      The paper reports shorter cross-partisan Thanksgiving dinners (p. 1) and a larger reduction in heavily advertised markets, including swing-state markets (p. 4). The claim generalizes from Thanksgiving gatherings to family interactions broadly and presents advertising as the cause, whereas the paper says other campaign activities may also have contributed (p. 4). (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data

    Comments by Clinton supporters have much larger scores on average, while the scores of Trump supporters span a larger interval of values.

    “comments by Clinton supporters have much larger scores on average, while the scores of Trump supporters span a larger interval of values.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Clinton supporters tend to interact more with Trump supporters (72% of interactions) than Trump supporters themselves within the community (62%).

    “Clinton supporters tend to interact more with Trump supporters (72% of interactions) than Trump supporters themselves within the community (62%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The method identifies 10,240 users as Clinton supporters and 110,806 users as Trump supporters.

    “Our method identifies 10,240 users as Clinton supporters and 110,806 users as Trump supporters.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Users show assortative behavior for activity: high-activity users tend to interact with similarly active users, and low-activity users with low-activity users.

    “users show assortative behavior for activity”
    • Also stated in: § Deviation of conditional and joint probabilities · plain
      “Thus, we observe that users show an assortative behavior with respect to activity, i.e., user with high activity tend to interact with similarly-active users, and the same for users with low activity.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The Politics network is characterized by asymmetry between the two political groups: Clinton supporters interact with Trump supporters more than the other way around, with a 6.2% increase with respect to a random null model on one side and 3.3% on the other.

    “The Politics network is characterized by an asymmetry between the two political groups: Clinton supporters interact with Trump supporters more than the other way around, with a 6.2% increase with respect to a random null model on one side and 3.3% on the other.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The null model assumes that interactions are unaffected by the political leaning of users.
  • May combine two claims.

    Findingown data

    The activity distribution of Trump supporters decays more rapidly than for Clinton supporters, indicating a propensity to engage in a larger number of interactions from Clinton supporters.

    “The activity distribution of Trump supporters decays more rapidly than for the Clinton ones, thus indicating a propensity to engage in a larger number of interactions from Clinton supporters.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    State information is slightly unbalanced: 36% for Trump supporters and 43% for Clinton supporters.

    “State information is slightly unbalanced (36% for Trump’s supporters, 43% for Clinton’s).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Users show disassortative, asymmetric behavior for popularity: low-score users tend to interact with high-score users, and the reverse is slightly less frequent.

    “and disassortative, asymmetric behavior for popularity.”
    • Also stated in: § Deviation of conditional and joint probabilities · plain
      “Users show a disassortative, slightly asymmetric behavior with respect to scores: users with low score tend to interact with users with high score, viceversa is less slightly frequent.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Users with a higher average score are more likely both to initiate and receive interactions.

    “users with a higher average score are more likely both to initiate and receive interactions.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The likelihood of interactions does not seem to be correlated with income inequality or education level.

    “the likelihood of interactions does not seem to be correlated with income inequality or education level.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    There is significant homophily among users living in the same US state; interactions between users in the same state are significantly more likely than random chance.

    “There is in fact a significant () homophily among users living in the same US state.”
    • Also stated in: § Discussion · plain
      “interactions between users located in the same state are significantly more likely than random chance.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Swing states are less likely to show cross-party interactions but foster more homophilic interactions.

    “We find swing states to be less likely to show cross-party interactions, but to foster more homophilic interactions ().”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In our data, the same measure used by Conover et al. gives opposite results.

    “In our data, the same measure gives opposite results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductreasoning

    There is no need to control for activity variables because the null model already takes that aspect into account.

    “There is no need to control for activity variables as our null model already takes that aspect into account, as explained next.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The null model assumes that interactions are unaffected by the political leaning of users.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Reddit was a fundamental platform for the success of Donald Trump's political campaign.

    “It was a fundamental platform for the success of Donald Trump’s political campaign23.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] Karpf, D. Digital politics after trump. Ann. Int. Commun. Assoc. 41, 198–207 (2017). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Polarization along party lines in the United States is on the rise, and the 2016 elections deepened the divide.

    “Polarization along party lines in the United States is on the rise2, and 2016 elections have deepen the divide3.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [2] Baldassarri, D. & Gelman, A. Partisans without constraint: Political polarization and trends in American public opinion. Am. J. Sociol. 114, 408–446 (2008). source
    • cites [3] Jacobson, G. C. Polarization, gridlock, and presidential campaign politics in 2016. Ann. Am. Acad. Polit. Soc. Sci. 667, 226–246 (2016). source
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    This liberal bias in the general opinion of r/politics does not seem to discourage Trump supporters from commenting in large numbers.

    “This liberal bias in the general opinion of r/politics, however, does not seem to discourage Trump supporters from commenting in large numbers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Study design and conductnone given

    The set of users of interest is not representative of r/politics users.

    “Our set of users of interest is not a representative of r/politics users.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The effects observed for political interactions across communities are not confounded by average score, fraction of positively scored comments, or both.

    “This result confirms that the effects we observe for political interactions across communities are not confounded by these other user characteristics.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductnone given

    The sampling procedure for negative links only changes the intercept coefficient and does not affect the interpretation of the important parts of the model.

    “This sampling procedure only changes the value of the intercept coefficient, which is not of interest, and does not affect the interpretation of the important parts of the model (the coefficients of the community variables under study).”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The null model assumes that interactions are unaffected by the political leaning of users.
  • May combine two claims.

    Interpretationreasoning

    Average score can be interpreted as a proxy measure for visibility: authors able to attract a large number of upvotes are also more prolific, and they also attract more comments, which explains the larger-than-one ratios.

    “We can interpret average score as a proxy measure for visibility: authors able to attract a large number of upvotes are also more prolific, and they also attract more comments, which explains the larger-than-one ratios.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The political leaning and general interests of Reddit users may differ from those of the general population.

    “it has been shown that the political leaning and general interests of Reddit users may differ from those of the general population46.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [46] Singer, P., Flöck, F., Meinhart, C., Zeitfogel, E. & Strohmaier, M. Evolution of reddit: From the front page of the internet to a self-referential community? In Proceedings of the 23rd International Conference on World Wide Web, 517–522, https://doi.org/10.1145/2567948.2576943 (New York, NY, USA, 2014). source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Bakshy et al. found homophily in the social network, which is the main cause of decrease of exposure to ideologically cross-cutting content (compared to the effect of the news feed algorithm).

    “Their findings show the presence of homophily in the social network, which is also the main cause of decrease of exposure to ideologically cross-cutting content (compared to the effect of the news feed algorithm).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [25] Bakshy, E., Messing, S. & Adamic, L. A. Exposure to ideologically diverse news and opinion on facebook. Science 348, 1130–1132 (2015). source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Mutz argued that conflicts within one's own social environment can produce ambivalence, which can in turn reduce the intensity of support for one's side.

    “Mutz26 arguing that conflicts within one’s own social environment can produce ambivalence, which can in turn reduce the intensity of support for one’s side.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [26] Mutz, D. C. The consequences of cross-cutting networks for political participation. Am. J. Polit. Sci. 838–855, 20 (2002). source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Conover et al. found that users are more likely to interact with people with whom they agree, with odds ratios of 1.2-1.3 for mentions and 1.7-2.3 for retweets, concluding that the retweet network is highly polarized.

    “they find that users are more likely to interact people with whom they agree, with an odds ratio of 1.2–1.3 for mentions and 1.7–2.3 for retweets, thus concluding that the retweet network is highly polarized.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [4] Conover, M. D. et al. Political polarization on twitter. In Fifth International AAAI Conference on Weblogs and Social Media (2011). source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Exposure to cross-cutting political views is associated with diminished political participation.

    “exposure to cross-cutting political views is associated with diminished political participation25–27.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [25] Bakshy, E., Messing, S. & Adamic, L. A. Exposure to ideologically diverse news and opinion on facebook. Science 348, 1130–1132 (2015). source
    • cites [26] Mutz, D. C. The consequences of cross-cutting networks for political participation. Am. J. Polit. Sci. 838–855, 20 (2002). source
    • cites [27] Huckfeldt, R., Mendez, J. M. & Osborn, T. Disagreement, ambivalence, and engagement: The political consequences of heterogeneous networks. Polit. Psychol. 25, 65–95 (2004). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The state-level aggregation is coarse-grained and does not take into consideration differences between areas within the same state (e.g., urban vs rural).

    “the state-level aggregation is coarse-grained, and does not take into consideration differences between areas within the same state (e.g., urban vs rural).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Barberá et al. found that exchange of information on some controversial topics on Twitter starts and persists as a national conversation participated by different political sides, before sliding into an echo-chamber picture.

    “The authors of Ref.43 found that the exchange of information with respect to some controversial topics on Twitter starts and persists as a national conversation participated by different political sides, before sliding into an echo-chamber picture.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [43] Barberá, P., Jost, J. T., Nagler, J., Tucker, J. A. & Bonneau, R. Tweeting from left to right: Is online political communication more than an echo chamber?. Psychol. Sci. 26, 1531–1542 (2015). source
  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Premisecitation

    People perceive to encounter more disagreement in online than in offline interactions.

    “Reportedly, people perceive to encounter more disagreement in online than in offline interactions42.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [42] Vaccari, C. How prevalent are filter bubbles and echo chambers on social media? Not as much as conventional wisdom has it (2018).

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Reddit is much more popular in urban rather than rural areas.

    “Reddit is much more popular in urban rather than rural areas44.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [44] Duggan, M. & Smith, A. 6% of online adults are reddit users. Pew Internet Am. Life Project 3, 1–10 (2013).
36 of 36
  • The authors state this as an assumption.

    The null model assumes that interactions are unaffected by the political leaning of users.

    “The simplest null model for our data follows the hypothesis that the interactions are unaffected by the political leaning of users.”
  • The authors state this as an assumption.

    The community interaction features are independent.

    “The combinations of these variables, that we assume to be independent, represent all four possible scenarios of political labels”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Studies on social media have found limited evidence for homogeneous clusters on most social media platforms; users may be unlikely to rebroadcast opposing content but are often exposed to it and may respond.

    “Studies on social media have found limited evidence for the described homogeneous clusters on most social media platforms: while users may be unlikely to rebroadcast content from the opposing side, they are often exposed to it and may even respond (11, 62–69).”

    From How digital media drive affective polarization through partisan sorting (2022) · cites this paper as [69]

    The Introduction and Discussion (pages unavailable) report that, in Reddit discussions of the 2016 US election, opposing political groups interacted more often than expected and Clinton supporters were particularly likely to answer Trump supporters. That supports the possibility of exposure and response, but the paper does not establish limited homogeneous clustering on most social media platforms; its Discussion describes echo chambers on other platforms. It also does not establish a general pattern of users declining to rebroadcast opposing content. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • On Reddit, studies find minimal evidence of echo chambers due to platform features encouraging cross-cutting exposure.

    “On Reddit, studies find minimal evidence of echo chambers due to platform features encouraging cross-cutting exposure [17,61,63].”

    From A systematic review of echo chamber research: comparative analysis of conceptualizations, operationalizations, and varying outcomes (2025) · cites this paper as [63]

    The Introduction reports no evidence of echo chambers and more cross-cutting political interactions than expected in the Reddit discussions studied. The Discussion suggests that Reddit’s forum structure might matter, but says further research is needed to determine whether the finding extends beyond the 2016 election; it does not establish that platform features caused the cross-cutting interactions. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • Reddit's customizable recommendation algorithms encourage exposure to diverse viewpoints, reducing echo chamber effects compared to Facebook.

    “For example, Reddit's customizable recommendation algorithms encourage exposure to diverse viewpoints, reducing echo chamber effects compared to Facebook [17,61,63].”

    From A systematic review of echo chamber research: comparative analysis of conceptualizations, operationalizations, and varying outcomes (2025) · cites this paper as [63]

    The Discussion reports interactions between opposing political groups on Reddit during the 2016 election and suggests that its forum structure may be less conducive to echo chambers than social networks such as Facebook. It does not attribute that difference to Reddit’s customizable recommendation algorithms; its discussion of Facebook instead emphasizes friendship-network homophily over the news-feed algorithm. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Reddit's customizable algorithms reduce echo chambers by encouraging diverse exposure.

    “Findings show that Reddit's customizable algorithms reduce echo chambers by encouraging diverse exposure [63]”

    From A systematic review of echo chamber research: comparative analysis of conceptualizations, operationalizations, and varying outcomes (2025) · cites this paper as [63]

    The Discussion reports increased interactions between people with opposing political views on Reddit during the 2016 election, consistent with the claim’s reduced-echo-chamber finding. It does not establish that Reddit’s customizable algorithms caused those interactions or encouraged diverse exposure; the paper instead raises its forum structure as a possible explanation. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Cites

Flagged first, then by citations

5 of the 55 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. Guess, A., Nyhan, B., Lyons, B. & Reifler, J. Avoiding the Echo Chamber About Echo Chambers (Knight Foundation, Miami, 2018).

Cited by

Sorted by citations

Authors
De Francisci Morales, G., Monti, C., & Starnini, M.
Affiliations
Institute for Scientific Interchange (IT)
Corresponding author
  • Monti, Corrado
  • Starnini, Michele
Venue
Scientific Reports
Published
2021-02-02
Volume
11
Issue
1
Pages
2818-2818
ISSN
2045-2322 (ISSN-L)
OpenAlex
W3127024247
Cited by
98
References
55
Citations by year
2026: 13 · 2025: 25 · 2024: 15 · 2023: 19 · 2022: 18 · 2021: 8
FWCI
19.87
Type
journal article
Language
en
Open access
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • UPCommons institutional repository (Universitat Politècnica de Catalunya) (submittedVersion, cc-by)
  • PubMed Central (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
Intesa Sanpaolo Innovation Center
Topics
  • Social Sciences › Communication › Social Media and Politics
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Opinion Dynamics and Social Influence
Keywords
echo chambers, political polarization, Reddit, 2016 US presidential election, Donald Trump, Hillary Clinton, asymmetric interactions, electoral abstention, public opinion formation, social media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review