Cited by 0Complex Network Analysis TechniquesOpinion Dynamics and Social InfluenceSocial Media and Politics

DSP: A Statistically-Principled Structural Polarization Measure

Open access
Preti, Giulia, Riondato, Matteo, Gionis, Aristides, De Francisci Morales, Gianmarco·2026·Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining

Abstract

Social and information networks may become polarized, leading to echo chambers and political gridlock. Accurately measuring this phenomenon is a critical challenge. Existing measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks, and failing to distinguish real-world networks from randomized null models. We introduce DSP, a Diffusion-based Structural Polarization measure designed from first principles to correct for such biases. DSP removes the arbitrary concept of 'influencers' used by the popular Random Walk Controversy (RWC) score, instead treating every node as a potential origin for a random walk. To validate our approach, we introduce a set of desirable properties for polarization measures, expressed through reference topologies with known structural properties. We show that DSP satisfies these desiderata, being near-zero for non-polarized structures such as cliques and random networks, while correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks. Our method applied to U.S. Congress datasets uncovers trends of increasing polarization in recent years. By integrating a null model into its core definition, DSP provides a reliable and interpretable diagnostic tool, highlighting the necessity of statistically-grounded metrics to analyze societal fragmentation.

AI snapshot

Written from the paper’s full text.

TL;DR

DSP is a diffusion-based structural polarization measure designed to be zero in expectation on labeled Erdős–Rényi \(G(n,p,\ell)\) networks by removing RWC’s arbitrary “influencers” and treating every vertex as a diffusion source. It satisfies reference-topology desiderata, distinguishes polarized from non-polarized real networks comparably to RWC, and shows increasing polarization in U.S. Congress data.

Key findings

  • DSP is near-zero on \(G(n,p,\ell)\) random networks across average degrees and partition skews (50%, 70%, 90% red), while RWC and ARWC show positive bias; among other measures, only AEI consistently produces desired near-zero values.
  • On reference topologies, DSP gives 0 on bi-colored cliques regardless of partition sizes, negative values on color-alternating cycles, and maximum/positive values on monochromatic-splittable networks; denoising via the \(1k\)-series often worsens other measures’ scores.
  • On real data, DSP achieves AUC values close to RWC for distinguishing polarized from non-polarized networks; on Congress data, DSP scores correlate between co-sponsorship and roll-call networks (House Pearson 0.73, Spearman 0.70; Senate Pearson 0.59, Spearman 0.74), and bill-cosponsorship DSP remains below 0.16 across sessions while showing a general increase over time.
  • Approximate DSP using vertex samples needs at least 20% of vertices for good approximation and at least 40% to reduce variability; ROC/AUC remains roughly stable across sample sizes.

Methods

  • DSP defines a diffusion process \(\phi_v\) (instantiated as random walk with restart) from every vertex, computes vertex exposure \(h_Q(v)\) to each community, and aggregates via a probing process that samples target community, target vertex, and source community without predefined influencers.
  • Validation uses synthetic reference networks (cliques, color-alternating cycles, monochromatic-splittable networks), the \(G(n,p,\ell)\) null model, and stochastic block models, with analytical derivations and simulations.
  • Real-world experiments use salloum (183 polarized/non-polarized Twitter retweet networks from the 2019 Finnish Parliamentary Elections), congress-bill-cosp and congress-bill-rollcall (93rd–114th U.S. Congresses), ROC/AUC classification, sampling-based approximation, and Polaris/configuration-model null comparisons.

Limitations

  • The paper states that theoretically deriving the sample complexity of approximate DSP is left as future work, and that additional properties on more reference classes are future work.
  • The paper states DSP is sensitive to the choice of \(\alpha\): lower \(\alpha\) decreases DSP on alternating cycles, though classification performance remains stable in tested settings.
  • The paper notes exact DSP computation is computationally intensive (\(O(nmk)\) for PPR from every vertex), motivating sampling-based approximation; it also discusses ethical risks of misuse and overinterpretation. Evident from the text: empirical validation is limited to the listed synthetic families and real datasets, and the approximation’s accuracy depends on retaining a substantial fraction of vertices.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3773966.3777942

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

14 of 23 cited sources checked · 6 supported · 2 flagged · accuracy not yet measured

  • Premisereasoning
    § 1 Introduction · p. 1

    Post-hoc normalization via randomization tests remains fundamentally unprincipled, as it applies arbitrary null models retroactively without rigorous justification.

    “Attempts to correct these biases, such as post-hoc normalization via randomization tests [38], remain fundamentally unprincipled, as they apply arbitrary null models retroactively without rigorous justification.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source

      Section 3 (Methods; page unavailable) specifies what each null model preserves and explains why randomization is used to separate structural bias from polarization, rather than presenting the models as arbitrary. Section 5.3 (Normalization of the scores; page unavailable) reports that every normalized score outperformed the best unnormalized score. The paper uses and supports this approach; it does not characterize it as fundamentally unprincipled. (LLM, conf=0.88)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Findingown data
    § 4.1 Reference Network Topologies · p. 7

    Overall, denoising [38] often moves the polarization scores away from their ideal values rather than correcting them.

    “Overall, denoising [38] often moves the polarization scores away from their ideal values rather than correcting them.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source

      Section 5.3 says denoising corrects for the expected effects of network size and degree distribution, and reports improved performance for all scores after normalization. The Discussion (Section 6) recommends the procedure because it removes substantial noise. The paper does not describe denoising as often moving scores away from ideal values; it reports the opposite effect on its evaluation measures. Page numbers were not available in our copy. (LLM, conf=0.90)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Interpretationcitation
    § 2.2 The RWC Measure and its Limitations · p. 3

    The proposed solution of standardizing the RWC score by its values in a random graph null model requires considerable computational resources.

    “In addition, it requires considerable computational resources.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source

      Section 5.3 (page unavailable) says normalization requires randomizing the network multiple times and recomputing the score; the authors sampled each network 500 times. This supports the claim that the procedure involves repeated computation, but the paper does not characterize its resource requirements as considerable. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Interpretationcitation
    § 1 Introduction · p. 1

    DSP removes the biases found in the original Random Walk Controversy by eliminating the problematic role of predefined influencers.

    “Our design explicitly removes the biases found in the original Random Walk Controversy (RWC) [15], by eliminating the problematic role of predefined influencers.”
    • Also stated in: § Abstract · p. 1 · plain
      “DSP removes the arbitrary concept of 'influencers' used by the popular Random Walk Controversy (RWC) score, instead treating every node as a potential origin for a random walk.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source

      The Results > Synthetic data section reports a limitation of Random Walk Controversy (RWCG): it misses changes in opinion polarization because it bisects the network into two communities. Our copy does not identify predefined influencers as the source of that limitation or say that removing them eliminates bias. The citing authors’ statement about their own design is not a finding attributed to this source. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Premisecitation
    § 2.2 The RWC Measure and its Limitations · p. 3

    RWC has systematic bias.

    “A key critique of RWC (as well as of other measures) is its systematic bias [38].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
  • May combine two claims. 20
  • Classified as probably not a substantial claim. 13
  • Borderline: one of the tests for a substantial claim is unclear. 1
  • The quote only partly states this claim. 2
  • May combine two claims.

    Premisecitation
    § 1 Introduction · p. 1

    Recent structural polarization measures such as Betweenness Centrality Controversy, Boundary Polarization, Dipole Polarization, Krackhardt E/I Ratio, and Random Walk Controversy can produce high polarization scores even for random networks, indicating sensitivity to elementary network features such as average degree and network size.

    “Other more recent measures, such as Betweenness Centrality Controversy [15], Boundary Polarization [16], Dipole Polarization [29], Krackhardt E/I Ratio [22], and Random Walk Controversy [15], can produce high polarization scores even for random networks, indicating an undesirable sensitivity to elementary network features such as average degree and network size [38].”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source

      Split into 2 atoms — 0 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
    • cites [16] [16] Pedro Guerra, Wagner Meira Jr, Claire Cardie, and Robert Kleinberg. 2013. A measure of polarization on social media networks based on community boundaries. In ICWSM , Vol. 7. 215-224. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
    • The authors state this as an assumption: High polarization scores on random networks are undesirable.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 2.2 The RWC Measure and its Limitations · p. 3

    RWC is a widely-used structural polarization measure that informs the present work.

    “RWC [12, 15] is a widely-used structural polarization measure that informs the present work.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [12] [12] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2016. Quantifying Controversy in Social Media. In WSDM . ACM, 33-42. - source

      Section 6.1 defines RWC as a random-walk measure of controversy on a graph, supporting its identification as a structural polarization measure. Section 8.4 evaluates and uses the score, but our copy does not establish that it is widely used. Whether it informs the citing authors’ present work is their own framing, not a claim this source can verify. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
    • cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 2.2 The RWC Measure and its Limitations · p. 3

    RWC measures the relative exposure of a user to influential members of their own community versus those of an opposing community.

    “At its core, RWC measures the relative exposure of a user to influential members of their own community versus those of an opposing community.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [12] [12] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2016. Quantifying Controversy in Social Media. In WSDM . ACM, 33-42. - source
    • cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source

      The Results section identifies RWC as a random-walk controversy measure, and the Synthetic data section says it bisects a network into two communities and detects structural separation. Our copy does not explain RWC as measuring an individual user’s relative exposure to influential members of their own versus the opposing community; it refers calculation details to section S1. (LLM, conf=0.77)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given
    § 3 DSP: Improved Polarization Measure · p. 5

    With k >= 2 colors, the range of DSP is roughly (-1/k, 1/k).

    “With 𝑘 ≥ 2 colors, the range of the DSP is roughly (-1 / 𝑘 , 1 / 𝑘 ) .”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 4.1 Reference Network Topologies · p. 5

    In a bi-colored clique with 5000 vertices, EI and CCA are sensitive to community size imbalance and yield positive scores when the partition is unbalanced.

    “EI and CCA, which are sensitive to community size imbalance and yield positive scores when the partition is unbalanced.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § Abstract · p. 1

    DSP satisfies the proposed desiderata, being near-zero for non-polarized structures such as cliques and random networks.

    “We show that DSP satisfies these desiderata, being near-zero for non-polarized structures such as cliques and random networks, while correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Cliques and random networks are non-polarized structures.
  • May combine two claims.

    Findingreasoning
    § 4.1 Reference Network Topologies · p. 5

    In a clique, the denominators of Equation (4) are all equal to 1, and the four numerators are (|R|-1)/(n-1), |B|/(n-1), (|B|-1)/(n-1), and |R|/(n-1).

    “The denominators of Equation (4) are therefore all equal to 1, while the four numerators are, in order, (| 𝑅 | -1 )/( 𝑛 -1 ) , | 𝐵 |/( 𝑛 -1 ) , (| 𝐵 | -1 )/( 𝑛 -1 ) , and | 𝑅 |/( 𝑛 -1 ) .”
    Quote in the paperSubstantial claim
  • Borderline on S3 (load-bearing), S4 (based): unclear from the text.

    Findingnone given
    § 1 Introduction · p. 2

    DSP can be approximated efficiently with good accuracy.

    “Finally, we show that DSP can be approximated efficiently with good accuracy.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data
    § 4.1 Reference Network Topologies · p. 5

    In a bi-colored clique with 5000 vertices, measures other than RWC, ARWC, DM, EI, and CCA yield the desired polarization score of 0.

    “the other measures yield the desired polarization score of 0”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § E Additional Experiments · p. 12

    Excluding influencers from the restart set removes the bias that RWC exhibits on random graphs; average RWC score in random networks drawn from G(n,p,l) converges to zero.

    “Indeed, Figure 1 shows that, under this modification, the average RWC score in random networks drawn from 𝐺 ( 𝑛, 𝑝, ℓ ) correctly converges to zero.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 5 Experiments on real-world data · p. 9

    DSP scores are correlated between co-sponsorship and roll-call networks; in the House, Pearson is 0.73 and Spearman is 0.70; in the Senate, Pearson is 0.59 and Spearman is 0.74.

    “Consistently, we observe correlated DSP scores between the two types of congress networks, especially in the House, where both Pearson (0.73) and Spearman (0.70) are high. In the Senate, while Pearson is lower (0.59), Spearman remains high (0.74), indicating a strong agreement in trend.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § E Additional Experiments · p. 13

    Higher assortativity tends to correspond to higher polarization scores across datasets.

    “This chart helps understand whether higher assortativity tends to correspond to higher polarization scores. We find that this relationship generally holds across datasets.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 5 Experiments on real-world data · p. 9

    There is a general increase in polarization over time in the bill-cosponsorship networks.

    “Nonetheless, consistent with previous research, we observe a general increase in polarization over time [13].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] [13] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2017. The Effect of Collective Attention on Controversial Debates on Social Media. In International Web Science Conference . ACM, 43-52. - source
  • May combine two claims.

    Findingown data
    § 4.3 The Stochastic Block Model · p. 7

    In SBM networks (n=1600, 2 blocks, 100 networks), DSP increases with denser intra-community connectivity and decreases as inter-community connectivity increases; for fixed intra-community connectivity, lower inter-community connectivity gives higher scores.

    “DSP behaves as expected: it increases with denser intra-community connectivity and decreases as inter-community connectivity increases. For a fixed intra-community connectivity, lower inter-community connectivity gives higher scores.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: In the stochastic block model, higher intra-block edge probability p, especially with lower inter-block edge probability q, corresponds to higher structural polarization; increasing q reduces structural polarization.
  • The quote only partly states this claim.

    Findingown data
    § E Additional Experiments · p. 12

    DSP performance is comparable to RWC on the garimella networks.

    “Figure 13 shows that the performance of DSP is comparable to that of RWC.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 1 Introduction · p. 1

    Different null assumptions, such as preserving degree sequences versus erasing all structure, yield conflicting baselines, so post-hoc normalization risks over- or under-correction.

    “As such, they risk over- or under-correction, as different null assumptions (e.g., preserving degree sequences vs. erasing all structure) yield conflicting baselines [35].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [35] [35] Giulia Preti, Gianmarco De Francisci Morales, and Matteo Riondato. 2022. ALICE and the Caterpillar: A More Descriptive Null Model for Assessing Data Mining Results. In ICDM . IEEE. - source
  • May combine two claims.

    Premisenone given
    § Abstract · p. 1

    Existing structural polarization measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks and failing to distinguish real-world networks from randomized null models.

    “Existing measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks, and failing to distinguish real-world networks from randomized null models.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: High polarization scores on random networks are undesirable.
  • May combine two claims.

    Premisereasoning
    § 1 Introduction · p. 1

    Normalization is treated as an external adjustment rather than a core component of the measure's design, perpetuating ambiguities in score interpretation.

    “Moreover, normalization is treated as an external adjustment rather than a core component of the measure's design, perpetuating ambiguities in score interpretation.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 3 DSP: Improved Polarization Measure · p. 5

    The DSP definitions for k >= 2 colors collapse to the previous ones when k=2.

    “These definitions collapse to the previous ones when 𝑘 = 2.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given
    § 2.2 The RWC Measure and its Limitations · p. 3

    There is no a priori way to define the set of influencers within each community.

    “there is no a priori way to define the set of influencers within each community”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 3 DSP: Improved Polarization Measure · p. 3

    In smaller networks, or when using more influencers, the RWC bias can be substantial.

    “In smaller networks, or when using more influencers, this bias can be substantial.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given
    § Abstract · p. 1

    DSP is designed from first principles to correct for biases in structural polarization measurement.

    “We introduce DSP, a Diffusion-based Structural Polarization measure designed from first principles to correct for such biases.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § 3 DSP: Improved Polarization Measure · p. 5

    It is possible to extend the DSP definition to the general case of k >= 2 colors.

    “It is possible to extend the DSP definition to the general case of 𝑘 ≥ 2 colors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 3 DSP: Improved Polarization Measure · p. 4

    Calculating DSP boils down to computing four aggregate diffusion scores.

    “The equation shows that calculating DSP boils down to computing four aggregate diffusion scores: within-community ( 𝑅 → 𝑅 ,”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
  • May combine two claims.

    Interpretationreasoning
    § Abstract · p. 1

    DSP provides a reliable and interpretable diagnostic tool.

    “By integrating a null model into its core definition, DSP provides a reliable and interpretable diagnostic tool, highlighting the necessity of statistically-grounded metrics to analyze societal fragmentation.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given
    § 2.2 The RWC Measure and its Limitations · p. 3

    There is no principled criterion for choosing how many influencers to include in the set.

    “there is no principled criterion for choosing how many influencers to include in the set.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning
    § 1 Introduction · p. 1

    By considering every vertex a potential source, DSP becomes more robust to different network structures and better reflects how information spreads across the network.

    “Nonetheless, by considering every vertex a potential source, DSP becomes more robust to different network structures and better reflects how information spreads across the network (see Section 4).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 3 DSP: Improved Polarization Measure · p. 3

    DSP is designed to eliminate the biases of existing measures by removing the concept of influencers and considering every vertex as a potential source of diffusion.

    “DSP is designed to eliminate the biases of existing measures by removing the concept of 'influencers' and instead considering every vertex as a potential source of diffusion.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
  • May combine two claims.

    Premisenone given
    § 1 Introduction · p. 2

    A random walk (re)starting from a given vertex v has high probability of visiting v more frequently, introducing a new source of bias when all vertices are potential influencers.

    “Eliminating the idea of designating a small number of vertices as influencers and considering all vertices as potential influencers poses new challenges, as a random walk (re)starting from a given vertex 𝑣 has high probability of visiting vertex 𝑣 more frequently, which introduces a new source of bias.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § 5 Experiments on real-world data · p. 9

    Co-sponsorship data can produce estimates of ideal points that are highly correlated with those derived from roll-call votes.

    “Despite these differences, previous work [3] showed that co-sponsorship data can produce estimates of ideal points that are highly correlated with those derived from roll-call votes.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [3] [3] Eduardo Alemán, Ernesto Calvo, Mark P Jones, and Noah Kaplan. 2009. Comparing Cosponsorship and Roll-Call Ideal Points. Legislative studies quarterly 34, 1 (2009), 87-116. - source
  • May combine two claims.

    Interpretationreasoning
    § E Additional Experiments · p. 12

    The decrease in DSP as α decreases is expected because each node's immediate neighbors belong to the opposite community; when diffusion is more strongly influenced by neighbors, more probability mass flows across community boundaries, leading to a lower polarization score.

    “This behavior is expected, as each node's immediate neighbors belong to the opposite community. When the diffusion process is more strongly influenced by neighbors, more probability mass flows across community boundaries, leading to a lower polarization score.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data
    § 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7

    DSP is robust to partition size and network density.

    “The average DSP score is close to 0 with minimal deviations for all average degrees and partition skews, proving the robustness of the measure to the partition size and network density.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning
    § 5 Experiments on real-world data · p. 9

    DSP is a structural measure and will yield high values only when the network presents a strong structural division.

    “This result is expected, as DSP is a structural measure, and thus, will yield high values only when the network presents a strong structural division.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § B Limitations of Assortativity as a Polarization Measure · p. 12

    Assortativity is overly sensitive to initial structural changes when separation is weak, but loses sensitivity as structural separation becomes strong.

    “Similarly, Hohmann et al. [18] showed that assortativity is overly sensitive to initial structural changes when separation is weak, but loses sensitivity as structural separation becomes strong.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [18] [18] Marilena Hohmann, Karel Devriendt, and Michele Coscia. 2023. Quantifying ideological polarization on a network using generalized Euclidean distance. Science Advances 9, 9 (March 2023), eabq2044. - source
  • May combine two claims.

    Interpretationown data
    § E Additional Experiments · p. 12

    The fix addresses the issue in random graphs but simultaneously degrades performance on networks where strong polarization should be clearly detectable.

    “In other words, while the fix addresses the issue in random graphs, it simultaneously degrades performance on networks where strong polarization should be clearly detectable.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: For the bi-colored half-split cycle with 5000 vertices, the expected polarization value is close to 1.
35 of 35
  • The authors state this as an assumption.

    High polarization scores on random networks are undesirable.

    “can produce high polarization scores even for random networks, indicating an undesirable sensitivity to elementary network features such as average degree and network size [38].”
  • The authors state this as an assumption.

    Cliques and random networks are non-polarized structures.

    “being near-zero for non-polarized structures such as cliques and random networks”
  • The authors state this as an assumption.

    Monochromatic-splittable networks have a known expected polarization.

    “correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks”
  • The authors state this as an assumption.

    The function phi_v is arbitrary provided it does not depend on the colors of the vertices.

    “We assume a function 𝜙 𝑣 : 𝑉 → R + that assigns a non-negative value to each vertex 𝑤 ∈ 𝑉 , parameterized by a vertex 𝑣 ∈ 𝑉 . The function 𝜙 𝑣 is arbitrary, provided it does not depend on the colors of the vertices.”
  • The authors state this as an assumption.

    For every vertex v in R, the sum of diffusion scores from vertices in R to v equals 1.

    “assume that for every 𝑣 ∈ 𝑅 it is 𝑤 ∈ 𝑅 𝜋 𝑤 ( 𝑣 ) = 1”
  • The authors state this as an assumption.

    For every vertex v in B, the sum of diffusion scores from vertices in B to v equals 1.

    “and for every 𝑣 ∈ 𝐵 it is 𝑤 ∈ 𝐵 𝜋 𝑤 ( 𝑣 ) = 1”
  • The paper relies on this without support.

    For the bi-colored half-split cycle with 5000 vertices, the expected polarization value is close to 1.

    “even though the expected value for this highly polarized topology is close to 1”
  • The paper relies on this without support.

    In the stochastic block model, higher intra-block edge probability p, especially with lower inter-block edge probability q, corresponds to higher structural polarization; increasing q reduces structural polarization.

    “Higher values of 𝑝 , especially when paired with lower values of 𝑞 , correspond to higher structural polarization. In contrast, increasing 𝑞 leads to greater inter-community connectivity, hence reducing structural polarization.”
8 of 8

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Modularity is assigned two different null models

    Minor

    Section 4.2 says modularity uses an Erdős-Rényi null model, while Appendix A says it uses the configuration model.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. Michael Conover, Jacob Ratkiewicz, Matthew Francisco, Bruno Gonçalves, Filippo Menczer, and Alessandro Flammini. 2011. Political polarization on twitter. In ICWSM, Vol. 5. 89-96.
  2. George Karypis and Vipin Kumar. 1997. METIS: A software package for partitioning unstructured graphs, partitioning meshes, and computing fill-reducing orderings of sparse matrices. (1997).
  3. Jeffrey B Lewis, Keith Poole, Howard Rosenthal, Adam Boche, Aaron Rudkin, and Luke Sonnet. 2019. Voteview: Congressional roll-call votes database. See https://voteview.com/(accessed 27 July 2018) (2019).

Authors
Preti, G., Riondato, M., Gionis, A., & De Francisci Morales, G.
Affiliations
  • CENTAI, Turin, Italy
  • Amherst College (US)
  • KTH Royal Institute of Technology (SE)
Venue
Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining
Publisher
ACM
Published
2026-02-21
Pages
531-540
OpenAlex
W7129025265
Cited by
0
References
9
FWCI
0.00
Type
conference paper
Open access
Licence
cc-by
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation (2238693)
  • European Research Council (834862)
  • European Commission (101168951)
Topics
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Opinion Dynamics and Social Influence
  • Social Sciences › Communication › Social Media and Politics
Keywords
structural polarization, null models, echo chambers, political polarization, United States Congress, cliques

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review