DSP: A Statistically-Principled Structural Polarization Measure
Open accessAbstract
Social and information networks may become polarized, leading to echo chambers and political gridlock. Accurately measuring this phenomenon is a critical challenge. Existing measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks, and failing to distinguish real-world networks from randomized null models. We introduce DSP, a Diffusion-based Structural Polarization measure designed from first principles to correct for such biases. DSP removes the arbitrary concept of 'influencers' used by the popular Random Walk Controversy (RWC) score, instead treating every node as a potential origin for a random walk. To validate our approach, we introduce a set of desirable properties for polarization measures, expressed through reference topologies with known structural properties. We show that DSP satisfies these desiderata, being near-zero for non-polarized structures such as cliques and random networks, while correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks. Our method applied to U.S. Congress datasets uncovers trends of increasing polarization in recent years. By integrating a null model into its core definition, DSP provides a reliable and interpretable diagnostic tool, highlighting the necessity of statistically-grounded metrics to analyze societal fragmentation.
AI snapshot
Written from the paper’s full text.
TL;DR
DSP is a diffusion-based structural polarization measure designed to be zero in expectation on labeled Erdős–Rényi \(G(n,p,\ell)\) networks by removing RWC’s arbitrary “influencers” and treating every vertex as a diffusion source. It satisfies reference-topology desiderata, distinguishes polarized from non-polarized real networks comparably to RWC, and shows increasing polarization in U.S. Congress data.
Key findings
- DSP is near-zero on \(G(n,p,\ell)\) random networks across average degrees and partition skews (50%, 70%, 90% red), while RWC and ARWC show positive bias; among other measures, only AEI consistently produces desired near-zero values.
- On reference topologies, DSP gives 0 on bi-colored cliques regardless of partition sizes, negative values on color-alternating cycles, and maximum/positive values on monochromatic-splittable networks; denoising via the \(1k\)-series often worsens other measures’ scores.
- On real data, DSP achieves AUC values close to RWC for distinguishing polarized from non-polarized networks; on Congress data, DSP scores correlate between co-sponsorship and roll-call networks (House Pearson 0.73, Spearman 0.70; Senate Pearson 0.59, Spearman 0.74), and bill-cosponsorship DSP remains below 0.16 across sessions while showing a general increase over time.
- Approximate DSP using vertex samples needs at least 20% of vertices for good approximation and at least 40% to reduce variability; ROC/AUC remains roughly stable across sample sizes.
Methods
- DSP defines a diffusion process \(\phi_v\) (instantiated as random walk with restart) from every vertex, computes vertex exposure \(h_Q(v)\) to each community, and aggregates via a probing process that samples target community, target vertex, and source community without predefined influencers.
- Validation uses synthetic reference networks (cliques, color-alternating cycles, monochromatic-splittable networks), the \(G(n,p,\ell)\) null model, and stochastic block models, with analytical derivations and simulations.
- Real-world experiments use salloum (183 polarized/non-polarized Twitter retweet networks from the 2019 Finnish Parliamentary Elections), congress-bill-cosp and congress-bill-rollcall (93rd–114th U.S. Congresses), ROC/AUC classification, sampling-based approximation, and Polaris/configuration-model null comparisons.
Limitations
- The paper states that theoretically deriving the sample complexity of approximate DSP is left as future work, and that additional properties on more reference classes are future work.
- The paper states DSP is sensitive to the choice of \(\alpha\): lower \(\alpha\) decreases DSP on alternating cycles, though classification performance remains stable in tested settings.
- The paper notes exact DSP computation is computationally intensive (\(O(nmk)\) for PPR from every vertex), motivating sampling-based approximation; it also discusses ethical risks of misuse and overinterpretation. Evident from the text: empirical validation is limited to the listed synthetic families and real datasets, and the approximation’s accuracy depends on retaining a substantial fraction of vertices.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
14 of 23 cited sources checked · 6 supported · 2 flagged · accuracy not yet measured
- Premisereasoning§ 1 Introduction · p. 1
Post-hoc normalization via randomization tests remains fundamentally unprincipled, as it applies arbitrary null models retroactively without rigorous justification.
“Attempts to correct these biases, such as post-hoc normalization via randomization tests [38], remain fundamentally unprincipled, as they apply arbitrary null models retroactively without rigorous justification.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
Section 3 (Methods; page unavailable) specifies what each null model preserves and explains why randomization is used to separate structural bias from polarization, rather than presenting the models as arbitrary. Section 5.3 (Normalization of the scores; page unavailable) reports that every normalized score outperformed the best unnormalized score. The paper uses and supports this approach; it does not characterize it as fundamentally unprincipled. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
- Findingown data§ 4.1 Reference Network Topologies · p. 7
Overall, denoising [38] often moves the polarization scores away from their ideal values rather than correcting them.
“Overall, denoising [38] often moves the polarization scores away from their ideal values rather than correcting them.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
Section 5.3 says denoising corrects for the expected effects of network size and degree distribution, and reports improved performance for all scores after normalization. The Discussion (Section 6) recommends the procedure because it removes substantial noise. The paper does not describe denoising as often moving scores away from ideal values; it reports the opposite effect on its evaluation measures. Page numbers were not available in our copy. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
- Interpretationcitation§ 2.2 The RWC Measure and its Limitations · p. 3
The proposed solution of standardizing the RWC score by its values in a random graph null model requires considerable computational resources.
“In addition, it requires considerable computational resources.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
Section 5.3 (page unavailable) says normalization requires randomizing the network multiple times and recomputing the score; the authors sampled each network 500 times. This supports the claim that the procedure involves repeated computation, but the paper does not characterize its resource requirements as considerable. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Interpretationcitation§ 1 Introduction · p. 1
DSP removes the biases found in the original Random Walk Controversy by eliminating the problematic role of predefined influencers.
“Our design explicitly removes the biases found in the original Random Walk Controversy (RWC) [15], by eliminating the problematic role of predefined influencers.”
- Also stated in: § Abstract · p. 1 · plain
“DSP removes the arbitrary concept of 'influencers' used by the popular Random Walk Controversy (RWC) score, instead treating every node as a potential origin for a random walk.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source
The Results > Synthetic data section reports a limitation of Random Walk Controversy (RWCG): it misses changes in opinion polarization because it bisects the network into two communities. Our copy does not identify predefined influencers as the source of that limitation or say that removing them eliminates bias. The citing authors’ statement about their own design is not a finding attributed to this source. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Also stated in: § Abstract · p. 1 · plain
- Premisecitation§ 2.2 The RWC Measure and its Limitations · p. 3
RWC has systematic bias.
“A key critique of RWC (as well as of other measures) is its systematic bias [38].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
- Premisecitation§ 2.2 The RWC Measure and its Limitations · p. 3
RWC reports positive polarization scores on random Erdős-Rényi networks where edges are independent and no true structural division exists.
“The measure reports positive polarization scores on random Erdős-Rényi networks, where edges are independent, thus no true structural division exists.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
- Interpretationcitation§ 2.2 The RWC Measure and its Limitations · p. 3
The proposed solution of standardizing the RWC score by its values in a random graph null model is post-hoc.
“Second, the solution, while widely applicable to all measures, is post-hoc.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
- Premisecitation§ B Limitations of Assortativity as a Polarization Measure · p. 12
Assortativity alone is insufficient to explain the overall level of polarization of a network.
“Additionally, existing studies additionally indicate that assortativity alone is insufficient to explain the overall level of polarization of a network.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [33] [33] Leto Peel, Jean-Charles Delvenne, and Renaud Lambiotte. 2018. Multiscale mixing patterns in networks. Proceedings of the National Academy of Sciences 115, 16 (2018), 4057-4062. - source
The Introduction (p. 2) and section 2 (p. 7) argue for measuring polarization with network modularity rather than relying on spatial-model measures. A search for “assortativity” found no passage addressing whether assortativity alone is insufficient, so our copy does not verify the specific claim. (LLM, conf=0.75)
Experimental — accuracy not yet measured
- Findingown data§ 4.1 Reference Network Topologies · p. 5
In a bi-colored clique with 5000 vertices, DM presents a positive bias on balanced partitions.
“DM, which also presents a positive bias on balanced partitions”
Quote in the paperSubstantial claim - Findingreasoning§ 4.1 Reference Network Topologies · p. 6
In monochromatic-splittable networks, as alpha decreases, the value of DSP tends to its maximum attainable value n/(2(n-1)).
“Thus, the value of DSP tends to its maximum attainable value 𝑛 2 ( 𝑛 -1 ) , as these are exactly the conditions that we assumed when analyzing the range of DSP (recall that DSP ∈ ( -1 / 2 , 1 / 2 ) approximately).”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
In a bi-colored half-split cycle with 5000 vertices, all measures yield positive scores for both partitioning scenarios (equal-sized and 90%-10%).
“We observe that all measures yield positive scores for both partitioning scenarios”
Quote in the paperNot a substantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 6
In a bi-colored alternating cycle with 5000 vertices, RWC and ARWC display a positive bias.
“As in the clique experiment, RWC and ARWC display a positive bias.”
Quote in the paperSubstantial claim - Findingown data§ 1 Introduction · p. 2
For real-world networks, DSP distinguishes ideologically polarized communities from structurally similar but neutralized configurations.
“Second, for real-world networks, DSP distinguishes ideologically polarized communities from structurally similar but neutralized configurations, further demonstrating its robustness to group size imbalances and addressing limitations of both RWC and traditional metrics.”
Quote in the paperSubstantial claim - Findingreasoning§ 4.1 Reference Network Topologies · p. 6
A lower value of alpha for phi_v (a RWR that restarts more often) leads to a lower value of z.
“A lower value of 𝛼 for 𝜙 𝑣 (a RWR that restarts more often) leads to a lower value of 𝑧 .”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
In a bi-colored half-split barbell network with 2000 vertices, most measures correctly reach the desired polarization value of 1 in the balanced case.
“Most measures correctly reach this value in the balanced case”
Quote in the paperNot a substantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
In a bi-colored half-split cycle with 5000 vertices, DSP consistently achieves the highest possible score, along with a few other measures.
“DSP consistently achieves the highest possible score, along with a few other measures.”
Quote in the paperSubstantial claim - Findingreasoning§ 3 DSP: Improved Polarization Measure · p. 5
Under the assumptions that for every v in R, sum_{w in R} pi_w(v)=1, and for every v in B, sum_{w in B} pi_w(v)=1, DSP is maximized.
“assume that for every 𝑣 ∈ 𝑅 it is 𝑤 ∈ 𝑅 𝜋 𝑤 ( 𝑣 ) = 1 , and for every 𝑣 ∈ 𝐵 it is 𝑤 ∈ 𝐵 𝜋 𝑤 ( 𝑣 ) = 1 . It is easy to see that these assumptions maximize the value of DSP to be”
Quote in the paperSubstantial claim- The authors state this as an assumption: For every vertex v in R, the sum of diffusion scores from vertices in R to v equals 1.
- The authors state this as an assumption: For every vertex v in B, the sum of diffusion scores from vertices in B to v equals 1.
- Findingown data§ 4.1 Reference Network Topologies · p. 5
In a bi-colored clique with 5000 vertices, RWC and ARWC exhibit a positive bias.
“We observe that RWC and its adaptive variant ARWC exhibit a positive bias.”
Quote in the paperSubstantial claim - Findingnone given§ 4.1 Reference Network Topologies · p. 7
The value z1, which is a function of n and alpha, increases as alpha decreases.
“The value 𝑧 1 , which is a function of 𝑛 and 𝛼 , increases as 𝛼 decrease.”
Quote in the paperNot a substantial claim - Findingreasoning§ 2.2 The RWC Measure and its Limitations · p. 3
Excluding influencers from the restart set corrects the bias for random graphs.
“As shown in Figure 1, a simple fix is to exclude influencers from the restart set, which corrects the bias for random graphs.”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 6
In a bi-colored alternating cycle with 5000 vertices, denoising often worsens the results: measures that initially yield negative values become less negative or even turn positive after applying the proposed correction.
“We observe that the denoising often worsens the results: measures that initially yield negative values become less negative-or even turn positive-after applying the proposed correction.”
Quote in the paperNot a substantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
In a bi-colored half-split cycle with 5000 vertices, in several cases, the denoising approach reduces these values, worsening their performance.
“however, in several cases, the denoising approach reduces these values, hence worsening their performance.”
Quote in the paperSubstantial claim - Findingreasoning§ 3 DSP: Improved Polarization Measure · p. 5
The range of DSP is from -1/2 * (n-2)/(n-1) to 1/2 * n/(n-1).
“The range of DSP is (-1 2 𝑛 -2 𝑛 -1 , 1 2 𝑛 𝑛 -1 ) .”
Quote in the paperSubstantial claim- The authors state this as an assumption: For every vertex v in R, the sum of diffusion scores from vertices in R to v equals 1.
- The authors state this as an assumption: For every vertex v in B, the sum of diffusion scores from vertices in B to v equals 1.
- Findingown data§ 3 DSP: Improved Polarization Measure · p. 4
DSP produces a zero score for a fully connected clique regardless of the community sizes.
“such as producing a zero score for a fully connected clique regardless of the community sizes, as shown in Section 4.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
- Findingreasoning§ 4.1 Reference Network Topologies · p. 6
In a color-alternating cycle, there is a positive z = z(n,alpha) in (0,1) such that for every vertex v in V, h_c(v)(v)=z and h_c(v)(v)=1-z.
“The high level of symmetry in such a network implies that there is a positive 𝑧 = 𝑧 ( 𝑛, 𝛼 ) ∈ ( 0 , 1 ) such that, for every vertex 𝑣 ∈ 𝑉 , it holds that ℎ c ( 𝑣 ) ( 𝑣 ) = 𝑧 and ℎ c ( v ) ( 𝑣 ) = 1 -𝑧 .”
Quote in the paperSubstantial claim - Findingreasoning§ 1 Introduction · p. 2
On G(n,p,l) networks, DSP exhibits near-zero scores as theoretically guaranteed.
“On 𝐺 ( 𝑛, 𝑝, ℓ ) networks, DSP exhibits near-zero scores as theoretically guaranteed.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
DSP correctly captures the expected polarization of reference topologies such as monochromatic-splittable networks.
“We show that DSP satisfies these desiderata, being near-zero for non-polarized structures such as cliques and random networks, while correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Monochromatic-splittable networks have a known expected polarization.
- Findingown data§ 1 Introduction · p. 2
DSP is robust to group size imbalances.
“Second, for real-world networks, DSP distinguishes ideologically polarized communities from structurally similar but neutralized configurations, further demonstrating its robustness to group size imbalances and addressing limitations of both RWC and traditional metrics.”
Quote in the paperSubstantial claim - Findingreasoning§ 4.1 Reference Network Topologies · p. 6
When the two connected components of a monochromatic-splittable network are of the same size (|R|=|B|=n/2) and isomorphic, symmetry implies that there are non-negative values z1 and z2 such that [formula].
“In these cases, symmetry implies that there are non-negative values 𝑧 1 = 𝑧 1 ( 𝑛, 𝛼 ) and 𝑧 2 = 𝑧 2 ( 𝑛, 𝛼 ) such that”
Quote in the paperNot a substantial claim - Findingreasoning§ 4.1 Reference Network Topologies · p. 6
In such symmetric monochromatic-splittable networks, z2 can be expressed as n/2 - z1.
“Thus, we can express 𝑧 2 as 𝑛 / 2 -𝑧 1 .”
Quote in the paperNot a substantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
In a bi-colored half-split barbell network with 2000 vertices, performance tends to degrade, particularly after denoising, in the unbalanced setting.
“but performance tends to degrade-particularly after denoising-in the unbalanced setting.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
DSP applied to U.S. Congress datasets uncovers trends of increasing polarization in recent years.
“Our method applied to U.S. Congress datasets uncovers trends of increasing polarization in recent years.”
Quote in the paperSubstantial claim - Findingown data§ 5 Experiments on real-world data · p. 8
Retaining at least 40% of the vertices reduces variability in the approximation across samples.
“To reduce variability in the approximation across samples, we should retain at least 40% of the vertices.”
Quote in the paperNot a substantial claim - Findingown data§ E Additional Experiments · p. 13
For salloum, DSP classification performance remains stable across α values (AUC 0.68 using α=0.85 and 0.64 using α=0.35).
“Although the polarization scores are slightly lower for larger values of 𝛼 , the classification performance of DSP remains stable (0 . 68 using 𝛼 = 0 . 85 and 0 . 64 using 𝛼 = 0 . 35).”
Quote in the paperNot a substantial claim - Findingown data§ B Limitations of Assortativity as a Polarization Measure · p. 12
Assortative mixing is correlated with polarization.
“Assortative mixing is known to influence network topology, and our experimental evaluation showed that it is also correlated with polarization (see Figure 8 and Figure 13).”
Quote in the paperNot a substantial claim - Findingown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
RWC and ARWC exhibit a positive bias on the G(n,p,l) null model.
“Consistent with previous observations, RWC and ARWC exhibit a positive bias, as do EI, BCC, CCA, and DM.”
Quote in the paperSubstantial claim - Findingreasoning§ E Additional Experiments · p. 12
DSP is sensitive to the choice of α: as α decreases, the DSP score also decreases.
“We observe that DSP is sensitive to the choice of 𝛼 : as 𝛼 decreases, the DSP score also decreases.”
Quote in the paperNot a substantial claim - Findingown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
Among the other measures, only AEI consistently produces near-zero values across all conditions on the G(n,p,l) null model.
“Among the other measures, only AEI consistently produces the desired near-zero values across all conditions.”
Quote in the paperSubstantial claim - Findingnone given§ B Limitations of Assortativity as a Polarization Measure · p. 12
Color assortativity is not zero on a bichromatic clique with equal numbers of nodes of the two colors; it takes a slightly negative value.
“For example, it is not zero on a bichromatic clique, even in the case when there are equal numbers of nodes of the two colors, rather it takes a slightly negative value.”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Reference Network Topologies · p. 7
Across all scenarios, only two measures consistently align with the expected behavior: DSP and AEI.
“Across all scenarios, only two measures consistently align with the expected behavior: DSP and AEI.”
Quote in the paperSubstantial claim - Findingown data§ 5 Experiments on real-world data · p. 8
ROC curves and corresponding AUC values are roughly the same across sample sizes for approximate DSP.
“Finally, the chart on the right shows that the ROC curves and the corresponding AUC values are roughly the same across sample sizes, indicating that even when using a small vertex set, the score has the same capability of distinguishing between polarized and non-polarized networks.”
Quote in the paperSubstantial claim - Findingown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
DSP yields average scores close to 0 with minimal deviations across all tested average degrees and partition skews in G(n,p,l) random networks (n=10000, 1000 networks).
“The average DSP score is close to 0 with minimal deviations for all average degrees and partition skews, proving the robustness of the measure to the partition size and network density.”
Quote in the paperSubstantial claim - Findingown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
BP shows a negative bias on the G(n,p,l) null model.
“In contrast, BP shows a negative bias.”
Quote in the paperNot a substantial claim - Findingown data§ 5 Experiments on real-world data · p. 8
Retaining at least 20% of the vertices is needed to achieve a good approximation of the original DSP score.
“Figure 9 (top) shows that we need to retain at least 20% of the vertices to achieve a good approximation of the original score.”
Quote in the paperSubstantial claim - Findingown data§ 5 Experiments on real-world data · p. 9
DSP remains below 0.16 across all sessions on the bill-cosponsorship networks.
“Similarly, our findings on the bill-cosponsorship networks align with previous studies [18], as we also observe low polarization levels (DSP remains below 0.16 across all sessions).”
Quote in the paperNot a substantial claim - Findingown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
EI, BCC, CCA, and DM exhibit a positive bias on the G(n,p,l) null model.
“Consistent with previous observations, RWC and ARWC exhibit a positive bias, as do EI, BCC, CCA, and DM.”
Quote in the paperSubstantial claim - Findingown data§ 5 Experiments on real-world data · p. 9
Networks with higher polarization levels tend to show a stronger influence from color assortativity, as the Polaris baseline is closer to the observed value as polarization increases.
“Overall, networks with higher polarization levels tend to show a stronger influence from color assortativity, as the Polaris baseline is closer to the observed value as polarization increases.”
Quote in the paperSubstantial claim - Findingreasoning§ C Computational Complexity · p. 12
Sampling-based approximation reduces complexity to O(smk).
“This reduces the complexity to O( 𝑠𝑚𝑘 ) .”
Quote in the paperSubstantial claim - Findingown data§ E Additional Experiments · p. 12
For the bi-colored half-split cycle with 5000 vertices, the adjusted score ARWC NoInfl collapses to 0, even though the expected value for this highly polarized topology is close to 1.
“In particular, for the bi-colored half-split cycle with 5000 vertices (Figure 12), the adjusted score-ARWC NoInfl-collapses to 0, even though the expected value for this highly polarized topology is close to 1 (results for RWC No-Infl are similar).”
Quote in the paperNot a substantial claim- Rests on an assumption: For the bi-colored half-split cycle with 5000 vertices, the expected polarization value is close to 1.
- Findingown data§ E Additional Experiments · p. 12
The improvement from excluding influencers does not generalize to more structured graph families.
“However, this improvement does not generalize to more structured graph families.”
Quote in the paperSubstantial claim - Findingreasoning§ C Computational Complexity · p. 12
Exact computation of DSP has total time complexity O(nmk).
“Thus, the exact computation of DSP has total time complexity O( 𝑛𝑚𝑘 ) .”
Quote in the paperSubstantial claim - Findingown data§ 5 Experiments on real-world data · p. 9
The influence of the degree distribution remains relatively constant across datasets, as indicated by the consistent gap between the CM baseline and the observed values.
“Meanwhile, the influence of the degree distribution remains relatively constant across datasets, as indicated by the consistent gap between the CM baseline and the observed values.”
Quote in the paperNot a substantial claim - Findingreasoning§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7
Q yields an average score of 0 on the G(n,p,l) null model.
“As expected, Q yields an average score of 0, since it uses an Erdős-Rényi network as its null model.”
Quote in the paperSubstantial claim - Premisereasoning§ 1 Introduction · p. 1
The biases of existing controversy measures occur because they conflate topological artifacts, such as low density, small network size, or uneven group splits, with genuine structural division.
“These biases occur because existing controversy measures conflate topological artifacts, such as low density, small network size, or uneven group splits, with genuine structural division.”
Quote in the paperSubstantial claim - Premisecitation§ 1 Introduction · p. 1
Many traditional methods, such as modularity or assortativity, rely on simplistic null models that often fail to capture the complex dynamics of real-world networks.
“Many traditional methods, such as modularity or assortativity, rely on simplistic null models that often fail to capture the complex dynamics of the real-world networks [16, 23].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [16] [16] Pedro Guerra, Wagner Meira Jr, Claire Cardie, and Robert Kleinberg. 2013. A measure of polarization on social media networks based on community boundaries. In ICWSM , Vol. 7. 215-224. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [23] [23] Philip Leifeld. 2018. Polarization in the social sciences: Assortative mixing in social science collaboration networks is resilient to interventions. Physica A: Statistical Mechanics and its Applications 507 (2018), 510-523. - source
- Interpretationreasoning§ 4.1 Reference Network Topologies · p. 6
Smaller alpha values lead to more importance for the immediate neighbors of the starting vertex.
“The rationale is the same for the alternating cycle: smaller 𝛼 values lead to more importance for the immediate neighbors of the starting vertex, which, in this case, are vertices with the same color as the starting vertex.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 4.1 Reference Network Topologies · p. 6
A color-alternating cycle is expected to exhibit negative polarization.
“A negative polarization is expected in this network, because each vertex is directly connected to only vertices of the other color, and thus it is more likely to access content (and interact with vertices) from the other color than its own.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction · p. 1
DSP treats each vertex as a potential source for a random walk, with all other vertices as targets.
“Instead, DSP treats each vertex as a potential source for a random walk, with all other vertices as targets.”
- Also stated in: § Abstract · p. 1 · plain
“DSP removes the arbitrary concept of 'influencers' used by the popular Random Walk Controversy (RWC) score, instead treating every node as a potential origin for a random walk.”
Quote in the paperSubstantial claim - Also stated in: § Abstract · p. 1 · plain
- Interpretationreasoning§ 4.1 Reference Network Topologies · p. 5
A clique of n vertices, arbitrarily partitioned into R and B, possibly with |R| != |B|, should exhibit no structural polarization.
“A clique of 𝑛 vertices, arbitrarily partitioned into 𝑅 and 𝐵 , possibly with | 𝑅 | ≠ | 𝐵 | , should exhibit no structural polarization: every vertex is connected to every other vertex, so every vertex has the same opportunities of accessing content (or interacting with vertices) from its own partition as it does from the other partition.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction · p. 2
DSP avoids the bias from self-visiting by designing a probing process tailored to the task.
“We show how to avoid this bias by designing a probing process tailored to our task.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction · p. 2
By integrating a statistically principled null model into its core formulation, DSP advances polarization measurement beyond ad hoc corrections.
“By integrating a statistically principled null model into its core formulation, DSP advances polarization measurement beyond ad hoc corrections.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 4.1 Reference Network Topologies · p. 6
Monochromatic-splittable networks, as long as at least one of |R| or |B| is much larger than the size of the cut, exhibit strongly positive polarization.
“As long as at least one of | 𝑅 | or | 𝐵 | is much larger than the size of the cut, these networks exhibit strongly positive polarization, because all but a few vertices of each color are connected only to vertices of the same color, and thus most interactions are between homochromatic vertices.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction · p. 2
DSP is statistically more principled than RWC, which incorporates products of probabilities with no clear statistical interpretation.
“As a result, DSP is statistically more principled than RWC, which incorporates products of probabilities with no clear statistical interpretation.”
Quote in the paperSubstantial claim - Interpretationnone given§ 1 Introduction · p. 1
DSP is designed to have an expected value of zero on G(n,p,l) networks, a labeled extension of Erdős-Rényi G(n,p) where edges and labels are assigned randomly, ensuring no structural correlation between the two.
“Unlike previous proposals, DSP is designed to have an expected value of zero on 𝐺 ( 𝑛, 𝑝, ℓ ) networks, a labeled extension of the Erdős-Rényi 𝐺 ( 𝑛, 𝑝 ) model where edges and labels are assigned randomly, thus ensuring no structural correlation exists between the two.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 4.1 Reference Network Topologies · p. 6
As alpha goes to zero, the lower bound on the range of DSP is -1/2 * (n-2)/(n-1).
“As 𝑧 is a probability, it is bounded below by zero, thus allowing us to recover the lower bound on the range of DSP as -1 2 𝑛 -2 𝑛 -1 as 𝛼 goes to zero.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 2.2 The RWC Measure and its Limitations · p. 3
RWC is sensitive to elementary network features such as size, density, and community balance, rather than capturing only genuine structural divisions.
“These results suggest RWC is sensitive to elementary network features such as size, density, and community balance, rather than capturing only genuine structural divisions.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 2.2 The RWC Measure and its Limitations · p. 3
A bias in RWC is introduced when the walk's restart set overlaps with the target influencer set.
“However, a bias is introduced when the walk's restart set overlaps with the target influencer set.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 4
The probing process gives more weight to cross-community influence in unbalanced communities, where otherwise the smaller group could be drowned out.
“While this may seem counterintuitive, it serves to give more weight to cross-community influence in unbalanced communities, where otherwise, the smaller group could be drowned out.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
- Interpretationreasoning§ 4.1 Reference Network Topologies · p. 5
The reference networks (cliques, color-alternating cycles, monochromatic-splittable networks) have a simple enough structure to enable deriving the exact solution of the DSP polarization measure.
“These specific networks have a simple enough structure that enables deriving the exact solution of the DSP polarization measure.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 5
The maximum of DSP is attained when diffusions from a community only reach vertices within that same community.
“The maximum is attained when diffusions from a community only reach vertices within that same community, the hallmark of extreme structural polarization.”
Quote in the paperSubstantial claim - Interpretationown data§ 3 DSP: Improved Polarization Measure · p. 3
In the original RWC formulation, the set of influencers was negligible compared to the network, so the bias was not apparent.
“In the original formulation, the set of influencers was negligible compared to the network (10 in networks with thousands of vertices), so the bias was not apparent.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 5
The minimum of DSP is attained when diffusions only reach vertices of the opposite community.
“The minimum is attained when diffusions only reach vertices of the opposite community.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 4.1 Reference Network Topologies · p. 7
As z1 is upper bounded by n/2, the upper bound on the range of DSP is 1/2 * n/(n-1).
“As 𝑧 1 is upper bounded by 𝑛 2 , we recover the upper bound on the range of DSP as 1 2 𝑛 𝑛 -1 .”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 2.2 The RWC Measure and its Limitations · p. 3
The overlap between the restart set and the target influencer set artificially inflates the probability of a walk staying within its own community.
“This overlap artificially inflates the probability of a walk 'staying' within its own community, as a walk starting from an influencer has already reached its destination.”
Quote in the paperSubstantial claim - Premisecitation§ 2.2 The RWC Measure and its Limitations · p. 3
RWC scores on real-world networks are often preserved after randomization with null models that preserve basic degree structure for d=0 and d=1.
“Its scores on real-world networks are often preserved even after randomization with null models that preserve basic degree structure (for 𝑑 = 0 and 𝑑 = 1 using the dk-series terminology [25]).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] [25] Priya Mahadevan, Dmitri Krioukov, Kevin Fall, and Amin Vahdat. 2006. Systematic topology analysis and generation using degree correlations. ACM SIGCOMM Computer Communication Review 36, 4 (Aug. 2006), 135-146. - source
- Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 5
Negative values of DSP indicate that, on average, the network structure promotes cross-community diffusion more than within-community diffusion.
“A key advantage of DSP is that negative values are clearly interpretable: they indicate that, on average, the network structure promotes cross-community diffusion more than within-community diffusion.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction · p. 2
DSP can be interpreted as the average score of how likely a vertex is to receive information from a given community, where the average is taken over the distribution defined by the probing process.
“The resulting DSP measure can be interpreted as the average score of how likely a vertex is to receive information from a given community, where the average is taken over the distribution defined by our probing process.”
Quote in the paperSubstantial claim - Interpretationown data§ 5 Experiments on real-world data · p. 9
Color assortativity alone is insufficient to fully account for the observed polarization in less polarized networks, especially when the score is low.
“Nonetheless, the differences between the observed and Polaris values in less polarized networks suggest that color assortativity alone is insufficient to fully account for the observed polarization, especially when the score is low.”
Quote in the paperSubstantial claim - Interpretationown data§ 6 Conclusion · p. 9
DSP can reliably differentiate between polarized and non-polarized networks.
“The results of our experimental evaluation highlight how DSP can reliably differentiate between polarized and non-polarized networks.”
Quote in the paperSubstantial claim - Interpretationown data§ 5 Experiments on real-world data · p. 8
Even when using a small vertex set, DSP score has the same capability of distinguishing between polarized and non-polarized networks.
“Finally, the chart on the right shows that the ROC curves and the corresponding AUC values are roughly the same across sample sizes, indicating that even when using a small vertex set, the score has the same capability of distinguishing between polarized and non-polarized networks.”
Quote in the paperSubstantial claim - Interpretationown data§ 6 Conclusion · p. 9
DSP does not suffer from the biases exhibited by previous measures.
“It does not suffer from the biases exhibited by previous measures, as we show by analytically deriving DSP values on families of reference networks.”
Quote in the paperSubstantial claim - Premisecitation§ B Limitations of Assortativity as a Polarization Measure · p. 12
In a study of collaboration networks, interventions targeting assortative mixing had little effect on the macroscopic polarization of the network.
“For example, in a study of collaboration networks, Leifeld [23] found that assortative mixing could indicate polarization, but interventions targeting it had little effect on the macroscopic polarization of the network.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23] [23] Philip Leifeld. 2018. Polarization in the social sciences: Assortative mixing in social science collaboration networks is resilient to interventions. Physica A: Statistical Mechanics and its Applications 507 (2018), 510-523. - source
- May combine two claims. 20
- Classified as probably not a substantial claim. 13
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 2
May combine two claims.
Premisecitation§ 1 Introduction · p. 1Recent structural polarization measures such as Betweenness Centrality Controversy, Boundary Polarization, Dipole Polarization, Krackhardt E/I Ratio, and Random Walk Controversy can produce high polarization scores even for random networks, indicating sensitivity to elementary network features such as average degree and network size.
“Other more recent measures, such as Betweenness Centrality Controversy [15], Boundary Polarization [16], Dipole Polarization [29], Krackhardt E/I Ratio [22], and Random Walk Controversy [15], can produce high polarization scores even for random networks, indicating an undesirable sensitivity to elementary network features such as average degree and network size [38].”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source
Split into 2 atoms — 0 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured - cites [16] [16] Pedro Guerra, Wagner Meira Jr, Claire Cardie, and Robert Kleinberg. 2013. A measure of polarization on social media networks based on community boundaries. In ICWSM , Vol. 7. 215-224. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [38] [38] Ali Salloum, Ted Hsuan Yun Chen, and Mikko Kivelä. 2022. Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1-33. source
- The authors state this as an assumption: High polarization scores on random networks are undesirable.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 2.2 The RWC Measure and its Limitations · p. 3RWC is a widely-used structural polarization measure that informs the present work.
“RWC [12, 15] is a widely-used structural polarization measure that informs the present work.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [12] [12] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2016. Quantifying Controversy in Social Media. In WSDM . ACM, 33-42. - source
Section 6.1 defines RWC as a random-walk measure of controversy on a graph, supporting its identification as a structural polarization measure. Section 8.4 evaluates and uses the score, but our copy does not establish that it is widely used. Whether it informs the citing authors’ present work is their own framing, not a claim this source can verify. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 2.2 The RWC Measure and its Limitations · p. 3RWC measures the relative exposure of a user to influential members of their own community versus those of an opposing community.
“At its core, RWC measures the relative exposure of a user to influential members of their own community versus those of an opposing community.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [12] [12] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2016. Quantifying Controversy in Social Media. In WSDM . ACM, 33-42. - source
- cites [15] [15] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACMTransactions on Social Computing 1, 1 (2018), 3. - source
The Results section identifies RWC as a random-walk controversy measure, and the Synthetic data section says it bisects a network into two communities and detects structural separation. Our copy does not explain RWC as measuring an individual user’s relative exposure to influential members of their own versus the opposing community; it refers calculation details to section S1. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone given§ 3 DSP: Improved Polarization Measure · p. 5With k >= 2 colors, the range of DSP is roughly (-1/k, 1/k).
“With 𝑘 ≥ 2 colors, the range of the DSP is roughly (-1 / 𝑘 , 1 / 𝑘 ) .”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 4.1 Reference Network Topologies · p. 5In a bi-colored clique with 5000 vertices, EI and CCA are sensitive to community size imbalance and yield positive scores when the partition is unbalanced.
“EI and CCA, which are sensitive to community size imbalance and yield positive scores when the partition is unbalanced.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ Abstract · p. 1DSP satisfies the proposed desiderata, being near-zero for non-polarized structures such as cliques and random networks.
“We show that DSP satisfies these desiderata, being near-zero for non-polarized structures such as cliques and random networks, while correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Cliques and random networks are non-polarized structures.
May combine two claims.
Findingreasoning§ 4.1 Reference Network Topologies · p. 5In a clique, the denominators of Equation (4) are all equal to 1, and the four numerators are (|R|-1)/(n-1), |B|/(n-1), (|B|-1)/(n-1), and |R|/(n-1).
“The denominators of Equation (4) are therefore all equal to 1, while the four numerators are, in order, (| 𝑅 | -1 )/( 𝑛 -1 ) , | 𝐵 |/( 𝑛 -1 ) , (| 𝐵 | -1 )/( 𝑛 -1 ) , and | 𝑅 |/( 𝑛 -1 ) .”
Quote in the paperSubstantial claimBorderline on S3 (load-bearing), S4 (based): unclear from the text.
Findingnone given§ 1 Introduction · p. 2DSP can be approximated efficiently with good accuracy.
“Finally, we show that DSP can be approximated efficiently with good accuracy.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown data§ 4.1 Reference Network Topologies · p. 5In a bi-colored clique with 5000 vertices, measures other than RWC, ARWC, DM, EI, and CCA yield the desired polarization score of 0.
“the other measures yield the desired polarization score of 0”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ E Additional Experiments · p. 12Excluding influencers from the restart set removes the bias that RWC exhibits on random graphs; average RWC score in random networks drawn from G(n,p,l) converges to zero.
“Indeed, Figure 1 shows that, under this modification, the average RWC score in random networks drawn from 𝐺 ( 𝑛, 𝑝, ℓ ) correctly converges to zero.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 5 Experiments on real-world data · p. 9DSP scores are correlated between co-sponsorship and roll-call networks; in the House, Pearson is 0.73 and Spearman is 0.70; in the Senate, Pearson is 0.59 and Spearman is 0.74.
“Consistently, we observe correlated DSP scores between the two types of congress networks, especially in the House, where both Pearson (0.73) and Spearman (0.70) are high. In the Senate, while Pearson is lower (0.59), Spearman remains high (0.74), indicating a strong agreement in trend.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data§ E Additional Experiments · p. 13Higher assortativity tends to correspond to higher polarization scores across datasets.
“This chart helps understand whether higher assortativity tends to correspond to higher polarization scores. We find that this relationship generally holds across datasets.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingcitation§ 5 Experiments on real-world data · p. 9There is a general increase in polarization over time in the bill-cosponsorship networks.
“Nonetheless, consistent with previous research, we observe a general increase in polarization over time [13].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] [13] Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2017. The Effect of Collective Attention on Controversial Debates on Social Media. In International Web Science Conference . ACM, 43-52. - source
May combine two claims.
Findingown data§ 4.3 The Stochastic Block Model · p. 7In SBM networks (n=1600, 2 blocks, 100 networks), DSP increases with denser intra-community connectivity and decreases as inter-community connectivity increases; for fixed intra-community connectivity, lower inter-community connectivity gives higher scores.
“DSP behaves as expected: it increases with denser intra-community connectivity and decreases as inter-community connectivity increases. For a fixed intra-community connectivity, lower inter-community connectivity gives higher scores.”
Quote in the paperSubstantial claim- Rests on an assumption: In the stochastic block model, higher intra-block edge probability p, especially with lower inter-block edge probability q, corresponds to higher structural polarization; increasing q reduces structural polarization.
The quote only partly states this claim.
Findingown data§ E Additional Experiments · p. 12DSP performance is comparable to RWC on the garimella networks.
“Figure 13 shows that the performance of DSP is comparable to that of RWC.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ 1 Introduction · p. 1Different null assumptions, such as preserving degree sequences versus erasing all structure, yield conflicting baselines, so post-hoc normalization risks over- or under-correction.
“As such, they risk over- or under-correction, as different null assumptions (e.g., preserving degree sequences vs. erasing all structure) yield conflicting baselines [35].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] [35] Giulia Preti, Gianmarco De Francisci Morales, and Matteo Riondato. 2022. ALICE and the Caterpillar: A More Descriptive Null Model for Assessing Data Mining Results. In ICDM . IEEE. - source
May combine two claims.
Premisenone given§ Abstract · p. 1Existing structural polarization measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks and failing to distinguish real-world networks from randomized null models.
“Existing measures often conflate genuine structural division with random topological features, yielding misleadingly high polarization scores on random networks, and failing to distinguish real-world networks from randomized null models.”
Quote in the paperSubstantial claim- The authors state this as an assumption: High polarization scores on random networks are undesirable.
May combine two claims.
Premisereasoning§ 1 Introduction · p. 1Normalization is treated as an external adjustment rather than a core component of the measure's design, perpetuating ambiguities in score interpretation.
“Moreover, normalization is treated as an external adjustment rather than a core component of the measure's design, perpetuating ambiguities in score interpretation.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone given§ 3 DSP: Improved Polarization Measure · p. 5The DSP definitions for k >= 2 colors collapse to the previous ones when k=2.
“These definitions collapse to the previous ones when 𝑘 = 2.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone given§ 2.2 The RWC Measure and its Limitations · p. 3There is no a priori way to define the set of influencers within each community.
“there is no a priori way to define the set of influencers within each community”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 3In smaller networks, or when using more influencers, the RWC bias can be substantial.
“In smaller networks, or when using more influencers, this bias can be substantial.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone given§ Abstract · p. 1DSP is designed from first principles to correct for biases in structural polarization measurement.
“We introduce DSP, a Diffusion-based Structural Polarization measure designed from first principles to correct for such biases.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone given§ 3 DSP: Improved Polarization Measure · p. 5It is possible to extend the DSP definition to the general case of k >= 2 colors.
“It is possible to extend the DSP definition to the general case of 𝑘 ≥ 2 colors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 4Calculating DSP boils down to computing four aggregate diffusion scores.
“The equation shows that calculating DSP boils down to computing four aggregate diffusion scores: within-community ( 𝑅 → 𝑅 ,”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
May combine two claims.
Interpretationreasoning§ Abstract · p. 1DSP provides a reliable and interpretable diagnostic tool.
“By integrating a null model into its core definition, DSP provides a reliable and interpretable diagnostic tool, highlighting the necessity of statistically-grounded metrics to analyze societal fragmentation.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone given§ 2.2 The RWC Measure and its Limitations · p. 3There is no principled criterion for choosing how many influencers to include in the set.
“there is no principled criterion for choosing how many influencers to include in the set.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationreasoning§ 1 Introduction · p. 1By considering every vertex a potential source, DSP becomes more robust to different network structures and better reflects how information spreads across the network.
“Nonetheless, by considering every vertex a potential source, DSP becomes more robust to different network structures and better reflects how information spreads across the network (see Section 4).”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ 3 DSP: Improved Polarization Measure · p. 3DSP is designed to eliminate the biases of existing measures by removing the concept of influencers and considering every vertex as a potential source of diffusion.
“DSP is designed to eliminate the biases of existing measures by removing the concept of 'influencers' and instead considering every vertex as a potential source of diffusion.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
May combine two claims.
Premisenone given§ 1 Introduction · p. 2A random walk (re)starting from a given vertex v has high probability of visiting v more frequently, introducing a new source of bias when all vertices are potential influencers.
“Eliminating the idea of designating a small number of vertices as influencers and considering all vertices as potential influencers poses new challenges, as a random walk (re)starting from a given vertex 𝑣 has high probability of visiting vertex 𝑣 more frequently, which introduces a new source of bias.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Premisecitation§ 5 Experiments on real-world data · p. 9Co-sponsorship data can produce estimates of ideal points that are highly correlated with those derived from roll-call votes.
“Despite these differences, previous work [3] showed that co-sponsorship data can produce estimates of ideal points that are highly correlated with those derived from roll-call votes.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] [3] Eduardo Alemán, Ernesto Calvo, Mark P Jones, and Noah Kaplan. 2009. Comparing Cosponsorship and Roll-Call Ideal Points. Legislative studies quarterly 34, 1 (2009), 87-116. - source
May combine two claims.
Interpretationreasoning§ E Additional Experiments · p. 12The decrease in DSP as α decreases is expected because each node's immediate neighbors belong to the opposite community; when diffusion is more strongly influenced by neighbors, more probability mass flows across community boundaries, leading to a lower polarization score.
“This behavior is expected, as each node's immediate neighbors belong to the opposite community. When the diffusion process is more strongly influenced by neighbors, more probability mass flows across community boundaries, leading to a lower polarization score.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown data§ 4.2 The 𝐺 ( 𝑛, 𝑝, ℓ ) Null Model · p. 7DSP is robust to partition size and network density.
“The average DSP score is close to 0 with minimal deviations for all average degrees and partition skews, proving the robustness of the measure to the partition size and network density.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Interpretationreasoning§ 5 Experiments on real-world data · p. 9DSP is a structural measure and will yield high values only when the network presents a strong structural division.
“This result is expected, as DSP is a structural measure, and thus, will yield high values only when the network presents a strong structural division.”
Quote in the paperSubstantial claimMay combine two claims.
Premisecitation§ B Limitations of Assortativity as a Polarization Measure · p. 12Assortativity is overly sensitive to initial structural changes when separation is weak, but loses sensitivity as structural separation becomes strong.
“Similarly, Hohmann et al. [18] showed that assortativity is overly sensitive to initial structural changes when separation is weak, but loses sensitivity as structural separation becomes strong.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] [18] Marilena Hohmann, Karel Devriendt, and Michele Coscia. 2023. Quantifying ideological polarization on a network using generalized Euclidean distance. Science Advances 9, 9 (March 2023), eabq2044. - source
May combine two claims.
Interpretationown data§ E Additional Experiments · p. 12The fix addresses the issue in random graphs but simultaneously degrades performance on networks where strong polarization should be clearly detectable.
“In other words, while the fix addresses the issue in random graphs, it simultaneously degrades performance on networks where strong polarization should be clearly detectable.”
Quote in the paperNot a substantial claim- Rests on an assumption: For the bi-colored half-split cycle with 5000 vertices, the expected polarization value is close to 1.
The authors state this as an assumption.
High polarization scores on random networks are undesirable.
“can produce high polarization scores even for random networks, indicating an undesirable sensitivity to elementary network features such as average degree and network size [38].”
The authors state this as an assumption.
Cliques and random networks are non-polarized structures.
“being near-zero for non-polarized structures such as cliques and random networks”
The authors state this as an assumption.
Monochromatic-splittable networks have a known expected polarization.
“correctly capturing the expected polarization of reference topologies such as monochromatic-splittable networks”
The authors state this as an assumption.
The function phi_v is arbitrary provided it does not depend on the colors of the vertices.
“We assume a function 𝜙 𝑣 : 𝑉 → R + that assigns a non-negative value to each vertex 𝑤 ∈ 𝑉 , parameterized by a vertex 𝑣 ∈ 𝑉 . The function 𝜙 𝑣 is arbitrary, provided it does not depend on the colors of the vertices.”
The authors state this as an assumption.
For every vertex v in R, the sum of diffusion scores from vertices in R to v equals 1.
“assume that for every 𝑣 ∈ 𝑅 it is 𝑤 ∈ 𝑅 𝜋 𝑤 ( 𝑣 ) = 1”
The authors state this as an assumption.
For every vertex v in B, the sum of diffusion scores from vertices in B to v equals 1.
“and for every 𝑣 ∈ 𝐵 it is 𝑤 ∈ 𝐵 𝜋 𝑤 ( 𝑣 ) = 1”
The paper relies on this without support.
For the bi-colored half-split cycle with 5000 vertices, the expected polarization value is close to 1.
“even though the expected value for this highly polarized topology is close to 1”
The paper relies on this without support.
In the stochastic block model, higher intra-block edge probability p, especially with lower inter-block edge probability q, corresponds to higher structural polarization; increasing q reduces structural polarization.
“Higher values of 𝑝 , especially when paired with lower values of 𝑞 , correspond to higher structural polarization. In contrast, increasing 𝑞 leads to greater inter-community connectivity, hence reducing structural polarization.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Modularity is assigned two different null models
MinorSection 4.2 says modularity uses an Erdős-Rényi null model, while Appendix A says it uses the configuration model.
“As expected, Q yields an average score of 0, since it uses an Erdős-Rényi network as its null model.”
“Modularity (Q) [39] compares the connectivity of the communities to that observable in random graphs extracted from the configuration model:”
Cites
An Efficient Heuristic Procedure for Partitioning Graphs
Kernighan, B. W., & Lin, S. M. (1970) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1970.tb01770.x · Cited by 5,337 · see citing works
Newman, M. (2002) · Physical review. E, Statistical, nonlinear, and soft matter physics · doi:10.1103/physreve.67.026126 · Cited by 3,130 · see citing works
The echo chamber effect on social media
Cinelli, M., De Francisci Morales, G., Galeazzi, A., Quattrociocchi, W., & Starnini, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2023301118 · Cited by 2,092 · see citing works
Everyone's an influencer: quantifying influence on twitter
Bakshy, E., Hofman, J. M., Mason, W. A., & Watts, D. J. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935845 · Cited by 1,689 · see citing works
Informal Networks and Organizational Crises: An Experimental Simulation
Krackhardt, D., & Stern, R. N. (1988) · Social Psychology Quarterly · doi:10.2307/2786835 · Cited by 1,256 · see citing works
Random walks and diffusion on networks
Masuda, N., Porter, M. A., & Lambiotte, R. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.07.007 · Cited by 661 · see citing works
Causes and Consequences of Polarization
Barber, M. J., & McCarty, N. (2015) · Solutions to Political Polarization in America · doi:10.1017/cbo9781316091906.002 · Cited by 375 · see citing works
Quantifying controversy on social media
Garimella, K., Morales, G. D. F., Gionis, A., & Mathioudakis, M. (2018) · ACM Transactions on Social Computing · doi:10.1145/3140565 · Cited by 348 · see citing works
Self-citationPoole, K. T., & Rosenthal, H. L. (2001) · Legislative Studies Quarterly · doi:10.2307/440401 · Cited by 313 · see citing works
Congress and the Politics of Problem Solving
Adler, E. S., & Wilkerson, J. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139150842 · Cited by 284 · see citing works
A Measure of Segregation Based on Social Interactions
Echenique, F., & Fryer, R. G. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.2.441 · Cited by 284 · see citing works
Measuring political polarization: Twitter shows the two sides of Venezuela
Morales, A. J., Borondo, J., Losada, J. C., & Benito, R. M. (2015) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4913758 · Cited by 219 · see citing works
A Measure of Polarization on Social Media Networks Based on Community Boundaries
Guerra, P., Meira, W., Cardie, C., & Kleinberg, R. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14421 · Cited by 188 · see citing works
Reducing Controversy by Connecting Opposing Views
Garimella, K., De Francisci Morales, G., Gionis, A., & Mathioudakis, M. (2017) · Proceedings of the Tenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3018661.3018703 · Cited by 165 · see citing works
Self-citationMeasuring and moderating opinion polarization in social networks
Matakos, A., Terzi, E., & Tsaparas, P. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0527-9 · Cited by 164 · see citing works
Quantifying Controversy in Social Media
Garimella, K., De Francisci Morales, G., Gionis, A., & Mathioudakis, M. (2016) · Proceedings of the Ninth ACM International Conference on Web Search and Data Mining · doi:10.1145/2835776.2835792 · Cited by 147 · see citing works
Self-citationSystematic topology analysis and generation using degree correlations
Mahadevan, P., Krioukov, D., Fall, K., & Vahdat, A. (2006) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1151659.1159930 · Cited by 135 · see citing works
Falling into the Echo Chamber: The Italian Vaccination Debate on Twitter
Cossard, A., De Francisci Morales, G., Kalimeri, K., Mejova, Y., Paolotti, D., & Starnini, M. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7285 · Cited by 126 · see citing works
Self-citationComparing Cosponsorship and Roll‐Call Ideal Points
ALEMÁN, E., CALVO, E., JONES, M. P., & KAPLAN, N. (2009) · Legislative Studies Quarterly · doi:10.3162/036298009787500358 · Cited by 125
Multiscale mixing patterns in networks
Peel, L., Delvenne, J., & Lambiotte, R. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1713019115 · Cited by 104 · see citing works
Poole, K. T., & Rosenthal, H. L. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1154162 · Cited by 93 · see citing works
Quantifying ideological polarization on a network using generalized Euclidean distance
Hohmann, M., Devriendt, K., & Coscia, M. (2023) · Science Advances · doi:10.1126/sciadv.abq2044 · Cited by 74 · see citing works
Right and left, partisanship predicts (asymmetric) vulnerability to misinformation
Nikolov, D., Flammini, A., & Menczer, F. (2021) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-55 · Cited by 68 · see citing works
Interian, R., G. Marzo, R., Mendoza, I., & Ribeiro, C. C. (2023) · International Transactions in Operational Research · doi:10.1111/itor.13224 · Cited by 67 · see citing works
Polarization of climate politics results from partisan sorting: Evidence from Finnish Twittersphere
Chen, T. H. Y., Salloum, A., Gronow, A., Ylä‐Anttila, T., & Kivelä, M. (2021) · Global Environmental Change · doi:10.1016/j.gloenvcha.2021.102348 · Cited by 65 · see citing works
Party Polarization in Congress: A Network Science Approach
Waugh, A. S., Pei, L., Fowler, J. H., Mucha, P. J., & Porter, M. A. (2009) · arXiv · doi:10.48550/arxiv.0907.3509 · Cited by 56 · see citing works
The Effect of Collective Attention on Controversial Debates on Social Media
Garimella, K., De Francisci Morales, G., Gionis, A., & Mathioudakis, M. (2017) · Proceedings of the 2017 ACM on Web Science Conference · doi:10.1145/3091478.3091486 · Cited by 56 · see citing works
Self-citationRePBubLik: Reducing Polarized Bubble Radius with Link Insertions
Haddadan, S., Menghini, C., Riondato, M., & Upfal, E. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441825 · Cited by 31 · see citing works
Self-citationMendoza, M., Parra, D., & Soto, Á. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102366 · Cited by 25 · see citing works
Emamgholizadeh, H., Nourizade, M., Tajbakhsh, M. S., Hashminezhad, M., & Hasheminezha, F. N. E. M. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00703-1 · Cited by 21 · see citing works
Separating Polarization from Noise: Comparison and Normalization of Structural Polarization Measures
Salloum, A., Chen, T. H. Y., & Kivelä, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512962 · Cited by 20 · see citing works
Leifeld, P. (2018) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2018.05.109 · Cited by 19 · see citing works
Polarization of Climate Politics Results from Partisan Sorting: Evidence from Finnish TwitterspherePreprint
Chen, T. H. Y., Salloum, A., Gronow, A., Ylä‐Anttila, T., & Kivelä, M. (2020) · doi:10.31235/osf.io/49qgu · Cited by 10 · see citing works
Quantifying Controversy in Social Media
Garimella, K., Morales, G. D. F., Gionis, A., & Mathioudakis, M. (2015) · arXiv · Cited by 7 · see citing works
Self-citationMinimizing Hitting Time between Disparate Groups with Shortcut Edges
Adriaens, F., Wang, H., & Gionis, A. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599434 · Cited by 5 · see citing works
Self-citationAlice and the Caterpillar: A More Descriptive Null Model for Assessing Data Mining Results
Preti, G., Morales, G. D. F., & Riondato, M. (2022) · 2022 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm54844.2022.00052 · Cited by 4
Self-citationCross-community affinity: A polarization measure for multi-community networks
Nair, S., & Iamnitchi, A. (2024) · Online Social Networks and Media · doi:10.1016/j.osnem.2024.100280 · Cited by 3 · see citing works
Higher-Order Null Models as a Lens for Social Systems
Preti, G., Fazzone, A., Petri, G., & Morales, G. D. F. (2024) · Physical Review X · doi:10.1103/physrevx.14.031032 · Cited by 3 · see citing works
Self-citationPolaris: Sampling from the Multigraph Configuration Model with Prescribed Color Assortativity
Preti, G., Riondato, M., Gionis, A., & Morales, G. D. F. (2025) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3701551.3703560 · Cited by 2 · see citing works
Self-citationCongress and the Politics of Problem Solving: Problem Solving and American Politics
Adler, E., & Wilkerson, J. (2013) · doi:10.1017/cbo9781139150842.015
Flagged first, then by citations
Research works printed but not linked: 3
- Michael Conover, Jacob Ratkiewicz, Matthew Francisco, Bruno Gonçalves, Filippo Menczer, and Alessandro Flammini. 2011. Political polarization on twitter. In ICWSM, Vol. 5. 89-96.
- George Karypis and Vipin Kumar. 1997. METIS: A software package for partitioning unstructured graphs, partitioning meshes, and computing fill-reducing orderings of sparse matrices. (1997).
- Jeffrey B Lewis, Keith Poole, Howard Rosenthal, Adam Boche, Aaron Rudkin, and Luke Sonnet. 2019. Voteview: Congressional roll-call votes database. See https://voteview.com/(accessed 27 July 2018) (2019).
- Authors
- Preti, G., Riondato, M., Gionis, A., & De Francisci Morales, G.
- Affiliations
- CENTAI, Turin, Italy
- Amherst College (US)
- KTH Royal Institute of Technology (SE)
- Venue
- Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining
- Publisher
- ACM
- Published
- 2026-02-21
- Pages
- 531-540
- OpenAlex
- W7129025265
- Cited by
- 0
- References
- 9
- FWCI
- 0.00
- Type
- conference paper
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2238693)
- European Research Council (834862)
- European Commission (101168951)
- Topics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Opinion Dynamics and Social Influence
- Social Sciences › Communication › Social Media and Politics
- Keywords
- structural polarization, null models, echo chambers, political polarization, United States Congress, cliques
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review