Cross-Partisan Interactions on Twitter
Open accessAbstract
Many social media studies argue that social media creates echo chambers where some users only interact with peers of the same political orientation. However, recent studies suggest that a substantial amount of Cross-Partisan Interactions (CPIs) do exist --- even within echo chambers, but they may be toxic. There is no consensus about how such interactions occur and when they lead to healthy or toxic dialogue. In this paper, we study a comprehensive Twitter dataset that consists of 3 million tweets from 2020 related to the U.S. context to understand the dynamics behind CPIs. We investigate factors that are more associated with such interactions, including how users engage in CPIs, which topics are more contentious, and what are the stances associated with healthy interactions. We find that CPIs are significantly influenced by the nature of the topics being discussed, with politically charged events acting as strong catalysts. The political discourse and pre-established political views sway how users participate in CPIs, but the direction in which users go is nuanced. While Democrats engage in cross-partisan interactions slightly more frequently, these interactions often involve more negative and nonconstructive stances compared to their intra-party interactions. In contrast, Republicans tend to maintain a more consistent tone across interactions. Although users are more likely to engage in CPIs with popular accounts in general, this is less common among Republicans who often engage in CPIs with accounts with a low number of followers for personal matters. Our study has implications beyond Twitter as identifying topics with low toxicity and high CPI can help highlight potential opportunities for reducing polarization while topics with high toxicity and low CPI may action targeted interventions when moderating harm.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper analyzes a 2020 U.S. Twitter reply dataset to identify which users, topics, and content features are associated with cross-partisan interactions (CPIs). It finds CPIs are shaped strongly by topic and user attributes, are often more toxic than intra-party replies, but some high-CPI/low-toxicity topics may offer bridge opportunities.
Key findings
- The final dataset contains 2,561,846 tweets from 726,140 users; 661,661 replies (34%) are classified as CPIs. Democrats originated 65% of CPIs, with 34.3% of Democrat tweets and 33.2% of Republican tweets being cross-partisan.
- Topic matters: politics/governance and political figures generate the highest CPI levels, with topics such as “Impeachment Proceedings and Senate Actions” and “Election Strategies” at 53–60% CPI, and sports events above 55%; public health mask/hygiene topics are 27–36%, and hobbies/religious topics 23–30%. Topic CPI and toxic content percentages have a Pearson correlation of 0.76.
- Repliers in CPIs tend to have fewer followers, followings, and tweets, while root users’ attributes matter more. Root reply count has the largest positive coefficient overall (0.525; Democrats 1.978, Republicans -0.304); root like count is negative for Democrats (-1.450) and positive for Republicans (0.788).
- CPI replies are consistently more toxic than non-CPI replies as political orientation moves away from the center, with lowest toxicity near the center (CPI 3.1%, non-CPI 2.7%). Democrats show more negative/confrontational stances in D→R than D→D, while Republicans maintain a more consistent tone; root sentiment–reply stance patterns correlate 95% between partisan and cross-partisan interactions.
Methods
- Used the Internet Archive’s 1% Twitter sample, recollecting replies and root tweets via Twitter API in March 2023, limited to English direct replies to root tweets in the 2020 U.S. context. Political orientation was measured with Barberá’s Bayesian ideal-point method (-5 to +5); a CPI is a reply between users with different orientations.
- Toxicity was scored with Google Jigsaw’s Perspective API, taking the maximum score across categories and using a 0.61 threshold. Topic modeling used BERTopic (BERT embeddings, UMAP, HDBSCAN) on root tweets, identifying 177 topics grouped into 11 categories.
- LLM annotation used Mistral-7B-Instruct-v0.2 to generate three adjectives for root sentiment and reply stance, sampling 100,000 tweet-reply pairs per interaction type (400,000 total). Validation on 100 pairs gave 97%/88% sentiment accuracy and 88%/85% stance accuracy by two annotators. Logistic and Lasso regressions modeled user/CPI associations.
Limitations
- Stated: continuous CPI values were not deeply analyzed; analysis is limited to root tweets and direct replies, excluding reply chains and media/links/images/videos; LLM annotation sometimes confused stance and sentiment or generated sentences; findings are specific to X/Twitter and the 2020 U.S. context under a Republican government.
- Evident from the text: political orientation classification excludes users without following data and neutral users, so results apply only to classified non-neutral partisans; toxicity classification depends on Perspective API and the 0.61 threshold, though sensitivity checks from 0.4 to 0.9 reportedly showed no substantial change.
- Evident from the text: the regression models have modest explanatory power—full logistic model Pseudo R-squared 0.05413 and ROC AUC 0.656, with the Republican model ROC AUC 0.538—so reported associations are not strong causal predictions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
9 of 14 cited sources checked · 6 supported · 1 flagged · accuracy not yet measured
- Findingown data
Political topics comprise approximately 35% of the 177 topics.
“Political topics comprise approximately 35% of these 177 topics”
Quote in the paperNot a substantial claim - Findingown data
The topic modeling identifies 177 distinct topics within the dataset.
“The topic modeling identifies 177 distinct topics within the dataset.”
Quote in the paperNot a substantial claim - Findingown data
Toxicity levels for CPI replies are consistently higher than for non-CPI replies as the political orientation score moves away from the center.
“The overall trend shows that toxicity levels for CPI replies (red bars) are consistently higher than for non-CPI replies (blue bars) as the political orientation score moves away from the center.”
Quote in the paperSubstantial claim - Findingnone given
Users are more likely to engage in CPIs with popular accounts in general.
“Although users are more likely to engage in CPIs with popular accounts in general”
Quote in the paperNot a substantial claim - Findingown data
There are 661,661 replies classified as CPI (34%).
“There are 661,661 replies classified as CPI (34%).”
Quote in the paperSubstantial claim
- Findingown data
Cross-partisan interactions originating from Democrats constitute 65% of all CPIs.
“While cross-partisan interactions originating from Democrats constitute 65% of all CPIs”
Quote in the paperNot a substantial claim - Findingnone given
Certain topics such as politics, economics, and golf have higher rates of CPI in contrast to public health, religion, and daily life.
“Certain topics such as politics, economics, and golf has higher rates of CPI in contrast to public health, religion, and daily life.”
Quote in the paperNot a substantial claim - Findingnone given
Toxicity scores have a symmetric behavior with respect to the point zero for both parties.
“Overall, the toxicity scores have a symmetric behavior with respect to the point zero for both parties.”
Quote in the paperNot a substantial claim - Findingown data
The coefficients of users show a Pearson correlation of 0.78 with their CPI versus non-CPI ratios.
“The coefficients of the users show a Pearson correlation of 0.78 with their CPI versus non-CPI ratios”
Quote in the paperSubstantial claim - Findingown data
Democrats engage in cross-partisan interactions slightly more frequently than Republicans.
“While Democrats engage in cross-partisan interactions slightly more frequently”
Quote in the paperSubstantial claim - Findingown data
Quote count is less associated with CPIs for both camps.
“Quote count is less associated with CPIs for both camps”
Quote in the paperNot a substantial claim - Findingown data
Popular users are more likely to foster CPIs as they attract replies from users with opposite views.
“we find that popular users are more likely to foster CPIs as they attract replies from users with opposite views.”
Quote in the paperSubstantial claim - Findingreasoning
Political orientation scores show an inverse relationship with the probability of creating CPIs.
“Moreover, the political orientation scores show an inverse relationship with the probability of creating CPIs”
Quote in the paperSubstantial claim - Findingown data
All coefficients in the logistic regression models are statistically significant (p < 0.0001).
“All coefficients are statistically significant (p < 0.0001).”
Quote in the paperNot a substantial claim - Findingnone given
More polarized users tend to use offensive language.
“the study confirms that more polarized users tend to use offensive language.”
Quote in the paperNot a substantial claim - Findingnone given
Toxicity decreases at the edges of the spectrum.
“Interestingly, toxicity decreases at the edges of the spectrum.”
Quote in the paperNot a substantial claim - Findingown data
Republicans tend to maintain a more consistent tone across interactions.
“In contrast, Republicans tend to maintain a more consistent tone across interactions.”
Quote in the paperSubstantial claim - Findingown data
The coefficients for root attributes are higher than repliers' attributes.
“We observe that the coefficients for the root's attributes are higher than the repliers' attributes.”
Quote in the paperSubstantial claim - Findingown data
Democrats' cross-partisan interactions often involve more negative and nonconstructive stances compared to their intra-party interactions.
“these interactions often involve more negative and nonconstructive stances compared to their intra-party interactions.”
Quote in the paperSubstantial claim - Findingown data
The reply count of the root tweet has the biggest coefficient by far for the entire dataset.
“The reply count of the root tweet has the biggest coefficient by far for the entire dataset.”
Quote in the paperSubstantial claim - Findingown data
Users close to the political center have a higher percentage of CPI involvement.
“users close to the political center have a higher percentage of CPI involvement”
Quote in the paperSubstantial claim - Findingown data
CPIs are correlated with heightened toxicity.
“CPIs are correlated with heightened toxicity”
Quote in the paperSubstantial claim - Findingown data
Users with more extreme scores on the political spectrum are less likely to be involved in CPIs.
“In contrast, those with more extreme scores on the political spectrum are less likely to be involved in CPIs.”
Quote in the paperSubstantial claim - Findingown data
Discussions around Golf and Football topics show higher CPI percentages, ranging from 51% to 55%.
“discussions around Golf and Football topics show higher CPI percentages, ranging from 51% to 55%.”
Quote in the paperNot a substantial claim - Findingown data
A Pearson correlation of 0.76 exists between topic CPI and toxic content percentages.
“A Pearson correlation of 0.76 between topic CPI and toxic content percentages”
Quote in the paperSubstantial claim - Findingown data
Topics under Hobbies & Daily Life and Religious & Praying exhibit considerably lower CPI percentages.
“Topics under the categories Hobbies & Daily Life and Religious & Praying exhibit considerably lower CPI percentages”
Quote in the paperSubstantial claim - Findingown data
Topics under Politics & Governance and Political Figures generate the highest levels of CPI.
“The topics under Politics & Governance and Politic Figures generate the highest levels of CPI”
Quote in the paperSubstantial claim - Interpretationreasoning
New or small accounts are more likely to engage in CPIs, possibly to attract attention and grow their accounts.
“This means that new or small accounts are more likely to engage in CPIs, possibly to attract attention and grow their accounts.”
Quote in the paperSubstantial claim - Interpretationown data
The overrepresentation of Democrats in CPIs is due to the dataset containing a larger number of users labeled as Democrats.
“this is due to the dataset containing a larger number of users labeled as Democrats.”
Quote in the paperNot a substantial claim - Interpretationown data
Popular tweets with many replies also attract many CPIs (rich-get-richer effect).
“This suggests a richget-richer effect, i.e., popular tweets with many replies also attract many CPIs.”
Quote in the paperSubstantial claim - Interpretationown data
As coefficient values increase, the likelihood of a user contributing to CPIs also rises proportionally.
“This suggests that as the coefficient values increase, the likelihood of a user contributing to CPIs also rises proportionally.”
Quote in the paperSubstantial claim - Study design and conductcitation
The 1% random sample of Twitter provided by the Internet Archive is an unbiased sample of replies.
“To have an unbiased sample of replies, we employed the 1% random sample of Twitter provided by the Internet Archive (Archive 2024).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Archive 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Only replies provide evidence that people intend to engage in a direct reciprocal interaction that can lead to a dialogue.
“We limited our analysis only to replies, as only replies provide evidence that people intend to engage in a direct reciprocal interaction that can lead to a dialogue (An et al. 2024;Zade et al. 2024).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites An et al. 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Zade et al. 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
CPIs depend mostly on root users.
“This suggests that the CPIs depend mostly on root users.”
Quote in the paperSubstantial claim - Interpretationown data
Users participating in these discussions are more insular, predominantly interacting with like-minded individuals.
“which suggests that users participating in these discussions are more insular, predominantly interacting with like-minded individuals.”
Quote in the paperSubstantial claim - Interpretationown data
Topics under Hobbies & Daily Life and Religious & Praying are more likely to be confined within echo chambers.
“indicating that they are more likely to be confined within echo chambers.”
Quote in the paperSubstantial claim - Interpretationown data
Topics under Politics & Governance and Political Figures are particularly effective at breaking through echo chambers.
“suggesting that they are particularly effective at breaking through echo chambers.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 20
- May combine two claims. 23
Classified as probably not a substantial claim.
Study design and conductcitationThe toxicity threshold is set at 0.61, identified by Kumar et al. (2021) and Aleksandric et al. (2024).
“We set the threshold at 0.61 which is identified by Kumar et al. (2021) by employing a survey on 17,280 participants and Aleksandric et al. (2024) who found that Perspective API gets the highest accuracy on this threshold on their independent test set.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites Kumar et al. (2021) source
Section 6.1 (p. 11) reports 0.61 as the median of thresholds optimized separately for individual participants, not as a recommended single toxicity threshold. It instead gives 0.18–0.49 as the optimal range for the aggregate dataset. The Conclusion (p. 12) confirms that the study surveyed 17,280 participants. (LLM, conf=0.90)
Experimental — accuracy not yet measured - cites Aleksandric et al. (2024) source
In “GPT Labels” (page not provided), Aleksandric et al. report that Perspective API achieved its highest accuracy at a threshold of 0.6, not 0.61, and say they used 0.6 to classify toxic replies. They compared the API against a manually labeled sample; the passage does not describe an independent test set. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe median optimal threshold for classifying toxic content across participants is 0.61.
“They find that the median optimal threshold across participants 0.61.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Kumar et al. (2021) source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSantoro and Broockman (2022) find that the effectiveness of cross-partisan conversations depends on the topic through a randomized controlled trial.
“Santoro and Broockman (2022) find that the effectiveness of cross-partisan conversations depends on the topic through a randomized controlled trial.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Santoro and Broockman (2022) source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA substantial portion of the audience accesses news from outlets with varying ideological perspectives from both online and offline platforms.
“A substantial portion of the audience accesses news from outlets with varying ideological perspectives from both online and offline platforms (Gentzkow and Shapiro 2011).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Gentzkow and Shapiro 2011 source
The Introduction reports that a significant share of consumers get online news from multiple outlets, including outlets with differing ideological audiences. Section 4.1 finds low ideological segregation in several offline media, but it does not establish that a substantial portion of individuals accesses differently oriented outlets across both online and offline platforms. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
Study design and conductcitationThe methodology of Barberá (2015) measures users' political orientation.
“We employ the methodology of Barberá (2015) to measure users' political orientation.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Barberá 2015 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPast studies have not reached a consensus on whether cross-partisan interactions bridge divides or exacerbate tensions.
“Past studies have not reached a consensus on whether such interactions bridge divides or exacerbate tensions”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Bail et al. (2018) source
- cites Rajadesingan et al. (2021)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationLLMs are capable of text mining tasks such as stance detection, sentiment analysis, hate speech, and sociopolitical affiliation of texts.
“recent studies suggest that LLMs are capable of text mining tasks such as stance detection (Lan et al. 2024), sentiment analysis (Lee et al. 2024), hate speech (Kaya, Ozcelik, and Toraman 2024), and sociopolitical affiliation of texts (Ghafouri et al. 2023).”
Quote in the paperNot a substantial claim2 of 3 sources checkedMay combine two claims.
Findingnone givenRepliers in CPIs tend to have lower number of followers, followings, and tweet counts.
“In contrast, the repliers in CPIs tend to have lower number of followers, followings and tweet counts.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRoot users' tweet counts have negative association with CPIs, while their following counts have contrasting but negligible associations.
“Root users' tweet counts have negative association while their following counts have contrasting but negligible associations with CPIs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOf all Republican tweets, 33.2% are Republicans replying to Democrats; of all Democrat tweets, 34.3% are Democrats replying to Republicans.
“Of these, 196,642 are from Republicans replying to Democrats, making up 33.2% of all Republican tweets, and 432,004 are from Democrats replying to Republicans, accounting for 34.3% of all Democrat tweets.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAround 10-15% of topics specifically pertain to election-related discourse.
“A notable subset of these, around 10-15%, specifically pertains to electionrelated discourse”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe political discourse and pre-established political views sway how users participate in CPIs, but the direction in which users go is nuanced.
“The political discourse and pre-established political views sway how users participate in CPIs, but the direction in which users go is nuanced.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAccounts fostering CPIs by replying have fewer followers, followings, and tweets (negative coefficients).
“We observe that accounts fostering CPIs by replying have fewer count of followers, following, and tweets as these have negative coefficients.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataRoot tweets from users with high follower count are more associated with CPIs from Democrats but less with CPIs from Republicans.
“On the other hand, root tweets from users with high follower count are more associated with CPIs from Democrats but less with CPIs from Republicans.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCPIs are significantly influenced by the nature of the topics being discussed, with politically charged events acting as strong catalysts.
“We find that CPIs are significantly influenced by the nature of the topics being discussed, with politically charged events acting as strong catalysts.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenAmong Republicans, engaging in CPIs with popular accounts is less common; they often engage in CPIs with accounts with a low number of followers for personal matters.
“this is less common among Republicans who often engage in CPIs with accounts with a low number of followers for personal matters.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe tweet's retweet count has a similar association and generalizes to Republicans although the coefficient is low.
“The tweet's retweet count has a similar association and generalizes to Republicans although the coefficient is low.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataToxicity scores gradually decrease toward the center, reaching their lowest around the center, where CPI toxicity drops to 3.1% and non-CPI toxicity to 2.7%.
“As moving toward the center, toxicity scores gradually decrease for both CPI and non-CPI interactions, reaching their lowest around the center, where CPI toxicity drops to 3.1% and non-CPI toxicity to 2.7%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataDemocrats tend not to be involved in CPIs, as their bins have more negative coefficient portions compared to Republicans, who are more likely to engage in CPIs.
“Our analysis reveals that Democrats tend not to be involved in CPIs, as their bins have more negative coefficient portions compared to Republicans, who are more likely to engage in CPIs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataLike count has a very high negative coefficient for Democrats and a very high positive coefficient for Republicans.
“Surprisingly, like count has a very high negative coefficient for Democrats and a very high positive coefficient for Republicans.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe rich-get-richer effect is more pronounced for Democrats but does not generalize to Republicans, which has a negative coefficient for the same attribute.
“This findings is even more pronounced for Democrats, but does not generalize to Republicans, which has a negative coefficient for the same attribute.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningCross-partisan engagement is influenced not only by root tweet attributes but also by the alignment of the repliers.
“The differences between the camps underline how crosspartisan engagement is influenced not only by root tweet attributes but also by the alignment of the repliers”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationcitationThe dynamics of cross-partisan interactions are complex, and their impact varies on a case-by-case basis.
“These studies suggest that the dynamics of cross-partisan interactions are complex, and their impact varies on a caseby-case basis.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationIndividuals are not wholly isolated within echo chambers but rather encounter diverse viewpoints.
“Such cross-partisan media consumption indicates that individuals are not wholly isolated within echo chambers but rather encounter diverse viewpoints.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningCPIs can bridge ideological gaps but also risk escalating tensions.
“which suggests that while these interactions can bridge ideological gaps, they also risk escalating tensions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataRepublicans are more inclined to engage in CPIs with highly liked tweets from the opposing camp, whereas Democrats may tend to create discussions on tweets they dislike.
“This indicates that Republicans are more inclined to engage in CPIs with highly liked tweets from the opposing camp, whereas Democrats may tend to create discussions on tweets they (and the general public) dislike.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe code is fully shared online.
“the code is fully shared online”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe data used in the study was opensourced.
“the data we used was opensourced”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe analysis does not reveal the identity of the users.
“our analysis does not reveal the identity of the users”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAll training details were specified.
“Did you specify all the training details (e.g., data splits, hyperparameters, how they were chosen)?Yes”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThese bottom-right quadrant topics offer opportunities for bridging societal divides, acting as contact points where cross-partisan dialogue can flourish.
“which offer opportunities for bridging societal divides, acting as contact points where cross-partisan dialogue can flourish.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataPolitically and socially significant topics tend to disrupt echo chamber dynamics, while more personal or neutral topics may reinforce them, leading to isolated discussions within homogeneous groups.
“The findings suggest that while politically and socially significant topics tend to disrupt echo chamber dynamics, more personal or neutral topics may reinforce them, leading to isolated discussions within homogeneous groups.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe total amount of compute and the type of resources used are included in the Data & Methodology section.
“Did you include the total amount of compute and the type of resources used (e.g., type of GPUs, internal cluster, or cloud provider)?Yes, see Data & Methodology section.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe machine learning experiment was for generating text, so accuracy and error bars do not apply.
“Our machine learning experiment was done for generating text where the concept of accuracy and error-bar does not apply.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Study design and conductnone givenThe proposed evaluation is justified as sufficient and appropriate to the claims made.
“Do you justify how the proposed evaluation is sufficient and appropriate to the claims made?Yes”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe labels are shared on GitHub for reproducibility.
“we share our labels on GitHub for reproducibility”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Study design and conductnone givenThe cost of misclassification and fault tolerance is discussed.
“Do you discuss what is "the cost" of misclassification and fault (in)tolerance?Yes”
Quote in the paperNot a substantial claim
The paper relies on this without support.
A case-by-case understanding of the likeliness and impact of CPIs is not clearly established.
“To the best of our knowledge, such a case-by-case understanding of the likeliness and impact of CPIs is not clearly established.”
The paper relies on this without support.
The year 2020 captures general discussions and political discussions relevant to the study.
“We limit the data period to 2020 as it captures the general discussions, such as the pandemic (often non-political) and the political discussions related to the 2020 U.S. presidential election.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Party-specific CPI counts do not sum to the reported total
MajorThe reported Republican-to-Democrat and Democrat-to-Republican counts sum to 628,646, which is 33,015 fewer than the reported 661,661 CPI replies.
Reported 661661 · recomputed 628646
“There are 661,661 replies classified as CPI (34%).Of these, 196,642 are from Republicans replying to Democrats, making up 33.2% of all Republican tweets, and 432,004 are from Democrats replying to Republicans”
Reported CPI share does not match the final reply count
MajorThe paper reports 661,661 CPI replies and 1,594,271 replies in the final dataset. That is 41.5% of replies, not 34%.
Reported 34 · recomputed 41.502417
“There are 661,661 replies classified as CPI (34%).”
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 1
- C ¸etinkaya, Y. M.; Lee, Y.; Külah, E.; Toroslu, İ. H.; Cowan, M. A.; and Davulcu, H. 2024. Toward a Programmable Hu- manizing Artificial Intelligence Through Scalable Stance- Directed Architecture . IEEE Internet Computing, 28(05): 20-27.
Cited by
Sorted by citations
NARRA-SCALE: Scaling Users and Messaging Through Narrative Detection in Retweet Networks
Çetinkaya, Y. M., Trivedi, A., Yanamandala, V. D., Cowan, M. A., Toroslu, İ. H., & Davulcu, H. (2025) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai66417.2025.00032
Self-citationNagura, T., & Akiyama, E. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402391
- Authors
- Çetinkaya, Y. M., Ghafouri, V., Suarez-Tangil, G., Such, J., & Elmas, T.
- Affiliations
- Middle East Technical University (TR)
- IMDEA Networks (ES)
- University of Edinburgh (GB)
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2025-06-07
- Volume
- 19
- Pages
- 324-340
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W4411120955
- Cited by
- 2
- References
- 0
- Citations by year
- 2025: 2
- FWCI
- 13.78
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the International AAAI Conference on Web and Social Media (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- Agencia Estatal de Investigación (13039, AEI/10)
- European Social Fund
- Topics
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- echo chambers, political polarization, Twitter, online toxicity, political discourse, 2020 US presidential election, content moderation, user engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review