Dynamics of cross-platform attention to retracted papers
Open accessThe DOI matches its Crossref record; 61 of the 63 references it cites were found in a registry or an index; 13 of the 61 sources its claims cite were checked for support.
Abstract
Retracted papers often circulate widely on social media, digital news, and other websites before their official retraction. The spread of potentially inaccurate or misleading results from retracted papers can harm the scientific community and the public. Here, we quantify the amount and type of attention 3,851 retracted papers received over time in different online platforms. Comparing with a set of nonretracted control papers from the same journals with similar publication year, number of coauthors, and author impact, we show that retracted papers receive more attention after publication not only on social media but also, on heavily curated platforms, such as news outlets and knowledge repositories, amplifying the negative impact on the public. At the same time, we find that posts on Twitter tend to express more criticism about retracted than about control papers, suggesting that criticism-expressing tweets could contain factual information about problematic papers. Most importantly, around the time they are retracted, papers generate discussions that are primarily about the retraction incident rather than about research findings, showing that by this point, papers have exhausted attention to their results and highlighting the limited effect of retractions. Our findings reveal the extent to which retracted papers are discussed on different online platforms and identify at scale audience criticism toward them. In this context, we show that retraction is not an effective tool to reduce online attention to problematic papers.
Overview
CoChat Summary
TL;DR
Retracted papers attract more online attention than matched nonretracted papers across social media, news, blogs, and knowledge repositories, but most have already exhausted their attention by the time they are retracted. Retraction therefore does little to curb the online spread of problematic findings, although Twitter discussions before retraction contain more criticism of subsequently retracted papers.
Key findings
- Across 2,830 retracted and 13,599 control papers with at least a 6-mo tracking window, retracted papers received more mentions after publication on all four platform types and in top news outlets; the surplus was higher on curated platforms such as news outlets and knowledge repositories than on social media and blogs.
- By the time of retraction, attention was largely exhausted: 80.2% of retracted papers received no mentions in the 2 mo before retraction, and 93.6% received no mentions in the last month before retraction.
- After excluding critical tweets, retracted papers still received more Twitter mentions than control papers, indicating uncritical sharing of potentially flawed findings.
- Retracted papers received a higher fraction of critical tweets than control papers before retraction, especially over longer windows such as 5–6 mo, with regression coefficients for retraction status positive and statistically significant (P < 0.001 for 5–6 mo).
Methods
- Used Altmetric (October 8, 2019 version) to track mentions of papers across four platform types—social media, news media, blogs, and knowledge repositories—and Retraction Watch for retracted papers; the analysis covered 3,985 retracted papers on 14 online platforms.
- Matched five control papers to each retracted paper using coarsened exact matching on publication journal, publication year within ±2 y, author count within ±2, and most-highly-cited author’s citation rank percentile within 20%; this yielded 19,255 control papers matched to 3,851 retracted papers.
- Compared attention using negative binomial regression, Mann–Whitney U tests, and interrupted time series analysis; labeled critical tweets using a 76-keyword heuristic with recall 0.9 followed by manual annotation by three to four annotators, achieving weighted average Cohen’s kappa of 0.72.
Limitations
- The paper states that not all problematic papers are retracted, and findings are based only on the subset recorded in Altmetric, which may not represent all problematic papers.
- The paper states that Altmetric may not cover all mentions, and that the matching scheme leaves factors such as prestige of affiliation uncharted.
- The paper states that critical-mention detection focuses on Twitter only, and that the study analyzes public attention without distinguishing different online audiences; the text also notes that after-retraction filtering was not applied to all platforms, so mention volume after excluding retraction-related content is an overestimation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
8 Valid · 1 Not valid · 21 Not checked · 66 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“the web has become the primary channel through which the lay public interacts with scientific information (21–23).”
§ Dynamics of cross-platform attention to retracted papers > Abstract
What the sources say
- Not checked yetcites [21] S. S. Sundar, Effect of source attribution on perception of online news stories. J. Mass Commun. Q. 75, 55– 68 (1998).
- Not checked yetcites [22] A. J. Flanagin, M. J. Metzger, Perceptions of internet information credibility. J. Mass Commun. Q. 77, 515– 540 (2000).
- Partly supportedcites [23] D. A. Scheufele, N. M. Krause, Science audiences, misinformation, and fake news. Proc. Natl. Acad. Sci. U.S.A. 116, 7662– 7669 (2019). 30642953 PMC6475373 sourceExperimental — accuracy not yet measured
Our copy supports the directional part of the claim: the 'How Does Misinformation Take Root' section describes audiences moving online ('As younger audiences worldwide flock to social media and other seemingly free sources of news (79)... traditional news producers driving audiences to online versions of their stories rather than to newspapers or television broadcasts (80)'), and the Outlook/research-agenda sections treat online channels as 'ubiquitous' and note the decline of legacy science journalism. But no passage states that the web is the PRIMARY channel through which the lay public interacts with scientific information — the paper never ranks channels or asserts primacy, and its strongest statements concern news generally and younger audiences rather than science information specifically. The claim's superlative ('primary channel') is therefore an overstatement of what this source says. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of them, published in a top biology journal, reported that treatment with chloroquine had no benefit in COVID-19 patients based on data that were likely fabricated (18).”
§ Dynamics of cross-platform attention to retracted papers > Abstract
What the sources say
- Partly supportedcites [18] M. R. Mehra, F. Ruschitzka, A. N. Patel, Retraction: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: A multinational registry analysis. Lancet 395, 1820 (2020). 32511943 PMC7274621 sourceExperimental — accuracy not yet measured
The Retraction notice (page not given) confirms that the chloroquine/COVID-19 paper was retracted because the authors could not vouch for the veracity of its data. It does not state that chloroquine had no benefit or establish that the data were likely fabricated; it reports concerns about data veracity and an unsuccessful independent review. (LLM, conf=0.87)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“research shows that prominent journals with rigorous screening and high publishing standards are as likely to publish erroneous papers as less prominent journals (11).”
§ Dynamics of cross-platform attention to retracted papers > Abstract
What the sources say
- Partly supportedcites [11] M. Cokol, I. Iossifov, R. Rodriguez-Esteban, A. Rzhetsky, How many scientific papers should be retracted? EMBO Rep. 8, 422– 423 (2007). PMC1866214 17471252 sourceExperimental — accuracy not yet measured
The paper’s analysis (passage [4]) suggests that high- and lower-impact journals have similar pre-publication scrutiny, supporting the comparison in the claim. But the claim states equal likelihood of publishing erroneous papers as a fact, whereas the paper presents a model-based inference about nearly uniform pre-publication quality control. It also reports fewer undetected flawed articles in high-impact journals (passage [2]). (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Past research on the online diffusion of science has mainly studied the spread of papers without regard to their retraction status (24–29).”
§ Dynamics of cross-platform attention to retracted papers > Abstract
What the sources say
- Not checked yetcites [24] M. R. Morris, S. Counts, A. Roseway, A. Hoff, J. Schwarz, “Tweeting is believing?: Understanding microblog credibility perceptions” in Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (ACM, New York, NY, 2012), pp. 441– 450. source
- Not checked yetcites [25] D. Brossard, New media landscapes and the science information consumer. Proc. Natl. Acad. Sci. U.S.A. 110 (suppl. 3), 14096– 14101 (2013). 23940316 PMC3752175 source
- Could not verifycites [26] D. A. Scheufele, Communicating science in social settings. Proc. Natl. Acad. Sci. U.S.A. 110 (suppl. 3), 14040– 14047 (2013). 23940341 PMC3752169 sourceExperimental — accuracy not yet measured
The section on crumbling science–public infrastructures discusses audiences moving toward online sources for science news, not studies of how scientific papers spread online. Searches for retraction status and online diffusion found no passage addressing whether past research distinguished retracted from non-retracted papers. (LLM, conf=0.76)
- Not checked yetcites [27] K. L. Milkman, J. Berger, The science of sharing and the sharing of science. Proc. Natl. Acad. Sci. U.S.A. 111 (suppl. 4), 13642– 13649 (2014). 25225360 PMC4183177 source
- Not checked yetcites [28] L. Y. F. Su, H. Akin, D. Brossard, D. A. Scheufele, M. A. Xenos, Science news consumption patterns and their implications for public understanding of science. J. Mass Commun. Q. 92, 597– 616 (2015). source
- Supportedcites [29] I. Zakhlebin, E.-Á. Horvát, “Diffusion of scientific articles across online platforms” in Proceedings of the International AAAI Conference on Web and Social Media (Association for the Advancement of Artificial Intelligence, Palo Alto, CA, 2020), pp. 762– 773. source
This paper is an example of the research the citing sentence describes. Its Dataset Description (p. 3) selects articles by whether they were mentioned online, and its Discussion (p. 11) describes analyzing their diffusion across platforms; neither treats retraction status as an analytic category. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“More than half of retracted papers are flagged because of scientific misconduct, such as fabrication, falsification, and plagiarism (4, 5).”
§ Dynamics of cross-platform attention to retracted papers > Abstract
What the sources say
- Supportedcites [4] F. C. Fang, R. G. Steen, A. Casadevall, Misconduct accounts for the majority of retracted scientific publications. Proc. Natl. Acad. Sci. U.S.A. 109, 17028– 17033 (2012). 23027971 PMC3479492 source
The paper's opening summary and the Causes of Retraction section report that of 2,047 biomedical/life-science articles indexed by PubMed as retracted, 67.4% were attributable to misconduct — fraud or suspected fraud 43.4%, duplicate publication 14.2%, plagiarism 9.8% — versus only 21.3% for error, i.e. a clear majority. Methods/abstract classify documented fraud as data falsification or fabrication, matching the claim's examples alongside plagiarism. The only scope qualifier is that the sample is the PubMed-indexed biomedical and life-science literature, which the citing sentence generalizes to 'retracted papers'. (LLM, conf=0.92)
- Not checked yetcites [5] X. Shuai., A multidimensional investigation of the effects of publication retraction on scholarly impact. J. Assoc. Inf. Sci. Technol. 68, 2225– 2236 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
36 more claims · 1 with their cited sources checked
Create a free account to see all 96 claims and to verify the 48 references still open.
- Probably not a substantial claim. 48
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the recent finding that most retractions occur when research attention has been exhausted”
From Protection of the human gene research literature from contract cheating organizations known as research paper mills (2022) · cites this paper as [96]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Dynamics of cross-platform attention to retracted papers > Results > Is Retraction Effective in Reducing Attention?
“In the case of retracted papers, we also manually excluded all after-retraction posts that discussed the retraction in some form.”
§ Dynamics of cross-platform attention to retracted papers > Materials and Methods > Filtering Retraction-Related Posts.
“Note that since we did not label posts from all platforms, the mention volume of retracted papers after excluding retraction-related content is an overestimation.”
Citations
Cites
5 retracted
Mehra, M. R., Desai, S. S., Ruschitzka, F., & Patel, A. N. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31180-6 · Cited by 1,200
RetractedMehra, M. R., Ruschitzka, F., & Patel, A. N. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31324-6 · Cited by 553
RetractedRetraction policies of top scientific journals ranked by impact factor
Resnik, D. B., Wager, E., & Kissling, G. E. (2015) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.103.3.006 · Cited by 71
RetractedAlShebli, B., Makovi, K., & Rahwan, T. (2020) · Nature Communications · doi:10.1038/s41467-020-19723-8 · Cited by 66
RetractedAlShebli, B., Makovi, K., & Rahwan, T. (2020) · Nature Communications · doi:10.1038/s41467-020-20617-y · Cited by 23
RetractedInterrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
What is Twitter, a social network or a news media?
Kwak, H., Lee, C., Park, H., & Moon, S. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772751 · Cited by 6,652
Causal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 2×
“[4] David McDowall, Richard McCleary, and Bradley J Bartos.”
BackgroundMethodPerceptions of Internet Information Credibility
Flanagin, A. J., & Metzger, M. J. (2000) · Journalism & Mass Communication Quarterly · doi:10.1177/107769900007700304 · Cited by 1,069
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Science audiences, misinformation, and fake news
Scheufele, D. A., & Krause, N. M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1805871115 · Cited by 878
Multi-University Research Teams: Shifting Impact, Geography, and Stratification in Science
Jones, B. F., Wuchty, S., & Uzzi, B. (2008) · Science · doi:10.1126/science.1158357 · Cited by 812
An Overview of Microsoft Academic Service (MAS) and Applications
Sinha, A., Shen, Z., Song, Y., Ma, H., Eide, D., Hsu, B.-J. (., & Wang, K. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742839 · Cited by 658
Novelty and collective attention
Wu, F., & Huberman, B. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704916104 · Cited by 608
New media landscapes and the science information consumer
Brossard, D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212744110 · Cited by 430
Is science really facing a reproducibility crisis, and do we need it to?
Fanelli, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708272114 · Cited by 416
Why has the number of scientific retractions increased?
Steen, R. G., Casadevall, A., & Fang, F. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068397 · Cited by 415
Tweeting is believing?: understanding microblog credibility perceptions
Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145274 · Cited by 411
Retractions in the scientific literature: is the incidence of research fraud increasing?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040923 · Cited by 405 · cited 3×
“[3] Mark Jurkowitz, Amy Mitchell, Elisa Shearer, and Mason Walker.”
BackgroundMethodPublication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395
Science publishing: The trouble with retractions
Van Noorden, R. (2011) · Nature · doi:10.1038/478026a · Cited by 328
Data-driven predictions in the science of science
Clauset, A., Larremore, D. B., & Sinatra, R. (2017) · Science · doi:10.1126/science.aal4217 · Cited by 265
Design and Update of a Classification System: The UCSD Map of Science
Börner, K., Klavans, R., Patek, M., Zoss, A. M., Biberstine, J. R., Light, R. P., Larivière, V., & Boyack, K. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039464 · Cited by 246 · cited 2×
“[1] Katy Börner, Richard Klavans, Michael Patek, Angela M Zoss, Joseph R Biberstine, Robert P Light, Vincent Larivière, and Kevin W Boyack.”
BackgroundCommunicating science in social settings
Scheufele, D. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213275110 · Cited by 231
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
Modelling science trustworthiness under publish or perish pressure
Grimes, D. R., Bauch, C. T., & Ioannidis, J. P. A. (2018) · Royal Society Open Science · doi:10.1098/rsos.171511 · Cited by 225
Effect of Source Attribution on Perception of Online News Stories
Sundar, S. S. (1998) · Journalism & Mass Communication Quarterly · doi:10.1177/107769909807500108 · Cited by 214
The Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191
Interrupted Time Series Analysis
McDowall, D., McCleary, R., & Bartos, B. J. (2019) · doi:10.1093/oso/9780190943943.001.0001 · Cited by 179
A systematic identification and analysis of scientists on Twitter
Ke, Q., Ahn, Y.-Y., & Sugimoto, C. R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175368 · Cited by 175
The Sciences’ Media Connection –Public Communication and its Repercussions
Rödder, S., Weingart, P., & Franzen, M. (2011) · Sociology of the sciences/Sociology of the sciences yearbook · doi:10.1007/978-94-007-2085-5 · Cited by 156
What a massive database of retracted papers reveals about science publishing's ‘death penalty'
(2018) · AAAS Articles DO Group · doi:10.1126/science.aav8384 · Cited by 155
The science of sharing and the sharing of science
Milkman, K. L., & Berger, J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317511111 · Cited by 154
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151
US studies may overestimate effect sizes in softer research
Fanelli, D., & Ioannidis, J. P. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1302997110 · Cited by 130
How many scientific papers should be retracted?
Cokol, M., Iossifov, I., Rodriguez‐Esteban, R., & Rzhetsky, A. (2007) · The EMBO Reports · doi:10.1038/sj.embor.7400970 · Cited by 113
Hargittai, E., Füchslin, T., & Schäfer, M. S. (2018) · Social Media + Society · doi:10.1177/2056305118797720 · Cited by 100
Azoulay, P., Furman, J. L., Krieger, & Murray, F. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00469 · Cited by 91
Science News Consumption Patterns and Their Implications for Public Understanding of Science
Su, L. Y.-F., Akin, H., Brossard, D., Scheufele, D. A., & Xenos, M. A. (2015) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699015586415 · Cited by 91
Signaling the trustworthiness of science
Jamieson, K. H., McNutt, M., Kiermer, V., & Sever, R. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1913039116 · Cited by 89
The (lack of) Impact of Retraction on Citation Networks
Madlock-Brown, C. R., & Eichmann, D. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-014-9532-1 · Cited by 89
A Century of Science: Globalization of Scientific Collaborations, Citations, and Innovations
Dong, Y., Ma, H., Shen, Z., & Wang, K. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098016 · Cited by 89
A Field Guide for Science Writers
(2005) · Oxford University Press eBooks · doi:10.1093/oso/9780195174991.001.0001 · Cited by 66
Avenell, A., Stewart, F., Grey, A., Gamble, G., & Bolland, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031909 · Cited by 59
Media and social media attention to retracted articles according to Altmetric
Serghiou, S., Marton, R. M., & Ioannidis, J. P. A. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248625 · Cited by 55
A Multidimensional Investigation of the Effects of Publication Retraction on Scholarly Impact
Shuai, X., Rollins, J., Moulinier, I., Custis, T., Edmunds, M., & Schilder, F. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23826 · Cited by 48 · cited 2×
“We compiled a list of 27 top news outlets that are believed to be trustworthy, have high-quality science reporting, and represent popular media brands across a range of platforms according to the Pew Research Center [3, 5].”
MethodA Century of Science: Globalization of Scientific Collaborations, Citations, and InnovationsPreprint
Dong, Y., Ma, H., Shen, Z., & Wang, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.05150 · Cited by 46
The Reverse Matthew Effect: Consequences of Retraction in Scientific Teams
Jin, G. Z., Jones, B., Lu, S. F., & Uzzi, B. (2019) · The Review of Economics and Statistics · doi:10.1162/rest_a_00780 · Cited by 41
An investigation of retracted articles in the biomedical literature
Budd, J. M., Coble, Z., & Abritis, A. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301055 · Cited by 36
Correction and retraction practices in library and information science journals
Ajiferuke, I., & Adekannbi, J. O. (2020) · Journal of Librarianship and Information Science · doi:10.1177/0961000618785408 · Cited by 33 · cited 2×
“[1] Katy Börner, Richard Klavans, Michael Patek, Angela M Zoss, Joseph R Biberstine, Robert P Light, Vincent Larivière, and Kevin W Boyack.”
BackgroundA scientist's fraudulent studies put patients at risk
Marcus, A. (2018) · Science · doi:10.1126/science.362.6413.394-a · Cited by 30
Haunschild, R., & Bornmann, L. (2021) · Scientometrics · doi:10.1007/s11192-021-03962-7 · Cited by 29
Measuring Sentence-Level and Aspect-Level (Un)certainty in Science Communications
Pei, J., & Jurgens, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.784 · Cited by 21
Diffusion of Scientific Articles across Online Platforms
Zakhlebin, I., & Horvát, E.-Á. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7341 · Cited by 16
Self-citationTemporal Trends, Characteristics, and Citations of Retracted Articles in Cardiovascular Medicine
Wadhwa, R. R., Rasendran, C., Popovic, Z. B., Nissen, S. E., & Desai, M. Y. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.18263 · Cited by 14
Honesty study was based on fabricated data
O’Grady, C. (2021) · Science · doi:10.1126/science.373.6558.950 · Cited by 9
Patterns of retractions from 1981-2020 : Does a fraud lead to another fraud?Preprint
Sharma, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13091 · Cited by 8
Honesty study was based on fabricated data
O’Grady, C. (2021) · Science · doi:10.1126/science.acx8950 · Cited by 2
Research works printed but not linked: 1
- 10.1038/478026a · DOI · Paper page
Cited by
Byrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
Promotional language and the adoption of innovative ideas in science
Peng, H., Qiu, H. S., Fosse, H. B., & Uzzi, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320066121 · Cited by 26
“These changes additionally burden researchers with the task of conveying their ideas to multiple audiences who hold different perspectives on innovativeness (30, 34, 44).”
Self-citationKeeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI
Pangakis, N., & Wolken, S. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35883 · Cited by 27
Khan, K. S., Fawzy, M., & Chien, P. F. W. (2023) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.14837 · Cited by 20
The gender gap in scholarly self-promotion on social media
Peng, H., Teplitskiy, M., Romero, D. M., & Horvát, E.-Á. (2025) · Nature Communications · doi:10.1038/s41467-025-60590-y · Cited by 17
Self-citation
Metadata
- Authors
- Peng, H., Romero, D. M., & Horvát, E.-Á.
- Affiliations
- University of Michigan (US)
- Northwestern University (US)
- Corresponding author
- Romero, Daniel M.
- Horvát, Emőke-Ágnes
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2022-06-14
- Volume
- 119
- Issue
- 25
- Pages
- e2119086119-e2119086119
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC9231484
- OpenAlex
- W4282823329
- Cited by
- 57
- References
- 63
- Citations by year
- 2026: 12 · 2025: 19 · 2024: 13 · 2023: 11 · 2022: 2
- FWCI
- 9.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (IIS-1943506)
- DOD | USAF | AMC | Air Force Office of Scientific Research (FA9550-19-1-0029)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- retracted article, scientific retraction, online attention, social media, Twitter, news organizations, knowledge repository, misinformation, public understanding of science, audience criticism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.