Media and social media attention to retracted articles according to Altmetric
Open accessThe DOI matches its Crossref record; 31 of the 34 references it cites were found in a registry or an index; 8 of the 37 sources its claims cite were checked for support.
Abstract
The number of retracted articles has grown fast. However, the extent to which researchers and the public are made adequately aware of these retractions and how the media and social media respond to them remains unknown. Here, we aimed to evaluate the media and social media attention received by retracted articles and assess also the attention they receive post-retraction versus pre-retraction. We downloaded all records of retracted literature maintained by the Retraction Watch Database and originally published between January 1, 2010 to December 31, 2015. For all 3,008 retracted articles with a separate DOI for the original and its retraction, we downloaded the respective Altmetric Attention Score (AAS) (from Altmetric) and citation count (from Crossref), for the original article and its retraction notice on June 6, 2018. We also compared the AAS of a random sample of 572 retracted full journal articles available on PubMed to that of unretracted full articles matched from the same issue and journal. 1,687 (56.1%) of retracted research articles received some amount of Altmetric attention, and 165 (5.5%) were even considered popular (AAS>20). 31 (1.0%) of 2,953 with a record on Crossref received >100 citations by June 6, 2018. Popular articles received substantially more attention than their retraction, even after adjusting for attention received post-retraction (Median difference, 29; 95% CI, 17–61). Unreliable results were the most frequent reason for retraction of popular articles (32; 19%), while fake peer review was the most common reason (421; 15%) for the retraction of other articles. In comparison to matched articles, retracted articles tended to receive more Altmetric attention (23/31 matched groups; P-value, 0.01), even after adjusting for attention received post-retraction. Our findings reveal that retracted articles may receive high attention from media and social media and that for popular articles, pre-retraction attention far outweighs post-retraction attention.
Overview
CoChat Summary
TL;DR
Retracted articles often receive media and social media attention, and popular retracted articles receive substantially more attention than their retraction notices even after accounting for post-retraction attention. Retracted articles also tended to receive more Altmetric attention than matched unretracted articles from the same journal issues.
Key findings
- Among 3,097 retracted research articles with Altmetric data, 1,733 (56%) received any media/social media attention (AAS>0) and 168 (5.4%) were “popular” (AAS>20); 28/3,008 (0.9%) original articles with Crossref data had ≥100 citations, while no retraction notices did.
- Popular original articles received substantially more attention than their retraction notices (median difference 30; IQR 14–91; P<10−16); after restricting to 279 articles retracted within a year and adjusting for post-retraction AAS, the median difference for popular articles was 31 (IQR 21–82).
- Retracted articles tended to receive more Altmetric attention than matched unretracted articles: in 47 matched groups of articles retracted within a year, the median retracted article had higher AAS on 23 occasions versus 8 for unretracted articles after excluding the last year (relative risk 2.88; 95% CI 1.24–7.40; P=0.01).
- Common retraction reasons differed: unreliable results was most frequent for popular articles (33/168; 20%), while fake peer review was most common for other articles (487/2,923; 17%); for highly cited articles (>100 citations), manipulation/duplication of images was most common (8/28; 29%).
Methods
- Retrospective cohort using Retraction Watch Database records originally published 2010–2015; 4,603 eligible research articles were identified, with Altmetric Attention Score and Crossref citation counts retrieved on June 6, 2018 for original articles and retraction notices.
- Case-control comparison: a random sample of 572 retracted full journal articles was matched to up to 5 unretracted articles from the same issue and journal, creating 450 distinct groups initially and 47 groups for articles retracted within a year of Altmetric data retrieval.
- Analyses used descriptive statistics; paired comparisons with Wilcoxon signed-rank and binomial sign tests; matched comparisons with nonparametric bootstrap percentile confidence intervals; all processing in R.
Limitations
- Stated: the retrospective design lacked longitudinal data to control for possible effects of retraction over time; the analysis was descriptive and exploratory; popular-article analyses included relatively small samples, especially when adjusting for retraction effects over the last year.
- Evident: Altmetric and citation data were from June 6, 2018 and based on a beta Retraction Watch version, while some descriptive results use an updated database, producing count mismatches; AAS captures media/social media attention only, and missing AAS/citation data were excluded without imputation.
- Evident: tweet negativity/non-negativity was judged by the authors’ impression, and only a subset of tweets was openly available for the sensitivity analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
6 Valid · 0 Not valid · 22 Not checked · 70 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
§ Media and social media attention to retracted articles according to Altmetric > Introduction
What the sources say
- Partly supportedcites [7] J Bar-Ilan, 2017, Post retraction citations in context: a case study, Scientometrics sourceExperimental — accuracy not yet measured
Bar-Ilan and Halevi (2017) is indeed a case-study analysis of post-retraction citation sentiment, and its Discussion and conclusions report that 198 of 238 analysed post-retraction citations (83%) were positive, echoing the >85% positive citations they attribute to Kochan and Budd (1992) in the Background. However, the ~80% figure in our copy is a property of CITATIONS, not of retracted ARTICLES: the paper never states that at least 80% of retracted articles receive positive post-retraction citations, and its sample was deliberately restricted to 15 retracted articles that each received more than 10 recent citations, with the authors explicitly noting 'There are limitations to our findings as we considered a small specific sample, and thus it is not possible to generalize'. So the magnitude and the case-study framing are supported, while the claim's unit of analysis (articles rather than citations) and its generalised reach are not. (LLM, conf=0.80)
- Not checked yetcites [8] CA Kochan, 1992, The persistence of fraud in the literature: the Darsee case, J Am Soc Inf Sci doi:10.1002/(sici)1097-4571(199208)43:7<488::aid-asi3>3.0.co;2-7
- Not checked yetcites [9] A Rapani, 2020, Retracted publications and their citation in dental literature: A systematic review, Clin Exp Dent Res
- Partly supportedcites [10] JM Budd, 2016, An investigation of retracted articles in the biomedical literature, Proceedings of the Association for Information Science and Technology sourceExperimental — accuracy not yet measured
In 'Total Articles: 265' our copy reports Tacit Cites 3,946 (80.25%), Substantive Cites 767 (15.60%), Retraction Noted 204 (4.15%), and states that 'almost all of the citations (roughly 96%) are positive in some way', with 250 of 265 retracted articles having citations. So the source does support the substance of the claim — retracted biomedical articles are overwhelmingly cited as if valid — but its 80.25% is a share of the citations analysed (tacit positive cites), not a share of retracted articles receiving positive citations; the per-article statistic in the citing sentence ('at least 80% of retracted articles') is not what this paper reports. The paper's own figures on this point (citations to articles retracted 2001–2005, per the Abstract and CITATIONS sections) are narrower in scope than the general 'broader literature' phrasing. (LLM, conf=0.78)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The problems are even worse for articles kept on central repositories or personal libraries [21, 22], despite clear guidelines by the Committee On Publication Ethics (COPE) [23] and the National Library of Medicine [24] recommendations.”
§ Media and social media attention to retracted articles according to Altmetric > Discussion
What the sources say
- Could not verifycites [21] K Wright, 2011, Reporting of article retractions in bibliographic databases and online journals., J Med Libr Assoc sourceExperimental — accuracy not yet measured
Our copy of Wright & McDaid (2011) documents problems annotating retractions only in three bibliographic databases (MEDLINE, EMBASE, CENTRAL; RESULTS, DISCUSSION) and in the online journals' own contents pages, HTML and PDF versions (RESULTS, DISCUSSION); it never addresses central/institutional repositories or authors' personal libraries, nor makes any comparative claim that problems are 'worse' there. The nearest passage (DISCUSSION) quotes the ICMJE rule that electronic articles must be kept in a permanent archive on the journal site, which concerns journal archiving rather than repositories or personal copies. Searches for 'personal library / institutional repository', 'central repository / permanent archive' and 'downloaded copy' returned nothing on that point, so the attributed claim can be neither supported nor contradicted. (LLM, conf=0.68)
- Supportedcites [22] PM Davis, 2012, The persistence of error: a study of retracted articles on the Internet and in personal libraries, J Med Libr Assoc source
The Discussion (p. n/a, 'DISCUSSION') states that retracted articles 'persist, without notification of invalidation, on the public Internet and in personal libraries' and that 'digital repositories are not designed with the functionality to remove, update, or append what is deposited in them and, at present, lack editorial oversight.' The Introduction ('Scientists depend on personal libraries') adds that for EndNote, Mendeley, RefWorks, Zotero, 'none of these tools function to alert the user when a correction or retraction has been made,' and the Abstract Results report that just 15 (5%) full-article views — including the 138 (43%) held in PubMed Central — carried a retraction statement. Together these support the paraphrase that the retraction-notification problem is worse for copies held in central repositories and personal libraries, notwithstanding the COPE and NLM/MEDLINE measures the same paper describes as attempts to improve the system. (LLM, conf=0.85)
- Not checked yetcites [23] E Wager, 2009, Retractions: Guidance from the Committee on Publication Ethics (COPE)., Committee on Publication Ethics (COPE)
- Not checked yetcites [24] National Library of Medicine (NLM). Errata, Retractions, Partial Retractions, Corrected and Republished Articles, Duplicate Publications, Comments (including Author Replies), Updates, Patient Summaries, and Republished (Reprinted) Articles Policy for MEDLINE®. In: National Library of Medicine (NLM) [Internet]. 31 Jan 2018 [cited 10 Apr 2020]. Available: http://www.nlm.nih.gov/pubs/factsheets/errata.html
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Over the previous year, the 279 articles gained most attention in the months following their retraction (Fig 5A)”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of 4,142 retraction notices with a unique DOI or PMID, 44 referred to the retraction of more than one original article”
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, for 3,097 original articles and their retraction notice, the AAS of each original article did not differ substantially from its retraction notice (Median difference, 0; IQR, -1.0–1.0; P-value, 0.54).”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
45 more claims
Create a free account to see all 98 claims and to verify the 29 references still open.
- It may state two separate claims as one. 36
- Probably not a substantial claim. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent research indicates that, overall, retracted papers tend to receive more attention than nonretracted ones (38).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“179 (64%) articles received at least some attention before or after retraction—87 (49%) received most attention before retraction and 88(49%) before retraction (4 had similar attention before and after retraction).”
§ Media and social media attention to retracted articles according to Altmetric > Discussion
“In fact, 100/175 (57%) retracted articles received most of their attention after retraction.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Altmetric attention score and citations
“28 of the original articles (0.9%), but none of the retraction notices, received at least 100 citations.”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“out of 3,008 records, the median difference in citations between the original and its retraction notice was 4 (IQR, 1–11; P-value < 10−16) and for 31 highly cited original articles (>100 citations) it was 138”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“(A) Cumulative AAS for 279 articles retracted within a year of Altmetric data retrieval”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“(B) Even though the median gain is zero in both 2,812 recently and 279 not recently retracted articles”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
“The most highly represented countries were China (1,260; 27%), United States (891; 19%) and India (402; 8.7%)”
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
“| Country | United States | 915 | 19% |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Of 4,324/4,603 original articles with a DOI, 3,363 (81%) had a different DOI for the original article than the retraction notice.”
§ Media and social media attention to retracted articles according to Altmetric > Results > Altmetric attention score and citations
Reported 81 · recomputed 77.775208
Citations
Cites
4 retracted
Larkin, G. L., & Beautrais, A. L. (2011) · International Journal of Neuropsychopharmacology · doi:10.1017/s1461145711000629 · Cited by 258 · cited 2×
“Similarly, the median number of post-retraction tweets was 2 (IQR, 1–3)—all tweets were negative for 5 articles, 1 article did not receive any tweets and, surprisingly, 2 articles exclusively received non-negative tweets [16, 17].”
BackgroundRetractedRetracted publications and their citation in dental literature: A systematic review
Rapani, A., Lombardi, T., Berton, F., Del Lupo, V., Di Lenarda, R., & Stacchi, C. (2020) · Clinical and Experimental Dental Research · doi:10.1002/cre2.292 · Cited by 62 · cited 1×
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
ResultRetractedRetraction note to multiple articles in Tumor Biology
Stigbrand, T. (2017) · Tumor Biology · doi:10.1007/s13277-017-5487-6 · Cited by 57 · cited 1×
“Out of 4,142 retraction notices with a unique DOI or PMID, 44 referred to the retraction of more than one original article—the largest retraction was published in Tumor Biology, retracting 103 unique articles due to fake peer review [15].”
BackgroundRetractedRETRACTED: Can Branding Improve School Lunches?
Wansink, B., Just, D. R., & Payne, C. R. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2012.999 · Cited by 49 · cited 2×
“and concluded that branding school lunches can improve uptake of healthy food by school children [16].”
BackgroundRetractedR: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766 · cited 1×
“The report was compiled using the guiding principles of the STROBE statement for retrospective cohort studies [31].”
MethodWhy Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
Self-citationIs science really facing a reproducibility crisis, and do we need it to?
Fanelli, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708272114 · Cited by 416 · cited 1×
“All of these issues amalgamate into a critical problem, which is not inconsequential and which substantially hinders the ability of science to self-correct [25, 26].”
BackgroundPost retraction citations in context: a case study
Bar-Ilan, J., & Halevi, G. (2017) · Scientometrics · doi:10.1007/s11192-017-2242-0 · Cited by 191 · cited 1×
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
Result
Research works printed but not linked: 8
- A Gawrylewski, 2007, Glossary of retractions., The Scientist
- I Oransky, 2020, The Retraction Watch Database., Retraction Watch
- I Oransky, 2010, Why write a blog about retractions?, Retraction Watch
- I Oransky, 2019, Top 10 most highly cited retracted papers., Retraction Watch
- I Oransky, 2016, How to better flag retractions? Here’s what PubMed is trying., Retraction Watch
- D Stillman, 2019, Retracted item notifications with Retraction Watch integration., Zotero
- A Marcus, 2014, Retraction Watch is growing, thanks to a $400,000 grant from the MacArthur Foundation., Retraction Watch
- A Marcus, 2015, New $300,000 grant marks the fifth anniversary of Retraction Watch., Retraction Watch
Cited by
Threats to scholarly research integrity arising from paper mills: a rapid scoping review
Pérez-Neri, I., Pineda, C., & Sandoval, H. (2022) · Clinical Rheumatology · doi:10.1007/s10067-022-06198-9 · Cited by 70
“org/) in May 2021, from inception to the present, as in previous studies [22].”
ResultDynamics of cross-platform attention to retracted papers
Peng, H., Romero, D. M., & Horvát, E.-Á. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2119086119 · Cited by 57
Kataoka, Y., Banno, M., Tsujimoto, Y., Ariie, T., Taito, S., Suzuki, T., Oide, S., & Furukawa, T. A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.06.015 · Cited by 44
RetractedBibliometric and Altmetric Analysis of Retracted Articles on COVID-19
Khan, H., Gupta, P., Zimba, O., & Gupta, L. (2022) · Journal of Korean Medical Science · doi:10.3346/jkms.2022.37.e44 · Cited by 41
Agley, J. D., Xiao, Y., Eldridge, L. A., Meyerson, B. E., & Golzarri‐Arroyo, L. (2022) · BMC Public Health · doi:10.1186/s12889-022-13298-3 · Cited by 27
“We note, for example, popular articles that are retracted often receive more popular attention than the retractions [45].”
BackgroundFleerackers, A., Nehring, L., Maggio, L. A., et al. (2022) · Scientometrics · doi:10.1007/s11192-022-04510-7 · Cited by 23
“It has also been used to compare online attention to retracted papers, finding that retracted articles were 1.2–7.4 times more likely than matched, unretracted articles to receive altmetric attention (Serghiou et al., 2021).”
BackgroundInfluentialThe spread of retracted research into policy literature
Malkov, D., Yaqub, O., & Siepel, J. (2023) · Quantitative Science Studies · doi:10.1162/qss_a_00243 · Cited by 25
The effectiveness of peer review in identifying issues leading to retractions
Zheng, X. M., Chen, J., Tollas, A., & Ni, C. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101423 · Cited by 23
Pastor-Ramón, E., Herrera‐Peco, I., Agirre, O., García‐Puente, M., & Morán, J. M. (2022) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe12050034 · Cited by 19
“However, at first glance, this situation may seem anecdotal; the number of retracted scientific publications has increased enormously, from less than 100 in 2000 to 1772 reported in 2019 [7].”
BackgroundSchneider, J., Woods, N. D., Proescholdt, R., Fu, Y., & The RISRS Team (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ms579 · Cited by 18
Fernández, L. M., Hardwicke, T. E., & Vadillo, M. A. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cszpy · Cited by 15
Amiri, M., Yaghtin, M., & Sotudeh, H. (2023) · Scientometrics · doi:10.1007/s11192-023-04871-7 · Cited by 11
“Since Copiello (2020), Serghiou et al. (2021), Shema et al. (2019), Bornmann and Haunschild, (2018a), Marcus and Oran-sky (2011), and Sugawara et al. (2017) concluded a higher altmetrics for retracted papers, implying an association between low-quality and altmetrics counts, while Bornmann and…”
The propagation of error: retracted articles in marketing and their citations
Moussa, S. (2022) · Italian Journal of Marketing · doi:10.1007/s43039-021-00044-7 · Cited by 10
“Though retracted articles represent a minuscule party of the published literature, the topic of retractions has been lately receiving an upward interest across disciplines (e.g., Cox et al., 2018; Craig et al., 2020; Greitemeyer, 2014; Halevi, 2020; Hamilton, 2019; Serghiou et al., 2021; Teixeira da Silva & Bornemann-…”
BackgroundJournal editors and publishers’ legal obligations with respect to medical research misconduct
Holbeach, N., Freckelton, I. R., & Mol, B. W. (2022) · Research Ethics · doi:10.1177/17470161221147440 · Cited by 12
“The average time for investigations and outcomes from the time that concerns are raised is difficult to estimate, but the median time from publication to retraction is between 1 and 2 year (Chambers et al., 2019; Serghiou et al., 2021).”
BackgroundRetractions in academic publishing: insights from highly ranked global universities
Khan, R., Joshi, A., Kaur, K., Sinhababu, A., & Chakravarty, R. (2024) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-01-2024-0037 · Cited by 11
Sridharan, K., & Sivaramakrishnan, G. (2026) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2025.1737168 · Cited by 8
“Compared to controls, retracted articles garnered greater Altmetric attention (23/31 groups; p = 0.01), demonstrating their disproportionate visibility persists post-retraction (Serghiou et al., 2021).”
InfluentialZheng, E., Fu, H., Thelwall, M. A., & Fang, Z. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70028 · Cited by 13
“Most of this engagement occurs before a formal retraction notice is issued (Dambanemuya et al., 2024; Serghiou et al., 2021).”
Yaqub, W., Kay, J., & Goldwater, M. B. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637335 · Cited by 10
“Misinformation that is based on retracted science is an under-studied contributor to the systematic dissemination of disinformation and misinformation 3 [70].”
BackgroundMethodSantos-d’Amorim, K., Casado, E. S., & dos Santos, R. N. M. (2025) · Scientometrics · doi:10.1007/s11192-025-05343-w · Cited by 10
“…have been widely shared online in an increasingly connected ecosystem; this can lead to the spread of scientific misinformation, which can harm the reputations of institutions, journals, and researchers, and undermine public trust in science (Serghiou et al., 2021; Sotudeh et al., 2020).”
Do male leading authors retract more articles than female leading authors?
Zheng, E., Fu, H., Thelwall, M. A., & Fang, Z. (2025) · Journal of Informetrics · doi:10.1016/j.joi.2025.101682 · Cited by 8
“They Only Silence the Truth”: COVID-19 retractions and the politicization of science
Abhari, R., & Horvát, E.-Á. (2024) · Public Understanding of Science · doi:10.1177/09636625241290142 · Cited by 8
“This may be especially true of retractions shared on social media, which often get more attention than non-retracted articles, especially before their retraction (Peng et al., 2022; Serghiou et al., 2021).”
High-cited favorable studies for COVID-19 treatments ineffective in large trials
Ioannidis, J. P. A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.04.001 · Cited by 7
Self-citationThe trend and ripple effects of retractions in primary health care: A bibliometric analysis
Lin, K.-C., Chen, Y.-C., Lin, M.-H., & Chen, T. (2024) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000001149 · Cited by 7
Retraction in the online world—Shall we rethink the policy?
Rzymski, P. (2021) · Science and Public Policy · doi:10.1093/scipol/scab085 · Cited by 5
Bhattacharyya, S., Chatterjee, N., & Ramanathan, A. (2025) · International Journal for Educational Integrity · doi:10.1007/s40979-025-00193-8 · Cited by 4
“Similar patterns were also reported by Serghiou et al. (2021) whereas Bhat (2021) reported the United States, China, Japan, India and Germany were ranked the top five countries experiencing a high load of retraction in life science and biosciences.”
Continued Visibility of COVID-19 Article Removals
Peterson, C., Anderson, C., & NUGENT, K. M. (2022) · Southern Medical Journal · doi:10.14423/smj.0000000000001397 · Cited by 4
“For example, Serghiou et al found that popular retracted articles received more attention regarding the original publication than the retraction, suggesting that those engaged with the article were less aware of or interested in the removal than in the original publication.(13) Second, the availability of problematic…”
Background(2022) · doi:10.1101/2022.01.30.22270124 · Cited by 44
Mukhamediyarov, M., Zimba, O., Yessirkepov, M., & Koçyiğit, B. F. (2026) · Journal of Korean Medical Science · doi:10.3346/jkms.2026.41.e84 · Cited by 4
Do Journalists Update Retracted Science News?
Valinčiūtė, A., & Halffman, W. (2025) · Journalism Practice · doi:10.1080/17512786.2025.2540460 · Cited by 4
“Altmetric’s precision and recall has been tested (Fleerackers et al., 2022; Yu et al., 2021), and it has been widely used in research (Ortega, 2020a), including research focused on mentions of scientific papers in the news media (Fraser et al., 2021; Maggio et al., 2019; Serghiou et al., 2021).”
Amiri, M., & Sotudeh, H. (2025) · Scientometrics · doi:10.1007/s11192-025-05231-3 · Cited by 4
“The number of retracted papers has sharply increased in recent years (Eldakar et al., 2023; Rapani et al., 2020; Serghiou et al., 2021; Tripathi et al., 2019; Wang et al., 2019), highlighting the success of this mechanism in identifying dubious outputs and a growing vigilance in maintaining…”
Influential"Here's Your Evidence": False Consensus in Public Twitter Discussions of COVID-19 Science
Efstratiou, A., Efstratiou, M., Yudhoatmojo, S. B., Blackburn, J., & Cristofaro, E. D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687010 · Cited by 9
“Whereas retraction notices receive little attention compared to the original articles [69].”
Wang, P. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578281 · Cited by 6
“retweets over time to analyzing the text to identify if critical tweets on circulated papers can provide some discussion of or clue to problematic papers [27, 46].”
BackgroundAmiri, M., & Sotudeh, H. (2025) · Scientometrics · doi:10.1007/s11192-025-05477-x · Cited by 3
“Consequently, the dichotomous role of X in disseminating and criticizing scientific outputs challenges the use of the quantitative approach in evaluating research and requires recognizing social users’ motivations (Serghiou et al., 2021).”
Sharp, M. K., Logullo, P., Murphy, P., Baral, P., Burke, S., Grimes, D. R., Ryan, M., & Clyne, B. (2024) · HRB Open Research · doi:10.12688/hrbopenres.13895.2 · Cited by 2
Citations in Wikipedia for understanding research reach
Smith, D. A., McKinnell, J., & Young, J. (2024) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2024.1730 · Cited by 1
From Research to Impact: Assessing a Decade of CDC’s Public Health Science by Topic Area, 2014-2023
Ortega, J., Knuth, M., Dunkley, V. E., Kim, C., Meites, E., Yoo, B. K., Wainwright, K., Zhu, B., & Reynolds, M. G. (2026) · Public Health Reports · doi:10.1177/00333549261451188 · Cited by 2
Retraction topography among NIRF-ranked Indian institutions: the other side of the coin
Sankhua, S., & Batcha, M. S. (2026) · SN Social Sciences · doi:10.1007/s43545-026-01423-7 · Cited by 1
“Although the attention can be both negative and positive(Serghiou et al. 2021).”
Tips to Young Researchers: Conflicts of Interest
Kalyani, C. V., Rohilla, K. K., Gupta, P., et al. (2024) · Journal of Medical Evidence · doi:10.4103/jme.jme_120_23 · Cited by 1
“They Only Silence the Truth”: COVID-19 Retractions and the Politicization of SciencePreprint
Abhari, R., & Horvát, Á. (2024) · doi:10.31235/osf.io/m48fk · Cited by 1
Dehdarirad, T., & Schirone, M. (2023) · Journal of Information Science · doi:10.1177/01655515231176650 · Cited by 1
“The most common characteristics that have been studied in several research works were journal impact factor [8], affiliation country or institution [2,9], reasons for retraction [2,5], accessibility of data regarding retraction notices [10] and publisher [9].”
Comparative analysis of retracted pre-print and peer-reviewed articles on COVID-19Preprint
Sra, M. S., Arora, M., Mazumder, A., Goyal, R. M., Parameswaran, G. G., & Meena, J. K. (2022) · medRxiv · doi:10.21203/rs.3.rs-1850641/v1 · Cited by 1
From discovery to disrepute: a study of retractions in biological research
Bhat, M., & Malik, B. A. (2026) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-06-2025-0414
The Search for Life Elsewhere: Avoiding Hype and Fostering Public Understanding
Albergaria, D., Baan, M., Bimm, J., Devecka, M., Fortuna, M. C., Heenatigala, T., ten Kate, I. L., Kokori, A., Muñoz-Mateos, J. C., Nováková, J., et al. (2026) · Astrobiology · doi:10.1177/15311074261475082
“Such refutations or retractions typically receive little attention on both social media and in traditional media (Serghiou et al., 2021).”
Khan, M. S. R., & Park, H. W. (2026) · Annals of the International Communication Association · doi:10.1093/anncom/wlag018
Jafari, A., SeyyedHosseini, S., & BasirianJahromi, R. (2026) · International Dental Journal · doi:10.1016/j.identj.2026.109406
“3 Furthermore, Mendeley is a reference manager and academic social network whose users store copies or records of published papers; a classic study found that personal Mendeley libraries contained records for about 75% of a sample of retracted articles, even though almost none of these records were…”
Yaghtin, M., Sotudeh, H., Hoseini, M., & Amiri, M. A. (2026) · Online Information Review · doi:10.1108/oir-04-2025-0270 · Cited by 2
Retraction Analysis in Social Media Research: A Scopus Based Data From 2011 to 2025
Koçyiğit, B. F., Mukhamediyarov, M., Qumar, A. B., Fedorchenko, Y., & Zimba, O. (2026) · Journal of Korean Medical Science · doi:10.3346/jkms.2026.41.e235
Saikia, S., Nisha, F., & Verma, M. K. (2025) · Applied Environmental Education & Communication · doi:10.1080/1533015x.2025.2599330
“Serghiou et al. (2021) have studied the social media attention received by the retracted articles to understand the post-retraction and pre-retrac-tion effects using the Retraction Watch database.”
Social Impact Analysis of Retracted Paper in the Context of Public Health Emergencies
Xiaojuan, L., Jianing, S., Xinran, D., & Yu, Y. (2025) · International Conference on Scientometrics and Informetrics (ISSI) · doi:10.51408/issi2025_013
Politicisation of Science and Health Topics
Stein, R. A., & Ometa, O. (2024) · Springer eBooks · doi:10.1007/978-3-031-49084-2_21
Retrakcie vo vedeckom publikovaní
Stožická, Z., & Dobbersteinová, J. (2023) · ITlib Informačné technológie a knižnice · doi:10.52036/1335793x.2023.sc.34-49
Trust, scholarship and data sharing
Thistlethwaite, J. E. (2022) · The Clinical Teacher · doi:10.1111/tct.13452
“retracted papers, and the number of these is rising, with one small study suggesting that unreliable results are the most frequent reason for retraction.(5) Data may be fabricated or falsified.”
BackgroundHigh-cited favorable studies for COVID-19 treatments ineffective in large trialsPreprint
Ioannidis, J. P. A. (2022) · medRxiv · doi:10.1101/2022.01.11.22269097
Self-citationPeng, H., Romero, D. M., & Horvát, E.-Á. (2021) · arXiv (Cornell University)
Metadata
- Authors
- Serghiou, S., Marton, R. M., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-05-12
- Volume
- 16
- Issue
- 5
- Pages
- e0248625
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8115781
- OpenAlex
- W3163888857
- Semantic Scholar
- fc21cb7478124b73d44a0d6fe321be140d0ea3e6
- Cited by
- 55
- References
- 34
- Citations by year
- 2026: 10 · 2025: 9 · 2024: 9 · 2023: 6 · 2022: 17 · 2021: 3
- FWCI
- 7.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Department of Epidemiology and Population Health, Stanford University
- Stanford Data Science Initiative
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- retracted article, media attention, social media attention, Altmetric Attention Score, fake peer review, Retraction Watch Database
- MeSH terms
- Humans, Peer Review, Publications, Bibliometrics, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.