Media and social media attention to retracted articles according to Altmetric
Open accessThe DOI matches its Crossref record; 31 of the 34 references it cites were found in a registry or an index; 8 of the 37 sources its claims cite were checked for support.
Abstract
The number of retracted articles has grown fast. However, the extent to which researchers and the public are made adequately aware of these retractions and how the media and social media respond to them remains unknown. Here, we aimed to evaluate the media and social media attention received by retracted articles and assess also the attention they receive post-retraction versus pre-retraction. We downloaded all records of retracted literature maintained by the Retraction Watch Database and originally published between January 1, 2010 to December 31, 2015. For all 3,008 retracted articles with a separate DOI for the original and its retraction, we downloaded the respective Altmetric Attention Score (AAS) (from Altmetric) and citation count (from Crossref), for the original article and its retraction notice on June 6, 2018. We also compared the AAS of a random sample of 572 retracted full journal articles available on PubMed to that of unretracted full articles matched from the same issue and journal. 1,687 (56.1%) of retracted research articles received some amount of Altmetric attention, and 165 (5.5%) were even considered popular (AAS>20). 31 (1.0%) of 2,953 with a record on Crossref received >100 citations by June 6, 2018. Popular articles received substantially more attention than their retraction, even after adjusting for attention received post-retraction (Median difference, 29; 95% CI, 17–61). Unreliable results were the most frequent reason for retraction of popular articles (32; 19%), while fake peer review was the most common reason (421; 15%) for the retraction of other articles. In comparison to matched articles, retracted articles tended to receive more Altmetric attention (23/31 matched groups; P-value, 0.01), even after adjusting for attention received post-retraction. Our findings reveal that retracted articles may receive high attention from media and social media and that for popular articles, pre-retraction attention far outweighs post-retraction attention.
Overview
CoChat Summary
TL;DR
Retracted articles often receive media and social media attention, and popular retracted articles receive substantially more attention than their retraction notices even after accounting for post-retraction attention. Retracted articles also tended to receive more Altmetric attention than matched unretracted articles from the same journal issues.
Key findings
- Among 3,097 retracted research articles with Altmetric data, 1,733 (56%) received any media/social media attention (AAS>0) and 168 (5.4%) were “popular” (AAS>20); 28/3,008 (0.9%) original articles with Crossref data had ≥100 citations, while no retraction notices did.
- Popular original articles received substantially more attention than their retraction notices (median difference 30; IQR 14–91; P<10−16); after restricting to 279 articles retracted within a year and adjusting for post-retraction AAS, the median difference for popular articles was 31 (IQR 21–82).
- Retracted articles tended to receive more Altmetric attention than matched unretracted articles: in 47 matched groups of articles retracted within a year, the median retracted article had higher AAS on 23 occasions versus 8 for unretracted articles after excluding the last year (relative risk 2.88; 95% CI 1.24–7.40; P=0.01).
- Common retraction reasons differed: unreliable results was most frequent for popular articles (33/168; 20%), while fake peer review was most common for other articles (487/2,923; 17%); for highly cited articles (>100 citations), manipulation/duplication of images was most common (8/28; 29%).
Methods
- Retrospective cohort using Retraction Watch Database records originally published 2010–2015; 4,603 eligible research articles were identified, with Altmetric Attention Score and Crossref citation counts retrieved on June 6, 2018 for original articles and retraction notices.
- Case-control comparison: a random sample of 572 retracted full journal articles was matched to up to 5 unretracted articles from the same issue and journal, creating 450 distinct groups initially and 47 groups for articles retracted within a year of Altmetric data retrieval.
- Analyses used descriptive statistics; paired comparisons with Wilcoxon signed-rank and binomial sign tests; matched comparisons with nonparametric bootstrap percentile confidence intervals; all processing in R.
Limitations
- Stated: the retrospective design lacked longitudinal data to control for possible effects of retraction over time; the analysis was descriptive and exploratory; popular-article analyses included relatively small samples, especially when adjusting for retraction effects over the last year.
- Evident: Altmetric and citation data were from June 6, 2018 and based on a beta Retraction Watch version, while some descriptive results use an updated database, producing count mismatches; AAS captures media/social media attention only, and missing AAS/citation data were excluded without imputation.
- Evident: tweet negativity/non-negativity was judged by the authors’ impression, and only a subset of tweets was openly available for the sensitivity analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
6 Valid · 0 Not valid · 22 Not checked · 70 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
§ Media and social media attention to retracted articles according to Altmetric > Introduction
What the sources say
- Partly supportedcites [7] J Bar-Ilan, 2017, Post retraction citations in context: a case study, Scientometrics sourceExperimental — accuracy not yet measured
Bar-Ilan and Halevi (2017) is indeed a case-study analysis of post-retraction citation sentiment, and its Discussion and conclusions report that 198 of 238 analysed post-retraction citations (83%) were positive, echoing the >85% positive citations they attribute to Kochan and Budd (1992) in the Background. However, the ~80% figure in our copy is a property of CITATIONS, not of retracted ARTICLES: the paper never states that at least 80% of retracted articles receive positive post-retraction citations, and its sample was deliberately restricted to 15 retracted articles that each received more than 10 recent citations, with the authors explicitly noting 'There are limitations to our findings as we considered a small specific sample, and thus it is not possible to generalize'. So the magnitude and the case-study framing are supported, while the claim's unit of analysis (articles rather than citations) and its generalised reach are not. (LLM, conf=0.80)
- Not checked yetcites [8] CA Kochan, 1992, The persistence of fraud in the literature: the Darsee case, J Am Soc Inf Sci doi:10.1002/(sici)1097-4571(199208)43:7<488::aid-asi3>3.0.co;2-7
- Not checked yetcites [9] A Rapani, 2020, Retracted publications and their citation in dental literature: A systematic review, Clin Exp Dent Res
- Partly supportedcites [10] JM Budd, 2016, An investigation of retracted articles in the biomedical literature, Proceedings of the Association for Information Science and Technology sourceExperimental — accuracy not yet measured
In 'Total Articles: 265' our copy reports Tacit Cites 3,946 (80.25%), Substantive Cites 767 (15.60%), Retraction Noted 204 (4.15%), and states that 'almost all of the citations (roughly 96%) are positive in some way', with 250 of 265 retracted articles having citations. So the source does support the substance of the claim — retracted biomedical articles are overwhelmingly cited as if valid — but its 80.25% is a share of the citations analysed (tacit positive cites), not a share of retracted articles receiving positive citations; the per-article statistic in the citing sentence ('at least 80% of retracted articles') is not what this paper reports. The paper's own figures on this point (citations to articles retracted 2001–2005, per the Abstract and CITATIONS sections) are narrower in scope than the general 'broader literature' phrasing. (LLM, conf=0.78)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The problems are even worse for articles kept on central repositories or personal libraries [21, 22], despite clear guidelines by the Committee On Publication Ethics (COPE) [23] and the National Library of Medicine [24] recommendations.”
§ Media and social media attention to retracted articles according to Altmetric > Discussion
What the sources say
- Could not verifycites [21] K Wright, 2011, Reporting of article retractions in bibliographic databases and online journals., J Med Libr Assoc sourceExperimental — accuracy not yet measured
Our copy of Wright & McDaid (2011) documents problems annotating retractions only in three bibliographic databases (MEDLINE, EMBASE, CENTRAL; RESULTS, DISCUSSION) and in the online journals' own contents pages, HTML and PDF versions (RESULTS, DISCUSSION); it never addresses central/institutional repositories or authors' personal libraries, nor makes any comparative claim that problems are 'worse' there. The nearest passage (DISCUSSION) quotes the ICMJE rule that electronic articles must be kept in a permanent archive on the journal site, which concerns journal archiving rather than repositories or personal copies. Searches for 'personal library / institutional repository', 'central repository / permanent archive' and 'downloaded copy' returned nothing on that point, so the attributed claim can be neither supported nor contradicted. (LLM, conf=0.68)
- Supportedcites [22] PM Davis, 2012, The persistence of error: a study of retracted articles on the Internet and in personal libraries, J Med Libr Assoc source
The Discussion (p. n/a, 'DISCUSSION') states that retracted articles 'persist, without notification of invalidation, on the public Internet and in personal libraries' and that 'digital repositories are not designed with the functionality to remove, update, or append what is deposited in them and, at present, lack editorial oversight.' The Introduction ('Scientists depend on personal libraries') adds that for EndNote, Mendeley, RefWorks, Zotero, 'none of these tools function to alert the user when a correction or retraction has been made,' and the Abstract Results report that just 15 (5%) full-article views — including the 138 (43%) held in PubMed Central — carried a retraction statement. Together these support the paraphrase that the retraction-notification problem is worse for copies held in central repositories and personal libraries, notwithstanding the COPE and NLM/MEDLINE measures the same paper describes as attempts to improve the system. (LLM, conf=0.85)
- Not checked yetcites [23] E Wager, 2009, Retractions: Guidance from the Committee on Publication Ethics (COPE)., Committee on Publication Ethics (COPE)
- Not checked yetcites [24] National Library of Medicine (NLM). Errata, Retractions, Partial Retractions, Corrected and Republished Articles, Duplicate Publications, Comments (including Author Replies), Updates, Patient Summaries, and Republished (Reprinted) Articles Policy for MEDLINE®. In: National Library of Medicine (NLM) [Internet]. 31 Jan 2018 [cited 10 Apr 2020]. Available: http://www.nlm.nih.gov/pubs/factsheets/errata.html
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Over the previous year, the 279 articles gained most attention in the months following their retraction (Fig 5A)”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of 4,142 retraction notices with a unique DOI or PMID, 44 referred to the retraction of more than one original article”
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, for 3,097 original articles and their retraction notice, the AAS of each original article did not differ substantially from its retraction notice (Median difference, 0; IQR, -1.0–1.0; P-value, 0.54).”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
45 more claims
Create a free account to see all 98 claims and to verify the 29 references still open.
- It may state two separate claims as one. 36
- Probably not a substantial claim. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent research indicates that, overall, retracted papers tend to receive more attention than nonretracted ones (38).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“179 (64%) articles received at least some attention before or after retraction—87 (49%) received most attention before retraction and 88(49%) before retraction (4 had similar attention before and after retraction).”
§ Media and social media attention to retracted articles according to Altmetric > Discussion
“In fact, 100/175 (57%) retracted articles received most of their attention after retraction.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Altmetric attention score and citations
“28 of the original articles (0.9%), but none of the retraction notices, received at least 100 citations.”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“out of 3,008 records, the median difference in citations between the original and its retraction notice was 4 (IQR, 1–11; P-value < 10−16) and for 31 highly cited original articles (>100 citations) it was 138”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“(A) Cumulative AAS for 279 articles retracted within a year of Altmetric data retrieval”
§ Media and social media attention to retracted articles according to Altmetric > Results > Attention and citations to the original article vs. its retraction notice
“(B) Even though the median gain is zero in both 2,812 recently and 279 not recently retracted articles”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
“The most highly represented countries were China (1,260; 27%), United States (891; 19%) and India (402; 8.7%)”
§ Media and social media attention to retracted articles according to Altmetric > Results > The RetractionWatch database
“| Country | United States | 915 | 19% |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Of 4,324/4,603 original articles with a DOI, 3,363 (81%) had a different DOI for the original article than the retraction notice.”
§ Media and social media attention to retracted articles according to Altmetric > Results > Altmetric attention score and citations
Reported 81 · recomputed 77.775208
Citations
Cites
4 retracted
Larkin, G. L., & Beautrais, A. L. (2011) · International Journal of Neuropsychopharmacology · doi:10.1017/s1461145711000629 · Cited by 258 · cited 2×
“Similarly, the median number of post-retraction tweets was 2 (IQR, 1–3)—all tweets were negative for 5 articles, 1 article did not receive any tweets and, surprisingly, 2 articles exclusively received non-negative tweets [16, 17].”
BackgroundRetractedRetracted publications and their citation in dental literature: A systematic review
Rapani, A., Lombardi, T., Berton, F., Del Lupo, V., Di Lenarda, R., & Stacchi, C. (2020) · Clinical and Experimental Dental Research · doi:10.1002/cre2.292 · Cited by 62 · cited 1×
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
ResultRetractedRetraction note to multiple articles in Tumor Biology
Stigbrand, T. (2017) · Tumor Biology · doi:10.1007/s13277-017-5487-6 · Cited by 57 · cited 1×
“Out of 4,142 retraction notices with a unique DOI or PMID, 44 referred to the retraction of more than one original article—the largest retraction was published in Tumor Biology, retracting 103 unique articles due to fake peer review [15].”
BackgroundRetractedRETRACTED: Can Branding Improve School Lunches?
Wansink, B., Just, D. R., & Payne, C. R. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2012.999 · Cited by 49 · cited 2×
“and concluded that branding school lunches can improve uptake of healthy food by school children [16].”
BackgroundRetractedR: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766 · cited 1×
“The report was compiled using the guiding principles of the STROBE statement for retrospective cohort studies [31].”
MethodWhy Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
Self-citationIs science really facing a reproducibility crisis, and do we need it to?
Fanelli, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708272114 · Cited by 416 · cited 1×
“All of these issues amalgamate into a critical problem, which is not inconsequential and which substantially hinders the ability of science to self-correct [25, 26].”
BackgroundPost retraction citations in context: a case study
Bar-Ilan, J., & Halevi, G. (2017) · Scientometrics · doi:10.1007/s11192-017-2242-0 · Cited by 191 · cited 1×
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
ResultWhat a massive database of retracted papers reveals about science publishing's ‘death penalty'
(2018) · AAAS Articles DO Group · doi:10.1126/science.aav8384 · Cited by 155 · cited 2×
“It was made available to the public in October, 2018 [2], at which point it hosted more than 18,000 articles published from the 1970s to 2018.”
Backgroundrvest: Easily Harvest (Scrape) Web Pages
Wickham, H. (2014) · doi:10.32614/cran.package.rvest · Cited by 109
Retractions: Guidance from the Committee on Publication Ethics (COPE)
Wager, E., Barbour, V., Yentis, S. M., & Kleinert, S. (2009) · Maturitas · doi:10.1016/j.maturitas.2009.09.018 · Cited by 98
Bornemann-Cimenti, H., Szilagyi, I. S., & Sandner-Kiesling, A. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9680-y · Cited by 87 · cited 1×
“Reuben that have been retracted, it transpired that 74% of citations received post-retraction did not clearly state that the work they were referring to had been retracted [6].”
BackgroundWhat studies of retractions tell us
Marcus, A., & Oransky, I. (2014) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v15i2.855 · Cited by 81 · cited 1×
“There may be some reluctance of publishers to publish a retraction notice, to publish clear and informative notices and to make all potential readers of a retracted article aware that this article has been retracted [18].”
The persistence of error: a study of retracted articles on the Internet and in personal libraries
Davis, P. M. (2012) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.100.3.008 · Cited by 74 · cited 1×
“The problems are even worse for articles kept on central repositories or personal libraries [21, 22], despite clear guidelines by the Committee On Publication Ethics (COPE) [23] and the National Library of Medicine [24] recommendations.”
BackgroundVisibility of retractions: a cross-sectional one-year study
Decullier, E., Huot, L., Samson, G., & Maisonneuve, H. (2013) · BMC Research Notes · doi:10.1186/1756-0500-6-238 · Cited by 69 · cited 1×
“A similar study found that out of 235 studied retractions, 21 (9%) did not offer a detailed reason and 52 (22%) articles were available with no mention of retraction [20].”
Elia, N., Wager, E., & Tramèr, M. R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085846 · Cited by 67 · cited 1×
“Boldt, which 18 journals had agreed to retract in 2011, 9/88 (10%) had yet to be retracted by 2013 [19].”
BackgroundReproducibility failures are essential to scientific inquiry
Redish, A. D., Kummerfeld, E., Morris, R. L., & Love, A. C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806370115 · Cited by 66 · cited 1×
“All of these issues amalgamate into a critical problem, which is not inconsequential and which substantially hinders the ability of science to self-correct [25, 26].”
BackgroundRetractions: guidance from the Committee on Publication Ethics (COPE)
Wager, E., Barbour, V., Yentis, S. M., & Kleinert, S. (2009) · Obesity Reviews · doi:10.1111/j.1467-789x.2009.00702.x · Cited by 62
Avenell, A., Stewart, F., Grey, A., Gamble, G., & Bolland, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031909 · Cited by 59 · cited 1×
“Such perpetuated misinformation is not inconsequential: guidelines and meta-analyses seem to be very rarely updated to remove retracted articles [11] and a recent preprint suggests that doing so would lead to a median reduction in estimated effect size of 13% and an average reduction of 30% [12].”
BackgroundFanelli, D., Wong, J., & Moher, D. (2022) · Accountability in Research · doi:10.1080/08989621.2021.1947810 · Cited by 49
Reporting of article retractions in bibliographic databases and online journals.
Wright, K., & McDaid, C. (2011) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.99.2.010 · Cited by 48 · cited 1×
“The problems are even worse for articles kept on central repositories or personal libraries [21, 22], despite clear guidelines by the Committee On Publication Ethics (COPE) [23] and the National Library of Medicine [24] recommendations.”
BackgroundAn investigation of retracted articles in the biomedical literature
Budd, J. M., Coble, Z., & Abritis, A. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301055 · Cited by 36
RISmed: Download Content from NCBI Databases
Kovalchik, S. A. (2011) · doi:10.32614/cran.package.rismed · Cited by 29
rcrossref: Client for Various 'CrossRef' 'APIs'
Chamberlain, S., Zhu, H., Jahn, N., Boettiger, C., & Ram, K. (2014) · doi:10.32614/cran.package.rcrossref · Cited by 24
Transition to Adult Health Care for Adolescents and Young Adults
Joffe, A., & Rivara, F. P. (2012) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpediatrics.2012.1727 · Cited by 13
Client for Various 'CrossRef' 'APIs' [R package rcrossref version 1.1.0]
Chamberlain, S., Zhu, H., Jahn, N., Boettiger, C., & Ram, K. (2020) · Cited by 11
Fanelli, D., & Moher, D. (2019) · doi:10.1101/734137 · Cited by 10 · cited 1×
“Such perpetuated misinformation is not inconsequential: guidelines and meta-analyses seem to be very rarely updated to remove retracted articles [11] and a recent preprint suggests that doing so would lead to a median reduction in estimated effect size of 13% and an average reduction of 30% [12].”
BackgroundMedical misinformation in the era of Google: Computational approaches to a pervasive problem
Granter, S. R., & Papke, D. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808264115 · Cited by 7 · cited 1×
“The good news is that we do have the technology required to substantially improve our ability to flag retractions [28].”
BackgroundKochan, C. (1992) · doi:10.1002/(sici)1097-4571(199208)43:7<488::aid-asi3>3.0.co;2-7 · cited 1×
“These results align well with literature on case studies [7, 8], specific disciplines [9] and the broader literature [10], which identify that at least 80% of retracted articles receive positive post-retraction citations.”
Result
Research works printed but not linked: 8
- A Gawrylewski, 2007, Glossary of retractions., The Scientist
- I Oransky, 2020, The Retraction Watch Database., Retraction Watch
- I Oransky, 2010, Why write a blog about retractions?, Retraction Watch
- I Oransky, 2019, Top 10 most highly cited retracted papers., Retraction Watch
- I Oransky, 2016, How to better flag retractions? Here’s what PubMed is trying., Retraction Watch
- D Stillman, 2019, Retracted item notifications with Retraction Watch integration., Zotero
- A Marcus, 2014, Retraction Watch is growing, thanks to a $400,000 grant from the MacArthur Foundation., Retraction Watch
- A Marcus, 2015, New $300,000 grant marks the fifth anniversary of Retraction Watch., Retraction Watch
Cited by
Threats to scholarly research integrity arising from paper mills: a rapid scoping review
Pérez-Neri, I., Pineda, C., & Sandoval, H. (2022) · Clinical Rheumatology · doi:10.1007/s10067-022-06198-9 · Cited by 70
“org/) in May 2021, from inception to the present, as in previous studies [22].”
ResultDynamics of cross-platform attention to retracted papers
Peng, H., Romero, D. M., & Horvát, E.-Á. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2119086119 · Cited by 57
Kataoka, Y., Banno, M., Tsujimoto, Y., Ariie, T., Taito, S., Suzuki, T., Oide, S., & Furukawa, T. A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.06.015 · Cited by 44
RetractedBibliometric and Altmetric Analysis of Retracted Articles on COVID-19
Khan, H., Gupta, P., Zimba, O., & Gupta, L. (2022) · Journal of Korean Medical Science · doi:10.3346/jkms.2022.37.e44 · Cited by 41
Agley, J. D., Xiao, Y., Eldridge, L. A., Meyerson, B. E., & Golzarri‐Arroyo, L. (2022) · BMC Public Health · doi:10.1186/s12889-022-13298-3 · Cited by 27
“We note, for example, popular articles that are retracted often receive more popular attention than the retractions [45].”
Background
Metadata
- Authors
- Serghiou, S., Marton, R. M., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-05-12
- Volume
- 16
- Issue
- 5
- Pages
- e0248625
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8115781
- OpenAlex
- W3163888857
- Semantic Scholar
- fc21cb7478124b73d44a0d6fe321be140d0ea3e6
- Cited by
- 55
- References
- 34
- Citations by year
- 2026: 10 · 2025: 9 · 2024: 9 · 2023: 6 · 2022: 17 · 2021: 3
- FWCI
- 7.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Department of Epidemiology and Population Health, Stanford University
- Stanford Data Science Initiative
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- retracted article, media attention, social media attention, Altmetric Attention Score, fake peer review, Retraction Watch Database
- MeSH terms
- Humans, Peer Review, Publications, Bibliometrics, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.