The Retraction Penalty: Evidence from the Web of Science
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Scientific articles are retracted at increasing rates, with the highest rates among top journals. Here we show that a single retraction triggers citation losses through an author's prior body of work. Compared to closely-matched control papers, citations fall by an average of 6.9% per year for each prior publication. These chain reactions are sustained on authors' papers (a) published up to a decade earlier and (b) connected within the authors' own citation network by up to 4 degrees of separation from the retracted publication. Importantly, however, citation losses among prior work disappear when authors self-report the error. Our analyses and results span the range of scientific disciplines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Other work has examined the dissemination of retracted papers in scientific communities, focusing mainly on the associated citation penalty (5, 14, 30–36).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [30]
In the citing paper
“research indicates that retractions can lead to a substantial decrease in citations to researchers’ prior work [77].”
From The natural selection of bad science (2016) · cites this paper as [77]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Distribution-free estimation of some nonlinear panel data models
Wooldridge, J. M. (1999) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00033-5 · Cited by 858
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151
Effects of article retraction on citation and practice in medicine.
(1999) · Europe PMC (PubMed Central) · Cited by 101
Plastic fantastic: how the biggest fraud in physics shook the scientific world
(2009) · Choice Reviews Online · doi:10.5860/choice.47-2065 · Cited by 91
Analysis of Citations to Biomedical Articles Affected by Scientific Misconduct
Neale, A. V., Dailey, R. K., & Abrams, J. (2010) · Science and Engineering Ethics · doi:10.1007/s11948-009-9151-4 · Cited by 66
Korpela, K. M. (2010) · Current Medical Research and Opinion · doi:10.1185/03007991003603804 · Cited by 58
Cited by
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“This last assumption may appear unrealistically harsh, but research indicates that retractions can lead to a substantial decrease in citations to researchers’ prior work [77].”
ResultThe science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
“focused on the penalty caused by retracting papers [349].”
BackgroundReputation and impact in academic careers
Petersen, A. M., Fortunato, S., Pan, R. K., Kaski, K., Penner, O., Rungi, A., Riccaboni, M., Stanley, H. E., & Pammolli, F. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323111111 · Cited by 304
“Indeed, recent evidence indicates that the retraction of a publication can have a negative impact on the potential growth of Ci (30).”
BackgroundChallenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 267
The incidence and role of negative citations in science
Catalini, C., Lacetera, N., & Oettl, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502280112 · Cited by 189
Financial costs and personal consequences of research misconduct resulting in retracted publications
Stern, A. M., Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · eLife · doi:10.7554/elife.02956 · Cited by 189
“A recent report demonstrated a significant decline in the citation of an author's work after one of his or her papers was retracted (Lu et al., 2013).”
BackgroundNonreplicable publications are cited more than replicable ones
Serra-Garcia, M., & Gneezy, U. (2021) · Science Advances · doi:10.1126/sciadv.abd1705 · Cited by 177
The visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153
“, 1994) find no or little citation loss, newer work (Furman et al., 2012; Lu et al., 2013) finds stronger effects in similar cases.”
BackgroundInfluentialMukherjee, S., Romero, D. M., Jones, B., & Uzzi, B. (2017) · Science Advances · doi:10.1126/sciadv.1601315 · Cited by 143
Self-citationAcademic Misconduct, Misrepresentation and Gaming: A ReassessmentPreprint
Biagioli, M., Kenney, M. F., Martin, B. R., & Walsh, J. P. (2018) · SSRN Electronic Journal · doi:10.1016/j.respol.2018.10.025 · Cited by 146
“For the scientist forced to make the retraction, there is also a significant citation penalty with regards to their non-retracted articles, as these are subsequently less cited (Lu et al., 2013).”
BackgroundVuong, Q. (2020) · Learned Publishing · doi:10.1002/leap.1282 · Cited by 126
“However, in retractions, where the authors self-report the error, their previous works do not suffer from citation losses (Lu et al ., 2013).”
BackgroundResultInfluentialMentorship and protégé success in STEM fields
Ma, Y., Mukherjee, S., & Uzzi, B. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915516117 · Cited by 124
Self-citationData, measurement and empirical methods in the science of science
Liu, L., Jones, B. F., Uzzi, B., & Wang, D. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01562-4 · Cited by 181
Self-citationThe career effects of scandal: Evidence from scientific retractions
Azoulay, P., Bonatti, A., & Krieger, J. L. (2017) · Research Policy · doi:10.1016/j.respol.2017.07.003 · Cited by 118
“A related paper by Lu et al. (2013) uses self-citation linkages (starting with the retracted paper) to build author publication histories; this approach has the advantage that it is automated, scalable, and effectively deals with errors of commission—mistakenly attributing publications authored by a namesake to the fo…”
InfluentialLinguistic Obfuscation in Fraudulent Science
Markowitz, D. M., & Hancock, J. T. (2016) · Journal of Language and Social Psychology · doi:10.1177/0261927x15614605 · Cited by 113
Temporal characteristics of retracted articles
Bar-Ilan, J., & Halevi, G. (2018) · Scientometrics · doi:10.1007/s11192-018-2802-y · Cited by 107
“Other studies that examined the yearly number of citations post retraction include (Furman et al. 2012; Lu et al. 2013).”
BackgroundInfluentialHow stars matter: Recruiting and peer effects in evolutionary biology
Agrawal, A. K., McHale, J., & Oettl, A. (2017) · Research Policy · doi:10.1016/j.respol.2017.02.007 · Cited by 94
Toward a more scientific science
Azoulay, P., Zivin, J. G., Uzzi, B., Wang, D., Williams, H., Evans, J. A., Jin, G. Z., Lu, S. F., Jones, B. F., Börner, K., et al. (2018) · Science · doi:10.1126/science.aav2484 · Cited by 94
Self-citationCostly collaborations: The impact of scientific fraud on co‐authors' careers
Mongeon, P., & Larivière, V. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23421 · Cited by 83
“Robert Merton (1968) has described the scientific system as a stratified and hierarchical space in which scientists make contributions to the common stock of knowledge in exchange for different forms of recognition, or what Bourdieu (1986) calls symbolic capital.”
BackgroundWhat studies of retractions tell us
Marcus, A., & Oransky, I. (2014) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v15i2.855 · Cited by 81
Fanelli, D., Costas, R., Fang, F. C., Casadevall, A., & Bik, E. M. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-018-0023-7 · Cited by 65
“2012), offer a pool of actual cases whose analyses have yielded important insights (Grieneisen and Zhang 2012; Lu et al. 2013; Fang et al. 2012; Fanelli et al. 2015).”
BackgroundDynamics of cross-platform attention to retracted papers
Peng, H., Romero, D. M., & Horvát, E.-Á. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2119086119 · Cited by 57
Ribeiro, M. D., & Vasconcelos, S. M. R. (2018) · Scientometrics · doi:10.1007/s11192-017-2621-6 · Cited by 69
“2013), though, for self-reported retractions, there seems to be no statistically significant relationship with loss in citations to prior work (Lu et al. 2013).”
BackgroundResultInfluentialThe reproducibility of biomedical research: Sleepers awake!
Bustin, S. A. (2014) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.01.002 · Cited by 56
Pathogenic organization in science: Division of labor and retractions
Walsh, J. P., Lee, Y.-N., & Tang, L. (2019) · Research Policy · doi:10.1016/j.respol.2018.09.004 · Cited by 56
“We examine division of labor and retractions in biomedical and life sciences, where retractions tend to be sufficiently common to allow us to analyze these relationships (Lu et al., 2013; Tang et al., 2016).”
BackgroundPlagiarism Allegations Account for Most Retractions in Major Latin American/Caribbean Databases
de Almeida, R. M. V. R., Rocha, K. D. A., Catelani, F., Fontes-Pereira, A. J., & Vasconcelos, S. M. R. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-015-9714-5 · Cited by 63
Collaboration and its influence on retraction based on retracted publications during 1978–2017
Zhang, Q., Abraham, J., & Fu, H. (2020) · Scientometrics · doi:10.1007/s11192-020-03636-w · Cited by 59
“Another one is combining the results of retracted publications in (1) retraction of publication list, and (2) complementing publications that have not been flagged in reference to retraction notices (Lu et al. 2013).”
BackgroundDoing the Right Thing: A Qualitative Investigation of Retractions Due to Unintentional Error
Hosseini, M., Hilhorst, M. T., de Beaufort, I., & Fanelli, D. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9894-2 · Cited by 52
“This latter finding corroborates recent studies suggesting that authors of a self-reported retraction benefit from a boost in citations (Lu et al. 2013).”
ResultEnding the retraction stigma: Encouraging the reporting of errors in the biomedical record
da Silva, J. A. T., & Al‐Khatib, A. (2019) · Research Ethics · doi:10.1177/1747016118802970 · Cited by 59
da Silva, J. A. T. (2022) · Journal for General Philosophy of Science · doi:10.1007/s10838-022-09607-4 · Cited by 60
“The model proposed by Heckers et al. (2015) may go some way in annulling the negative stigma and reputational penalty associated with retractions when authors retract of their own accord (Lu et al. 2013), provided that this is done in a transparent manner (Marasović et al. 2018 ).”
BackgroundGuilt by association: How scientific misconduct harms prior collaborators
Hussinger, K., & Pellens, M. (2019) · Research Policy · doi:10.1016/j.respol.2018.01.012 · Cited by 49
“It is thus only rational that scientists shy away from the results of authors that have been involved in retractions in the past (Azoulay et al., 2015, 2014a; Lu et al., 2013; Mongeon and Larivière, 2015).”
BackgroundResultInfluentialAn analysis of the validity of retraction annotation in pubmed and the web of science
Schmidt, M. (2018) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23913 · Cited by 47
“I processed the respective search strategies for RoPs as specified in Chen et al. (2013), Fanelli (2013), He (2013), and Lu et al. (2013) with WoS raw data.6 As the indexing of retraction notices has increased massively since the beginning of the last decade and their labeling before that is even…”
MethodA Multidimensional Investigation of the Effects of Publication Retraction on Scholarly Impact
Shuai, X., Rollins, J., Moulinier, I., Custis, T., Edmunds, M., & Schilder, F. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23826 · Cited by 48
“…of American Medical Colleges, whereas we applied a more advanced and patented tool to normalize and disambiguate authors names; third, similar to Lu et al. (2013), they applied Poisson regression analysis to quantify the effect of retraction to an author’s citation rate, whereas we used a…”
BackgroundMethodResultInfluentialFrampton, G. K., Woods, L., & Scott, D. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258935 · Cited by 58
“Retraction rates have been found to vary with the scholarly discipline [8, 16], journal impact factor [3, 4, 6, 14] and country of authorship [5, 7].”
BackgroundCorrecting the Scientific Record: Retraction Practices in Chemistry and Materials Science
Coudert, F.-X. (2019) · Chemistry of Materials · doi:10.1021/acs.chemmater.9b00897 · Cited by 48
Scientific prizes and the extraordinary growth of scientific topics
Jin, C., Ma, Y., & Uzzi, B. (2021) · Nature Communications · doi:10.1038/s41467-021-25712-2 · Cited by 67
Self-citationTeam size and retracted citations reveal the patterns of retractions from 1981 to 2020
Sharma, K. (2021) · Scientometrics · doi:10.1007/s11192-021-04125-4 · Cited by 45
Craig, R., Cox, A., Tourish, D., & Thorpe, A. (2020) · Research Policy · doi:10.1016/j.respol.2020.103930 · Cited by 56
Retraction: The “Other Face” of Research Collaboration?
Tang, L., Hu, G., Sui, Y., Yang, Y., & Cao, C. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00209-1 · Cited by 50
“Inspired by prior scholarship (for example, Azoulay et al. 2012; Furman et al. 2012; Jin et al. 2013; Lu et al. 2013), our research brought a new perspective— collaboration—into the literature on research retraction and provided empirical evidence on the driving factors and the speed of retraction.”
A Quantitative Perspective on Ethics in Large Team Science
Petersen, A. M., Pavlidis, I. T., & Semendeferi, I. (2014) · Science and Engineering Ethics · doi:10.1007/s11948-014-9562-8 · Cited by 47
Research ethics: a profile of retractions from world class universities
Lievore, C., Rubbo, P., dos Santos, C. B., Picinin, C. T., & Pìlatti, L. A. (2021) · Scientometrics · doi:10.1007/s11192-021-03987-y · Cited by 57
The Reverse Matthew Effect: Consequences of Retraction in Scientific Teams
Jin, G. Z., Jones, B., Lu, S. F., & Uzzi, B. (2019) · The Review of Economics and Statistics · doi:10.1162/rest_a_00780 · Cited by 41
“This figure follows Lu et al. (2013) but restricts analysis to retraction events where the retracted paper was”
BackgroundMethodResultInfluentialSelf-citationHill, R., Yin, Y., Stein, C., Wang, X., Wang, D., & Jones, B. F. (2025) · Nature · doi:10.1038/s41586-025-09048-1 · Cited by 41
Self-citationA cross-disciplinary and severity-based study of author-related reasons for retraction
Xu, S. B., & Hu, G. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1952870 · Cited by 43
“Methodologically, investigations that drew on cross-disciplinary databases like Web of Science (WoS) and Scopus usually covered relatively small time windows (e.g., Bar-Ilan and Halevi 2018; He 2012; Lei and Zhang 2018; Lu et al. 2013).”
BackgroundOrtega, J. L., & Delgado‐Quirós, L. (2024) · Scientometrics · doi:10.1007/s11192-024-05034-y · Cited by 55
“Thus, for instance, the number of studies using WoS began to raise from 2012 (Fanelli, 2013; Grieneisen & Zhang, 2012; Lu et al., 2013), when this database likely started to identify these documents.”
Misconduct, Marginality and Editorial Practices in Management, Business and Economics Journals
Karabağ, S. F., & Berggren, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159492 · Cited by 45
A Novel Rubric for Rating the Quality of Retraction Notices
Bilbrey, E., O'Dell, N., & Creamer, J. (2014) · Publications · doi:10.3390/publications2010014 · Cited by 37
“These results can be interpreted numerous ways: Greater care may be taken with retraction notices of prominent articles; researchers may cite articles from high-impact journals regardless of retraction; researchers might be unaware of the retraction; though retracted, some unaffected parts of an article might still be…”
BackgroundRetractions in the Engineering Field: A Study on the Web of Science Database
Rubbo, P., Helmann, C. L., Bilynkievycz dos Santos, C., & Pilatti, L. A. (2019) · Ethics & Behavior · doi:10.1080/10508422.2017.1390667 · Cited by 37
“2016) to avoid citations to those articles, which can lead to the dissemination of errors or false knowledge (Resnik & Dinse, 2013) and further compromise science (Fox, 1994; Santos, 2017). As noted by Van Noorden (2011), who analyzed 235 retracted articles during the period from 1966 to 1996, retracted publications w…”
BackgroundConcern noted: a descriptive study of editorial expressions of concern in PubMed and PubMed Central
Vaught, M., Jordan, D. C., & Bastian, H. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0030-2 · Cited by 34
Correction and retraction practices in library and information science journals
Ajiferuke, I., & Adekannbi, J. O. (2020) · Journal of Librarianship and Information Science · doi:10.1177/0961000618785408 · Cited by 33
“More than 30 years ago, a study by McDonald and Feather (1995) reported that valid quality control mechanisms were in place in LIS journals that UK academics frequently published, although the authors reported element of subjectivity in the application of quality control.”
BackgroundInfluentialMatthew effects in science and the serial diffusion of ideas: Testing old ideas with new methods
Farys, R., & Wolbring, T. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00129 · Cited by 38
Self-correction in science: The effect of retraction on the frequency of citations
Kühberger, A., Streit, D., & Scherndl, T. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277814 · Cited by 38
“Our study adds to the evidence on the limited effect of retractions on citations: retractions decrease citations, but do not eliminate them [4, 7, 14, 18, 22, 25, 28].”
ResultCitation of Retracted Articles in Engineering: A Study of the Web of Science Database
Rubbo, P., Pilatti, L. A., & Picinin, C. T. (2019) · Ethics & Behavior · doi:10.1080/10508422.2018.1559064 · Cited by 30
Retractions in medicine: the tip of the iceberg
Oransky, I., Fremes, S. E., Kurlansky, P., & Gaudino, M. (2021) · European Heart Journal · doi:10.1093/eurheartj/ehab398 · Cited by 30
“Whether they know it or not, such bravery need not mean a bump in the road of their career.(10) Just as we should trust journals that retract papers, and be wary of those that do not, we should be more confident in work by researchers who do what’s necessary to correct the record than in work by those who ignore criti…”
BackgroundKoo, M., & Lin, S.-C. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e38620 · Cited by 46
“While retractions can create substantial citation penalties [4] and may have negative implications for the authors involved, such as reputational damage or loss of credibility [5], they serve to prevent the dissemination of false or misleading information.”
RetractedXu, S. B., & Hu, G. (2022) · Learned Publishing · doi:10.1002/leap.1445 · Cited by 31
“…retraction stigma (Teixeira da Silva & Al-Khatib, 2021), damage to academic image (Hu & Xu, 2020; Xu & Hu, 2018, 2021), reduced publication counts, citation penalty (Azoulay et al., 2017; Lu et al., 2013), and decreased opportunities for funding, promotion, and other benefits (Stern et al., 2014).”
BackgroundMargalida, A., & Colomer, M. À. (2016) · PeerJ · doi:10.7717/peerj.1670 · Cited by 31
“This pattern coincides with the increasing rates on retracted articles among top journals (Feng Lu et al., 2013).”
ResultHeibi, I., & Peroni, S. (2021) · Scientometrics · doi:10.1007/s11192-021-04097-5 · Cited by 34
“2018) and (Lu et al. 2013), authors used the citation data collected from Web of Science to demonstrate that a single retraction could trigger citation losses through an author’s prior body of work.”
MethodRetraction Notices: Who Authored Them?
Xu, S. B., & Hu, G. (2018) · Publications · doi:10.3390/publications6010002 · Cited by 29
Systematic examination of pre‐ and post‐retraction citations
Dinh, L., Sarol, J., Cheng, Y., Hsiao, T., Parulian, N., & Schneider, J. (2019) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.35 · Cited by 23
Dal-Ré, R., & Ayuso, C. (2021) · Accountability in Research · doi:10.1080/08989621.2020.1835479 · Cited by 21
“On the other hand, authors could cite retracted articles when citing secondary sources—the “cut and paste” method (Madlock-Brown and Eichmann 2014)─leaving them unaware that they have been retracted.”
BackgroundFarys, R., & Wolbring, T. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23802 · Cited by 24
“The general idea is to construct tailor-made control groups of articles that are similar to the treated papers with respect to publication date, field, and yearly citations before the event (see Azoulay et al., 2014; Chan et al., 2014a; Lu et al., 2013, for similar approaches).”
BackgroundSalandra, R. (2018) · Research Policy · doi:10.1016/j.respol.2018.04.005 · Cited by 24
“Several studies have investigated the implications of defective science and errors in publication, focussing mostly on retractions (Lu et al., 2013; Furman et al., 2012, Azoulay et al., 2015; Azoulay et al., 2017).”
BackgroundThe unfortunately long life of some retracted biomedical research publications
Hagberg, J. M. (2020) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00003.2020 · Cited by 25
Yang, S., Qi, F., Diao, H., & Ajiferuke, I. (2022) · Journal of Information Science · doi:10.1177/01655515221097623 · Cited by 28
The Reverse Matthew Effect: Catastrophe and Consequence in Scientific Teams
Jin, G. Z., Jones, B., Lu, S. F., & Uzzi, B. (2013) · National Bureau of Economic Research · doi:10.3386/w19489 · Cited by 20
Self-citationTagne, A. M., Cassina, N., Furgiuele, A., Storelli, E., Cosentino, M., & Marino, F. (2020) · Journal of Academic Ethics · doi:10.1007/s10805-020-09359-0 · Cited by 20
A quantitative and qualitative open citation analysis of retracted articles in the humanities
Heibi, I., & Peroni, S. (2022) · Quantitative Science Studies · doi:10.1162/qss_a_00222 · Cited by 23
“For instance, several works (Lu et al., 2013; Azoulay et al., 2017; Mongeon & Larivière, 2016; Shuai et al., 2017) focused on showing how a single retraction could trigger citation losses through an author’s prior body of work.”
BackgroundSharma, K. (2024) · Scientometrics · doi:10.1007/s11192-024-05192-z · Cited by 28
“…the adverse impact of recurrent misconduct among collaborators, it is advisable to establish a comprehensive and legally protected system for reporting scientific misconduct, along with mentorship programs for institutions or research groups (Davis et al., 2007; Kornfeld, 2012; Lu et al., 2013).”
Agency and responsibility: A linguistic analysis of culpable acts in retraction notices
Hu, G., & Xu, S. B. (2020) · Lingua · doi:10.1016/j.lingua.2020.102954 · Cited by 23
The effectiveness of peer review in identifying issues leading to retractions
Zheng, X. M., Chen, J., Tollas, A., & Ni, C. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101423 · Cited by 23
Above a swamp: A theory of high-quality scientific production
Kiri, B., Lacetera, N., & Zirulia, L. (2018) · Research Policy · doi:10.1016/j.respol.2018.01.011 · Cited by 20
“Science may "go wrong" for outright fraud or mistakes that, if major and detected, lead to retraction from publication (Azoulay et al., 2015a-b; Broad and Wade, 1982; Lacetera and Zirulia, 2011; Lu et al., 2013).”
Abernethy, N. J. (2024) · AI and Ethics · doi:10.1007/s43681-024-00575-7 · Cited by 18
“Many of these researchers would be afraid of expert readers reporting LLM-generated inaccuracies to the journal, which could retract the article and thus harm the researcher’s reputation and their ability to get citations [101], jobs, funding, speaking engagements, collaboration opportunities, etc.”
Gewin, V. L. (2014) · Nature · doi:10.1038/nj7492-389a · Cited by 16
Santos-d’Amorim, K., Wang, T., Lund, B. D., & dos Santos, R. N. M. (2022) · Ethics & Behavior · doi:10.1080/10508422.2022.2141747 · Cited by 22
“Previous research has identified that the rate of retractions has accelerated in the past decades (Lu et al., 2013; Van Noorden, 2011).”
BackgroundFrom Symbols to Embeddings: A Tale of Two Representations in Computational Social Science
Chen, H., Yang, C. H., Zhang, X., Liu, Z., Sun, M., & Jin, J. (2021) · Journal of Social Computing · doi:10.23919/jsc.2021.0011 · Cited by 21
How bibliometrics and school rankings reward unreliable science
Oransky, I., Marcus, A., & Abritis, A. J. (2023) · BMJ · doi:10.1136/bmj.p1887 · Cited by 16
The Citation of Retracted Papers and Impact on the Integrity of the Scientific Biomedical Literature
da Silva, J. A. T., Santos-d’Amorim, K., & Bornemann‐Cimenti, H. (2025) · Learned Publishing · doi:10.1002/leap.1667 · Cited by 21
Sebo, P., & Sebo, M. (2025) · Accountability in Research · doi:10.1080/08989621.2025.2484555 · Cited by 25
“…and Casadevall 2012; Foo 2011; Grieneisen and Zhang 2012; Rosenkrantz 2016; Steen 2011; Steen, Casadevall, and Fang 2013; Stretton et al. 2012) and WoS (Bilbrey, O’Dell, and Creamer 2014; Chen et al. 2013; Fanelli 2013; Grieneisen and Zhang 2012; He 2013; Lievore et al. 2021; Lu et al. 2013).”
Salandra, R., Criscuolo, P., & Salter, A. J. (2020) · Research Policy · doi:10.1016/j.respol.2020.104130 · Cited by 16
Influence of accessibility (open and toll-based) of scholarly publications on retractions
Shah, T. A., Gul, S., Bashir, S., Ahmad, S., Huertas, A., Oliveira, A., Gulzar, F., Najar, A. H., & Chakraborty, K. (2021) · Scientometrics · doi:10.1007/s11192-021-03990-3 · Cited by 17
“Other than Medline/PubMed, Web of Science has also been used to study retracted publications in all subject fields (Almeida et al., 2016; Fanelli, 2013, 2015; He, 2013; Jin et al., 2013; Lu et al., 2013; Trikalinos et al., 2008).”
BackgroundMethodResearch Misconduct Investigations in China’s Science Funding System
Tang, L., Wang, L., & Hu, G. (2023) · Science and Engineering Ethics · doi:10.1007/s11948-023-00459-9 · Cited by 13
“The citation penalty and its long-term impact on bad actors’ career development is also found in the research by Lu et al. (2013) and Galbraith (2017).”
BackgroundA protocol to gather, characterize and analyze incoming citations of retracted articles
Heibi, I., & Peroni, S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270872 · Cited by 13
“Notable examples consist of works such as [4] that used the citation data collected from Web of Science to demonstrate that a single retraction could trigger citation losses through an author’s prior body of work.”
MethodMultiple Publications: The Main Reason for the Retraction of Papers in Computer Science
Hidabi, M. A., & Teh, P. L. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-03402-3_35 · Cited by 18
Correcting duplicate publications: follow up study of MEDLINE tagged duplications
Malički, M., Utrobičić, A., & Marušić, A. (2018) · Biochemia Medica · doi:10.11613/bm.2019.010201 · Cited by 13
“al field alongside the title of DP, such as Web of Science practice for retracted publications), as well as to clearly identify the final versions of papers (4,5,30-32).”
BackgroundSchneider, J., Woods, N. D., Proescholdt, R., Fu, Y., & The RISRS Team (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ms579 · Cited by 18
Sotudeh, H., Barahmand, N., Yousefi, Z., & Yaghtin, M. (2020) · Journal of Information Science · doi:10.1177/0165551520945853 · Cited by 14
“[16] used the retracted papers or the prior publications by the same authors as the treatment group, and the papers with similar citation patterns to the treated papers prior to the date of retraction as the control one.”
BackgroundMethodResultInfluentialExploring Retraction in Tourism and Hospitality Journals
Alrawadıeh, Z., & Zareer, A. (2019) · European Journal of Tourism Research · doi:10.54055/ejtr.v22i.372 · Cited by 13
“…retraction are likely to suffer substantial decline in the volume of citations they receive (Azoulay, Bonatti, & Krieger, 2017; Furman et al., 2012; Fang et al., 2012; Lu et al., 2013; Shuai et al., 2017) which indicates a decreasing reliability in the retracted authors’ entire academic record.”
BackgroundInfluentialThe role of testimony in mathematics
Andersen, L. E., Andersen, H. M., & Sørensen, H. K. (2020) · Synthese · doi:10.1007/s11229-020-02734-9 · Cited by 13
The Career Effects of Scandal: Evidence from Scientific Retractions
Azoulay, P., Bonatti, A., & Krieger, J. (2015) · National Bureau of Economic Research · doi:10.3386/w21146 · Cited by 20
Xu, H., Ding, Y., Zhang, C., & Tan, B. C. Y. (2023) · Research Policy · doi:10.1016/j.respol.2023.104815 · Cited by 13
Why do some retracted articles continue to get cited?
Schmidt, M. A. (2024) · Scientometrics · doi:10.1007/s11192-024-05147-4 · Cited by 23
“Early research (Furman et al., 2012; Lu et al., 2013) claims that retractions result in substantial citation losses compared to control papers, although the estimates vary: Furman et al. (2012) estimate 65%, Lu et al. (2013) 82% after self-reported and 87% after non-self reported retractions.”
Comer, J. S., Georgiadis, C., Schmarder, K., Chen, D., Coyne, C. A., Gudiño, O. G., Kazantzis, N., Langer, D. A., LeBeau, R. T., Liu, R. T., et al. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.05.006 · Cited by 12
Azoulay, P., Furman, J., Krieger, J., & Murray, F. (2012) · National Bureau of Economic Research · doi:10.3386/w18499 · Cited by 11
Fanelli, D., & Moher, D. (2019) · doi:10.1101/734137 · Cited by 10
A scoping review of retracted publications in anesthesiology
Fiore, M., Alfieri, A., Pace, M. C., Simeon, V., Chiodini, P., Leone, S., Wirz, S., Cuomo, A., Stoia, V., & Cascella, M. (2021) · Saudi Journal of Anaesthesia · doi:10.4103/sja.sja_1110_20 · Cited by 11
“Because publishing is mandatory to achieve career progression, funding, and prestige for academic institutions and universities, the “publish or perish” paradigm is most appropriate for expressing the publication pressure underlying this regrettable phenomenon.[2,3] On the other hand, unintentional misconduct can be d…”
BackgroundMotivating and Maintaining Ethics, Equity, Effectiveness, Efficiency, and Expertise in Peer Review
Brain Health Alliance, Craig, A., Lee, C., Bala, N., & Taswell, C. (2022) · Brainiacs Journal of Brain Imaging And Computing Sciences · doi:10.48085/i5b147d9d · Cited by 13
“[69] Susan Feng Lu, Ginger Zhe Jin, Brian Uzzi, and Benjamin Jones.”
BackgroundResearch practices and assessment of research misconduct
Hartgerink, C. H. J., & Wicherts, J. M. (2016) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-socsci.arysbi.v1 · Cited by 11
Amend: an integrated platform of retracted papers and concerned papers
Li, M., Chen, F., Tong, S., Yang, L., & Shen, Z. (2024) · Journal of Data and Information Science · doi:10.2478/jdis-2024-0012 · Cited by 12
“Only a few studies have taken a broader approach, utilizing data from the Web of Science ( Fanelli, 2013; Grieneisen & Zhang, 2012; He, 2013; Lu et al., 2013; Sharma, 2021; Trikalinos et al., 2008).”
Retraction of Scientific Papers: Types of Retraction, Consequences, and Impacts
Candal‐Pedreira, C., Pérez‐Ríos, M., & Ruano‐Raviña, A. (2022) · Springer eBooks · doi:10.1007/978-3-030-99680-2_40 · Cited by 10
Metadata
- Authors
- Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B.
- Affiliations
- University of Rochester (US)
- National Bureau of Economic Research (US)
- Northwestern University (US)
- Corresponding author
- Jones, Benjamin
- Venue
- Scientific Reports
- Published
- 2013-11-06
- Volume
- 3
- Issue
- 1
- Pages
- 3146-3146
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC3818648
- OpenAlex
- W2153924055
- Cited by
- 191
- References
- 15
- Citations by year
- 2026: 7 · 2025: 18 · 2024: 16 · 2023: 18 · 2022: 21 · 2021: 21 · 2020: 17 · 2019: 9 · 2018: 19 · 2017: 14 · 2016: 11 · 2015: 10 · 2014: 7 · 2013: 2
- FWCI
- 11.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/3.0/ (tdm)
- creativecommons.org/licenses/by/3.0/ (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Northwestern University
- National Institutes of Health (UL1TR000150)
- Defense Advanced Research Projects Agency (BAA-11-64, W911NF-09-2-0053)
- National Center for Advancing Translational Sciences
- Army Research Laboratory (W911NF, W911NF-09-2-0053)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retracted article, citation networks, research misconduct, scholarly publishing, Web of Science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.