Retractions
Open accessThe DOI matches its Crossref record; 27 of the 28 references it cites were found in a registry or an index.
Abstract
To what extent does “false science” affect the rate and direction of scientific change? We examine the impact of over 1,100 scientific retractions on the citation trajectories of articles that are related to retracted papers in intellectual space but were published prior to the retraction event. Following retraction and relative to carefully selected controls, related articles experience a lasting 5% to 10% decline in the rate of citations received. This penalty is more severe when the retracted article involves fraud or misconduct rather than honest mistakes. In addition, we find that the arrival rate of new articles and funding flows into these fields decrease after a retraction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other work has examined the dissemination of retracted papers in scientific communities, focusing mainly on the associated citation penalty (5, 14, 30–36).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [36]
Citations
Cites
1 retracted
Patient-Specific Embryonic Stem Cells Derived from Human SCNT Blastocysts
Hwang, W. S., Roh, S. I., Lee, B. C., Kang, S. K., Kwon, D. K., Kim, S., Kim, S. J., Park, S. W., Kwon, H. S., Lee, C. K., et al. (2005) · Science · doi:10.1126/science.1112286 · Cited by 480
RetractedFilders, R. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90130-2 · Cited by 16,165
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
The Origins of Endogenous Growth
Romer, P. M. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.1.3 · Cited by 3,783
The Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
Econometric Models for Count Data with an Application to the Patents-R & D Relationship
Hausman, J., Hall, B. H., & Griliches, Z. (1984) · Econometrica · doi:10.2307/1911191 · Cited by 3,393
Toward a new economics of science
Partha, D., & David, P. A. (1994) · Research Policy · doi:10.1016/0048-7333(94)01002-1 · Cited by 2,448
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 4×
“NLM’s professional indexers are trained to select 7This represents an inversion of the relative prevalence of fraud and mistakes, compared to an earlier analysis performed by Nath et al. (2006), but is in line with the recent results reported by Fang et al. (2012).”
InfluentialMartinson, B. C., Anderson, M. S., & de Vries, R. (2005) · Nature · doi:10.1038/435737a · Cited by 1,096
Pseudo Maximum Likelihood Methods: Applications to Poisson Models
Gourieroux, C., Monfort, A., & Trognon, A. (1984) · Econometrica · doi:10.2307/1913472 · Cited by 1,065
Do Scientists Pay to Be Scientists?
Stern, S. (2004) · Management Science · doi:10.1287/mnsc.1040.0241 · Cited by 748
Azoulay, P., Zivin, J. S. G., & Wang, J. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.2.549 · Cited by 720
Self-citationDo formal intellectual property rights hinder the free flow of scientific knowledge?
Murray, F., & Stern, S. (2007) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2006.05.017 · Cited by 514
Self-citationAcademic freedom, private‐sector focus, and the process of innovation
Aghion, P., Dewatripont, M., & Stein, J. C. (2008) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2008.00031.x · Cited by 427
Murray, F. (2010) · American Journal of Sociology · doi:10.1086/653599 · Cited by 401
Self-citationClimbing atop the Shoulders of Giants: The Impact of Institutions on Cumulative Research
Furman, J. L., & Stern, S. (2011) · American Economic Review · doi:10.1257/aer.101.5.1933 · Cited by 344
Self-citationRestructuring Research: Communication Costs and the Democratization of University Innovation
Agrawal, A., & Goldfarb, A. (2008) · American Economic Review · doi:10.1257/aer.98.4.1578 · Cited by 269
Henrietta lacks, HeLa cells, and cell culture contamination
Lucey, B. P., Nelson-Rees, W. A., & Hutchins, G. M. (2009) · Archives of Pathology & Laboratory Medicine · doi:10.5858/133.9.1463 · Cited by 255
PubMed related articles: a probabilistic topic-based model for content similarity
Lin, J., & Wilbur, W. J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-423 · Cited by 243 · cited 1×
“11 Lin and Wilbur (2007) report that one fifth of “nontrivial” browser sessions in PubMed involve at least one invocation of PMRA. thesaurus, consists of sets of terms naming descriptors in a hierarchical structure that permits searching at various levels of specificity.”
Histocompatible Embryonic Stem Cells by Parthenogenesis
Kim, K., Lerou, P., Yabuuchi, A., Lengerke, C., Ng, K., West, J., Kirby, A., Daly, M. J., & Daley, G. Q. (2007) · Science · doi:10.1126/science.1133542 · Cited by 229
The Impact of Information Technology on Academic Scientists' Productivity and Collaboration Patterns
Ding, W. W., Levin, S. G., Stephan, P. E., & Winkler, A. E. (2010) · Management Science · doi:10.1287/mnsc.1100.1195 · Cited by 208
Retractions in the research literature: misconduct or mistakes?
Nath, S. B., Marcus, S. C., & Druss, B. G. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00504.x · Cited by 161
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151 · cited 1×
“Some researchers abandoned the field altogether, while others pursued adjacent research lines that built on firmer foundations (Furman, Murray, & Stern, 2012).”
Self-citationHall, B. H., Mairesse, J., & Turner, L. (2007) · Economics of Innovation and New Technology · doi:10.1080/10438590600983010 · Cited by 147
Selection of Medline contents, the development of its thesaurus, and the indexing process
Bachrach, C. A., & Charen, T. (1978) · Medical Informatics · doi:10.3109/14639237809014183 · Cited by 75
Growing Stem Cells: The Impact of Federal Funding Policy on the U.S. Scientific Frontier
Furman, J. L., Murray, F., & Stern, S. (2012) · Journal of Policy Analysis and Management · doi:10.1002/pam.21644 · Cited by 55
Self-citationThe Economics of Scientific Misconduct
Lacetera, N., & Zirulia, L. (2011) · Journal of Law, Economics, and Organization · doi:10.1093/jleo/ewp031 · Cited by 5
Research works printed but not linked: 4
- Aghion Philippe, 2009, NBER working paper, 14819
- Borjas George J, 2012, NBER working paper, 18614
- 10.2202/1932-0213.1040 · DOI
- Jin Ginger Zhe, 2013, NBER working paper, 19489
Cited by
Does Science Advance One Funeral at a Time?
Azoulay, P., Fons-Rosen, C., & Zivin, J. S. G. (2019) · American Economic Review · doi:10.1257/aer.20161574 · Cited by 371
Self-citationThe visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153
Mukherjee, S., Romero, D. M., Jones, B. F., & Uzzi, B. (2017) · Science Advances · doi:10.1126/sciadv.1601315 · Cited by 171
The gendered nature of authorship
Ni, C., Smith, E. M. R., Yuan, H., Larivière, V., & Sugimoto, C. R. (2021) · Science Advances · doi:10.1126/sciadv.abe4639 · Cited by 170
Academic Misconduct, Misrepresentation and Gaming: A ReassessmentPreprint
Biagioli, M., Kenney, M. F., Martin, B. R., & Walsh, J. P. (2018) · SSRN Electronic Journal · doi:10.1016/j.respol.2018.10.025 · Cited by 146
Metadata
- Authors
- Azoulay, P., Furman, J. L., Krieger, & Murray, F.
- Affiliations
- Massachusetts Institute of Technology (US)
- Boston University (US)
- Venue
- Review of Economics and Statistics
- Publisher
- MIT Press - Journals
- Published
- 2015-12
- Volume
- 97
- Issue
- 5
- Pages
- 1118-1136
- ISSN
- 0034-6535 (ISSN-L)
- 1530-9142
- OpenAlex
- W4230095525
- Cited by
- 91
- References
- 28
- Citations by year
- 2026: 7 · 2025: 14 · 2024: 9 · 2023: 12 · 2022: 5 · 2021: 8 · 2020: 6 · 2019: 4 · 2018: 12 · 2017: 8 · 2016: 4
- Type
- retraction
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-sa
- Locations
- The Review of Economics and Statistics (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Science Foundation (0738142, 0738394)
- National Institutes of Health
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- scientific retraction, research misconduct, scientific fraud, scientific change, research funding, publication rates, retracted article
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.