The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Why Current Publication Practices May Distort Science
Open accessAbstract
DOAJ is a unique and extensive index of diverse open access journals from around the world, driven by a growing community, committed to ensuring quality content is freely available online for everyone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationThe Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Several factors may predict irreproducibility (small effects, small studies, “hot” fields, strong interests, large databases, flexible statistics) [19], but claiming that a specific study is wrong is a difficult, charged decision.”
Self-citationPublication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“In the basic biological sciences, statistical considerations are secondary or nonexistent, results entirely unpredicted by hypotheses are celebrated, and there are few formal rules for reproducibility [”
Toward a new economics of science
Partha, D., & David, P. A. (1994) · Research Policy · doi:10.1016/0048-7333(94)01002-1 · Cited by 2,448
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Learning from the Behavior of Others: Conformity, Fads, and Informational Cascades
Bikhchandani, S., Hirshleifer, D., & Welch, I. (1998) · Journal of Economic Perspectives · doi:10.1257/jep.12.3.151 · Cited by 1,915
Priorities in Scientific Discovery: A Chapter in the Sociology of Science
Merton, R. K. (1957) · American Sociological Review · doi:10.2307/2089193 · Cited by 1,593
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · cited 1×
“An important role of systematic reviews may be to correct the inflated effects present in the initial studies published in famous journals [12], but this process may be similarly prolonged and even systematic reviews may perpetuate inflated results [13,14].”
Self-citation
Cited by
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
A catalogue of reporting guidelines for health research
Simera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2009.02234.x · Cited by 1,047
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Self-citationWhy Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
Self-citationVerhage, M. L., Schuengel, C., Madigan, S., Fearon, R. M. P., Oosterman, M., Cassibba, R., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2016) · Psychological Bulletin · doi:10.1037/bul0000038 · Cited by 550
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citationShedding Light on the Dark Data in the Long Tail of Science
Heidorn, P. B. (2008) · Library trends · doi:10.1353/lib.0.0036 · Cited by 470
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
How I treat acquired aplastic anemia
Scheinberg, P., & Young, N. S. (2012) · Blood · doi:10.1182/blood-2011-12-274019 · Cited by 443
Self-citationPoynton, F. E., Bright, S. A., Blasco, S., Williams, D. C., Kelly, J. M., & Gunnlaugsson, T. (2017) · Chemical Society Reviews · doi:10.1039/c7cs00680b · Cited by 421
Contextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398
Meta-assessment of bias in science
Fanelli, D., Costas, R., & Ioannidis, J. P. A. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618569114 · Cited by 364
Self-citationPublic Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363
“The observations of scientists as coded in their primary data constitute a central commodity in the scientific enterprise [1].”
BackgroundSelf-citationHow to Use an Article Reporting a Multiple Treatment Comparison Meta-analysis
Mills, E. J., Ioannidis, J. P. A., Thorlund, K., Schünemann, H. J., Puhan, M. A., & Guyatt, G. H. (2012) · JAMA · doi:10.1001/2012.jama.11228 · Cited by 360
Self-citationKirmayer, L. J. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.03.018 · Cited by 341
A Bayesian Perspective on the Reproducibility Project: Psychology
Etz, A., & Vandekerckhove, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149794 · Cited by 295
“Since studies in which the null hypothesis is confidently rejected are published at a higher rate than those in which it is not, the literature is “unrepresentative of scientists’ repeated samplings of the real world” [21].”
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Cobo, E., Cortes, J., Ribera, J. M., Cardellach, F., Selva-O'Callaghan, A., Kostov, B., Garcia, L., Cirugeda, L., Altman, D. G., Gonzalez, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d6783 · Cited by 290
Excess Significance Bias in the Literature on Brain Volume Abnormalities
Ioannidis, J. P. A. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.28 · Cited by 299
Self-citationPickering, C., Grignon, J., Steven, R., Guitart, D., & Byrne, J. (2015) · Studies in Higher Education · doi:10.1080/03075079.2014.914907 · Cited by 285
Giner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274
“It is this suspicion that Young, Ioannidis, and Al-Ubaydli (2008) describe as the “winner’s curse” of scientific publishing.”
BackgroundLeonti, M. (2011) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2011.01.017 · Cited by 281
One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects
Maniadis, Z., Tufano, F., & List, J. A. (2014) · American Economic Review · doi:10.1257/aer.104.1.277 · Cited by 280
When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis
Scannell, J. W., & Bosley, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147215 · Cited by 279
“With a lower signal to noise ratio in the remaining stock, the play of chance [13] [29] [72] and professional biases [95] [96] [94] can start to exert more visible effects on the quality of the scientific literature.”
BackgroundRezende, L. F. M. D., Sá, T. H. D., Markozannes, G., Rey-López, J. P., Lee, I.-M., Tsilidis, K. K., Ioannidis, J. P. A., & Eluf-Neto, J. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098391 · Cited by 276
Self-citationARE ALL ECONOMIC FACTS GREATLY EXAGGERATED? THEORY COMPETITION AND SELECTIVITY
Doucouliagos, C., & Stanley, T. D. (2013) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2011.00706.x · Cited by 276
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
Rigorous Large-Scale Educational RCTs Are Often Uninformative: Should We Be Concerned?
Lortie-Forgues, H., & Inglis, M. (2019) · Educational Researcher · doi:10.3102/0013189x19832850 · Cited by 234
Hardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190806 · Cited by 217
Self-citationEstimates of the Continuously Publishing Core in the Scientific Workforce
Ioannidis, J. P. A., Boyack, K. W., & Klavans, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101698 · Cited by 160
Self-citationPereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160
Self-citationOverinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013) · Radiology · doi:10.1148/radiol.12120527 · Cited by 158
Science and the sources of hype
Caulfield, T., & Condit, C. (2012) · Public Health Genomics · doi:10.1159/000336533 · Cited by 152
Optimal incentives for collective intelligence
Mann, R. P., & Helbing, D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618722114 · Cited by 112
Bowen, A., & Casadevall, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1504955112 · Cited by 104
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
Self-citationSimera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2009) · Maturitas · doi:10.1016/j.maturitas.2009.03.011 · Cited by 97
Prasad, V., Jorgenson, J., Ioannidis, J. P. A., & Cifu, A. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.005 · Cited by 90
Self-citationCommensuration Bias in Peer Review
Lee, C. J. (2015) · Philosophy of Science · doi:10.1086/683652 · Cited by 90
Gonon, F., Bezard, E., & Boraud, T. (2011) · PLoS ONE · doi:10.1371/journal.pone.0014618 · Cited by 71
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Arsevska, E., Valentin, S., Rabatel, J., de Goër de Hervé, J., Falala, S., Lancelot, R., & Roche, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199960 · Cited by 64
Kirkpatrick, R. H., Munoz, D. P., Khalid-Khan, S., & Booij, L. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.11.023 · Cited by 41
Overflow in science and its implications for trust
Siebert, S., Machesky, L. M., & Insall, R. H. (2015) · eLife · doi:10.7554/elife.10825 · Cited by 34
“The exponential growth of scientific outputs stands in contrast with the artificial scarcity (Young et al., 2008) of prestigious publication outlets (Eisen, 2015).”
ResultWho is afraid of reviewers’ comments? Or, why anything can be published and anything can be cited
Ioannidis, J. P. A., Tatsioni, A., & Karassa, F. B. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2010.02272.x · Cited by 35
Self-citationLeviton, A. (2018) · Nutrients · doi:10.3390/nu10091152 · Cited by 27
“The result is publication bias [157,158], which is especially distorting in meta-analyses [159].”
BackgroundExamining the predictive validity of NIH peer review scores
Lindner, M. D., & Nakamura, R. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126938 · Cited by 24
Moery, E., & Calin-Jageman, R. J. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550616639649 · Cited by 16
The darker side of quantitative academic performance metrics
Crous, C. J. (2019) · South African Journal of Science · doi:10.17159/sajs.2019/5785 · Cited by 14
Neglect of Multiplicity When Testing Families of Related Hypotheses*
Holland, B., fang, S. W., & Basu, S. (2009) · doi:10.2139/ssrn.1466343 · Cited by 13
Metadata
- Authors
- Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-10-07
- Volume
- 5
- Issue
- 10
- Pages
- e201
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W2096656075
- Cited by
- 502
- References
- 52
- FWCI
- 63.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.