Meta-research: Evaluation and Improvement of Research Methods and Practices
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
As the scientific enterprise has grown in size and diversity, we need empirical evidence on the research process to test and apply interventions that make it more efficient and its results more reliable. Meta-research is an evolving scientific discipline that aims to evaluate and improve research practices. It includes thematic areas of methods, reporting, reproducibility, evaluation, and incentives (how to do, report, verify, correct, and reward science). Much work is already done in this growing field, but efforts to-date are fragmented. We provide a map of ongoing efforts and discuss plans for connecting the multiple meta-research efforts across science worldwide.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The first is that the validity of these concerns is being assessed scientifically by a global metaresearch program, with results that have been briefly overviewed above (44).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
Self-citationPolicy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
Self-citationBiomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Self-citationRescuing US biomedical research from its systemic flaws
Alberts, B., Kirschner, M. W., Tilghman, S., & Varmus, H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404402111 · Cited by 817
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Self-citationVan Noorden, R., Maher, B., & Nuzzo, R. (2014) · Nature · doi:10.1038/514550a · Cited by 508
Estimates of the Continuously Publishing Core in the Scientific Workforce
Ioannidis, J. P. A., Boyack, K. W., & Klavans, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101698 · Cited by 160 · cited 1×
“Several million new research papers are published annually, and the number of publishing authors in 1996–2011 exceeded, according to one estimate, 15 million [2].”
BackgroundSelf-citationReproducibility of Results in Preclinical Studies: A Perspective From the Bone Field
Manolagas, S. C., & Kronenberg, H. M. (2014) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2293 · Cited by 44
Cited by
Items 301–400 of 545
Chapter 25. Classic Antipsychotic Medications
Nasrallah, H. A., & Tandon, R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as25 · Cited by 2
Strategic citations for a fairer academic landscapePreprint
Beck, M., Annasawmy, P. A., Birre, D., Busana, M., Casajus, N., Coux, C., Marino, C., Mouquet, N., Nicvert, L., Oliveira, B. F., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.06.668908 · Cited by 2
“In part, this may reflect a tendency to cite articles from the same journal (see S5), potentially to increase the chances of publication acceptance [29,30].”
Kaplan, A. (2022) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3530019.3535345 · Cited by 1
“, conducting research on research or namely the science of science [14].”
BackgroundMartinou, E., & Angelidi, A. M. (2022) · F1000Research · doi:10.12688/f1000research.127179.1 · Cited by 1
“highlighted the need for a strong educational curriculum to equip researchers and meta-researchers with the knowledge of best scientific practices to promote FAIRness in meta-research.(53) Furthermore, Universities and other academic institutions may consider rewarding meta-researchers who make their analytic code and…”
BackgroundBİLİMSEL ARAŞTIRMALARDA TEKRAR EDİLEBİLİRLİK SORUNLARI VE AÇIK BİLİM
Hayran, O. (2023) · Eskişehir Türk Dünyası Uygulama ve Araştırma Merkezi Halk Sağlığı Dergisi · doi:10.35232/estudamhsd.1359038 · Cited by 1
Chapter 60. Treatment of Child and Adolescent Disorders
Wagner, K., & Pliszka, S. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as60 · Cited by 1
Chapter 52. Treatment of Obsessive-Compulsive Disorder
Kayser, R. R., & Simpson, H. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as52 · Cited by 1
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0009 · Cited by 1
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0015 · Cited by 1
Science of Science: An Integrated and Methods-Driven Understanding of Science
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0017 · Cited by 1
Metapesquisa da função pedagógica da ficção seriada
Sigiliano, D., Furtuoso, G., & Borges, G. (2025) · E-Compós · doi:10.30962/e-comps.3249 · Cited by 1
Meta-science in neuroscience: why we need to study how we research the brain
Galarza, W. D. C. (2025) · Journal of Applied Cognitive Neuroscience · doi:10.17981/jacn.6.2.2025.6938 · Cited by 1
Kennett, J., Moss, S. J., Leigh, J. P., Bobrovitz, N., & Stelfox, H. T. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112135 · Cited by 1
Silva, J. M., Lima, J. P., Lawson, D. O., Nyambi, A., Sadeghirad, B., Logie, C. H., Moher, D., Pieper, D., Collins, G. S., Guyatt, G. H., et al. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112245 · Cited by 1
Chapter 14. Citalopram and Escitalopram
Shelton, R. C. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as14 · Cited by 1
Chapter 31. Ziprasidone and Asenapine
Newcomer, J. W., Lipsey, J., Strassnig, M., & Citrome, L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as31 · Cited by 1
Yang, Y. W.-H., & Marder, S. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as26 · Cited by 1
Buckley, P. F., & Foster, A. E. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as32 · Cited by 1
Chapter 29. Risperidone and Paliperidone
Lopez, L. V., Hill, M. B., & GOFF, D. C. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as29 · Cited by 1
Reproducibility of biomedical research: Quo vadis?
Dal‐Ré, R., Bernad, A., & Garesse, R. (2016) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2016.06.029 · Cited by 1
Bittlinger, M. (2018) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180118000142 · Cited by 1
Metariset atas Karya Riset Komunitas Pengkaji komunikasi
Handayani, S., Alfira, N., & Ar, M. F. R. (2020) · Jurnal Digital Media dan Relationship · doi:10.51977/jdigital.v2i1.199 · Cited by 1
Paradigmas: significados y propuestas para la investigación en comunicación
Diago, G. G. (2020) · Signo y Pensamiento · doi:10.11144/javeriana.syp39-77.pspi · Cited by 1
The Future of Behavioral Randomized Clinical Trials
Powell, L. H., Kaufmann, P. G., & Freedland, K. E. (2021) · Springer eBooks · doi:10.1007/978-3-030-39330-4_11 · Cited by 1
Nigerian Migrants' Remittances: The Unofficial Channel
Martins, A. A. (2021) · European Journal of Business and Management · doi:10.7176/ejbm/13-23-05 · Cited by 1
Catalá-López, F., Driver, J. A., Page, M. J., Hutton, B., Ridao-López, M., Berrozpe‐Villabona, C., Alonso‐Arroyo, A., Medín, C. A. F., Bernal‐Delgado, E., Valencia, A., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058738 · Cited by 1
What can simulation test beds teach us about social science? Results of the ground truth program
Naugle, A., Krofcheck, D., Warrender, C., Lakkaraju, K., Swiler, L. P., Verzi, S., Emery, B. F., Murdock, J., Bernard, M. L., & Romero, V. (2022) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-021-09349-6 · Cited by 1
“This gives an incredible opportunity to study metascience—the study of science itself (Ossowska and Ossowski 1935; Ioannidis et al. 2015).”
BackgroundETC Distance Learning Studies during COVID-19, a meta-analysis
Dreifuss-Serrano, C., & Herrera, P. C. (2022) · IEEE World Engineering Education Conference (EDUNINE) · doi:10.1109/edunine53672.2022.9782397 · Cited by 1
Schmidt, M. H. M., & Dluzen, D. F. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-817218-6.00012-7 · Cited by 1
Schatzberg, A. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as17 · Cited by 1
Chapter 19. Venlafaxine and Desvenlafaxine
Thase, M. E. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as19 · Cited by 1
Chapter 10. Monoamine Oxidase Inhibitors
Krishnan, K. R. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as10 · Cited by 1
Chapter 39. Carbamazepine, Oxcarbazepine, and Eslicarbazepine
Post, R. M., Wang, P. W., & Ketter, T. A. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as39 · Cited by 1
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0016 · Cited by 1
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0005 · Cited by 1
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0001 · Cited by 1
Characteristics of search methods in dental meta-research studies: a methodological study
Weeber, L., Su, N., & Faggion, C. M. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111693 · Cited by 1
Introduction to the Special Series: Examining the Special Education Research Base
Cook, B. G., & Therrien, W. J. (2025) · Remedial and Special Education · doi:10.1177/07419325251379789 · Cited by 1
“…we briefly review literature regarding concerns regarding QRPs and systematic bias in other fields, the reproducibility crisis in science, and the nascent body of research examining research (i.e., meta-research or meta-science; see Ioannidis et al., 2015) in special education on these issues.”
A mathematical theory of knowledge, science, bias and pseudosciencePreprint
Fanelli, D. (2016) · doi:10.7287/peerj.preprints.1968v1 · Cited by 1
Self-citationResearch on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk7e · Cited by 1
The measurement and definition of self-esteem : meta-research and a new way forward
Pegler, A. (2018) · ePrints Soton (University of Southampton) · Cited by 2
The importance and need of more meta-research studies in medical ethics journals
Faggion, C. M. (2020) · Accountability in Research · doi:10.1080/08989621.2020.1813033 · Cited by 1
PENGARUH PEMBERIAN MADU PADA ANAK YANG MENDERITA DIARE AKUT CAIR DENGAN DEHIDRASI RINGAN SEDANG
Cholid, S. (2010) · Cited by 1
Science Abstract Model Simulation FrameworkPreprint
Abdol, A. M., & Wicherts, J. M. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zy29t · Cited by 1
Patterns of Patterns IIPreprint
Corneli, J., Alhasan, N., Vivier, L., Murphy, A., Puzio, R., Tabor, A., Ayloo, S., Pierce, C., Danoff, C. J., Tedeschi, M., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.08426 · Cited by 1
Testing the Consistency of Performance Scores Reported for Binary Classification ProblemsPreprint
Fazekas, A., & Kovács, G. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.12527 · Cited by 3
Chapter 63. Psychopharmacology During Pregnancy and Lactation
Newport, D. J., di Scalea, T. L., Richardson, E., Smith, T. L., Scott, N. P., & Stowe, Z. N. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as63 · Cited by 2
Chapter 3. Genetics and Epigenetics
Keverne, J., Czamara, D., & Binder, E. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as03 · Cited by 1
The Replication Crisis: A Persistent Challenge in Biomedical Research
Dagli, N., Haque, M., & Kumar, S. (2024) · Bangladesh Journal of Medical Science · doi:10.3329/bjms.v23i4.76503 · Cited by 1
“Meta-research, the study of research itself, has become increasingly important in understanding and addressing the replication crisis 20 .”
BackgroundHyde, B. V. E. (2025) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2025.2559568 · Cited by 1
Better Web Measurements: Enhancing Security and Privacy Research
Demir, N. (2023) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000163503 · Cited by 3
Lessons from Listening to the Voices of Unaccompanied Central American and Mexican Children
Schmidt, S. (2017) · UST Research Online (University of St. Thomas - Minnesota)
A Bayesian Nonparametric Test of Significance-Chasing Biases
Karabatsos, G. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1269
Saad, E. D., & Riechelmann, R. P. (2018) · Springer eBooks · doi:10.1007/978-3-319-71324-3_19
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
Cook, A. (2019) · Clinical Trials · doi:10.1177/1740774519845680
Norms for constructing language in humans and animals
Ullrich, R. C. (2019) · Refubium (Universitätsbibliothek der Freien Universität Berlin) · doi:10.17169/refubium-1665
Devezer, B., Nardin, L. G., Baumgaertner, B. O., & Buzbas, E. O. (2018) · arXiv (Cornell University)
Danko, K. J. (2018) · uO Research (University of Ottawa) · doi:10.20381/ruor-22479 · Cited by 1
“[235] Ioannidis JPA, Fanelli D, Dunne DD, Goodman SN.”
BackgroundGable, G. G., Xie, Y., & Onik, M. F. A. (2017) · Journal of the Association for Information Systems
Hidalgo, E. S. (2019) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · doi:10.6084/m9.figshare.11316851 · Cited by 2
Assessing interventions to improve adherence to reporting guidelines in biomedical research
Blanco, D. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-327395 · Cited by 1
Almgren, H. (2020) · Ghent University Academic Bibliography (Ghent University)
Rosa, P. G. P. (2020) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.5.2020.tde-14092021-152603
Publishing machine actionable reproducible scholarly knowledge
Ganfoud, A. (2021) · Institutional Repository of Leibniz Universität Hannover (Leibniz Universität Hannover) · doi:10.15488/11536
Hints for Meta-research on Ageing for Family Doctors
Veronese, N., & Demurtas, J. (2021) · Practical issues in geriatrics · doi:10.1007/978-3-030-78923-7_27
Jens, M. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736413398.793565114
Replication crisisPreprint
Quang-Loc, N. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/4wd5x
Zhou, Y. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736413398.793564879
Chaires, J. B. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736413398.793564337
Nicolson, D. (2016) · Springer eBooks · doi:10.1007/978-3-319-49190-5_5
Krise der Demokratie - Krise der Wissenschaften?
Österreichischer Wissenschaftstag 2018 Baden, N., Neck, R., Spiel, C., & Böhlau-Verlag (2020) · Böhlau Verlag eBooks · doi:10.7767/9783205233008
Almgren, H., Parsons, N., Bossche, S. V. D., & Marinazzo, D. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/9hg3j
Principles and applications of metaresearch
Harpe, S. E. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91888-6.00038-7
Why is meta-research important for the progress of clinical and applied medical research?Preprint
Helal, L. C. A. S. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/2x3kh
Bennett, M. (2023) · Springer eBooks · doi:10.1007/978-981-19-9240-7_1
(2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78973-899-520191011
Convergencias y divergencias en investigación 1
Fontaines-Ruíz, T., Maza-Córdova, J., Morillo, J. P., & Franco, Y. M. A. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.5281/zenodo.8011866
Avante e a todo vapor, analisando uma década de WPerformance e desempenho computacional no CSBC
Carvalho, L. P., Filho, S. L., Brandão, M. A., Oliveira, J., Santoro, F. M., & da Silva, M. F. (2023) · doi:10.5753/wperformance.2023.230601
“…de desempenho computacional e comunicacional brasileira, pelas suas dinâmicas montamos parte do quebra-cabeça através dos dados, gerando informações e conhecimentos e contribuindo meta-cientificamente com o amadurecimento, memória e cultura do cenário [Ioannidis et al. 2015, Ioannidis 2018].”
BackgroundInfluentialThe role of domain-general and mentalizing processes in spontaneous visual perspective-taking
Pesimena, G. (2022) · Sheffield Hallam University · doi:10.7190/shu-thesis-00522
Measuring review report quality in health research : development and validation of ARCADIA
Superchi, C. (2021) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-360915 · Cited by 1
Need for Open-Science Policies
Hayran, O. (2023) · Journal of Health Systems and Policies · doi:10.52675/jhesp.1372087
Vaudano, E., Georges, J., Ensini, M., & Lo, D. C. (2023) · Frontiers research topics · doi:10.3389/978-2-8325-3870-8
Royo‐Bordonada, M. Á., Damián, J., López, F. J. G., Galan, I., Pérez‐Gómez, B., Sanz‐Barbero, B., Catalá-López, F., Rodríguez‐Artalejo, F., Imaz-Iglesia, I., González-García, J., et al. (2023) · doi:10.4321/repisalud.17538
Measuring review report quality in health research
Superchi, C. (2021) · theses.fr (ABES) · doi:10.70675/78b7b7d3z3b48z4098z84d5z79cd7cc82515
Identifying meta-research with researchers as study subjects: Protocol for a scoping review
Laynor, G., & Stevens, E. R. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303905 · Cited by 1
“As a discipline designed to study research itself and its practices, meta-research is not only multidisciplinary, but is also comparably new [15,16].”
BackgroundAnalysis of the Current Status of COVID-19 Immunology Studies
王, 邦. (2024) · Journal of Clinical Personalized Medicine · doi:10.12677/jcpm.2024.32073
Chapter 62. Treatment of Women Excluding Pregnancy and Postpartum
Duffy, K. A., Nagle-Yang, S. M., & Epperson, C. N. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as62
Desfossés, C. Y., & Blier, P. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as16
Chapter 59. Treatment of Chronic Pain
Key, R. G., & Kroenke, K. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as59
Chapter 15. Trazodone and Nefazodone
Golden, R., Dawkins, K., & Nicholas, L. M. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as15
Chapter 58. Treatment of Insomnia
Krystal, A. D. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as58
Chapter 64. Treatment of Attention-Deficit/Hyperactivity Disorder in Adults
Deckler, E., & Coffey, B. J. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as64
Chapter 13. Sertraline and Paroxetine
Howlett, J. R., & Schatzberg, A. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as13 · Cited by 1
Chapter 61. Treatment During Late Life
Brewster, K., Rutherford, B. R., & Roose, S. P. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as61
Chapter 12. Fluoxetine and Fluvoxamine
Aboujaoude, E. N., Rosenbaum, J. F., Ionescu, D. F., & Koran, L. M. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as12
Chapter 56. Treatment of Personality Disorders
Hollander, E., Vats, T., & Desilva, N. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as56
Chapter 54. Treatment of Substance Use Disorders
Sherman, B. J., Hartwell, K. J., McRae‐Clark, A. L., Herron, A., & Brady, K. T. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as54
Stevenson, K. A., Hamilton, D. V., & Clayton, A. H. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as18
Metadata
- Authors
- Ioannidis, J. P. A., Fanelli, D., Dunne, D. D., & Goodman, S. N.
- Affiliations
- Stanford University (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-02
- Volume
- 13
- Issue
- 10
- Pages
- e1002264
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC4592065
- OpenAlex
- W1767553509
- Cited by
- 495
- References
- 10
- Citations by year
- 2026: 36 · 2025: 48 · 2024: 134 · 2023: 50 · 2022: 37 · 2021: 40 · 2020: 39 · 2019: 28 · 2018: 29 · 2017: 30 · 2016: 22 · 2015: 1
- FWCI
- 24.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Keywords
- meta-research, research practices, research methodology, reproducibility, research reporting, research evaluation, research incentives, research reliability, research efficiency
- MeSH terms
- Animals, Humans, Meta-Analysis as Topic, Guidelines as Topic, Evidence-Based Medicine, Biomedical Research, Empirical Research, Internationality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.