Reproducible Research Practices and Transparency across the Biomedical Literature
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
There is a growing movement to encourage reproducibility and transparency practices in the scientific community, including public access to raw data and protocols, the conduct of replication studies, systematic integration of evidence in systematic reviews, and the documentation of funding and potential conflicts of interest. In this survey, we assessed the current status of reproducibility and transparency addressing these indicators in a random sample of 441 biomedical journal articles published in 2000-2014. Only one study provided a full protocol and none made all raw data directly available. Replication studies were rare (n = 4), and only 16 studies had their data included in a subsequent systematic review or meta-analysis. The majority of studies did not mention anything about funding or conflicts of interest. The percentage of articles with no statement of conflict decreased substantially between 2000 and 2014 (94.4% in 2000 to 34.6% in 2014); the percentage of articles reporting statements of conflicts (0% in 2000, 15.4% in 2014) or no conflicts (5.6% in 2000, 50.0% in 2014) increased. Articles published in journals in the clinical medicine category versus other fields were almost twice as likely to not include any information on funding and to have private funding. This study provides baseline data to compare future progress in improving these indicators in the scientific literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the absence of stringent community norms or regulations, scientific claims are regularly published without public release of the research data upon which they are based [7,9,14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the literature contains studies with questionable methodologies, missing or incomplete data, false or exaggerated effect measures, and many studies do not mention funding or potential conflicts of interest [4–8].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, assessment of analytic reproducibility is typically precluded by poor access to research data [7–14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationEstimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Self-citationPharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Replication validity of genetic association studies
Ioannidis, J. P. A., Ntzani, E. E., Trikalinos, T. A., & Contopoulos-Ioannidis, D. G. (2001) · Nature Genetics · doi:10.1038/ng749 · Cited by 1,832
Self-citationScope and Impact of Financial Conflicts of Interest in Biomedical Research: A Systematic Review
Bekelman, J. E., Li, Y., & Gross, C. P. (2003) · JAMA · doi:10.1001/jama.289.4.454 · Cited by 1,816
Increasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Self-citationReproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Cited by
Items 101–200 of 310
A consensus privacy metrics framework for synthetic data
Pilgram, L., Dankar, F. K., Drechsler, J., Elliot, M. J., Domingo‐Ferrer, J., Francis, P., Kantarcıoğlu, M., Kong, L., Malin, B., Muralidhar, K., et al. (2025) · Patterns · doi:10.1016/j.patter.2025.101320 · Cited by 45
Industry-funded versus non-profit-funded critical care research: a meta-epidemiological overview
Janiaud, P., Cristea, I. A., & Ioannidis, J. P. A. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5325-3 · Cited by 28
Self-citationSchofield, P. N., Kulka, U., Tapio, S., & Grosche, B. (2019) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1589026 · Cited by 24
Running an open experiment: transparency and reproducibility in soil and ecosystem science
Bond‐Lamberty, B., Smith, A. P., & Bailey, V. (2016) · Environmental Research Letters · doi:10.1088/1748-9326/11/8/084004 · Cited by 23
Walters, C. G., Harter, Z. J., Wayant, C., Vo, N. H., Warren, M., Chronister, J., Tritz, D., & Vassar, M. B. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-033962 · Cited by 24
Data sharing practices of health researchers in Africa: a scoping review protocol
Obiora, O. L., Olivier, B., Shead, D. A., & Withers, A. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00502 · Cited by 23
Increase value and reduce waste in research on psychological therapies
Cristea, I. A., & Naudet, F. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103479 · Cited by 22
Inclusivity in stereoscopic XR: Human vision first
Pladere, T., Svarverud, E., Krūmiņa, G., Gilson, S. J., & Baraas, R. C. (2022) · Frontiers in Virtual Reality · doi:10.3389/frvir.2022.1006021 · Cited by 25
A data-driven approach for evaluating multi-modal therapy in traumatic brain injury
Haefeli, J., Ferguson, A. R., Bingham, D., Orr, A., Won, S. J., Lam, T. I., Shi, J., Hawley, S., Liu, J., Swanson, R. A., et al. (2017) · Scientific Reports · doi:10.1038/srep42474 · Cited by 25
McKeigue, P. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280218776989 · Cited by 22
Raising the bar: improving methodological rigour in cognitive alcohol research
Pennington, C. R., Jones, A., Bartlett, J. E., Copeland, A., & Shaw, D. J. (2021) · Addiction · doi:10.1111/add.15563 · Cited by 25
The availability of raw data in substance abuse scientific journals
Vidal‐Infer, A., Aleixandre‐Benavent, R., Lucas-Domínguez, R., & Sixto-Costoya, A. (2018) · Journal of Substance Use · doi:10.1080/14659891.2018.1489905 · Cited by 23
Evaluating the Utility and Privacy of Synthetic Breast Cancer Clinical Trial Data Sets
Kababji, S. E., Mitsakakis, N., Fang, X., Beltran-Bless, A.-A., Pond, G. R., Vandermeer, L., Radhakrishnan, D., Mosquera, L., Paterson, A. H. G., Shepherd, L. E., et al. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.23.00116 · Cited by 32
Estradiol does not affect spasms in the betamethasone‐ NMDA rat model of infantile spasms
Chachua, T., Grazia, P. D., Chern, C., Johnkutty, M., Hellman, B., Lau, H. A., Shakil, F., Daniel, M., Goletiani, C. J., Velı́šková, J., et al. (2016) · Epilepsia · doi:10.1111/epi.13434 · Cited by 20
Open Science Practices in Gambling Research Publications (2016–2019): A Scoping Review
Louderback, E. R., Gainsbury, S., Heirene, R. M., Amichia, K., Grossman, A., Bernhard, B. J., & LaPlante, D. A. (2022) · Journal of Gambling Studies · doi:10.1007/s10899-022-10120-y · Cited by 22
An analysis of key indicators of reproducibility in radiology
Wright, B., Vo, N. H., Nolan, J., Johnson, A., Braaten, T., Tritz, D., & Vassar, M. B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00870-x · Cited by 19
Methodology reporting improved over time in 176,469 randomized controlled trials
Kilicoglu, H., Jiang, L., Hoang, L., Mayo-Wilson, E., Vinkers, C. H., & Otte, W. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.08.004 · Cited by 19
Signaling Targets Related to Antiobesity Effects of Capsaicin: A Scoping Review
Ávila, D. L., Nunes, N. A. M., Almeida, P. H. R. F., Gomes, J. D. A. S., Rosa, C. D. O. B., & Alvarez-Leite, J. I. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab064 · Cited by 20
Pathways to breast cancer screening artificial intelligence algorithm validation
Lee, C. I., Houssami, N., Elmore, J. G., & Buist, D. S. M. (2019) · The Breast · doi:10.1016/j.breast.2019.09.005 · Cited by 26
Vibration of effects in epidemiologic studies of alcohol consumption and breast cancer risk
Chu, L., Ioannidis, J. P. A., Egilman, A. C., Vasiliou, V., Ross, J. S., & Wallach, J. D. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz271 · Cited by 23
Self-citationAI Slipping on Tiles: Data Leakage in Digital Pathology
Bussola, N., Marcolini, A., Maggio, V., Jurman, G., & Furlanello, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68763-2_13 · Cited by 66
The logical structure of experiments lays the foundation for a theory of reproducibility
Buzbas, E. O., Devezer, B., & Baumgaertner, B. O. (2023) · Royal Society Open Science · doi:10.1098/rsos.221042 · Cited by 26
A quick guide for using Microsoft OneNote as an electronic laboratory notebook
Guerrero, S. X., López‐Cortés, A., García-Cárdenas, J. M., Saa, P., Indacochea, A., Armendáriz‐Castillo, I., Zambrano, A. K., Yumiceba, V., Pérez‐Villa, A., Guevara‐Ramírez, P., et al. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006918 · Cited by 22
Payne, P., Lele, O., Johnson, B. H., & Holve, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6937 · Cited by 20
Opening GIScience: A process-based approach
Shannon, J., & Walker, K. E. (2018) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2018.1464167 · Cited by 18
A meta-epidemiological assessment of transparency indicators of infectious disease models
Zavalis, E. A., & Ioannidis, J. P. A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275380 · Cited by 19
Self-citationMapping the characteristics of meta-analyses of pharmacy services: a systematic review
Bonetti, A. D. F., Rocca, A. M. D., Lucchetta, R. C., Tonin, F. S., Fernández-Llimós, F., & Pontarolo, R. (2020) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-020-01058-5 · Cited by 17
Meta-Research: Broadening the Scope of PLOS Biology
Kousta, S. T., Ferguson, C., & Ganley, E. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002334 · Cited by 18
Spires‐Jones, T. L., Poirazi, P., & Grubb, M. S. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13234 · Cited by 17
Jiang, L., Lan, M., Menke, J. D., Vorland, C. J., & Kilicoglu, H. (2024) · Scientific Reports · doi:10.1038/s41598-024-72130-7 · Cited by 18
White paper: statement on conflicts of interest
Bion, J., Antonelli, M. M., Blanch, L. L., Curtis, J. R., Druml, C., Du, B., Machado, F. R., Gomersall, C. D., Hartog, C. S., Levy, M. M., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5349-8 · Cited by 19
Samota, E. K., & Davey, R. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.678554 · Cited by 23
Bullock, G. S., Ward, P., Impellizzeri, F. M., Kluzek, S., Hughes, T., Hillman, C., Waterman, B. R., Danelson, K., Henry, K., Barr, E., et al. (2023) · Journal of Orthopaedic & Sports Physical Therapy · doi:10.2519/jospt.2023.12016 · Cited by 15
Why Study the History of Neuroscience?
Brown, R. E. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00082 · Cited by 20
Kedron, P., Holler, J., & Bardin, S. (2023) · Annals of the American Association of Geographers · doi:10.1080/24694452.2023.2276115 · Cited by 15
Kababji, S. E., Mitsakakis, N., Jonker, E., Beltran-Bless, A.-A., Pond, G. R., Vandermeer, L., Radhakrishnan, D., Mosquera, L., Paterson, A. H. G., Shepherd, L. E., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/66821 · Cited by 19
Carlson, J. J., Walton, S. M., Basu, A., Chapman, R. H., Campbell, J. D., McQueen, R. B., Pearson, S. D., Touchette, D. R., Veenstra, D. L., Whittington, M. D., et al. (2019) · PharmacoEconomics · doi:10.1007/s40273-019-00832-2 · Cited by 14
Lubega, N., Anderson, A., & Nelson, N. C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0293584 · Cited by 16
Sanders, S., Rathbone, J., Bell, K., Glasziou, P., & Doust, J. A. (2017) · Diagnostic and Prognostic Research · doi:10.1186/s41512-017-0013-2 · Cited by 15
Money back guarantees for non-reproducible results?
Topol, E. J. (2016) · BMJ · doi:10.1136/bmj.i2770 · Cited by 15
FAIR Data and Software: Improving Efficiency and Quality of Biocatalytic Science
Pleiss, J. (2024) · ACS Catalysis · doi:10.1021/acscatal.3c06337 · Cited by 13
Wu, K. L., Chen, C., Moyzis, R. K., Greenberger, E., & Yu, Z. (2016) · Human Nature · doi:10.1007/s12110-016-9257-8 · Cited by 17
The New Age of -omics in Urothelial Cancer – Re-wording Its Diagnosis and Treatment
Κάτσιλα, Θ., Liontos, M., Patrinos, G. P., Bamias, A., & Kardamakis, D. M. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2018.01.044 · Cited by 13
Equity Gaps in Education: Nine Points toward More Transparency
Ziegler, A., Kuo, C.-C., Eu, S., Gläser‐Zikuda, M., Nuñez, M., Yu, H.-P., & Harder, B. (2021) · Education Sciences · doi:10.3390/educsci11110711 · Cited by 17
Use FlowRepository to share your clinical data upon study publication
Špidlen, J., & Brinkman, R. R. (2016) · Cytometry Part B Clinical Cytometry · doi:10.1002/cyto.b.21393 · Cited by 13
Big Data: Challenge and Opportunity for Translational and Industrial Research in Healthcare
Rossi, R. L., & Grifantini, R. (2018) · Frontiers in Digital Humanities · doi:10.3389/fdigh.2018.00013 · Cited by 16
An assessment of transparency and reproducibility‐related research practices in otolaryngology
Johnson, A., Torgerson, T., Skinner, M., Hamilton, T., Tritz, D., & Vassar, M. B. (2019) · The Laryngoscope · doi:10.1002/lary.28322 · Cited by 14
Valdez, J., Kim, M. J., Rueschman, M., Socrates, V., Redline, S. S., & Sahoo, S. S. (2017) · PubMed · Cited by 17
Desai, K. R., Carroll, I. R., Asch, S. M., Hernandez‐Boussard, T., & Ioannidis, J. P. A. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.012 · Cited by 12
Self-citationXiarchos, I., Morozinis, A. K., Kavouras, P., & Charitidis, C. A. (2020) · Small · doi:10.1002/smll.202001590 · Cited by 12
Chiriboga, L. A., Callis, G. M., Wang, Y., & Chlipala, E. A. (2022) · Journal of Histotechnology · doi:10.1080/01478885.2022.2134022 · Cited by 14
NuRsing Research in the 21st Century: R You Ready?
Wright, M. L., Higgins, M. K., Taylor, J. Y., & Hertzberg, V. (2018) · Biological Research For Nursing · doi:10.1177/1099800418810514 · Cited by 11
Hamilton, D. G., Fraser, H. S., Fidler, F. M., McDonald, S. J., Rowhani-Farid, A., Hong, K., & Page, M. J. (2021) · F1000Research · doi:10.12688/f1000research.53874.2 · Cited by 10
Munro, B. A., Bergen, P., & Pang, D. (2021) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2021.09.004 · Cited by 11
Openness and Computational Reproducibility in Plant Pathology: Where We Stand and a Way Forward
Sparks, A., Ponte, E. M. D., Alves, K. S., Foster, Z., & Grünwald, N. J. (2023) · Phytopathology · doi:10.1094/phyto-10-21-0430-per · Cited by 11
Meta-analyses in environmental and occupational health
Ioannidis, J. P. A. (2018) · Occupational and Environmental Medicine · doi:10.1136/oemed-2016-104128 · Cited by 12
Self-citationMethodological quality and risk of bias of meta-analyses of pharmacy services: A systematic review
Bonetti, A. D. F., Tonin, F. S., Rocca, A. M. D., Lucchetta, R. C., Fernández-Llimós, F., & Pontarolo, R. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.12.011 · Cited by 15
Biomedical supervisors’ role modeling of open science practices
Haven, T. L., Abunijela, S., & Hildebrand, N. (2023) · eLife · doi:10.7554/elife.83484 · Cited by 14
Nine quick tips for open meta-analyses
Moreau, D., & Wiebels, K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012252 · Cited by 12
Promoting Data Sharing: The Moral Obligations of Public Funding Agencies
Wendelborn, C., Anger, M., & Schickhardt, C. (2024) · Science and Engineering Ethics · doi:10.1007/s11948-024-00491-3 · Cited by 14
Reproducing Epidemiologic Research and Ensuring Transparency
Coughlin, S. S. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx065 · Cited by 10
Can You Repeat That? Exploring the Definition of a Successful Model Replication in Health Economics
McManus, E., Turner, D., & Sach, T. (2019) · PharmacoEconomics · doi:10.1007/s40273-019-00836-y · Cited by 13
Fladie, I. A., Adewumi, M. T., Vo, N. H., Tritz, D., & Vassar, M. B. (2019) · Kidney International Reports · doi:10.1016/j.ekir.2019.11.001 · Cited by 11
The use and abuse of meta‐analysis
Sotiriadis, A., Chatzakis, C., & Odibo, A. O. (2020) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.22060 · Cited by 9
Ioannidis, J. P. A. (2019) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-019-09621-y · Cited by 10
Self-citationMassen, G. M., Stone, P., Kwok, H. H. Y., Jenkins, G. R., Allen, R. J., Wain, L. V., Stewart, I. D., & Quint, J. K. (2024) · Open Heart · doi:10.1136/openhrt-2024-002640 · Cited by 9
Mukhtar, A., Hadwiger, M., Wotawa, F., & Schweiger, G. (2025) · Energy and AI · doi:10.1016/j.egyai.2025.100658 · Cited by 17
Hankenson, F. C., Prager, E. M., & Berridge, B. R. (2024) · Annual Review of Animal Biosciences · doi:10.1146/annurev-animal-021022-043531 · Cited by 10
Why published research is untrustworthy
Lose, G., & Klarskov, N. (2017) · International Urogynecology Journal · doi:10.1007/s00192-017-3389-1 · Cited by 10
ReScience C: A Journal for Reproducible Replications in Computational Science
Rougier, N. P., & Hinsen, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23987-9_14 · Cited by 9
Critical Assessment of Surveys in Plastic and Reconstructive Surgery: A Systematic Review
Chung, W. H. J., Gudal, R. A., Nasser, J. S., & Chung, K. C. (2019) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000006101 · Cited by 9
Kemper, J. M., Rolnik, D. L., Mol, B. W., & Ioannidis, J. P. A. (2020) · Fertility and Sterility · doi:10.1016/j.fertnstert.2020.05.020 · Cited by 10
Self-citationFish, L. A., & Jones, E. J. H. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245793 · Cited by 13
Russo, F., Righelli, D., & Angelini, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-44332-4_19 · Cited by 12
Costa, V., Righelli, D., Russo, F., Berardinis, P. D., Angelini, C., & D’Apice, L. (2017) · International Journal of Molecular Sciences · doi:10.3390/ijms18030494 · Cited by 9
The Sharing of Research Data in the Cell & Tissue Engineering Area: Is It a Common Practice?
Aleixandre‐Benavent, R., Lucas-Domínguez, R., Sixto-Costoya, A., & Vidal‐Infer, A. (2018) · Stem Cells and Development · doi:10.1089/scd.2018.0036 · Cited by 10
Transparency in surgical randomized clinical trials: cross-sectional observational study
Helliwell, J. A., Shelton, B., Mahmood, H., Blanco-Colino, R., Fitzgerald, J. E., Harrison, E. M., Bhangu, A., & Chapman, S. J. (2020) · BJS Open · doi:10.1002/bjs5.50333 · Cited by 9
Guidelines for Science: Evidence and ChecklistsPreprint
Armstrong, J. S., & Green, K. C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3055874 · Cited by 15
Carvalho, R. M., de Magalhães‐Barbosa, M. C., Bianchi, L. M., Rodrigues-Santos, G., da Cunha, A. J. L. A., Bastos, F. I., & Prata‐Barbosa, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-44533-5 · Cited by 10
Un-biased housekeeping gene panel selection for high-validity gene expression analysis
Casas, A. I., Hassan, A., Manz, Q., Wiwie, C., Kleikers, P. W. M., Egea, J., López, M. G., List, M., Baumbach, J., & Schmidt, H. H. H. W. (2022) · Scientific Reports · doi:10.1038/s41598-022-15989-8 · Cited by 12
Few randomized trials in preterm birth prevention meet predefined usefulness criteria
Hooft, J. V. ’., van Dijk, C. E., Axfors, C., Alfirević, Ž., Oudijk, M. A., Mol, B. W., Bossuyt, P. M., & Ioannidis, J. P. A. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.08.016 · Cited by 9
Self-citationMeta-analyses of diagnostic test accuracy could not be reproduced
Stegeman, I., & Leeflang, M. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.06.033 · Cited by 8
Transparent and Reproducible Research Practices in the Surgical Literature
Hughes, T., Niemann, A., Tritz, D., Boyer, K., Robbins, H. I., & Vassar, M. B. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2021.09.024 · Cited by 8
Li, S., Litvin, V., & Manski, C. F. (2022) · Epidemiology · doi:10.1097/ede.0000000000001593 · Cited by 15
Mirnics, Z., Hittner, J. B., Swickert, R., & Kövi, Z. (2022) · Journal of Health Psychology · doi:10.1177/1359105320946389 · Cited by 7
Avaliação da resposta inicial de desenvolvimento de ensaios clínicos para COVID-19 no Brasil
Ribeiro, T. B., Mazotti, T. A., Silva, N. A. D. O., Stein, A. T., Díaz-Quijano, F. A., & de Melo, D. O. (2020) · Revista Brasileira de Epidemiologia · doi:10.1590/1980-549720200104 · Cited by 7
Muthusi, J., Mwalili, S. M., & Young, P. W. (2019) · PLoS ONE · doi:10.1371/journal.pone.0214262 · Cited by 7
Igumbor, J. O., Bosire, E. N., Vicente-Crespo, M., Igumbor, E. U., Olalekan, U. A., Chirwa, T. F., Kinyanjui, S., Kyobutungi, C. K., & Fonn, S. (2021) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17000.1 · Cited by 9
Promoção de Transparência e Impacto da Pesquisa em Negócios
Mendes‐Da‐Silva, W. (2018) · Revista de Administração Contemporânea · doi:10.1590/1982-7849rac2018180210 · Cited by 10
Measuring and interpreting pervasive heterogeneity, poikilosis
Vihinen, M. (2021) · FASEB BioAdvances · doi:10.1096/fba.2021-00015 · Cited by 6
On the performance comparison of diagnostic techniques in machine monitoring
Pancaldi, F., Rubini, R., & Cocconcelli, M. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110872 · Cited by 6
Nanomaterial Ontologies for Nanosafety: A Rose by any Other Name
Valsami‐Jones, E. (2016) · Journal of Nanomedicine Research · doi:10.15406/jnmr.2016.03.00070 · Cited by 6
Smith, C. J., & Perfetti, T. A. (2019) · Toxicology Research and Application · doi:10.1177/2397847318822137 · Cited by 6
Evidence-Based Research in Nursing Science: A Reproducible Framework
Choi, S. (2020) · Western Journal of Nursing Research · doi:10.1177/0193945920977792 · Cited by 6
Fanelli, D. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0004 · Cited by 7
López‐Nicolás, R., López-López, J. A., Rubio‐Aparicio, M., & Sánchez‐Meca, J. (2021) · doi:10.31234/osf.io/dz8cm · Cited by 6
Assessing transparency practices in dental randomized controlled trials
Prado, M. C., Dotto, L., Agostini, B., & Sarkis-Onofre, R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02316-0 · Cited by 6
Mining Biomedical Publications With The LAPPS Grid
Ide, N., Suderman, K., & Kim, J.-D. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/328h4vy5y3tj · Cited by 5
Transparency in Infectious Disease Research: Meta-research Survey of Specialty Journals
Zavalis, E. A., Contopoulos‐Ioannidis, D. G., & Ioannidis, J. P. A. (2023) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiad130 · Cited by 7
Self-citationTransparency of research practices in cardiovascular literature
Heckerman, G. O., Tzng, E., Campos-Melendez, A., Ekwueme, C., & Mueller, A. L. (2025) · eLife · doi:10.7554/elife.81051 · Cited by 4
Metadata
- Authors
- Iqbal, S. A., Wallach, J. D., Khoury, M. J., Schully, S. D., & Ioannidis, J. P. A.
- Affiliations
- Emory University (US)
- Stanford Medicine (US)
- Centers for Disease Control and Prevention (US)
- National Institutes of Health (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-01-04
- Volume
- 14
- Issue
- 1
- Pages
- e1002333
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC4699702
- OpenAlex
- W2228927609
- Cited by
- 310
- References
- 41
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 19 · 2023: 26 · 2022: 19 · 2021: 38 · 2020: 33 · 2019: 40 · 2018: 42 · 2017: 31 · 2016: 33
- FWCI
- 92.66
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS Biology (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- reproducibility, research transparency, biomedical literature, data availability, raw data sharing, replication study, systematic reviews, funding disclosure, conflicts of interest
- MeSH terms
- Periodicals as Topic, Reproducibility of Results, Conflict of Interest, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

