Making Prospective Registration of Observational Research a Reality
Open accessAbstract
Key information about human observational studies should be publicly available before the study is initiated.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Protocol registration is applicable to and recommended for all studies and is supported by various platforms, such as the Open Science Framework.
“However, protocol registration is applicable to and recommended for all studies and is supported by various platforms, such as the Open Science Framework [3, 29, 35–37].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [35]
Cites
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363 · see citing works
Self-citationWhy Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · see citing works
Self-citationWorld Medical Association Declaration of Helsinki
Spiegel, R. (2003) · Psychopharmacology · doi:10.1002/047086947x.oth1 · Cited by 1,336 · see citing works
Observational research, randomised trials, and two views of medical science
Vandenbroucke, J. P. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050067 · Cited by 416 · see citing works
Public Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · see citing works
Self-citationClinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
Angelis, C. D. D., Drazen, J. M., Frizelle, F., Haug, C. J., Hoey, J., Horton, R., Kotzin, S., Laine, C. M., Marušić, A., Overbeke, A. J. P. M., et al. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-6-200409210-00109 · Cited by 264 · see citing works
International Ethical Guidelines for Epidemiological Studies
Rose, S. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp334 · Cited by 238 · see citing works
Krleža-Jerić, K., Chan, A., Dickersin, K., Sim, I., Grimshaw, J., & Gluud, C. N. (2005) · BMJ · doi:10.1136/bmj.330.7497.956 · Cited by 236 · see citing works
Self-citationDeming, Data and Observational Studies
Young, S. S., & Karr, A. F. (2011) · Significance · doi:10.1111/j.1740-9713.2011.00506.x · Cited by 235 · see citing works
Issues in the Registration of Clinical Trials
Zarin, D. A., Ide, N. C., Tse, T., Harlan, W. R., West, J. C., & Lindberg, D. A. B. (2007) · JAMA · doi:10.1001/jama.297.19.2112 · Cited by 228 · see citing works
False-Positive Results in Cancer Epidemiology: A Plea for Epistemological Modesty
Boffetta, P., McLaughlin, J. K., Vecchia, C. L., Tarone, R. E., Lipworth, L., & Blot, W. J. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn191 · Cited by 199 · see citing works
All trials must be registered and the results published
Chalmers, I., Glasziou, P., & Godlee, F. (2013) · BMJ · doi:10.1136/bmj.f105 · Cited by 131 · see citing works
Transforming Epidemiology for 21st Century Medicine and Public Health
Khoury, M. J., Lam, T. K., Ioannidis, J. P. A., Hartge, P., Spitz, M. R., Buring, J. E., Chanock, S. J., Croyle, R. T., Goddard, K. A., Ginsburg, G. S., et al. (2013) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-13-0146 · Cited by 119 · see citing works
Self-citationSelection in Reported Epidemiological Risks: An Empirical Assessment
Kavvoura, F. K., Liberopoulos, G., & Ioannidis, J. P. A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040079 · Cited by 114 · see citing works
Self-citationWHO facilitates international collaboration in setting standards for clinical trial registration
Gülmezoglu, A. M., Pang, T., Horton, R. C., & Dickersin, K. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66589-0 · Cited by 105 · see citing works
The Value of Statistical Analysis Plans in Observational Research
Thomas, L. E., & Peterson, E. D. (2012) · JAMA · doi:10.1001/jama.2012.9502 · Cited by 104 · see citing works
Ioannidis, J. P. A. (2012) · JAMA · doi:10.1001/jama.2012.8144 · Cited by 74 · see citing works
Self-citationShould protocols for observational research be registered?
Lancet, T. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60148-1 · Cited by 72 · see citing works
The Registration of Observational Studies—When Metaphors Go Bad
(2010) · Epidemiology · doi:10.1097/ede.0b013e3181eafbcf · Cited by 56 · see citing works
False positive outcomes and design characteristics in occupational cancer epidemiology studies.
Swaen, G., Teggeler, O., & van Amelsvoort, L. V. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.5.948 · Cited by 52 · see citing works
Deming, data and observational studies: A process out of control and needing fixing
Young, S. S., & Karr, A. F. (2013) · Quality Engineering · Cited by 43 · see citing works
Epidemiology, Data Sharing, and the Challenge of Scientific Replication
Hernán, M. Á., & Wilcox, A. J. (2009) · Epidemiology · doi:10.1097/ede.0b013e318196784a · Cited by 35 · see citing works
Preregistration of Epidemiologic Studies
Vandenbroucke, J. P. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181e942b8 · Cited by 32 · see citing works
Lash, T. L. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181e9bba6 · Cited by 29 · see citing works
Preregistration of Epidemiology Protocols
Bracken, M. B. (2011) · Epidemiology · doi:10.1097/ede.0b013e318207fc7c · Cited by 26 · see citing works
Self-citationRegistering observational research: second thoughts
Vandenbroucke, J. P. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60437-0 · Cited by 23 · see citing works
To Register or Not To Register
Samet, J. M. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181e9be54 · Cited by 15 · see citing works
Bracken, M. B., Baker, D., Cauley, J. A., Chambers, C., Culhane, J. F., Dabelea, D., Dearborn, D., Drews‐Botsch, C., Dudley, D. J., Durkin, M. S., et al. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws408 · Cited by 15 · see citing works
Self-citationCommentary: Prior specification of hypotheses: cause or just a correlate of informative studies?
Savitz, D. A. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.5.957 · Cited by 14 · see citing works
Health-care needs of people affected by conflict
Deribe, K. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60436-9 · Cited by 9 · see citing works
Registration of Observational Studies Does Not Enhance Validity
Savitz, D. A. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.199 · Cited by 9 · see citing works
Clinical Observational Research on Alzheimer's Disease: What Clinical Trial Registries Can Tell
Dal‐Ré, R., Fauria, K., Gramunt, N., & Molinuevo, J. L. (2013) · Journal of Alzheimer s Disease · doi:10.3233/jad-121525 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · see citing works
Self-citationBelbasis, L., Bellou, V., Εvangelou, Ε., Ioannidis, J. P. A., & Tzoulaki, I. (2015) · The Lancet Neurology · doi:10.1016/s1474-4422(14)70267-4 · Cited by 669 · see citing works
Self-citationEvidence Relating Health Care Provider Burnout and Quality of Care
Tawfik, D. S., Scheid, A., Profit, J., Shanafelt, T. D., Trockel, M., Adair, K. C., Sexton, J. B., & Ioannidis, J. P. A. (2019) · Annals of Internal Medicine · doi:10.7326/m19-1152 · Cited by 555 · see citing works
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471 · see citing works
Self-citationTransparency, Reproducibility, and the Credibility of Economics Research
Christensen, G., & Miguel, E. A. (2018) · Journal of Economic Literature · doi:10.1257/jel.20171350 · Cited by 448 · see citing works
Swedberg, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.002 · Cited by 408 · see citing works
Köhler, C. A., Evangelou, E., Stubbs, B., Solmi, M., Veronese, N., Belbasis, L., Bortolato, B., Melo, M. C. A., Coelho, C. A., Fernandes, B. S., et al. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.05.020 · Cited by 302 · see citing works
Self-citationTsai, A. C., & Burns, B. F. O. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.06.024 · Cited by 227 · see citing works
“…-- based on theoretical models or previously published empirical findings -- about excluding certain product terms from the regression models (thereby reducing the degrees of freedom), and prospectively registering their analysis plans in the interest of transparency (Dal-Re et al., 2014).”
Backgroundp-Curve and p-Hacking in Observational Research
Bruns, S. B., & Ioannidis, J. P. A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149144 · Cited by 210 · see citing works
Self-citationIs animal research sufficiently evidence based to be a cornerstone of biomedical research?
Pound, P., & Bracken, M. B. (2014) · BMJ · doi:10.1136/bmj.g3387 · Cited by 207 · see citing works
Self-citationGiannakou, K., Εvangelou, Ε., & Papatheodorou, S. (2017) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.18959 · Cited by 204 · see citing works
Reducing bias, increasing transparency and calibrating confidence with preregistration
Hardwicke, T. E., & Wagenmakers, E. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01497-2 · Cited by 190 · see citing works
Waste, Leaks, and Failures in the Biomarker Pipeline
Ioannidis, J. P. A., & Bossuyt, P. M. (2017) · Clinical Chemistry · doi:10.1373/clinchem.2016.254649 · Cited by 172 · see citing works
Self-citationPeat, G., Riley, R. D., Croft, P. R., Morley, K. I., Kyzas, P., Moons, K. G. M., Perel, P., Steyerberg, E. W., Schroter, S., Altman, D. G., et al. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001671 · Cited by 152 · see citing works
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 135 · see citing works
Spillover effects in epidemiology: parameters, study designs and methodological considerations
Benjamin‐Chung, J., Arnold, B. F., Berger, D., Luby, S. P., Miguel, E. A., Colford, J. M., & Hubbard, A. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyx201 · Cited by 116 · see citing works
How to make more published research true
Ioannidis, J. P. A. (2015) · Acimed · Cited by 115 · see citing works
Self-citationPlacing epidemiological results in the context of multiplicity and typical correlations of exposures
Patel, C. J., & Ioannidis, J. P. A. (2014) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-204195 · Cited by 110 · see citing works
Self-citationReproducibility and replicability: opportunities and challenges for geospatial research
Kedron, P., Li, W., Fotheringham, S., & Goodchild, M. (2021) · International Journal of Geographical Information Science · doi:10.1080/13658816.2020.1802032 · Cited by 108 · see citing works
Trepanowski, J. F., & Ioannidis, J. P. A. (2018) · Advances in Nutrition · doi:10.1093/advances/nmy014 · Cited by 106 · see citing works
Self-citationCalibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98 · see citing works
Self-citationMeta-analyses including non-randomized studies of therapeutic interventions: a methodological review
Faber, T., Ravaud, P., Riveros, C., Perrodeau, É., & Dechartres, A. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0136-0 · Cited by 101 · see citing works
Assessing Value in Biomedical Research
Ioannidis, J. P. A., & Khoury, M. J. (2014) · JAMA · doi:10.1001/jama.2014.6932 · Cited by 91 · see citing works
Self-citationSurvey of open science practices and attitudes in the social sciences
Ferguson, J., Littman, R., Christensen, G., Paluck, E. L., Swanson, N., Wang, Z., Miguel, E. A., Birke, D. J., & Pezzuto, J.-H. (2023) · Nature Communications · doi:10.1038/s41467-023-41111-1 · Cited by 86 · see citing works
Differential Globalization of Industry- and Non-Industry–Sponsored Clinical Trials
Atal, I., Trinquart, L., Porcher, R., & Ravaud, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0145122 · Cited by 78 · see citing works
Improving reproducibility by using high-throughput observational studies with empirical calibration
Schuemie, M. J., Ryan, P. B., Hripcsak, G., Madigan, D., & Suchard, M. A. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0356 · Cited by 74 · see citing works
Hörnell, A., Berg, C., Forsum, E., Larsson, C. L., Sonestedt, E., Åkesson, A., Lachat, C. K., Hawwash, D., Kolsteren, P. W., Byrnes, G. B., et al. (2017) · Advances in Nutrition · doi:10.3945/an.117.015941 · Cited by 73 · see citing works
Improving transparency in observational social science research: A pre-analysis plan approach
Burlig, F. (2018) · Economics Letters · doi:10.1016/j.econlet.2018.03.036 · Cited by 63 · see citing works
Significance chasing in research practice: causes, consequences and possible solutions
Ware, J. J., & Munafo, M. R. (2014) · Addiction · doi:10.1111/add.12673 · Cited by 58 · see citing works
Censoring Trace-Level Environmental Data: Statistical Analysis Considerations to Limit Bias
George, B. J., Gains-Germain, L., Broms, K., Black, K., Furman, M., Hays, M. D., Thomas, K., & Simmons, J. E. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.0c02256 · Cited by 56 · see citing works
Registration practices for observational studies on ClinicalTrials.gov indicated low adherence
Boccia, S., Rothman, K. J., Panić, N., Flacco, M. E., Rosso, A., Pastorino, R., Manzoli, L., Vecchia, C. L., Villari, P., Boffetta, P., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.009 · Cited by 53 · see citing works
Self-citationTransparency, Reproducibility, and the Credibility of Economics ResearchPreprint
Christensen, G., & Miguel, E. A. (2017) · doi:10.31222/osf.io/9a3rw · Cited by 57 · see citing works
Laskowski, T. J., Caeneghem, Y. V., Pourebrahim, R., Ma, C., Ni, Z., Garate, Z., Crane, A. M., Li, X. S., Liao, W., Gonzalez‐Garay, M. L., et al. (2016) · Stem Cell Reports · doi:10.1016/j.stemcr.2016.06.003 · Cited by 48 · see citing works
The limitations of observation studies for decision making regarding drugs efficacy and safety
Gueyffier, F., & Cucherat, M. (2018) · Therapies · doi:10.1016/j.therap.2018.11.001 · Cited by 48 · see citing works
DEBATE-statistical analysis plans for observational studies
Hiemstra, B., Keus, F., Wetterslev, J., Gluud, C. N., & van der Horst, I. C. C. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0879-5 · Cited by 48 · see citing works
Mahajan, R., Burza, S., Bouter, L. M., Sijtsma, K., Knottnerus, J. A., Kleijnen, J., Dael, P. V., & Zeegers, M. P. (2020) · JMIR Research Protocols · doi:10.2196/17864 · Cited by 38 · see citing works
Improving the transparency and reliability of observational studies through registration
Naudet, F., Patel, C. J., DeVito, N., Goff, G. L., Cristea, I. A., Braillon, A., & Hoffmann, S. (2024) · BMJ · doi:10.1136/bmj-2023-076123 · Cited by 33 · see citing works
Kappenman, E. S., & Keil, A. (2016) · Psychophysiology · doi:10.1111/psyp.12787 · Cited by 33 · see citing works
Prevention of selective outcome reporting: let us start from the beginning
Dal‐Ré, R., & Marušić, A. (2016) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-016-2112-3 · Cited by 32 · see citing works
Self-citationTransparency, Reproducibility, and the Credibility of Economics Research
Christensen, G., & Miguel, E. A. (2016) · National Bureau of Economic Research · doi:10.3386/w22989 · Cited by 30 · see citing works
Wong, E. K., Lachance, C. C., Page, M. J., Watt, J. A., Veroniki, A. A., Straus, S. E., & Tricco, A. C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031138 · Cited by 29 · see citing works
Faust, A., Sierawska, A. K., Krüger, K., Wisgalla, A., Hasford, J., & Strech, D. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00666-8 · Cited by 29 · see citing works
Pre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 30 · see citing works
Baudart, M., Ravaud, P., Baron, G., Dechartres, A., Haneef, R., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0551-4 · Cited by 27 · see citing works
A non-contrast CMR index for assessing myocardial fibrosis
Yin, Q., Abendschein, D. R., Muccigrosso, D., O'Connor, R. A., Goldstein, T., Chen, R., & Zheng, J. (2017) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2017.04.012 · Cited by 25 · see citing works
Reproducible and transparent research practices in published neurology research
Rauh, S. L., Torgerson, T., Johnson, A., Pollard, J., Tritz, D., & Vassar, M. B. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-0091-5 · Cited by 24 · see citing works
Multiplicity corrections in life sciences: challenges and consequences
Menyhárt, O., & Győrffy, B. (2025) · International Journal of Epidemiology · doi:10.1093/ije/dyaf098 · Cited by 24 · see citing works
Registration of health and medical research
Cashin, A. G., Richards, G. C., DeVito, N., Mellor, D. T., & Lee, H. (2021) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111836 · Cited by 24 · see citing works
The association of modic changes and chronic low back pain: A systematic review
Hopayian, K., Raslan, E. I., & Soliman, S. (2022) · Journal of Orthopaedics · doi:10.1016/j.jor.2022.11.003 · Cited by 23 · see citing works
Foundational Principles for Large-Scale Inference: Illustrations Through Correlation Mining
Hero, A. O., & Rajaratnam, B. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494178 · Cited by 23 · see citing works
Munkholm, K., Faurholt‐Jepsen, M., Ioannidis, J. P. A., & Hemkens, L. G. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.12.002 · Cited by 23 · see citing works
Self-citationVibration of effects in epidemiologic studies of alcohol consumption and breast cancer risk
Chu, L., Ioannidis, J. P. A., Egilman, A. C., Vasiliou, V., Ross, J. S., & Wallach, J. D. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz271 · Cited by 19 · see citing works
Self-citationRegistration audit of clinical trials given a favourable opinion by UK research ethics committees
Denneny, C., Bourne, S., & Kolstoe, S. E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026840 · Cited by 18 · see citing works
Ending publication bias: A values-based approach to surface null and negative results
Curry, S., Mercado-Lara, E., Arechavala‐Gomeza, V., Begley, C. G., Bernard, C., Bernard, R., Bertuzzi, S., Bhalla, N., Bowers, D., Brod, S., et al. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003368 · Cited by 20 · see citing works
Peacock, A., Larance, B., Bruno, R., Pearson, S., Buckley, N. A., Farrell, M., & Degenhardt, L. J. (2018) · Addiction · doi:10.1111/add.14380 · Cited by 16 · see citing works
Dacks, P. A., Andrieu, S., Blacker, D., Carman, A. J., Green, A. M., Grodstein, F., Henderson, V. W., James, B. D., Lane, R. F., Lau, J., et al. (2014) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2014.35 · Cited by 15 · see citing works
Making Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 15 · see citing works
Dal‐Ré, R., Delgado‐Rodríguez, M., & Bolúmar, F. (2014) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2014.10.006 · Cited by 13 · see citing works
Self-citationSpurious Precision in Meta-Analysis of Observational ResearchPreprint
Iršová, Z., Bom, P. R. D., Havránek, T., & Rachinger, H. J. (2023) · doi:10.31222/osf.io/3qp2w · Cited by 11 · see citing works
Leducq, S., Zaki, F., Hollestein, L. M., Apfelbacher, C., Ponna, N. P., Mazmudar, R. S., & Gran, S. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111341 · Cited by 15 · see citing works
George, B. J., Sobus, J. R., Phelps, L. P., Rashleigh, B., Simmons, J. E., Hines, R. N., & Groups, T. C. O. P. F. S. G. D. W. (2015) · Toxicological Sciences · doi:10.1093/toxsci/kfv020 · Cited by 12 · see citing works
Knowles, R. L., Ha, K. P., Mueller, J., Rawle, F. C., & Parker, R. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035283 · Cited by 12 · see citing works
Is menu design effective? A p-curving analysis
Chark, R., & Michael Man Him, I. P. (2022) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2022.103378 · Cited by 12 · see citing works
Improving Transparency in Observational Social Science Research: A Pre-Analysis Plan ApproachPreprint
Burlig, F. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2731920 · Cited by 11 · see citing works
Spurious precision in meta-analysis of observational research
Iršová, Z., Bom, P. R. D., Havránek, T., & Rachinger, H. J. (2025) · Nature Communications · doi:10.1038/s41467-025-63261-0 · Cited by 10 · see citing works
Bargeri, S., Pellicciari, L., Gallo, C., Rossettini, G., Castellini, G., & Gianola, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-068134 · Cited by 10 · see citing works
Achieving Milestones as a Prerequisite for Proceeding With a Clinical Trial
Mickle, A. M., Maybrier, H. R., Winter, A. C., McKinnon, S., Torres, B. A., Lin, N., Lenze, E. J., Stark, S., Muench, M. R., Jacobsohn, E., et al. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002680 · Cited by 8 · see citing works
Misstatements, misperceptions, and mistakes in controlling for covariates in observational research
Yu, X. D., Zoh, R. S., Fluharty, D. A., Mestre, L. M., Valdez, D., Tekwe, C. D., Vorland, C. J., Jamshidi‐Naeini, Y., Chiou, S. H., Lartey, S. T., et al. (2024) · eLife · doi:10.7554/elife.82268 · Cited by 9 · see citing works
Telemedicine in France: A review of registered clinical trials from 2000 to 2015
Ohannessian, R., Yaghobian, S., Chaleuil, M., & Salles, N. (2016) · European Research in Telemedicine / La Recherche Européenne en Télémédecine · doi:10.1016/j.eurtel.2016.04.001 · Cited by 9 · see citing works
Performance of SAPS II according to ICU length of stay: A Danish nationwide cohort study
Granholm, A., Christiansen, C. F., Christensen, S., Perner, A., & Møller, M. H. (2019) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13415 · Cited by 9 · see citing works
Papageorgiou, S. N., Tilen, R., Vandevska‐Radunovic, V., & Eliades, T. (2021) · Journal of Orofacial Orthopedics / Fortschritte der Kieferorthopädie · doi:10.1007/s00056-020-00273-z · Cited by 8 · see citing works
Papageorgiou, S. N., Cassina, C., Vandevska‐Radunovic, V., & Eliades, T. (2021) · Journal of the World Federation of Orthodontists · doi:10.1016/j.ejwf.2021.04.001 · Cited by 7 · see citing works
Credibility of observational studies: why public health researchers should care?
Boccia, S. (2015) · European Journal of Public Health · doi:10.1093/eurpub/ckv119 · Cited by 7 · see citing works
Malmsiø, D., Norlén, S., Jespersen, C., Neesgaard, V. E., Song, Z., Chan, A., & Hróbjartsson, A. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111686 · Cited by 6 · see citing works
Self-citationGranholm, A., Lange, T., Anthon, C. T., Marker, S., Krag, M., Meyhoff, T. S., Wise, M. P., Borthwick, M., Bendel, S., Keus, F., et al. (2018) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13144 · Cited by 6 · see citing works
Guilherme-Fernandes, J., Franco, N. H., Grierson, A. J., Hultgren, J., Furley, A. J., & Olsson, I. A. S. (2019) · BMJ Open Science · doi:10.1136/bmjos-2018-000016 · Cited by 6 · see citing works
Improving transparency in observational social science research: A pre-analysis plan approachPreprint
Burlig, F. (2017) · doi:10.31222/osf.io/qemkz · Cited by 6 · see citing works
Assessing transparency practices in dental randomized controlled trials
Prado, M. C., Dotto, L., Agostini, B., & Sarkis-Onofre, R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02316-0 · Cited by 6 · see citing works
Malmsiø, D., Frost, A. D., & Hróbjartsson, A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.12.012 · Cited by 5 · see citing works
Transparency in Infectious Disease Research: Meta-research Survey of Specialty Journals
Zavalis, E. A., Contopoulos‐Ioannidis, D. G., & Ioannidis, J. P. A. (2023) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiad130 · Cited by 5 · see citing works
Self-citationReliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 5 · see citing works
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 5 · see citing works
How to End Selective Reporting in Animal Research
ter Riet, G., & Bouter, L. M. (2016) · Methods and principles in medicinal chemistry · doi:10.1002/9783527695881.ch5 · Cited by 5 · see citing works
Kennedy, A. E., Khoury, M. J., Ioannidis, J. P. A., Brotzman, M. J., Miller, A., Lane, C., Lai, G. Y., Rogers, S. D., Harvey, C., Elena, J. W., et al. (2016) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-16-0412 · Cited by 4 · see citing works
Self-citationReplication for Quantitative Research
Jeremy Freese, A., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4 · see citing works
Gianola, S., Bargeri, S., Pellicciari, L., Gambazza, S., Rossettini, G., Fulvio, A., Genovese, V., Benedini, M., Proverbio, E., Cecchetto, S., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-075348 · Cited by 4 · see citing works
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4 · see citing works
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4 · see citing works
Realities of Observational Study Registration
Haymond, S. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2014.226258 · Cited by 4 · see citing works
Performance of SAPS II according to ICU length of stay: Protocol for an observational study
Granholm, A., Christiansen, C. F., Christensen, S., Perner, A., & Møller, M. H. (2018) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13233 · Cited by 3 · see citing works
Time to onset of gastrointestinal bleeding in the SUP‐ICU trial: A pre‐planned substudy
Granholm, A., Lange, T., Anthon, C. T., Marker, S., Krag, M., Meyhoff, T. S., Wise, M. P., Borthwick, M., Bendel, S., Keus, F., et al. (2019) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13459 · Cited by 3 · see citing works
Bairi, K. E., Jarroudi, O. A., & Afqir, S. (2021) · JCO Global Oncology · doi:10.1200/go.21.00310 · Cited by 4 · see citing works
Bier, D. M. (2017) · Annual Review of Nutrition · doi:10.1146/annurev-nutr-071715-050801 · Cited by 3 · see citing works
A few things to consider when deciding whether or not to conduct underpowered research
Campbell, H., de Jong, V. M. T., Debray, T. P. A., & Gustafson, P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.038 · Cited by 3 · see citing works
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 2 · see citing works
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 2 · see citing works
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2 · see citing works
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2 · see citing works
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 2 · see citing works
Improving Research Transparency in the Social Sciences
Christensen, G., & Miguel, E. A. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0002 · Cited by 1 · see citing works
- Authors
- Dal-Ré, R., Ioannidis, J. P., Bracken, M. B., Buffler, P. A., Chan, A.-W., Franco, E. L., La Vecchia, C., & Weiderpass, E.
- Affiliations
- Clinical Research Program, Pasqual Maragall Foundation, E-08003 Barcelona, Spain.
- Stanford Medicine (US)
- Yale University (US)
- University of California, Berkeley (US)
- University of Toronto (CA)
- McGill University (CA)
- Department of Epidemiology, Istituto di Ricerche Farmacologiche Mario Negri and Department of Clinical Sciences and Community Health, University of Milan, Milan I-20156, Italy.
- Karolinska Institutet (SE)
- Corresponding author
- Ioannidis, John P.
- Bracken, Michael B.
- Venue
- Science Translational Medicine
- Published
- 2014-02-19
- Volume
- 6
- Issue
- 224
- Pages
- 224cm1-224cm1
- ISSN
- 1946-6234 (ISSN-L)
- 1946-6242
- OpenAlex
- W2165828377
- Cited by
- 123
- References
- 32
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 8 · 2023: 5 · 2022: 4 · 2021: 10 · 2020: 26 · 2019: 10 · 2018: 10 · 2017: 12 · 2016: 12 · 2015: 9 · 2014: 11
- FWCI
- 14.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- public-domain
- Locations
- Science Translational Medicine (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- prospective registration, observational studies, research ethics, protocol registration, research ethics approval, research transparency, data sharing, analysis plan, research funding requirements
- MeSH terms
- Clinical Protocols, Humans, Prospective Studies, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
