Guidelines for reporting meta-epidemiological methodology research
Open accessAbstract
Published research should be reported to evidence users with clarity and transparency that facilitate optimal appraisal and use of evidence and allow replication by other researchers. Guidelines for such reporting are available for several types of studies but not for meta-epidemiological methodology studies. Meta-epidemiological studies adopt a systematic review or meta-analysis approach to examine the impact of certain characteristics of clinical studies on the observed effect and provide empirical evidence for hypothesised associations. The unit of analysis in meta-epidemiological studies is a study, not a patient. The outcomes of meta-epidemiological studies are usually not clinical outcomes. In this guideline, we adapt items from the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) to fit the context of meta-epidemiological studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Results are reported according to meta-epidemiologic study guidelines, which include an adapted PRISMA statement.
“Results are reported according to the said guidelines [22], which include an adapted PRISMA statement [26].”
A risk-of-bias assessment was not completed because bias was not pertinent to the review's research question, as per meta-epidemiologic study guidelines by Murad and Wang.
“However, a risk-of-bias assessment was not completed because bias was not pertinent to this review’s research question, as per the meta-epidemiologic study guidelines by Murad and Wang [22].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883 · see citing works
Enhancing the quality and transparency of health research
Groves, T. (2008) · British medical journal · doi:10.1136/bmj.a718 · Cited by 727 · see citing works
Rating the certainty in evidence in the absence of a single estimate of effect
Murad, M. H., Mustafa, R. A., Schünemann, H. J., Sultan, S., & Santesso, N. (2017) · Evidence Based Medicine · doi:10.1136/ebmed-2017-110668 · Cited by 717 · see citing works
Savović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668 · see citing works
Hróbjartsson, A., Emanuelsson, F., Skou Thomsen, A. S., Hilden, J., & Brorson, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu115 · Cited by 462 · see citing works
Murad, M. H., Montori, V. M., Ioannidis, J. P. A., Jaeschke, R., Devereaux, P. J., Prasad, K., Neumann, I., Carrasco-Labra, A., Agoritsas, T., Hatala, R., et al. (2014) · JAMA · doi:10.1001/jama.2014.5559 · Cited by 454 · see citing works
Randomisation to protect against selection bias in healthcare trials
Odgaard-Jensen, J., Vist, G. E., Timmer, A., Kunz, R., Akl, E. A., Schünemann, H., Briel, M., Nordmann, A. J., Pregno, S., & Oxman, A. D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000012.pub3 · Cited by 439 · see citing works
Sterne, J. A. C., Jüni, P., Schulz, K. F., Altman, D. G., Bartlett, C., & Egger, M. (2002) · Statistics in Medicine · doi:10.1002/sim.1184 · Cited by 382 · see citing works
Thompson, M., den Bruel, A. V., Verbakel, J. Y. J., Lakhanpaul, M., Haj-Hassan, T. A., Stevens, R., Moll, H. A., Buntinx, F., Berger, M. Y., Aertgeerts, B., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16150 · Cited by 324 · see citing works
Zhang, Z., Xu, X., & Ni, H. (2013) · Critical Care · doi:10.1186/cc11919 · Cited by 295 · see citing works
Patient-Important Outcomes in Registered Diabetes Trials
Gandhi, G. Y. (2008) · JAMA · doi:10.1001/jama.299.21.2543 · Cited by 252 · see citing works
Meta-analysis and the meta-epidemiology of clinical research
Naylor, C. D. (1997) · BMJ · doi:10.1136/bmj.315.7109.617 · Cited by 209 · see citing works
A systematic scoping review of adherence to reporting guidelines in health care literature
Thabane, L., Samaan, Mbuagbaw, L. C. E., Kosa, S. D., Debono, V. B., Dillenburg, Zhang, Fruci, V., Dennis, B. B., & Bawor, M. (2013) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s43952 · Cited by 194 · see citing works
Wang, A. T., McCoy, C. P., Murad, M. H., & Montori, V. M. (2010) · BMJ · doi:10.1136/bmj.c1344 · Cited by 173 · see citing works
Czoski‐Murray, C., Jones, M. L., McCabe, C. J., Claxton, K., Oluboyede, Y., Roberts, J., Nicholl, J., Rees, A., Reilly, C., Young, D., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16500 · Cited by 161 · see citing works
Ghimire, S., Kyung, E., Kang, W., & Kim, E. (2012) · Trials · doi:10.1186/1745-6215-13-77 · Cited by 140 · cited 1× · see citing works
“A descriptive analysis of published randomised trials in the four highest impact general medical journals shows inconsistencies and non-adherence to the CONSORT statement (eg, allocation concealment and details of blinding were reported only in 12% and 21%, respectively).(18) Adherence across all reporting guidelines…”
Method(2013) · Dove Medical Press (Taylor and Francis Group) · Cited by 122 · see citing works
Tsujimoto, Y., Tsujimoto, H., Kataoka, Y., Kimachi, M., Shimizu, S., Ikenoue, T., Fukuma, S., Yamamoto, Y., & Fukuhara, S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.008 · Cited by 69 · see citing works
Meta‐epidemiological study: a step‐by‐step approach by using R
Zhang, Z. (2016) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12191 · Cited by 16 · see citing works
New paradigms in the management of osteoarthritis patients with hypertension
Hochberg, M. C. (2010) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2010.04.001 · Cited by 12 · see citing works
Wang, Z., Alahdab, F., Almasri, J., Haydour, Q., Mohammed, K. S., Dabrh, A. M. A., Prokop, L. J., Alfarkh, W., Lakis, S., Montori, V. M., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.015 · Cited by 12 · see citing works
I-01 META-EPIDEMIOLOGY: BUILDING THE BRIDGE FROM RESEARCH EVIDENCE TO CLINICAL PRACTICE
Zhang, W. (2010) · Osteoarthritis and Cartilage · doi:10.1016/s1063-4584(10)00293-1 · Cited by 11 · see citing works
Murad, M. H., Guyatt, G. H., Domecq, J. P., Vernooij, R. W. M., Erwin, P. J., Meerpohl, J. J., Prutsky, G. J., Akl, E. A., Mueller, K. F., Bassler, D., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.10.006 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Systematic reviews of clinical practice guidelines: a methodological guide
Johnston, A., Kelly, S., Hsieh, S., Skidmore, B., & Wells, G. A. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.11.030 · Cited by 274 · see citing works
Moseley, A. M., Rahman, P., Wells, G. A., Zadro, J. R., Sherrington, C., Toupin‐April, K., & Brosseau, L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222770 · Cited by 176 · see citing works
A tutorial on methodological studies: the what, when, how and why
Mbuagbaw, L. C. E., Lawson, D. O., Puljak, L., Allison, D. B., & Thabane, L. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01107-7 · Cited by 164 · see citing works
Ayorinde, A., Williams, I., Mannion, R., Song, F., Skrybant, M., Lilford, R. J., & Chen, Y. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227580 · Cited by 111 · see citing works
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98 · see citing works
Khan, M. S., Lateef, N., Siddiqi, T. J., Rehman, K. A., Alnaimat, S., Khan, S. U., Riaz, H., Murad, M. H., Mandrola, J. M., Doukky, R., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.2622 · Cited by 94 · see citing works
Murad, M. H., Lin, L., Chu, H., Hasan, B., Alsibai, R. A., Abbas, A. S., Mustafa, R. A., & Wang, Z. (2023) · Canadian Medical Association Journal · doi:10.1503/cmaj.221802 · Cited by 88 · see citing works
Lawson, D. O., Puljak, L., Pieper, D., Schandelmaier, S., Collins, P. G. S., Brignardello‐Petersen, R., Moher, D., Tugwell, P., Welch, V. A., Samaan, Z., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040478 · Cited by 71 · see citing works
Hasan, B., Saadi, S. M., Rajjoub, N. S., Hegazi, M., Al-Kordi, M., Fleti, F., Farah, M. H., Riaz, I. B., Banerjee, I., Wang, Z., et al. (2024) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2023-112597 · Cited by 72 · see citing works
Association of Quality-of-Life Outcomes in Cancer Drug Trials With Survival Outcomes and Drug Class
Samuel, J. N., Booth, C. M., Eisenhauer, E. A., Brundage, M., Berry, S. R., & Gyawali, B. (2022) · JAMA Oncology · doi:10.1001/jamaoncol.2022.0864 · Cited by 67 · see citing works
The score after 10 years of registration of systematic review protocols
van der Braak, K., Ghannad, M., Orelio, C. C., Heus, P., Damen, J. A., Spijker, R., Robinson, K. A., Lund, H., & Hooft, L. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02053-9 · Cited by 64 · see citing works
Schwingshackl, L., Balduzzi, S., Beyerbach, J., Bröckelmann, N., Werner, S. S., Zähringer, J., Nagavci, B., & Meerpohl, J. J. (2021) · BMJ · doi:10.1136/bmj.n1864 · Cited by 63 · see citing works
Toews, I., Anglemyer, A., Nyirenda, J. L., Alsaid, D., Balduzzi, S., Grummich, K., Schwingshackl, L., & Bero, L. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000034.pub3 · Cited by 60 · see citing works
Riaz, I. B., Islam, M., Ikram, W., Naqvi, S. A. A., Maqsood, H., Saleem, Y., Riaz, A., Ravi, P. K., Wang, Z., Hussain, S. A., et al. (2022) · JAMA Oncology · doi:10.1001/jamaoncol.2022.5511 · Cited by 60 · see citing works
Cancer Incidence and Mortality among Firefighters: An Overview of Epidemiologic Systematic Reviews
Laroche, É., & L’Espérance, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052519 · Cited by 51 · see citing works
Plana, N., Pérez, T., & Zamora, J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.11.011 · Cited by 49 · see citing works
Moustgaard, H., Jones, H. E., Savović, J., Clayton, G., Sterne, J. A. C., Higgins, J. P. T., & Hróbjartsson, A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1392 · Cited by 45 · see citing works
Kataoka, Y., Banno, M., Tsujimoto, Y., Ariie, T., Taito, S., Suzuki, T., Oide, S., & Furukawa, T. A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.06.015 · Cited by 44 · see citing works
RetractedCara, K. C., Goldman, D. M., Kollman, B. K., Amato, S. S., Tull, M. D., & Karlsen, M. C. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.03.007 · Cited by 44 · see citing works
Schwab, S., Kreiliger, G., & Held, L. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045942 · Cited by 37 · see citing works
What does expert opinion in guidelines mean? a meta-epidemiological study
Ponce, O. J., Álvarez‐Villalobos, N. A., Shah, R., Khaled, M., Morgan, R. L., Sultan, S., Falck-Ytter, Y. T., Prokop, L. J., Dahm, P., Mustafa, R. A., et al. (2017) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2017-110798 · Cited by 40 · see citing works
Analysis of reporting completeness in exercise cancer trials: a systematic review
Meneses-Echavez, J. F., Rodríguez-Prieto, I., Elkins, M. R., Martínez-Torres, J., Nguyen, L., & Bidonde, J. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0871-0 · Cited by 38 · see citing works
Completeness of reporting of case reports in high‐impact medical journals
Calvache, J. A., Vera‐Montoya, M., Ordoñez, D., Hernández, A. V., Altman, D. G., & Moher, D. (2020) · European Journal of Clinical Investigation · doi:10.1111/eci.13215 · Cited by 37 · see citing works
Minozzi, S., González‐Lorenzo, M., Cinquini, M., Berardinelli, D., Cagnazzo, C., Ciardullo, S., Nardi, P. D., Gammone, M., Iovino, P., Lando, A., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.09.003 · Cited by 37 · see citing works
Effectiveness of smoking cessation interventions among adults: an overview of systematic reviews
Hersi, M., Beck, A., Hamel, C., Esmaeilisaraji, L., Pussegoda, K., Austin, B., Ahmadzai, N., Pratt, M., Thuku, M., Yazdi, F., et al. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02570-9 · Cited by 45 · see citing works
User engagement in clinical trials of digital mental health interventions: a systematic review
Elkes, J., Cro, S., Batchelor, R., O’Connor, S., Yu, L., Bell, L., Harris, V., Sin, J., & Cornelius, V. R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02308-0 · Cited by 37 · see citing works
Páez, A., Nunan, D., McCulloch, P. G., & Beard, D. J. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111610 · Cited by 36 · see citing works
Bargeri, S., Iannicelli, V., Castellini, G., Cinquini, M., & Gianola, S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.08.021 · Cited by 36 · see citing works
Overall Survival and Quality-of-Life Superiority in Modern Phase 3 Oncology Trials
Sherry, A. D., Miller, A. M., Parlapalli, J. P., Kupferman, G. S., Beck, E. J., McDonald, J. A., Kouzy, R., Jaoude, J. A., Lin, T. A., Sanford, N. N., et al. (2025) · JAMA Oncology · doi:10.1001/jamaoncol.2025.1002 · Cited by 35 · see citing works
Laguna, J. M., Puhan, M. A., Rodríguez‐Artalejo, F., Pauw, R. D., Wyper, G. M. A., Devleesschauwer, B., Santos, J. V., & Hincapié, C. A. (2023) · International Journal of Public Health · doi:10.3389/ijph.2023.1605763 · Cited by 33 · see citing works
Alahdab, F., Farah, W. H., Almasri, J., Barrionuevo, P., Zaiem, F., Benkhadra, R., Asi, N., Alsawas, M., Pang, Y., Ahmed, A. T., et al. (2018) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2017.10.020 · Cited by 32 · see citing works
Puljak, L., Makarić, Z. L., Buljan, I., & Pieper, D. (2020) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2019-0201 · Cited by 32 · see citing works
Gyawali, B., D’Andrea, E., Franklin, J. M., & Kesselheim, A. S. (2020) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2019.7345 · Cited by 31 · see citing works
Analysis of practices to promote reproducibility and transparency in anaesthesiology research
Okonya, O., Rorah, D., Tritz, D., Umberham, B. A., Wiley, M., & Vassar, M. B. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.03.035 · Cited by 29 · see citing works
Bröckelmann, N., Balduzzi, S., Harms, L., Beyerbach, J., Πετροπούλου, Μ., Kubiak, C., Wolkewitz, M., Meerpohl, J. J., & Schwingshackl, L. (2022) · BMC Medicine · doi:10.1186/s12916-022-02369-2 · Cited by 29 · see citing works
An evaluation of the practice of transparency and reproducibility in addiction medicine literature
Adewumi, M. T., Vo, N. H., Tritz, D., Beaman, J., & Vassar, M. B. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106560 · Cited by 26 · see citing works
Murad, M. H., Balla, A. K., Khan, M. S., Shaikh, A., Saadi, S. M., & Wang, Z. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111858 · Cited by 26 · see citing works
Gyawali, B., Tessema, F. A., Jung, E. H., & Kesselheim, A. S. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.9570 · Cited by 25 · see citing works
Reproducible and transparent research practices in published neurology research
Rauh, S. L., Torgerson, T., Johnson, A., Pollard, J., Tritz, D., & Vassar, M. B. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-0091-5 · Cited by 24 · see citing works
Reddy, A. K., Shepard, S., Ottwell, R., Thompson, J., Price, C. M., Arthur, W., Hanson, C. D., Ebert, A., Wright, D., Hartwell, M. L., et al. (2021) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2021.03.066 · Cited by 26 · see citing works
Banerjee, A., Mowforth, O. D., Nouri, A., Budu, A., Newcombe, V., Kotter, M., & Davies, B. M. (2022) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2022.03.002 · Cited by 25 · see citing works
Vassar, M. B., Jellison, S., Wendelbo, H., Wayant, C., Gray, H. M., & Bibens, M. E. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032024 · Cited by 25 · see citing works
Wallerstedt, S. M., Hoffmann, M., & Lönnbro, J. (2021) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15012 · Cited by 24 · see citing works
Katsura, M., Kuriyama, A., Tada, M., Tsujimoto, Y., Luo, Y., Yamamoto, K., So, R., Aga, M., Matsushima, K., Fukuma, S., et al. (2021) · British journal of surgery · doi:10.1093/bjs/znab328 · Cited by 24 · see citing works
Gianola, S., Bargeri, S., Nembrini, G., Varvello, A., Lunny, C., & Castellini, G. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2022.09.005 · Cited by 26 · see citing works
Vassar, M. B., Roberts, W., Cooper, C. M., Wayant, C., & Bibens, M. E. (2019) · Addiction · doi:10.1111/add.14902 · Cited by 26 · see citing works
Walters, C. G., Harter, Z. J., Wayant, C., Vo, N. H., Warren, M., Chronister, J., Tritz, D., & Vassar, M. B. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-033962 · Cited by 22 · see citing works
Evaluation of Oncology Trial Results Reporting Over a 10-Year Period
Liu, X., Zhang, Y., Li, W., Vokes, E. E., Sun, Y. H., Le, Q., & Ma, J. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.10438 · Cited by 23 · see citing works
Torgerson, T., Johnson, A., Jellison, S., Tanghetti, M., Langley, J., Nguyen, L. H. P., & Vassar, M. B. (2019) · The Laryngoscope · doi:10.1002/lary.28404 · Cited by 22 · see citing works
Palmer, W., Okonya, O., Jellison, S., Horn, J. G., Harter, Z. J., Wilkett, M., & Vassar, M. B. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111309 · Cited by 22 · see citing works
Lawson, D. O., Leenus, A., & Mbuagbaw, L. C. E. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0544-0 · Cited by 22 · see citing works
Ruano, J., Gómez-García, F. J., Gay-Mimbrera, J., Aguilar-Luque, M., Fernández-Rueda, J. L., Fernández-Chaichio, J., Alcalde‐Mellado, P., Carmona-Fernández, P. J., Sanz-Cabanillas, J. L., Viguera-Guerra, I., et al. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0709-6 · Cited by 21 · see citing works
Leyrat, C., Caille, A., Eldridge, S., Kerry, S., Dechartres, A., & Giraudeau, B. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyy229 · Cited by 20 · see citing works
Lu, V. M., Phan, K. H., Yin, J. X. M., & McDonald, K. L. (2018) · Journal of Neuro-Oncology · doi:10.1007/s11060-018-2897-2 · Cited by 20 · see citing works
Anderson, J. M., Stafford, A. L., Jellison, S., & Vassar, M. B. (2021) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2020.09.019 · Cited by 20 · see citing works
Tsujimoto, Y., Tsutsumi, Y., Kataoka, Y., Banno, M., & Furukawa, T. A. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.08.030 · Cited by 20 · see citing works
Evidence-based nutrition guidelines for cancer survivors in Europe: a call for action
Keaver, L., Houlihan, C., O’Callaghan, N., LaVertu, A. E., Ding, X., & Zhang, F. F. (2021) · European Journal of Clinical Nutrition · doi:10.1038/s41430-021-01036-8 · Cited by 20 · see citing works
Beck, A., Hamel, C., Thuku, M., Esmaeilisaraji, L., Bennett, A., Shaver, N., Skidmore, B., Colman, I., Grigoriadis, S., Nicholls, S. G., et al. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02022-2 · Cited by 21 · see citing works
Vassar, M. B., Pollard, J., Rorah, D., Jellison, S., Harter, Z. J., & Brasseux, S. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.107824 · Cited by 20 · see citing works
An analysis of key indicators of reproducibility in radiology
Wright, B., Vo, N. H., Nolan, J., Johnson, A., Braaten, T., Tritz, D., & Vassar, M. B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00870-x · Cited by 20 · see citing works
Requirements for trial registration and adherence to reporting guidelines in critical care journals
Sims, M. T., Checketts, J. X., Wayant, C., & Vassar, M. B. (2017) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000120 · Cited by 20 · see citing works
Assessment of Heterogeneity in Heart Failure–Related Meta-Analyses
Khan, M. S., Li, L., Yasmin, F., Khan, S. U., Bajaj, N. S., Pandey, A., Murad, M. H., Fonarow, G. C., Butler, J., & Vaduganathan, M. (2020) · Circulation Heart Failure · doi:10.1161/circheartfailure.120.007070 · Cited by 18 · see citing works
Beyerbach, J., Stadelmaier, J., HOFFMANN, G. E., Balduzzi, S., Bröckelmann, N., & Schwingshackl, L. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab095 · Cited by 19 · see citing works
Tsutsumi, Y., Tsujimoto, Y., Tajika, A., Omae, K., Fujii, T., Ōnishi, A., Kataoka, Y., Katsura, M., Noma, H., Sahker, E., et al. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111861 · Cited by 19 · see citing works
Gibson, M., Spiga, F., Campbell, A., Khouja, J. N., Richmond, R. C., & Munafo, M. R. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-112006 · Cited by 17 · see citing works
Bracchiglione, J., Meza, N., Pérez-Carrasco, I., Vergara‐Merino, L., Eva Madrid, A., Urrútia, G., & Bonfill, X. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.05.006 · Cited by 19 · see citing works
Paquette, M., Alotaibi, A., Nieuwlaat, R., Santesso, N. A., & Mbuagbaw, L. C. E. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1152-z · Cited by 19 · see citing works
Guidance on conducting methodological studies – an overview
Khalil, H., & Munn, Z. (2023) · Current Opinion in Epidemiology and Public Health · doi:10.1097/pxh.0000000000000013 · Cited by 18 · see citing works
Khan, M. S., Shaikh, A., Ochani, R. K., Akhtar, T., Fatima, K., Khan, S. U., Mookadam, F., Murad, M. H., Figueredo, V. M., Doukky, R., et al. (2019) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005260 · Cited by 21 · see citing works
Yao, M., Mei, F., Ma, Y., Qin, X., Huan, J., Zou, K., Li, L., & Sun, X. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111815 · Cited by 17 · see citing works
O’Sullivan, J. W., Albasri, A., Koshiaris, C., Aronson, J. K., Heneghan, C. J., & Perera, R. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.06.013 · Cited by 17 · see citing works
Anderson, J. M., Howard, C., Staggs, J., Steele, R. J., Strasser, T., Small, T. J., Vassar, M. B., & Checketts, J. X. (2022) · The Journal of Arthroplasty · doi:10.1016/j.arth.2022.06.004 · Cited by 17 · see citing works
Stadelmaier, J., Roux, I., Πετροπούλου, Μ., & Schwingshackl, L. (2022) · BMC Medicine · doi:10.1186/s12916-022-02540-9 · Cited by 18 · see citing works
Estrup, S., Barot, E., Mortensen, C. B., Anthon, C. T., Crescioli, E., Kjær, M. N., Vesterlund, G. K., Bruun, C. R. L., Collet, M. O., Rasmussen, B. S., et al. (2022) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.14183 · Cited by 17 · see citing works
Reddy, A. K., Lulkovich, K., Wirtz, A., Thompson, J. C., Scott, J., Checketts, J. X., Ottwell, R., Hanson, C. D., Hartwell, M. L., & Vassar, M. B. (2023) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671221137923 · Cited by 17 · see citing works
Santo, T. D., Rice, D. B., Amiri, L. S. N., Tasleem, A., Li, K., Boruff, J. T., Geoffroy, M., Benedetti, A., & Thombs, B. D. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.05.017 · Cited by 17 · see citing works
Hernández, J. A. Z., Dorsey-Treviño, E. G., González‐González, J. G., Brito, J. P., Montori, V. M., & Rodríguez‐Gutiérrez, R. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031259 · Cited by 17 · see citing works
Ivaldi, D., Burgos, M. A., Oltra, G. V., Liquitay, C. M. E., & Garegnani, L. (2024) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.12074 · Cited by 16 · see citing works
Evaluation of indicators supporting reproducibility and transparency within cardiology literature
Anderson, J. M., Wright, B., Rauh, S. L., Tritz, D., Horn, J. G., Parker, I., Bergeron, D., Cook, S., & Vassar, M. B. (2020) · Heart · doi:10.1136/heartjnl-2020-316519 · Cited by 15 · see citing works
Niederer, D., Weippert, M., & Behrens, M. (2022) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2022.11149 · Cited by 16 · see citing works
Assessment of transparent and reproducible research practices in the psychiatry literature
Sherry, C. E., Pollard, J., Tritz, D., Carr, B., Pierce, A. M., & Vassar, M. B. (2020) · General Psychiatry · doi:10.1136/gpsych-2019-100149 · Cited by 16 · see citing works
Bullock, G. S., Ward, P., Impellizzeri, F. M., Kluzek, S., Hughes, T., Hillman, C., Waterman, B. R., Danelson, K., Henry, K., Barr, E., et al. (2023) · Journal of Orthopaedic & Sports Physical Therapy · doi:10.2519/jospt.2023.12016 · Cited by 15 · see citing works
Bernardeau, C., Revol, B., Salvo, F., Fusaroli, M., Raschi, E., Cracowski, J., Roustit, M., & Khouri, C. (2025) · Drug Safety · doi:10.1007/s40264-025-01524-x · Cited by 15 · see citing works
Analysis of spin in vascular surgery randomized controlled trials with nonsignificant outcomes
Nguyen, J., Li, A., Tam, D. Y., & Forbes, T. L. (2021) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2021.09.051 · Cited by 15 · see citing works
Xu, C., Zhang, F., Doi, S. A. R., Furuya‐Kanamori, L., Lin, L., Chu, H., Yang, X., Li, S., Zorzela, L., Golder, S., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03300-7 · Cited by 14 · see citing works
Siedler, M. R., Kawtharany, H., Azzam, M., Ezgü, D., Alshorman, A., Mikati, I. K. E., Abid, S., Choaib, A., Hamarsha, Q., Murad, M. H., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111684 · Cited by 14 · see citing works
COVID-19 randomized controlled trials in medRxiv and PubMed
Kataoka, Y., Oide, S., Ariie, T., Tsujimoto, Y., & Furukawa, T. A. (2020) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2020.09.019 · Cited by 14 · see citing works
Emary, P. C., Stuber, K. J., Mbuagbaw, L. C. E., Oremus, M., Nolet, P. S., Nash, J., Bauman, C. A., Ciraco, C., Couban, R., & Busse, J. W. (2023) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2023.11.004 · Cited by 14 · see citing works
Mheissen, S., Khan, H., Normando, D., Vaiid, N., & Flores‐Mir, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298526 · Cited by 14 · see citing works
Blinding Assessments in Neonatal Ventilation Meta-Analyses: A Systematic Meta-Epidemiological Review
Kuitunen, I., Räsänen, K., Gualano, M. R., & Luca, D. D. (2024) · Neonatology · doi:10.1159/000539203 · Cited by 14 · see citing works
Treatment Effects in Randomized and Nonrandomized Studies of Pharmacological Interventions
Salcher‐Konrad, M., Nguyen, M., Savović, J., Higgins, J. P. T., & Naci, H. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.36230 · Cited by 14 · see citing works
Evidence certainty in neonatology—a meta-epidemiological analysis of Cochrane reviews
Varrio, T., Luca, D. D., & Kuitunen, I. (2025) · European Journal of Pediatrics · doi:10.1007/s00431-025-06023-w · Cited by 14 · see citing works
Kataoka, Y., Anan, K., Taito, S., Tsujimoto, Y., Kurata, Y., Wada, Y., Maruta, M., Kanaoka, K., Oide, S., Takahashi, S., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.025 · Cited by 14 · see citing works
Innocenti, T., Salvioli, S., Logullo, P., Giagio, S., Ostelo, R., & Chiarotto, A. (2023) · Journal of Pain · doi:10.1016/j.jpain.2023.08.006 · Cited by 15 · see citing works
Feller, D., Wingbermühle, R. W., Berg, B., Vigdal, Ø. N., Innocenti, T., Grotle, M., Ostelo, R., & Chiarotto, A. (2024) · Journal of Pain · doi:10.1016/j.jpain.2024.104624 · Cited by 13 · see citing works
Scaffidi, M. A., Gimpaya, N., Li, J., Bansal, R., Verma, Y., Elsolh, K., Donn, G. M., Panjwani, A., Khan, R., & Grover, S. C. (2021) · CMAJ Open · doi:10.9778/cmajo.20200140 · Cited by 13 · see citing works
Alfailany, D. T., Hajeer, M. Y., & Darwich, K. M. A. (2023) · Progress in Orthodontics · doi:10.1186/s40510-023-00457-4 · Cited by 13 · see citing works
An assessment of transparency and reproducibility‐related research practices in otolaryngology
Johnson, A., Torgerson, T., Skinner, M., Hamilton, T., Tritz, D., & Vassar, M. B. (2019) · The Laryngoscope · doi:10.1002/lary.28322 · Cited by 13 · see citing works
Scaffidi, M. A., Elsolh, K., Li, J., Verma, Y., Bansal, R., Gimpaya, N., Larivière, V., Khan, R., & Grover, S. C. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256577 · Cited by 13 · see citing works
- Authors
- Murad, M. H., & Wang, Z.
- Affiliations
- Mayo Clinic (US)
- Corresponding author
- Murad, Mohammad Hassan
- Venue
- Evidence Based Medicine
- Publisher
- BMJ
- Published
- 2017-07-12
- Volume
- 22
- Issue
- 4
- Pages
- 139-142
- ISSN
- 1356-5524 (ISSN-L)
- 1473-6810
- PMC
- PMC5537553
- OpenAlex
- W2735796955
- Cited by
- 515
- References
- 24
- Citations by year
- 2026: 61 · 2025: 67 · 2024: 92 · 2023: 62 · 2022: 103 · 2021: 54 · 2020: 43 · 2019: 22 · 2018: 9 · 2017: 2
- FWCI
- 18.58
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Evidence-Based Medicine (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- meta-epidemiology, reporting guidelines, PRISMA, study characteristics, research transparency, reproducibility, systematic reviews
- MeSH terms
- Systematic Reviews as Topic, Humans, Publishing, Quality Control, Meta-Analysis as Topic, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review