Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
Background: Several scales, checklists and domain-based tools for assessing risk of reporting biases exist, but it is unclear how much they vary in content and guidance. We conducted a systematic review of the content and measurement properties of such tools. Methods: We searched for potentially relevant articles in Ovid MEDLINE, Ovid Embase, Ovid PsycINFO and Google Scholar from inception to February 2017. One author screened all titles, abstracts and full text articles, and collected data on tool characteristics. Results: We identified 18 tools that include an assessment of the risk of reporting bias. Tools varied in regard to the type of reporting bias assessed (eg, bias due to selective publication, bias due to selective non-reporting), and the level of assessment (eg, for the study as a whole, a particular result within a study or a particular synthesis of studies). Various criteria are used across tools to designate a synthesis as being at ‘high’ risk of bias due to selective publication (eg, evidence of funnel plot asymmetry, use of non-comprehensive searches). However, the relative weight assigned to each criterion in the overall judgement is unclear for most of these tools. Tools for assessing risk of bias due to selective non-reporting guide users to assess a study, or an outcome within a study, as ‘high’ risk of bias if no results are reported for an outcome. However, assessing the corresponding risk of bias in a synthesis that is missing the non-reported outcomes is outside the scope of most of these tools. Inter-rater agreement estimates were available for five tools. Conclusion: There are several limitations of existing tools for assessing risk of reporting biases, in terms of their scope, guidance for reaching risk of bias judgements and measurement properties. Development and evaluation of a new, comprehensive tool could help overcome present limitations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Statistical and graphical methods exist to assess whether the observed data suggest potential for missing results (such as contour enhanced funnel plots, Egger’s test) and how robust the synthesis is to different assumptions about the nature of potentially missing results (such as selection models).84 122 123 124”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [84]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A systematic search for graphical and statistical approaches designed to detect or adjust for reporting biases identified nearly 100 methods published up to January 2013 43 , and additional methods have been developed since 44 .”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [43]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Tools (such as checklists, scales, or domain-based tools) that prompt users to consider some or all of these approaches are available.81 84”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [84]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Self-citationGRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationDowns, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Self-citationSYRCLE’s risk of bias tool for animal studies
Hooijmans, C. R., Rovers, M. M., de Vries, R. B., Leenaars, M., Ritskes-Hoitinga, M., & Langendam, M. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-43 · Cited by 4,415
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Research works printed but not linked: 5
- Whiting P, Davies P, Savovic J, et al Evidence to inform the development of ROBIS, a new tool to assess the risk of bias in systematic reviews, September 2013. 2013 https://www.researchgate.net/publication/303312018_Evidence_to_inform_the_development_of_ROBIS_a_new_tool_to_assess_the_risk_of_bias_in_systematic_reviews (accessed 1 Aug 2017).
- Berkman ND, Lohr KN, Ansari M, et al Chapter 15 Appendix A: A Tool for Evaluating the Risk of Reporting Bias (in Chapter 15: Grading the Strength of a Body of Evidence When Assessing Health Care Interventions for the Effective Health Care Program of the Agency for Healthcare Research and Quality: An Update). Methods Guide for Comparative Effectiveness Reviews (Prepared by the RTI-UNC Evidence-based Practice Center under Contract No. 290-2007-10056-I). AHRQ Publication No. 13(14)-EHC130-EF. Rockville, MD: Agency for Healthcare Research and Quality, 2013. 24404627
- Hartling L, Hamm M, Milne A, et al AHRQ Methods for Effective Health Care. Validity and Inter-Rater Reliability Testing of Quality Assessment Instruments. Rockville (MD: Agency for Healthcare Research and Quality (US), 2012. 22536612
- Norris SL, Holmer HK, Ogden LA, et al AHRQ Methods for Effective Health Care. Selective Outcome Reporting as a Source of Bias in Reviews of Comparative Effectiveness. Rockville (MD): Agency for Healthcare Research and Quality (US), 2012. 22993870
- Sterne JAC, Egger M, Moher D, et al Chapter 10: Addressing reporting biases: Higgins JPT, Churchill R, Chandler J, Cochrane Handbook for Systematic Reviews of Interventions version 5.2.0. Chichester, UK: The Cochrane Collaboration, 2017.
Cited by
Items 201–300 of 318
Exploring undiscovered public knowledge in neuroscience
França, T. F. A. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16396 · Cited by 2
A System for Rapidly Yet Rigorously Evaluating the Quality of Randomized Controlled Trials
Smith, E. G., & Grigorian, H. L. (2023) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000001724 · Cited by 2
Methodology of systematic review in the health system
Mosadeghrad, A. M., & Isfahani, P. (2024) · Payesh (Health Monitor) Journal · doi:10.61186/payesh.23.4.507 · Cited by 2
Greenberger, B. A., Taylor, J. M., Chen, V. E., & Den, R. B. (2020) · The Cancer Journal · doi:10.1097/ppo.0000000000000420 · Cited by 2
Reasons for missing evidence in rehabilitation meta-analyses: a cross-sectional meta-research study
Lazzarini, S. G., Yousif, M. S., Bargeri, S., Castellini, G., & Gianola, S. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02064-7 · Cited by 2
Kim, Y. J., & Chung, K. C. (2020) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000006602 · Cited by 2
Injuries in the Fire Service: An Updated Review and Strategies for Practitioners
Martin, J. R., McCummings, N., Shaul, Y., Fyock-Martin, M. B., & McConnell, J. (2025) · Strength and conditioning journal · doi:10.1519/ssc.0000000000000919 · Cited by 2
An examination of the use of clinical trials as a source of information in scientific research
Trigueiros, B. A. F. D. S., Ávila, A. R., & Pimenta, F. P. (2022) · Transinformação · doi:10.1590/2318-0889202234e210065 · Cited by 2
The Role of Social Media in Covid-19
Alomiry, H. (2022) · Social medicine · doi:10.71164/socialmedicine.v15i1.2022.1383 · Cited by 2
Mikdashi, J. A., & Krumholz, A. (2023) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2023.152250 · Cited by 2
Learning Preferences among Medical and Physical Therapy Students: A Systematic Review
Ali, S., Ahmad, A., Munawar, A., & Waqas, M. S. (2021) · Journal of Bahria University Medical and Dental College · doi:10.51985/jbumdc2021070 · Cited by 2
Immunocompetent mouse models of endometriosis: a systematic review and meta-analysis
Coté, J. J., Coté, R. D., Zent, I., Woods, K., Kedeshian, K., Hendry, M., Dykstal, K., & Walters, R. W. (2025) · F&S Reviews · doi:10.1016/j.xfnr.2025.100091 · Cited by 1
Miao, Y., Li, Q., Chen, J., & Liu, Z. (2026) · Medicine · doi:10.1097/md.0000000000048070 · Cited by 1
Effect of active-duty military service on neonatal birth outcomes: a systematic review
Morris, K. A. L., & McKee, M. (2024) · BMJ Military Health · doi:10.1136/military-2023-002634 · Cited by 1
Ramaswamy, S. N., Harikrishnan, S., Bhatt, N., Agarwal, Y., Chand, S., Matam, M. B., & Mohammed, L. (2025) · Cureus · doi:10.7759/cureus.89871 · Cited by 1
Ravalihasy, A., Ante-Testard, P. A., Kardaś-Słoma, L., Yazdanpanah, Y., Allegri, M. D., & Ridde, V. (2023) · AIDS and Behavior · doi:10.1007/s10461-023-04000-8 · Cited by 1
Lunny, C., Veroniki, A. A., Higgins, J. P. T., Dias, S., Hutton, B., Wright, J. M., White, I. R., Whiting, P. F., & Tricco, A. C. (2023) · Research Square · doi:10.21203/rs.3.rs-2010358/v2 · Cited by 1
Self-citationChoudhari, R. (2024) · Innovative Practice in Breast Health · doi:10.1016/j.ibreh.2024.100013 · Cited by 1
Vedula, S. S., Hróbjartsson, A., & Page, M. J. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_183 · Cited by 1
Self-citationMitigating Algorithmic Bias in Healthcare AI for Equitable Care
Yang, Y. T. (2024) · Wiley eBooks · doi:10.1002/9781394263752.ch6 · Cited by 1
Risk of bias across study designs
Fonnes, S., & Rosenberg, J. (2025) · Ugeskrift for Læger · doi:10.61409/v08240500 · Cited by 1
Shen, T., Zhou, J., & Zhao, Y. (2020) · Medicine · doi:10.1097/md.0000000000023379 · Cited by 1
Patil, S. R., & Bhide, S. S. (2021) · Perspectives in Clinical Research · doi:10.4103/picr.picr_19_21 · Cited by 1
Alkadhimi, A. F., Reeves, S., & DiBiase, A. T. (2022) · BDJ · doi:10.1038/s41415-022-4151-8 · Cited by 1
The Use of Meta‐analysis in Pharmacoepidemiology
Crowe, B. J., Evans, S. J. W., Xia, H. A., & Berlin, J. A. (2021) · Wiley eBooks · doi:10.1002/9781119701101.ch20 · Cited by 1
Liu, Y., Wang, S., Chen, W., Tan, Y., Dun, W., Zhang, Y., Lu, T., Hou, X., & Liu, J. (2023) · Complementary Medicine Research · doi:10.1159/000530245 · Cited by 1
Characteristics of search methods in dental meta-research studies: a methodological study
Weeber, L., Su, N., & Faggion, C. M. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111693 · Cited by 1
Langenhuijsen, L. F. S., Groenwold, R. H. H., Cannegieter, S. C., Klok, F. A., van Diepen, M., & de Jong, Y. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112232 · Cited by 1
Lunny, C., Veroniki, A. A., Higgins, J. P. T., Dias, S., Hutton, B., Wright, J. M., White, I. R., Whiting, P. F., & Tricco, A. C. (2022) · Research Square · doi:10.21203/rs.3.rs-2010358/v1 · Cited by 1
Self-citationAlhaijaa, E. A., Alblishi, I., Alnaeem, M. M., & Alshraideh, J. A. (2022) · Frontiers of Nursing · doi:10.2478/fon-2022-0025 · Cited by 1
Use of Systematic Review Terminology and Methodological Quality in Children’s Social Care
Willis, S., Morgan, H. E., Morgan, F. M., & Scourfield, J. (2021) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2021.1938827 · Cited by 1
Ma, F., Yang, L., He, Y., & Yang, Z. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-089095 · Cited by 1
Meta-analysis of rapid direct-to-PCR assays for the qualitative detection of SARS-CoV-2Preprint
Reginald, T. A., Grippon, S., Coldwell, M. J., Chen, H. A., Koh, L., Jan, U., Sanchez-Bretano, A., Borley, D. W., Oladimeji, P., Moore, N. A., et al. (2021) · medRxiv · doi:10.1101/2021.05.07.21256745 · Cited by 1
Ukagumaoha, J. (2023) · ScholarWorks (Walden University) · Cited by 1
Introducing scoping and systematic reviews
Roga, E., & Pruis, K. (2025) · doi:10.35843/iscasrv23 · Cited by 1
Savar, A. K., Wang, H., Chen, N., & Cheng, Y. (2025) · Cardiovascular Engineering and Technology · doi:10.1007/s13239-025-00778-x · Cited by 1
Berenova, M., Sarfaraz, I., Pascoal, S., Carvalho, J. G., Macedo, J. P., & Pereira, J. (2025) · Dental and Medical Problems · doi:10.17219/dmp/171269 · Cited by 1
Combining results from several studies: Systematic reviews and meta-analyses
Elwood, M. (2025) · Oxford University Press eBooks · doi:10.1093/med/9780198911258.003.0009
Chang, M. C., Chang, M. C., & Chang, W.-H. (2026) · Acta Neurologica Belgica · doi:10.1007/s13760-026-03143-4
Austin, A. E., Hergenrother, L. C., Honaker, S. J., Shanahan, M. E., & Chandler, C. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119895
Francis, B., Fino, E., & Heym, N. (2026) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2026.01.002
Huang, C.-X., Huang, C., & Zhou, G. (2020) · Medicine · doi:10.1097/md.0000000000022716
Staibano, P., McKechnie, T., Thabane, A., Olteanu, D., Nanji, K., Zhang, H., Lunny, C., Au, M., Gupta, M. K., Pasternak, J. D., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303315
Edwards, D. J., Clark, E., Csontos, J. K., Dobbins, M., Gillen, E., Hounsome, J. C., Neil‐Sztramko, S., Lewis, R., Mann, M. K., & Prue, G. (2026) · Research Square · doi:10.21203/rs.3.rs-8724550/v1
Edwards, D. J., Clark, E., Csontos, J. K., Dobbins, M., Gillen, E., Hounsome, J. C., Neil-Sztramko, S. E., Lewis, R., Mann, M. K., & Prue, G. (2026) · Research Square · doi:10.21203/rs.3.rs-8724550/v2
Edwards, D. J., Clark, E., Csontos, J. K., Dobbins, M., Gillen, E., Hounsome, J. C., Neil‐Sztramko, S., Lewis, R. A., Mann, M. K., & Prue, G. (2026) · Research Square · doi:10.21203/rs.3.rs-8724550/v3
Cybersecurity Challenges in Smart Homes: A Systematic Literature Review
Mangundu, J., Samuel, M., Mutasa, L. S., & Matubatuba, R. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-16779-8_17
Bunyan, N., Feuerer, C., & Vostanis, A. (2026) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-026-07547-2
Kumar, S., & Tian, E. J. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736356828.793568531
Stamp, J., & Mwapwele, S. D. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-64881-6_25
Kuhn, A. W., Inclan, P. M., Haider, A. A., Christy, M. N., Dunn, W. R., Alberton, L. A., Allen, C., Anderson, K., Andrews, J. R., Azar, F., et al. (2026) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671251380883
Vedula, S. S., Hróbjartsson, A., & Page, M. J. (2021) · Springer eBooks · doi:10.1007/978-3-319-52677-5_183-1
Self-citationGates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514679
Gates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514685
Gates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514688
Gates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514676
Gates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514682
Gates, A., Pillay, J., Reynolds, D., Stirling, R., Traversy, G., Korownyk, C. S., Moore, A. E., Thériault, G., Thombs, B. D., Little, J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13514673
Application of Systematic Review and Meta-Analysis in Musculoskeletal Research
Zeng, F., Sophocleous, A., & Idris, A. I. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4306-8_36
Ntjam, N. N. (2022) · theses.fr (ABES) · doi:10.70675/ac888420z707fz465ezb2d9z977fb7c34df1
Zapf, A., & Röver, C. (2023) · Springer eBooks · doi:10.1007/978-3-662-63496-7_19-1
Lavikainen, L. I., Guyatt, G. H., Lee, Y., Couban, R. J., Luomaranta, A. L., Sallinen, V. J., Kalliala, I. E. J., Karanicolas, P. J., Cartwright, R., Aaltonen, R. L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16778519
Wang, X., Wang, G., Liu, Y., Xia, L., Zhao, Y., Mao, L., Shi, X., & Yin, R. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1704096
Lunny, C., Veroniki, A. A., Higgins, J. P. T., Dias, S., Hutton, B., Wright, J. M., White, I. R., Whiting, P., & Tricco, A. C. (2024) · Figshare · doi:10.6084/m9.figshare.24993697
Self-citationLi, F., Bai, T., Ren, Y., Xue, Q., Hu, J., & Cao, J. (2023) · Figshare · doi:10.6084/m9.figshare.22615477
Lazzarini, S. G., Stella Yousif, M., Bargeri, S., Castellini, G., & Gianola, S. (2024) · Figshare · doi:10.6084/m9.figshare.24417626
Lazzarini, S. G., Stella Yousif, M., Bargeri, S., Castellini, G., & Gianola, S. (2023) · Figshare · doi:10.6084/m9.figshare.24417576
Adib‐Hajbaghery, M., Nabizadeh‐Gharghozar, Z., & Nasirpour, P. (2019) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_186_19
Evidence‐based Medicine in Obstetrics and Gynaecology
Bhattacharya, S., & Coomarasamy, A. (2018) · Wiley eBooks · doi:10.1002/9781119211457.ch70
Zeng, H., Wu, Z., Yu, B., Wang, B., Wu, C., Wu, J., Lai, J., Gao, X., & Chen, J. (2021) · Figshare · doi:10.6084/m9.figshare.14418437
Zeng, H., Wu, Z., Yu, B., Wang, B., Wu, C., Wu, J., Lai, J., Gao, X., & Chen, J. (2021) · Figshare · doi:10.6084/m9.figshare.14418443
Zeng, H., Wu, Z., Yu, B., Wang, B., Wu, C., Wu, J., Lai, J., Gao, X., & Chen, J. (2021) · Figshare · doi:10.6084/m9.figshare.14418440
Aboshama, R. A., Islam, B. A., Motaal, A. O. A., Labib, K. M., Hegab, A. S., Abdelhakim, A. M., Abbas, A. M., & Saleh, D. M. (2021) · Gynecological Endocrinology · doi:10.1080/09513590.2021.1900818
Ignatowicz, A., Tarrant, C., Mannion, R., El‐Sawy, D., Conroy, S., & Lasserson, D. (2023) · Figshare · doi:10.6084/m9.figshare.22662420
Ignatowicz, A., Tarrant, C., Mannion, R., El‐Sawy, D., Conroy, S., & Lasserson, D. (2023) · Figshare · doi:10.6084/m9.figshare.22662423
Bahji, A., Danilewitz, M., Crockford, D. N., Delva, N. J., & Rusak, B. (2023) · SAGE Open Medicine · doi:10.1177/20503121231216846
Hasanoff, S., Pollock, D., Kanukula, R., Holland, G., Saif-Ur-Rahman, K., Taneri, P. E., Valenzuela, C., Khalil, H., Ali, S., Stollery, L., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7537209
Royo‐Bordonada, M. Á., Damián, J., López, F. J. G., Galan, I., Pérez‐Gómez, B., Sanz‐Barbero, B., Catalá-López, F., Rodríguez‐Artalejo, F., Imaz-Iglesia, I., González-García, J., et al. (2023) · doi:10.4321/repisalud.17538
Amirova, A. (2021) · City Research Online (City University London)
Littell, J. H., Valentine, J. C., Gorman, D. M., & Pigott, T. (2026) · Campbell Systematic Reviews · doi:10.1177/18911803261435892
Littell, J. H., Valentine, J. C., Gorman, D. M., & Pigott, T. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/y45cg_v2
Evidence-Based Management for Low Back Pain : Quality, Mechanisms and Reporting
Cashin, A. (2021) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/22589
Cognitive flexibility and persistent pain
Howlett, C. (2023) · Adelaide Research & Scholarship (AR&S) (University of Adelaide)
Edwards, D. J., Clark, E., Csontos, J. K., Dobbins, M., Gillen, E., Hounsome, J. C., Neil‐Sztramko, S., Lewis, R. A., Mann, M. K., & Prue, G. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03270-2
Willis, S., & Scourfield, J. (2024) · ORCA Online Research @Cardiff (Cardiff University)
Systematic Review vs Scoping Review: Scoping Review with ☸️SAIMSARA
SAIMSARA (2026) · SAIMSARA Journal · doi:10.62487/saimsara32ffe7cd
Congenital heart defects and growth restriction of the newborn : population-based studies
Ghanchi, A. (2022) · theses.fr (ABES) · doi:10.70675/7b4a39bcz7718z42d6z9a49ze5ee0fd5167e
Fausett, W. A. (2023) · Tuwhera (Auckland University of Technology)
The relationship between trauma and substance misuse in high-risk mentally disordered offenders
Fehrman, E. (2021) · Nottingham ePrints (University of Nottingham)
Reply: Weight Loss in Individuals with Obesity and Asthma
Okoniewski, W., Lu, K. D., & Forno, E. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201903-249le
Jiu, L. (2024) · Utrecht University Repository (Utrecht University) · doi:10.33540/1310
Peng, L. (2026) · International Journal of Social Work · doi:10.5296/ijsw.v13i2.23898
Liu, Y., Chen, H., Li, H., Li, L., Wu, J., & Li, H. (2022) · doi:10.3389/fendo.2022.878585.s002
GALDINO-SANTOS, L., ELAGAMI, R. A., SENSEVER, F. D. A., LOOMANS, B., CHISINI, L. A., & PEREIRA-CENCI, T. (2026) · Brazilian Oral Research · doi:10.1590/1807-3107bor-2026.vol40.094
Du, H., Bo, L., Lai, X., Zhu, H., & Huo, X. (2023) · doi:10.3389/fnagi.2023.1095996.s008
Systematic review: methodological aspects of its role in drug safety assessment
Penedones, A. (2020) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Shi, Y., Xu, X., Yue, Y., Zhao, J., Yao, K., & Wu, H. S. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1837742
Generating evidence for the perioperative care of patients undergoing elective colorectal surgery
Rollins, K. E. (2019) · Nottingham ePrints (University of Nottingham)
Metadata
- Authors
- Page, M. J., McKenzie, J. E., & Higgins, J. P. T.
- Affiliations
- University of Bristol (GB)
- Monash University (AU)
- Corresponding author
- Page, Matthew J
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2018-03
- Volume
- 8
- Issue
- 3
- Pages
- e019703
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5857645
- OpenAlex
- W2791602881
- Semantic Scholar
- 0a9d7a001dd55caf9a82669293fcd854c29a9777
- Cited by
- 278
- References
- 63
- Citations by year
- 2026: 14 · 2025: 27 · 2024: 38 · 2023: 43 · 2022: 31 · 2021: 60 · 2020: 39 · 2019: 20 · 2018: 5
- FWCI
- 6.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Monash University Research Portal (Monash University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- Medical Research Council
- National Health and Medical Research Council
- Cancer Research UK
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- reporting bias, risk of bias assessment, risk of bias assessment tools, meta-analysis, measurement properties, interobserver agreement, funnel plot asymmetry
- MeSH terms
- Humans, Bias, Outcome Assessment, Health Care, Risk Assessment, Information Dissemination, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
