What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary
Open accessAbstract
BACKGROUND: Overviews of reviews (overviews) compile data from multiple systematic reviews to provide a single synthesis of relevant evidence for decision-making. Despite their increasing popularity, there is limited methodological guidance available for researchers wishing to conduct overviews. The objective of this scoping review is to identify and collate all published and unpublished documents containing guidance for conducting overviews examining the efficacy, effectiveness, and/or safety of healthcare interventions. Our aims were to provide a map of existing guidance documents; identify similarities, differences, and gaps in the guidance contained within these documents; and identify common challenges involved in conducting overviews. METHODS: We conducted an iterative and extensive search to ensure breadth and comprehensiveness of coverage. The search involved reference tracking, database and web searches (MEDLINE, EMBASE, DARE, Scopus, Cochrane Methods Studies Database, Google Scholar), handsearching of websites and conference proceedings, and contacting overview producers. Relevant guidance statements and challenges encountered were extracted, edited, grouped, abstracted, and presented using a qualitative metasummary approach. RESULTS: We identified 52 guidance documents produced by 19 research groups. Relatively consistent guidance was available for the first stages of the overview process (deciding when and why to conduct an overview, specifying the scope, and searching for and including systematic reviews). In contrast, there was limited or conflicting guidance for the latter stages of the overview process (quality assessment of systematic reviews and their primary studies, collecting and analyzing data, and assessing quality of evidence), and many of the challenges identified were also related to these stages. An additional, overarching challenge identified was that overviews are limited by the methods, reporting, and coverage of their included systematic reviews. CONCLUSIONS: This compilation of methodological guidance for conducting overviews of healthcare interventions will facilitate the production of future overviews and can help authors address key challenges they are likely to encounter. The results of this project have been used to identify areas where future methodological research is required to generate empirical evidence for overview methods. Additionally, these results have been used to update the chapter on overviews in the next edition of the Cochrane Handbook for Systematic Reviews of Interventions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is limited guidance on how to assess quality of evidence of outcome data in umbrella reviews.
“There is limited guidance on how to assess quality of evidence of outcome data in umbrella reviews (Gates et al., 2020, Pollock et al., 2016).”
From Impact of organized activities on mental health in children and adolescents: An umbrella review (2022) · cites this paper as Pollock et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · see citing works
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305 · see citing works
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J., Green, S. R., & Higgins, J. (2008) · Cited by 5,544 · see citing works
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · see citing works
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · see citing works
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · see citing works
Handbook for Synthesizing Qualitative Research
Sandelowski, M., & Barroso, J. V. (2006) · Medical Entomology and Zoology · Cited by 1,096 · see citing works
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 1× · see citing works
“Lastly, including SRs published outside of the CDSR can increase the complexity of the latter stages of the overview process due to greater variation in the methods and reporting of non-Cochrane SRs [22, 23] and the potential for topic overlap across multiple similar SRs [24].”
BackgroundBiologics for rheumatoid arthritis: an overview of Cochrane reviews
Singh, J. A., Christensen, R., Wells, G. A., Suarez-Almazor, M. E., Buchbinder, R., Lopez-Olivo, M. A., Ghogomu, E. T., & Tugwell, P. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007848.pub2 · Cited by 482 · see citing works
Checking reference lists to find additional studies for systematic reviews
Horsley, T., Dingwall, O., & Sampson, M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000026.pub2 · Cited by 446 · see citing works
Creating Metasummaries of Qualitative Findings
Sandelowski, M., & Barroso, J. (2003) · Nursing Research · doi:10.1097/00006199-200307000-00004 · Cited by 273 · see citing works
A descriptive analysis of overviews of reviews published between 2000 and 2011.
Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049667 · Cited by 241 · see citing works
Self-citationOverviews of reviews often have limited rigor: a systematic review
Pieper, D., Buechter, R., Jerinic, P., & Eikermann, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.015 · Cited by 213 · see citing works
Moseley, A. M., Elkins, M. R., Herbert, R. D., Maher, C. G., & Sherrington, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.018 · Cited by 202 · see citing works
Pollock, A., Farmer, S., Brady, M., Langhorne, P., Mead, G. E., Mehrholz, J., van Wijck, F., & Wiffen, P. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.013 · Cited by 181 · see citing works
Assisted reproductive technology: an overview of Cochrane Reviews
Farquhar, C. M., Rishworth, J. R., Brown, J., Nelen, W. L. D. M., & Marjoribanks, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010537.pub4 · Cited by 174 · see citing works
Biologics for rheumatoid arthritis: an overview of Cochrane reviews
Singh, J. A., Christensen, R., Wells, G. A., Suarez-Almazor, M. E., Buchbinder, R., Lopez-Olivo, M. A., Ghogomu, E. T., & Tugwell, P. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007848 · Cited by 169 · see citing works
Worswick, J., Wayne, S. C., Bennett, R., Fiander, M., Mayhew, A., Weir, M. C., Sullivan, K. J., & Grimshaw, J. M. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-26 · Cited by 130 · see citing works
Green, S., Higgins, J. P. T., Alderson, P., Clarke, M. J., Mulrow, C. D., & Oxman, A. D. (2008) · doi:10.1002/9780470712184.ch1 · Cited by 97 · see citing works
Methodology for jbi umbrella reviews
Aromataris, E., Fernandez, R. S., Godfrey, C. M., Holly, C. M., Khalil, H., & Tungpunkom, P. (2014) · Research Online (University of Wollongong) · Cited by 96 · see citing works
The prevention of eczema in infants and children: an overview of Cochrane and non‐Cochrane reviews
Foisy, M., Boyle, R. J., Chalmers, J. R., Simpson, E. L., & Williams, H. C. (2011) · Evidence-Based Child Health A Cochrane Review Journal · doi:10.1002/ebch.827 · Cited by 87 · see citing works
Safety of regular formoterol or salmeterol in adults with asthma: an overview of Cochrane reviews
Cates, C. J., Wieland, L. S., Oleszczuk, M., & Kew, K. M. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010314.pub2 · Cited by 66 · see citing works
Quality and transparency of overviews of systematic reviews
Li, L., Tian, J., Tian, H., Sun, R., Liu, Y., & Yang, K. (2012) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2012.01185.x · Cited by 60 · see citing works
Lunny, C., Brennan, S., McDonald, S. J., & McKenzie, J. E. (2016) · Systematic Reviews · doi:10.1186/s13643-015-0178-0 · Cited by 52 · see citing works
Thomson, D., Foisy, M., Oleszczuk, M., Wingert, A., Chisholm, A., & Hartling, L. (2013) · Evidence-Based Child Health A Cochrane Review Journal · doi:10.1002/ebch.1897 · Cited by 23 · see citing works
Self-citationImpact of choice of quality appraisal tool for systematic reviews in overviews
Pieper, D., Mathes, T., & Eikermann, M. (2014) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12097 · Cited by 19 · see citing works
Most overviews of Cochrane reviews neglected potential biases from dual authorship
Büchter, R. B., & Pieper, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.008 · Cited by 15 · see citing works
Crick, K., Wingert, A., Williams, K. J., Fernandes, R. M., Thomson, D., & Hartling, L. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0084-0 · Cited by 13 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 9
- [3]Becker LA, Oxman AD. Chapter 22: overviews of reviews. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions (version 5.1.0). The Cochrane Collaboration; 2011. www.handbook.cochrane.org.
- [11]Grimshaw J. A knowledge synthesis chapter. In: A guide to knowledge synthesis. Canadian Institutes of Health Research; 2010. http://www.cihr-irsc.gc.ca/e/41382.html. Accessed 30 Nov 2015
- [13]Foisy M Dryden DM Fernandes RM Hartling L Thomson D Advancing methods for overviews of reviews: a discussion of challenges and potential solutions. Abstracts of the 22nd Cochrane Colloquium, 21-26 Sept 2014 2014 Hyderabad Wiley
- [24]Foisy M Dryden DM Fernandes RM Hartling L Multiple systematic reviews published on the same topic area: an analysis of systematic reviews that overlap in content. Abstracts of the 22nd Cochrane Colloquium, 21-26 Sep 2014 2014 Hyderabad Wiley
- [25]Green S, Higgins JPT. Chapter 2: preparing a Cochrane review. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions (version 5.1.0). The Cochrane Collaboration; 2011. www.handbook.cochrane.org.
- [31]Foisy M Hartling L Challenges and considerations involved in using AMSTAR in overviews of reviews. Abstracts of the 22nd Cochrane Colloquium, 21-26 Sep 2014 2014 Hyderabad Wiley
- [32]Jia P Chen J Zhang L Zhao P Zhang M Challenges and considerations in assessing the reporting quality of systematic reviews in overviews using PRISMA. Abstracts of the 23rd Cochrane Colloquium, 03-07 Oct 2015 2015 Vienna Wiley
- [35]Foisy M Fernandes RM Dryden DM Hartling L Grading the quality of evidence in existing systematic reviews: challenges and considerations. Abstracts of the 22nd Cochrane Colloquium, 21-26 Sep 2014 2014 Hyderabad Wiley
- [39]Cochrane: Special collection: Cochrane overviews. http://www.cochranelibrary.com/app/content/special-collections/article/?doi=10.1002/(ISSN)14651858(CAT)na(VI)SC000036 (2014). Accessed 30 Nov 2015. · DOI
Cited by
Sorted by citations
Adverse Outcomes of Polypharmacy in Older People: Systematic Review of Reviews
Davies, L. E., Spiers, G., Kingston, A., Todd, A., Adamson, J., & Hanratty, B. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.10.022 · Cited by 548 · see citing works
Montazeri, A., Mohammadi, S., M.Hesari, P., Ghaemi, M., Riazi, H., & Sheikhi-Mobarakeh, Z. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02410-2 · Cited by 433 · see citing works
Panel, S. G. P. C., Hoekstra, F., Mrklas, K., Khan, M., McKay, R. C., Vis‐Dunbar, M., Sibley, K. M., Nguyen, T., Graham, I. D., & Gainforth, H. L. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-0544-9 · Cited by 346 · see citing works
An Overview of Reviews on Interprofessional Collaboration in Primary Care: Barriers and Facilitators
Rawlinson, C., Carron, T., Cohidon, C., Arditi, C., Hong, Q. N., Pluye, P., Peytremann‐Bridevaux, I., & Gilles, I. (2021) · International Journal of Integrated Care · doi:10.5334/ijic.5589 · Cited by 335 · see citing works
Hunt, H., Pollock, A., Campbell, P., Estcourt, L., & Brunton, G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0695-8 · Cited by 314 · see citing works
Prehabilitation in adult patients undergoing surgery: an umbrella review of systematic reviews
McIsaac, D. I., Gill, M., Boland, L., Hutton, B., Branje, K., Shaw, J., Grudzinski, A. L., Barone, N., Gillis, C., Akhtar, S., et al. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.11.014 · Cited by 312 · see citing works
Bougioukas, K. I., Liakos, A., Tsapas, A., Ntzani, E., & Haidich, A.-B. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.002 · Cited by 251 · see citing works
Pollock, M., Fernandes, R. M., Pieper, D., Tricco, A. C., Gates, M., Gates, A., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1252-9 · Cited by 228 · see citing works
Self-citationRouleau, G., Gagnon, M., Côté, J., Payne-Gagnon, J., Hudson, É., Dubois, C., & Bouix‐Picasso, J. (2019) · Journal of Medical Internet Research · doi:10.2196/15118 · Cited by 219 · see citing works
A psychometric study found AMSTAR 2 to be a valid and moderately reliable appraisal tool
Lorenz, R. C., Matthias, K., Pieper, D., Wegewitz, U. E., Morche, J., Nocon, M., Rissling, O., Schirm, J., & Jacobs, A. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.05.028 · Cited by 207 · see citing works
Rehfuess, E. A., Stratil, J. M., Scheel, I. B., Portela, A. G., Norris, S. L., & Baltussen, R. M. P. M. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000844 · Cited by 209 · see citing works
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184 · see citing works
Interventions during pregnancy to prevent preterm birth: an overview of Cochrane systematic reviews.
Medley, N., Vogel, J. P., Care, A., & Alfirevic, Z. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012505.pub2 · Cited by 144 · see citing works
Nair, M., Svedberg, P., Larsson, I., & Nygren, J. M. (2024) · PLOS ONE · doi:10.1371/journal.pone.0305949 · Cited by 179 · see citing works
Artificial Intelligence in the Tourism Industry: An Overview of Reviews
García-Madurga, M.-Á., & Grilló-Méndez, A.-J. (2023) · Administrative Sciences · doi:10.3390/admsci13080172 · Cited by 218 · see citing works
Digital health interventions in palliative care: a systematic meta-review
Finucane, A. M., O’Donnell, H., Lugton, J., Gibson-Watt, T., Swenson, C., & Pagliari, C. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00430-7 · Cited by 163 · see citing works
Selecting and implementing overview methods: implications from five exemplar overviews
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0534-3 · Cited by 134 · see citing works
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139 · see citing works
Introduction to Umbrella Reviews as a Useful Evidence-Based Practice
Choi, G. J., & Kang, H. (2023) · Journal of Lipid and Atherosclerosis · doi:10.12997/jla.2023.12.1.3 · Cited by 144 · see citing works
Overviews of systematic reviews: great promise, greater challenge
McKenzie, J. E., & Brennan, S. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0582-8 · Cited by 134 · see citing works
Medication adherence interventions and outcomes: an overview of systematic reviews
Wilhelmsen, N. C., & Eriksson, T. (2018) · European Journal of Hospital Pharmacy · doi:10.1136/ejhpharm-2018-001725 · Cited by 133 · see citing works
Pollock, M., Fernandes, R. M., Newton, A. S., Scott, S. D., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-018-0768-8 · Cited by 132 · see citing works
Self-citationTricco, A. C., Zarin, W., Ghassemi, M., Nincic, V., Lillie, E., Page, M. J., Shamseer, L., Antony, J., Rios, P., Hwee, J., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.014 · Cited by 122 · see citing works
Self-citationGates, M., Gates, A., Guitard, S., Pollock, M., & Hartling, L. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01509-0 · Cited by 115 · see citing works
Self-citationGallou‐Guyot, M., Mandigout, S., Bherer, L., & Perrochon, A. (2020) · Ageing Research Reviews · doi:10.1016/j.arr.2020.101135 · Cited by 119 · see citing works
McMahon, N. E., Thomson, K. H., Kaner, E., & Bambra, C. L. (2018) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.11.048 · Cited by 112 · see citing works
An Overview of Reviews on Interprofessional Collaboration in Primary Care: Effectiveness
Carron, T., Rawlinson, C., Arditi, C., Cohidon, C., Hong, Q. N., Pluye, P., Gilles, I., & Peytremann‐Bridevaux, I. (2021) · International Journal of Integrated Care · doi:10.5334/ijic.5588 · Cited by 111 · see citing works
Pollock, M., Fernandes, R. M., & Hartling, L. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0325-5 · Cited by 107 · see citing works
Self-citationResistance training and health in adults: an overview of systematic reviews
El-Kotob, R., Ponzano, M., Chaput, J., Janssen, I., Kho, M. E., Poitras, V. J., Ross, R., Ross‐White, A., Saunders, T. J., & Giangregorio, L. (2020) · Applied Physiology Nutrition and Metabolism · doi:10.1139/apnm-2020-0245 · Cited by 102 · see citing works
Cai, D. F., Fan, Q. H., Zhong, H. H., Peng, S., & Song, H. (2019) · Journal of Orthopaedic Surgery and Research · doi:10.1186/s13018-019-1422-4 · Cited by 100 · see citing works
Banzi, R., Cinquini, M., González‐Lorenzo, M., Pecoraro, V. L., Capobussi, M., & Minozzi, S. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.02.024 · Cited by 95 · see citing works
Family Involvement in Adult Chronic Disease Care: Reviewing the Systematic Reviews
Gilliss, C. L., Pan, W., & Davis, L. L. (2019) · Journal of Family Nursing · doi:10.1177/1074840718822365 · Cited by 96 · see citing works
Socio-Economic Inequalities in Lung Cancer Outcomes: An Overview of Systematic Reviews
Redondo‐Sánchez, D., Petrova, D., Rodríguez‐Barranco, M., Fernández‐Navarro, P., Jiménez‐Moleón, J. J., & Sánchez, M. (2022) · Cancers · doi:10.3390/cancers14020398 · Cited by 99 · see citing works
Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study
Gooßen, K., Heß, S., Lunny, C., & Pieper, D. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00983-3 · Cited by 89 · see citing works
Chakhtoura, M., Bacha, D. S., Gharios, C., Ajjour, S., Assaad, M. A., Jabbour, Y., Kahale, F., Bassatne, A., Antoun, S., Akl, E. A., et al. (2021) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgab742 · Cited by 85 · see citing works
Gates, M., Gates, A., Duarte, G. S., Cary, M., Becker, M., Prediger, B., Vandermeer, B., Fernandes, R. M., Pieper, D., & Hartling, L. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.04.026 · Cited by 73 · see citing works
Self-citationImproving outcomes for older people in the emergency department: a review of reviews
Preston, L. R., van Oppen, J. D., Conroy, S., Ablard, S., Woods, H. B., & Mason, S. M. (2020) · Emergency Medicine Journal · doi:10.1136/emermed-2020-209514 · Cited by 72 · see citing works
Lunny, C., Brennan, S. E., Reid, J., McDonald, S., & McKenzie, J. E. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.09.025 · Cited by 71 · see citing works
Gallou‐Guyot, M., Mandigout, S., Combourieu, L., Bherer, L., & Perrochon, A. (2020) · Neurophysiologie Clinique · doi:10.1016/j.neucli.2020.10.010 · Cited by 70 · see citing works
Impact of organized activities on mental health in children and adolescents: An umbrella review
Boelens, M., Smit, M. S., Raat, H., Bramer, W. M., & Jansen, W. (2022) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2021.101687 · Cited by 65 · see citing works
Hersi, M., Traversy, G., Thombs, B. D., Beck, A., Skidmore, B., Groulx, S., Lang, E., Reynolds, D. L., Wilson, B. J., Bernstein, S. L., et al. (2019) · Systematic Reviews · doi:10.1186/s13643-018-0928-x · Cited by 66 · see citing works
Pollock, M., Fernandes, R. M., Newton, A. S., Scott, S. D., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-018-0914-3 · Cited by 52 · see citing works
Self-citationGates, A., Gates, M., Duarte, G. S., Cary, M., Becker, M., Prediger, B., Vandermeer, B., Fernandes, R. M., Pieper, D., & Hartling, L. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0746-1 · Cited by 60 · see citing works
Self-citationCiocanel, O., Power, K., & Eriksen, A. (2019) · Sexual Medicine · doi:10.1016/j.esxm.2019.06.001 · Cited by 55 · see citing works
Pornography use and sexting amongst children and young people: a systematic overview of reviews
Raine, G., Khouja, C., Scott, R. H., Wright, K. E., & Sowden, A. J. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01541-0 · Cited by 49 · see citing works
Curnow, E., Rutherford, M., Maciver, D., Johnston, L., Prior, S., Boilson, M., Shah, P. J., Jenkins, N. D., & Meff, T. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288275 · Cited by 60 · see citing works
A review protocol on research partnerships: a Coordinated Multicenter Team approach
Hoekstra, F., Mrklas, K., Sibley, K. M., Nguyen, T., Vis‐Dunbar, M., Neilson, C. J., Crockett, L. K., Gainforth, H. L., & Graham, I. D. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0879-2 · Cited by 47 · see citing works
Advances in Precision Coffee Growing Research: A Bibliometric Review
Santana, L. S., Ferraz, G. A. E. S., Teodoro, A. J. D. S., Santana, M. S., Rossi, G., & Palchetti, E. (2021) · Agronomy · doi:10.3390/agronomy11081557 · Cited by 48 · see citing works
Laranjeira, F. O., de Andrade, K. R. C., Figueiredo, A. C. M. G., Silva, E. N., & Pereira, M. G. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194801 · Cited by 41 · see citing works
Świerz, M. J., Storman, D., Zając, J., Koperny, M., Węglarz, P., Staśkiewicz, W., Górecka, M., Skuza, A. A., Wach, A. A., Kaluzinska, K., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01457-w · Cited by 41 · see citing works
Patten, R. V., Mulhauser, K. R. W., Austin, T. A., Bellone, J. A., Cotton, E., Chan, L. C. N., Twamley, E. W., Sawyer, K., & LaFrance, W. C., Jr. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102648 · Cited by 38 · see citing works
Birnie, K. A., Ouellette, C., Amaral, T. D., & Stinson, J. (2020) · Canadian Journal of Pain · doi:10.1080/24740527.2020.1757384 · Cited by 39 · see citing works
Casteli, C. P. M., Mbemba, G. I. C., Dumont, S., Dallaire, C., Juneau, L., Martin, E., Laferrière, M.-C., & Gagnon, M. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01423-5 · Cited by 39 · see citing works
Understanding and Measuring the Wellbeing of Carers of People With Dementia
Cunningham, N. A., Cunningham, T., & Roberston, J. M. (2018) · The Gerontologist · doi:10.1093/geront/gny018 · Cited by 36 · see citing works
Systematic reviews and meta-analysis in nutrition research
Kelley, G. A., & Kelley, K. S. (2019) · British Journal Of Nutrition · doi:10.1017/s0007114519002241 · Cited by 35 · see citing works
Feng, T., Wang, X., Jin, Z., Qin, X., Sun, C., Qi, B., Zhang, Y., Zhu, L., & Wei, X. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1081238 · Cited by 29 · see citing works
Bunn, M., Gonzalez, N., Falek, I., Weine, S. M., & Acri, M. C. (2021) · Intervention · doi:10.4103/intv.intv_47_20 · Cited by 29 · see citing works
McMorrow, R., Kriza, C., Urbán, P., Amenta, V., Blasco‐Amaro, J. A., Panidis, D., Chassaigne, H., & Griesinger, C. B. (2020) · International Journal of Cardiology · doi:10.1016/j.ijcard.2020.04.022 · Cited by 28 · see citing works
Hendricks, L., Eshun‐Wilson, I., & Rohwer, A. C. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01582-z · Cited by 30 · see citing works
Salazar, J., Bracchiglione, J., Salas-Gama, K., Antequera, A., Auladell-Rispau, A., Dorantes-Romandía, R., Meade, A.-G., Quintana, M. J., Requeijo, C., Rodríguez-Grijalva, G., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.05.034 · Cited by 28 · see citing works
Quality of Life and Breast Cancer: How Can Mind–Body Exercise Therapies Help? An Overview Study
Husebø, A. M. L., & Husebø, T. (2017) · Sports · doi:10.3390/sports5040079 · Cited by 28 · see citing works
Tan, A. R., Nagraj, S. K., Nasser, M., Sharma, T., & Kuchenmüller, T. (2022) · Bulletin of the National Research Centre/Bulletin of the National Research Center · doi:10.1186/s42269-021-00687-8 · Cited by 27 · see citing works
Bhatia, D., Mishra, S., Kirubarajan, A., Yanful, B., Allin, S. M., & Ruggiero, E. D. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-052041 · Cited by 29 · see citing works
Chen, J., Chen, S., Yang, X., Wang, S., & Wu, W. (2022) · Phytomedicine · doi:10.1016/j.phymed.2022.154141 · Cited by 26 · see citing works
Pieper, D., Pollock, M., Fernandes, R. M., Büchter, R. B., & Hartling, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0468-9 · Cited by 25 · see citing works
Self-citationHuang, J., Liu, H., Chen, J., Cai, X., & Huang, Y. (2020) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2020.10.007 · Cited by 25 · see citing works
Huang, J., Qin, X., Shen, M., Xu, Y., & Huang, Y. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.589267 · Cited by 25 · see citing works
Umbrella reviews: A new tool to synthesize scientific evidence in surgery
Slim, K., & Marquillier, T. (2021) · Journal of Visceral Surgery · doi:10.1016/j.jviscsurg.2021.10.001 · Cited by 25 · see citing works
Knowledge Synthesis in Evidence-Based Medicine
Garritty, C., Stevens, A., Hamel, C., Golfam, M., Hutton, B., & Wolfe, D. M. (2019) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2018.11.006 · Cited by 25 · see citing works
Acupuncture for Post-Stroke Cognitive Impairment: An Overview of Systematic Reviews
Li, L., Yang, L., Luo, B., Deng, L., Zhong, Y., Gan, D., Wu, X., Feng, P., & Zhu, F. (2022) · International Journal of General Medicine · doi:10.2147/ijgm.s376759 · Cited by 24 · see citing works
Umbrella reviews: a useful study design in need of standardisation
Shi, X., & Wallach, J. D. (2022) · BMJ · doi:10.1136/bmj.o1740 · Cited by 23 · see citing works
Tillyard, G., & DeGennaro, V. A. (2018) · Qualitative Health Research · doi:10.1177/1049732318816675 · Cited by 23 · see citing works
The Current Trend in Management of Bruxism and Chronic Pain: An Overview of Systematic Reviews
Bussadori, S. K., Motta, L. J., Horliana, A. C. R. T., Santos, E. M., & Martimbianco, A. L. C. (2020) · Journal of Pain Research · doi:10.2147/jpr.s268114 · Cited by 23 · see citing works
Byrne, S., Cobham, V., Richardson, M., & Imuta, K. (2023) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-023-00436-5 · Cited by 23 · see citing works
Food-based indexes and their association with dietary inflammation
Reyneke, G. L., Lambert, K., & Beck, E. J. (2025) · Advances in Nutrition · doi:10.1016/j.advnut.2025.100400 · Cited by 24 · see citing works
Nonviolent Discipline Options for Caregivers and Teachers: A Systematic Overview of the Evidence
Quail, K. R., & Ward, C. L. (2020) · Trauma Violence & Abuse · doi:10.1177/1524838020967340 · Cited by 22 · see citing works
Exercise and Manual Therapy for the Treatment of Primary Headache: An Umbrella and Mapping Review
Varangot‐Reille, C., Suso‐Martí, L., Dubuis, V., Cuenca‐Martínez, F., Blanco‐Díaz, M., Salar-Andreu, C., Casaña, J., & Calatayud, J. (2022) · Physical Therapy · doi:10.1093/ptj/pzab308 · Cited by 21 · see citing works
Ribeiro, L. G., Antunes, L. S., Küchler, É. C., Baratto‐Filho, F., Kirschneck, C., Guimarães, L. S., & Antunes, L. A. A. (2023) · Clinical Oral Investigations · doi:10.1007/s00784-022-04837-8 · Cited by 21 · see citing works
Daguman, E. I., Hutchinson, M., & Lakeman, R. (2024) · International Journal of Mental Health Nursing · doi:10.1111/inm.13376 · Cited by 23 · see citing works
Rouleau, G., Gagnon, M., Côté, J., Payne-Gagnon, J., Hudson, É., Bouix‐Picasso, J., & Dubois, C. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018441 · Cited by 22 · see citing works
Doyle, F., Freedland, K. E., Carney, R. M., de Jonge, P., Dickens, C. M., Pedersen, S. S., Sørensen, J. R., & Dempster, M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-0985-9 · Cited by 18 · see citing works
Bracchiglione, J., Meza, N., Pérez-Carrasco, I., Vergara‐Merino, L., Eva Madrid, A., Urrútia, G., & Bonfill, X. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.05.006 · Cited by 19 · see citing works
Kedzior, K. K., & Kaplan, I. (2019) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2019.08.008 · Cited by 20 · see citing works
Advance care planning for older adults in community‐based settings: An umbrella review
Park, E., Jo, M., Park, M., & Kang, S. (2021) · International Journal of Older People Nursing · doi:10.1111/opn.12397 · Cited by 18 · see citing works
Development and application of an outcome-centric approach for conducting overviews of reviews
Kho, M. E., Poitras, V. J., Janssen, I., Chaput, J., Saunders, T. J., Giangregorio, L., Tomasone, J. R., Ross‐White, A., & Ross, R. (2020) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2020-0564 · Cited by 17 · see citing works
A step-by-step guide for conducting an umbrella review
Abdellatif, M., Dadam, M. N., Vu, N. T., Nam, N. H., Nguyen, Q. H., Taoube, Z., Tran, P., & Huy, N. T. (2025) · Tropical Medicine and Health · doi:10.1186/s41182-025-00764-y · Cited by 16 · see citing works
Compost Barns: A Bibliometric Analysis
Silva, G. G. B. S., Ferraz, P. F. P., Damasceno, F. A., Zotti, M. L. A. N., & Barbari, M. (2022) · Animals · doi:10.3390/ani12192492 · Cited by 16 · see citing works
Synthesising evidence on patient portals: a protocol for an umbrella review
Petrovskaya, O., Lau, F. Y., & Antonio, M. G. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024469 · Cited by 15 · see citing works
Botulinum Toxin for Bruxism: An Overview
Coelho, M. S., de Oliveira, J. M. D., Polmann, H., Pauletto, P., Stefani, C. M., Maciel, L. C. D. L., & Canto, G. D. L. (2025) · Toxins · doi:10.3390/toxins17050249 · Cited by 14 · see citing works
Silverwood, V., Bullock, L., Jordan, J. L., Turner, K. M., Chew-Graham, C. A., Kingstone, T., & Dawson, S. (2023) · BJGP Open · doi:10.3399/bjgpo.2023.0022 · Cited by 16 · see citing works
Nyanchoka, L., Smith, C. T., Porcher, R., & Hren, D. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-039932 · Cited by 14 · see citing works
An Overview of Systematic Reviews of Moxibustion for Knee Osteoarthritis
Yin, S., Zhu, F., Zhao, L., Che, D., Li, L., Feng, J., Zhang, L., & Huo, Z. (2022) · Frontiers in Physiology · doi:10.3389/fphys.2022.822953 · Cited by 16 · see citing works
Rouleau, G., Hong, Q. N., Kaur, N., Gagnon, M., Côté, J., Bouix‐Picasso, J., & Pluye, P. (2021) · Journal of Mixed Methods Research · doi:10.1177/15586898211054243 · Cited by 12 · see citing works
Borges, M. H. R., Miranda, L. F., Dini, C., Marañón‐Vásquez, G. A., Magno, M. B., Maia, L. C., & Barão, V. A. R. (2022) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2021.10.018 · Cited by 13 · see citing works
Laumbacher, H., Scholz, K. J., Knüttel, H., & Rosentritt, M. (2025) · Journal of Dentistry · doi:10.1016/j.jdent.2025.106004 · Cited by 11 · see citing works
Chen, J.-X., Chen, S., Zhou, Y., Wang, S.-M., & Wu, W.-Y. (2022) · Integrative Cancer Therapies · doi:10.1177/15347354221083910 · Cited by 12 · see citing works
Bougioukas, K. I., Karakasis, P., Pamporis, K., Bouras, E., & Haidich, A. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1705 · Cited by 11 · see citing works
Masri, J. E., Malak, A. A., Masri, D. E., Ghazi, M., Boussi, S. A., Masri, Y. E., Hassoun, M., Tlayss, M., Salameh, P., & Hosseini, H. (2024) · Brain Sciences · doi:10.3390/brainsci15010010 · Cited by 11 · see citing works
Pharmacological treatments for patients with irritable bowel syndrome
Qin, D., Yue, L., Xue, B., Chen, M., Tang, T., & Zheng, H. (2019) · Medicine · doi:10.1097/md.0000000000015920 · Cited by 11 · see citing works
Levack, W., & Fadyl, J. K. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-049522 · Cited by 12 · see citing works
- Authors
- Pollock, M., Fernandes, R. M., Becker, L. A., Featherstone, R., & Hartling, L.
- Affiliations
- University of Alberta (CA)
- University of Lisbon (PT)
- SUNY Upstate Medical University (US)
- Corresponding author
- Hartling, Lisa
- Venue
- Systematic Reviews
- Published
- 2016-11-14
- Volume
- 5
- Issue
- 1
- Pages
- 190-190
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5109841
- OpenAlex
- W2556359523
- Cited by
- 195
- References
- 29
- Citations by year
- 2026: 9 · 2025: 13 · 2024: 21 · 2023: 22 · 2022: 26 · 2021: 29 · 2020: 28 · 2019: 21 · 2018: 14 · 2017: 11 · 2013: 1
- FWCI
- 5.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Canadian Institutes of Health Research (119373)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- overviews of reviews, methodological recommendations, health interventions, evidence synthesis, quality of evidence, research methodology challenges
- MeSH terms
- Humans, Publications, Research Design, Research Personnel, Review Literature as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
