Best Practice Guidelines and Essential Methodological Steps to Conduct Rigorous and Systematic Meta‐Reviews

Hennessy, Emily A.; Johnson, Blair T.; Keenan, Ciara

doi:10.1111/aphw.12169

Cited by 91Meta-analysis and systematic reviewsPsychology Research and BibliometricsDelphi Technique in Research

Best Practice Guidelines and Essential Methodological Steps to Conduct Rigorous and Systematic Meta‐Reviews

Open access

Hennessy, Emily A., Johnson, Blair T., Keenan, Ciara·2019·Applied Psychology: Health and Well-Being

DOI 10.1111/aphw.12169PMC PMC6819213

Open this paper in CoChat — free account

Abstract

Background: A growing body of primary study and systematic review literature evaluates interventions and phenomena in applied and health psychology. Reviews of reviews (i.e., meta‐reviews) systematically synthesise and utilise this vast and often overwhelming literature; yet, currently there are few practical guidelines for meta‐review authors to follow. Objective: The aim of this article is to provide an overview of the best practice guidelines for all research synthesis and to detail additional specific considerations and methodological details for the best practice of conducting a rigorous meta‐review. Methods: This article provides readers with six systematic and practical steps along with accompanying examples to address with rigor the unique challenges that arise when authors familiar with systematic review methods begin a meta‐review: (a) detailing a clear scope, (b) identifying synthesis literature through strategic searches, (c) considering datedness of the literature, (d) addressing overlap among included reviews, (e) choosing and applying review quality tools, and (f) appropriate options for handling the synthesis and reporting of the vast amount of data collected in a meta‐review. Conclusions: We have curated best practice recommendations and practical tips for conducting a meta‐review. We anticipate that assessments of meta‐review quality will ultimately formalise best‐method guidelines.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1111/aphw.12169

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The search strategy retrieved 119 unique records, forward citation searching retrieved 92 citations, after deduplication 199 remained, after screening seven were included, one additional conference citation was found through expert knowledge, and one paper recently published was included after completion of the first draft.
“Our search strategy retrieved 119 unique records, and the forward citation searching retrieved 92 citations (Fig. 2). After deduplication 199 remained, and after screening abstracts and full text, seven were included [17–19, 28–31]. One additional conference citation was found through expert knowledge on the topic [32], and one paper recently published was included after completion of the first”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [30]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 2× · see citing works
“…of Medicine standards for high quality systematic reviews (Institute of Medicine, 2011), or the PRISMA statement and checklist (Moher, Liberati, Tetzlaff, Altman, & PRISMA Group, 2009; Moher et al., 2015), none of these are formalized quality assessment tools for individuals using those reviews.”
Background
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · cited 3× · see citing works
“…in the meta-review, help ensure a comprehensive report: (a) Characteristics of included reviews table (see example Overview of reviews table in Becker & Oxman, 2008); (b) a flow diagram to detail the search process; (c) review quality or risk of bias assessment results (aggregate figure of…”
Background
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · cited 6× · see citing works
“Research Synthesis Methods, 9(4), 602–614. doi: 10.1002/jrsm.1287 [PubMed: 29314757] Martin P, Surian D, Bashir R, Bourgeois FT, & Dunn AG (2019).”
BackgroundInfluential
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575 · see citing works
AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both.
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 1× · see citing works
“We name two that are widely used, especially for research using experimental designs: There are the two AMSTAR inventories (AMSTAR 2: Shea et al., 2017; AMSTAR: Shea et al., 2007) and Risk of Bias in Systematic Reviews (ROBIS: Whiting et al., 2016).”
Method
Untitled work
(2000) · Cited by 9,198 · see citing works
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374 · see citing works
Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis
Cooke, A., Smith, D., & Booth, A. (2012) · Qualitative Health Research · doi:10.1177/1049732312452938 · Cited by 2,608 · see citing works
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272 · see citing works
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R. W., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,255 · see citing works
A scoping review on the conduct and reporting of scoping reviews
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P., Wilson, K., et al. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0116-4 · Cited by 2,250 · cited 2× · see citing works
“Given that meta-reviews of both the Cochrane Library and the PROSPERO database have identified a substantial portion of reviews that had not pre-specified a primary outcome or, alternatively, had changed outcome reporting after conducting the review (Kirkham, Altman, & Williamson, 2010; Tricco et al., 2016), this prac…”
Background
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,087 · see citing works
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · see citing works
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483 · cited 2× · see citing works
“For such evidence to be put to maximal use, meta-reviews are important and even necessary (Bastian, Glasziou, & Chalmers, 2010; Ioannidis, 2016).”
Background
Systematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318 · cited 1× · see citing works
“Depending on the focus of the meta-review, authors may find it necessary to calculate the CCA both across all reports included and for particular outcomes (Pieper et al., 2014).”
Background
Introduction to Meta-Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., Rothstein, H. R., & Den, A. B. V. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.121 · Cited by 1,259 · see citing works
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · see citing works
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · cited 1× · see citing works
“—Effect size data are the “coin of the metaanalytic realm” (Rosenthal, 1995, p. 185), a sentiment highly relevant for meta-reviews incorporating quantitative findings.”
Background
Developing design propositions through research synthesis
Denyer, D., Tranfield, D., & van Aken, J. E. (2008) · Organization Studies · doi:10.1177/0170840607088020 · Cited by 1,057 · see citing works
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943 · see citing works
How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 1× · see citing works
“That is, a systematic review could have comprehensively searched the older literature so may include interventions that are no longer used in clinical practice (e.g., Shojania et al., 2007).”
Background
Qualitative Metasynthesis: Reflections on Methodological Orientation and Ideological Agenda
Thorne, S., Jensen, L., Kearney, M. H., Noblit, G., & Sandelowski, M. (2004) · Qualitative Health Research · doi:10.1177/1049732304269888 · Cited by 749 · see citing works
Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737 · see citing works
Robust variance estimation with dependent effect sizes: practical considerations including a software tutorial in Stata and <scp>spss</scp>
Tanner-Smith, E. E., & Tipton, E. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1091 · Cited by 588 · see citing works
Machine learning for identifying Randomized Controlled Trials: An evaluation and practitioner's guide
Marshall, I. J., Noel‐Storr, A., Kuiper, J., Thomas, J., & Wallace, B. C. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1287 · Cited by 435 · see citing works
The harvest plot: A method for synthesising evidence about the differential effects of interventions
Ogilvie, D., Fayter, D., Petticrew, M. P., Sowden, A. J., Thomas, S., Whitehead, M. M., & Worthy, G. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-8 · Cited by 423 · see citing works
Searching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371 · cited 1× · see citing works
“Both the Campbell Collaboration and the Cochrane Collaboration have published extensive guidelines for information retrieval in systematic reviews (Kugley et al., 2016) and these advocate consultations with an information retrieval specialist from the outset.”
Teaching the analysis of textual data: an experiential approach
Burnard, P. (1996) · Nurse Education Today · doi:10.1016/s0260-6917(96)80115-8 · Cited by 329 · cited 2× · see citing works
“…next requires data immersion by reading the reviews in depth multiple times to “mak[e]sense of the data”, i.e., gain a clear understanding of ‘who’ is reporting; ‘where’ it is happening; ‘when it happened; ‘what’ happened; and ‘why’ (Burnard, 1996; Dey, 1997; Duncan, 1989; Elo & Kyngas, 2008).”
Background
The Human Behaviour-Change Project: harnessing the power of artificial intelligence and machine learning for evidence synthesis and interpretation
Michie, S., Thomas, J., Johnston, M., Aonghusa, P. M., Shawe-Taylor, J. S., Kelly, M. P., Deleris, L. A., Finnerty, A. N., Marques, M. M., Norris, E., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0641-5 · Cited by 326 · cited 2× · see citing works
“hope in reduced effort in extracting data from reports (Michie et al., 2017).”
BackgroundMethod
Selecting Studies for Systemic Review: Inclusion and Exclusion Criteria
Meline, T. J. (2006) · Contemporary Issues in Communication Science and Disorders · doi:10.1044/cicsd_33_s_21 · Cited by 325 · cited 1× · see citing works
“Meta-review authors should report and justify any filtering decisions that are not substantively related to the question of interest (Meline, 2006).”
Background
Finding What Works in Health Care: Standards for Systematic Reviews
Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Board on Health Care Services, & Institute of Medicine (2011) · doi:10.17226/13059 · Cited by 289 · see citing works
Working with Low Survey Response Rates: The Efficacy of Weighting Adjustments
Dey, E. L. (1997) · Research in Higher Education · doi:10.1023/a:1024985704202 · Cited by 283 · cited 2× · see citing works
“…next requires data immersion by reading the reviews in depth multiple times to “mak[e]sense of the data”, i.e., gain a clear understanding of ‘who’ is reporting; ‘where’ it is happening; ‘when it happened; ‘what’ happened; and ‘why’ (Burnard, 1996; Dey, 1997; Duncan, 1989; Elo & Kyngas, 2008).”
Background
How to do a good systematic review of effects in international development: a tool kit
Waddington, H., White, H., Snilstveit, B., Hombrados, J. G., Vojtkova, M., Davies, P., Bhavsar, A., Eyers, J., Koehlmoos, T. P., Petticrew, M., et al. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711765 · Cited by 278 · cited 2× · see citing works
“…explicated in numerous texts (e.g., see Borenstein, Hedges, Higgins, & Rothstein, 2011; Lipsey & Wilson, 2001; The Cochrane Collaboration., 2011; Waddington et al., 2012) and will not be detailed here, nevertheless, there are additional considerations for conducting meta-reviews that should be…”
Background
Methods for dealing with multiple outcomes in meta-analysis<b>:</b>a comparison between averaging effect sizes, robust variance estimation and multilevel meta-analysis
Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · cited 1× · see citing works
“We add a final fourth approach, which is combining individual studies’ effect sizes from all meta-analyses in the sample (but only incorporate them once), and then model the effects using either multi-level meta-analysis or robust variance estimators, which both control for clustering of non-independent observations,…”
Method
Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234 · see citing works
Self-citation
Overviews of Reviews
Becker, L. A., & Oxman, A. D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch22 · Cited by 218 · see citing works
Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses
Johnson, B. T., & Hennessy, E. A. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.05.035 · Cited by 215 · cited 5× · see citing works
“As we conclude elsewhere for systematic reviews in general (Johnson & Hennessy, 2019), setting an appropriate scope will ease the steps that follow.”
BackgroundMethodInfluentialSelf-citation
The prevalence of and factors associated with inclusion of non-English language studies in Campbell systematic reviews: a survey and meta-epidemiological study
Rasmussen, L. N., & Montgomery, P. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0786-6 · Cited by 204 · cited 1× · see citing works
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript as it may increase bias and reduce precision of findings through the exclusion of useful and relevant data (Neimann Rasmussen & Montgomery, 2018).”
Background
The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship.
Cooper, H., & Koenka, A. C. (2012) · American Psychologist · doi:10.1037/a0027119 · Cited by 196 · cited 3× · see citing works
“Yet, evidence indicates that even meta-analyses are frequently opaque with regard to quantitative information and can present conflicting, incorrect, or inadequate data (Cooper & Koenka, 2012; Polanin, Hennessy, & Tsuji, 2019; Schmidt & Oh, 2013).”
BackgroundMethod
A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: The Study Design and Implementation Assessment Device (Study DIAD).
Valentine, J. C., & Cooper, H. M. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.2.130 · Cited by 184 · cited 1× · see citing works
“…uthor M anuscript simplified reporting, these scales were not intended to be used in this way and simply presenting a scale score without discussing the major issues and implications of these findings oversimplifies the issue (Cornell & Laine, 2008; Johnson, et al., 2015; Valentine & Cooper, 2008).”
Method
Failsafe N or File‐Drawer Number
Becker, B. J. (2005) · doi:10.1002/0470870168.ch7 · Cited by 179 · see citing works
Bias Due to Changes in Specified Outcomes during the Systematic Review Process
Kirkham, J. J., Altman, D. G., & Williamson, P. R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009810 · Cited by 164 · see citing works
Estimating Time to Conduct a Meta-analysis From Number of Citations Retrieved
Allen, I. E. (1999) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.282.7.634 · Cited by 163 · see citing works
Meta-Synthesis of Health Behavior Change Meta-Analyses
Johnson, B. T., Scott-Sheldon, L. A. J., & Carey, M. P. (2010) · American Journal of Public Health · doi:10.2105/ajph.2008.155200 · Cited by 160 · see citing works
Self-citation
Methods for second order meta-analysis and illustrative applications
Schmidt, F. L., & Oh, I.-S. (2013) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2013.03.002 · Cited by 151 · cited 3× · see citing works
“Yet, evidence indicates that even meta-analyses are frequently opaque with regard to quantitative information and can present conflicting, incorrect, or inadequate data (Cooper & Koenka, 2012; Polanin, Hennessy, & Tsuji, 2019; Schmidt & Oh, 2013).”
Background
Selecting and implementing overview methods: implications from five exemplar overviews
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0534-3 · Cited by 134 · see citing works
Overviews in Education Research
Polanin, J. R., Maynard, B. R., & Dell, N. A. (2016) · Review of Educational Research · doi:10.3102/0034654316631117 · Cited by 132 · see citing works
Umbrella Reviews
Biondi‐Zoccai, G. (2016) · Springer eBooks · doi:10.1007/978-3-319-25655-9 · Cited by 121 · see citing works
Meta-analyses with industry involvement are massively published and report no caveats for antidepressants
Ebrahim, S., Bance, S., Athale, A., Malachowski, C., & Ioannidis, J. P. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.021 · Cited by 107 · see citing works
Transparency and reproducibility of meta-analyses in psychology: A meta-review
Polanin, J. R., Hennessy, E. A., & Tsuji, S. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620906416 · Cited by 100 · see citing works
Self-citation
Do published studies yield larger effect sizes than unpublished studies in education and special education? A meta-review
Chow, J. C., & Ekholm, E. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9437-7 · Cited by 80 · see citing works
How is AMSTAR applied by authors – a call for better reporting
Pieper, D., Könsgen, N., Breuing, J., Ge, L., & Wegewitz, U. E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0520-z · Cited by 78 · see citing works
An exploration of crowdsourcing citation screening for systematic reviews
Mortensen, M. L., Adam, G. P., Trikalinos, T. A., Kraska, T., & Wallace, B. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1252 · Cited by 76 · see citing works
Many scenarios exist for selective inclusion and reporting of results in randomized trials and systematic reviews
Page, M. J., McKenzie, J. E., & Forbes, A. B. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.10.010 · Cited by 75 · see citing works
Content Analysis in Health Education Research: An Introduction to Purposes and Methods
Duncan, D. F. (1989) · Health Education · doi:10.1080/00970050.1989.10610182 · Cited by 70 · cited 2× · see citing works
“…next requires data immersion by reading the reviews in depth multiple times to “mak[e]sense of the data”, i.e., gain a clear understanding of ‘who’ is reporting; ‘where’ it is happening; ‘when it happened; ‘what’ happened; and ‘why’ (Burnard, 1996; Dey, 1997; Duncan, 1989; Elo & Kyngas, 2008).”
Background
Factors Underlying the Success of Behavioral HIV-Prevention Interventions for Adolescents: A Meta-Review
Protogerou, C., & Johnson, B. T. (2014) · AIDS and Behavior · doi:10.1007/s10461-014-0807-y · Cited by 68 · cited 1× · see citing works
“…Athale, Malachowski, & Ioannidis, 2016); comparing and contrasting effects of behavioral interventions by pooling and re-analyzing trends from multiple metaanalyses (e.g., Johnson, Scott-Sheldon, & Carey, 2010); and, to explicate or develop theoretical frameworks (e.g., Protogerou & Johnson, 2014).”
Self-citation
Panning for the gold in health research: Incorporating studies’ methodological quality in meta-analysis
Johnson, B. T., Low, R. E., & MacDonald, H. V. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953533 · Cited by 58 · see citing works
Self-citation
A Comparison of Statistical Methods for Identifying Out-of-Date Systematic Reviews
Pattanittum, P., Laopaiboon, M., Moher, D., Lumbiganon, P., & Ngamjarus, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048894 · Cited by 34 · cited 1× · see citing works
“Alternatively, some quantitative methods can assist with this task (e.g., see Pattanittum et al., 2012).”
Method
Harnessing the Power of Education Research Databases With the Pearl-Harvesting Methodological Framework for Information Retrieval
Sandieson, R., Kirkpatrick, L. C., Sandieson, R. M., & Zimmerman, W. (2009) · The Journal of Special Education · doi:10.1177/0022466909349144 · Cited by 30 · see citing works
Spatiotemporal meta-analysis: reviewing health psychology phenomena over space and time
Johnson, B. T., Cromley, E. K., & Marrouch, N. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1343679 · Cited by 30 · see citing works
Self-citation
Trial2rev: Combining machine learning and crowd-sourcing to create a shared space for updating systematic reviews
Martin, P. B., Surian, D., Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooy062 · Cited by 24 · see citing works
The Science and Art of Deduction: Complex Systematic Overviews
Cornell, J. E., & Laine, C. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-10-200805200-00012 · Cited by 9 · cited 2× · see citing works
“Decisions for each step may vary depending on the scope of the meta-review as well as the team’s resource capacity, size of the existing synthesis base, overlap among similar reviews, and degree of expected heterogeneity (Whitlock et al., 2008 in Cornell & Laine, 2008).”
BackgroundMethod
Designing the Review
Papageorgiou, S. N., & Biondi‐Zoccai, G. (2016) · Springer eBooks · doi:10.1007/978-3-319-25655-9_5 · Cited by 4 · cited 3× · see citing works
“When it comes to reporting key outcomes, authors of meta-reviews have three primary synthesis options (Papageorgiou & Biondi-Zoccai, 2016): (a) narrative synthesis; (b) “semiquantitative” synthesis”; or (c) quantitative synthesis.”
BackgroundMethod

Flagged first, then by citations

Research works printed but not linked: 5

Churchill R, Lasserson T, Chandler J, Tovey D, & Higgins JPT (2016). Standards for the conduct of new Cochrane Intervention Reviews. In Higgins JPT, Lasserson, Chandler J, Tovey D, & Churchill R (Eds.), Methodological Expectations of Cochrane Intervention Reviews London, England: Cochrane.
Hennessy EA, Johnson BT, Acabchuk RL, McCloskey K, Iqbal S, Roethke L, … McDavid K (2018). Self-regulation as a target mechanism of behaviour change interventions: A meta-review. Paper presented at the Presentation at the 32nd Annual Conference of the European Health Psychology Society. Galway, Ireland.
Higgins JP, & Green S (2011). Cochrane handbook for systematic reviews of interventions (5.1.0, Updated March 2011 ed.) The Cochrane Collaboration Retrieved from www.cochrane-handbook.org
Schünemann H, Brożek J, Guyatt G, & Oxman A (Eds.). (2013). GRADE handbook for grading quality of evidence and strength of recommendations The GRADE Working Group Retrieved from https://gdt.gradepro.org/app/handbook/handbook.html
The Cochrane Collaboration. (2011). In Higgins JPT (Ed.), Cochrane handbook for systematic reviews of interventions. Version 5.1.0 Retrieved from www.cochrane-handbook.org

Sorted by citations

Examining overlap of included studies in meta‐reviews: Guidance for using the corrected covered area index
Hennessy, E. A., & Johnson, B. T. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1390 · Cited by 348 · see citing works
“The extent to which systematic reviews in a particular domain include the same studies varies widely, depending on many factors.(1,9) On the one hand, if reviews address similar questions with similar methods and integrate largely the same primary-level studies' Received: 26 July 2019 Revised: 22 October 2019 Accepted…”
BackgroundSelf-citation
Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252 · see citing works
Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses
Johnson, B. T., & Hennessy, E. A. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.05.035 · Cited by 215 · see citing works
Self-citation
A comprehensive meta-review of systematic reviews and meta-analyses on nonpharmacological interventions for informal dementia caregivers
Cheng, S.-T., & Zhang, F. (2020) · BMC Geriatrics · doi:10.1186/s12877-020-01547-2 · Cited by 166 · see citing works
Digital transformation: A meta-review and guidelines for future research
dos Reis, J. C. G., & Melão, N. F. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e12834 · Cited by 201 · see citing works
“Meta-reviews are methods known to be able to gather the literature and which can have a significant influence on research, practice, and policy [35].”
Method
Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis
Noetel, M., Griffith, S., Delaney, O., Harris, N. R., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C. (2022) · Review of Educational Research · doi:10.3102/00346543211052329 · Cited by 148 · see citing works
“Our analyses, therefore, met all the assumptions for a second-order meta-analysis: random effects between and within meta-analyses, inverse sampling weights, and between-sample independence (Hennessy et al., 2019; Schmidt & Oh, 2013).”
COVID-19 and common mental health symptoms in the early phase of the pandemic: An umbrella review of the evidence
Witteveen, A. B., Young, S. Y., Cuijpers, P. J., Ayuso‐Mateos, J. L., Barbui, C., Bertolini, F., Cabello, M., Cadorin, C., Downes, N., Franzoi, D., et al. (2023) · PLoS Medicine · doi:10.1371/journal.pmed.1004206 · Cited by 135 · see citing works
Methods for depicting overlap in overviews of systematic reviews: An introduction to static tabular and graphical displays
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Savvides, E. D., Karakosta, C., Diakonidis, T., Tsapas, A., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.004 · Cited by 117 · see citing works
“Of note, based on the focus of the OoSRs, it may be essential to investigate potential overlap of information in particular primary outcomes of interest in addition to the overall degree of overlap across all included SRs [13,14,17,35].”
Background
Effects of chronic physical activity on cognition across the lifespan: a systematic meta-review of randomized controlled trials and realist synthesis of contextualized mechanisms
Pesce, C., Vazou, S., Benzing, V., Álvarez‐Bueno, C., Anzeneder, S., Mavilidi, M. F., Leone, L., & Schmidt, M. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1929404 · Cited by 108 · see citing works
“To provide an ‘ umbrella ’ for ‘ a rain of evidence ’ (Hennessy et al., 2019, p. 2) and navigate through an abundant production of SRs (Ioannidis, 2016), we need to address meta-issues with a systematic review of systematic reviews (i.e. systematic meta-review).”
BackgroundMethod
Effectiveness of interventions targeting self-regulation to improve adherence to chronic disease medications: a meta-review of meta-analyses
Wilson, T. E., Hennessy, E. A., Falzon, L., Boyd, R., Kronish, I. M., & Birk, J. L. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1706615 · Cited by 95 · see citing works
Self-citation
A Systematic Overview of Meta-Analyses on Socioeconomic Status, Cognitive Ability, and Achievement: The Need to Focus on Specific Pathways
Korous, K. M., Causadías, J. M., Bradley, R. H., Luthar, S. S., & Levy, R. (2020) · Psychological Reports · doi:10.1177/0033294120984127 · Cited by 96 · see citing works
“We followed recommended procedures (Cooper & Koenka, 2012; Hennessy et al., 2019; Polanin, Maynard, et al., 2017).”
Method
The evidence-base for positive psychology interventions: a mega-analysis of meta-analyses
Carr, A., Finneran, L., Boyd, C. G., Shirey, C., Canning, C., Stafford, O., Lyons, J., Cullen, K., Prendergast, C., Corbett, C., et al. (2023) · Journal of Positive Psychology · doi:10.1080/17439760.2023.2168564 · Cited by 82 · see citing works
“Best practice guidelines for conducting meta-reviews (Hennessy et al., 2019) and meta-analyses (Page et al., 2021) were followed.”
MethodResultInfluential
Umbrella reviews (systematic review of reviews)
Faulkner, G., Fagan, M. J., & Lee, J. S. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1934888 · Cited by 75 · see citing works
Benefits and Risks of Antidepressant Drugs During Pregnancy: A Systematic Review of Meta-analyses
Desaunay, P., Eude, L.-G., Dreyfus, M., Alexandre, C., Fédrizzi, S., Alexandre, J., Uğuz, F., & Guenolé, F. (2023) · Pediatric Drugs · doi:10.1007/s40272-023-00561-2 · Cited by 65 · see citing works
“To prevent outdatedness [21], only MAs published since 2010 were included.”
BackgroundMethodInfluential
ccaR: A package for assessing primary study overlap across systematic reviews in overviews
Bougioukas, K., Diakonidis, T., Mavromanoli, A., & Haidich, A. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1610 · Cited by 52 · see citing works
The impact of GenAI on learning outcomes: A systematic review and meta-analysis of experimental studies
Han, X., Peng, H., & Liu, M. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100714 · Cited by 70 · see citing works
Meta-review of implementation determinants for policies promoting healthy diet and physically active lifestyle: application of the Consolidated Framework for Implementation Research
Łobczowska, K., Banik, A., Brukało, K., Forberger, S., Kubiak, T., Romaniuk, P., Scheidmeir, M., Scheller, D. A., Steinacker, J. M., Wendt, J., et al. (2022) · Implementation Science · doi:10.1186/s13012-021-01176-2 · Cited by 53 · see citing works
“Although the heterogeneity of the aims and scope of included documents reduces the overlap in original studies (included in reviews), it may not be totally eliminated [29], and its effect should be investigated systematically.”
Background
Clinical Effectiveness of Dry Needling in Patients with Musculoskeletal Pain—An Umbrella Review
Chys, M., Meulemeester, K. D., Greef, I. D., Murillo, C., Kindt, W., Kouzouz, Y., Lescroart, B., & Cagnie, B. J. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12031205 · Cited by 60 · see citing works
Global mapping of overviews of systematic reviews in healthcare published between 2000 and 2020: a bibliometric analysis
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Papanastasiou, G. D., Savvides, E. D., Ntzani, E. E., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.019 · Cited by 46 · see citing works
Solar Radiation Forecasting: A Systematic Meta-Review of Current Methods and Emerging Trends
Chodakowska, E., Nazarko, J., Nazarko, Ł., & Rabayah, H. S. (2024) · Energies · doi:10.3390/en17133156 · Cited by 45 · see citing works
“The synthesis of reviews may take the form of narrative, semi-quantitative, or quantitative [31].”
Background
Where Are Smart Cities Heading? A Meta-Review and Guidelines for Future Research
dos Reis, J. C. G., Marques, P. A., & Marques, P. C. (2022) · Applied Sciences · doi:10.3390/app12168328 · Cited by 38 · see citing works
Systematic review and meta-analysis of physical activity interventions to increase elementary children’s motor competence: a comprehensive school physical activity program perspective
Moon, J., Webster, C. A., Stodden, D. F., Brian, A., Mulvey, K. L., Beets, M., Egan, C. A., McIntosh, L. I. F., Merica, C. B., & Russ, L. (2024) · BMC Public Health · doi:10.1186/s12889-024-18145-1 · Cited by 78 · see citing works
“Risk of bias in the included studies was assessed by two reviewers (JM and CAW) independently through discussion using the Cochrane Risk of Bias Tool (RoB 2.0) with additional considerations for C-RCTs and RCTs [48], which consists of five domains and an overall judgment [40].”
MethodInfluential
How, when, and why is social class linked to mental health and wellbeing? A systematic meta-review
Dougall, I., Vasiljevic, M., Wright, J. D., & Weick, M. (2023) · Social Science & Medicine · doi:10.1016/j.socscimed.2023.116542 · Cited by 37 · see citing works
The potential and paradoxes of eHealth research for digitally marginalised groups: A qualitative meta-review
Coetzer, J. A., Loukili, I., Goedhart, N. S., Ket, J. C. F., Schuitmaker‐Warnaar, T. J., Zuiderent‐Jerak, T., & Dedding, C. W. M. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.116895 · Cited by 36 · see citing works
What Works to Increase Charitable Donations? A Meta-Review with Meta-Meta-Analysis
Saeri, A. K., Slattery, P., Lee, J., Houlden, T., Farr, N., Gelber, R., Stone, J., Huuskes, L., Timmons, S., Windle, K., et al. (2022) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-022-00499-y · Cited by 36 · see citing works
“These models are the best practice for synthesising effects across different meta-analyses because they can compare effect sizes on a common metric while accounting for variability both within-and between reviews (Hennessy et al., 2019; Sch-midt & Oh, 2013).”
Harms in Systematic Reviews Paper 3: Given the same data sources, systematic reviews of gabapentin have different results for harms
Qureshı, R., Mayo‐Wilson, E., Rittiphairoj, T., McAdams‐DeMarco, M., Güallar, E., & Li, T. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.025 · Cited by 31 · see citing works
Systematic Review (2003–2023): Exploring Technology-Supported Cross-Cultural Learning through Review Studies
Shadiev, R., Sintawati, W., Kerimbayev, N., & Altınay, F. (2024) · Sustainability · doi:10.3390/su16020755 · Cited by 30 · see citing works
“In this study, we utilized a standardized tool, namely the Best Practice Guidelines and Essential Methodological Steps to Conduct Rigorous and Systematic Meta-Reviews [48].”
BackgroundMethodInfluential
How best to reduce unhealthy risk-taking behaviours? A meta-review of evidence syntheses of interventions using self-regulation principles
Protogerou, C., McHugh, R. K., & Johnson, B. T. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1707104 · Cited by 27 · see citing works
“Meta-reviews are a new approach to synthesising evidence, with ‘how-to’ guidance still developing (Hennessy & Johnson, in press; Hennessy et al., 2019; Hunt, Pollock, Campbell, Estcourt, & Brunton, 2018).”
MethodSelf-citation
Disease-Related Stigma, Stigmatizers, Causes, and Consequences: A Systematic Review
Akbari, H., Mohammadi, M., & Hosseini, A. (2023) · Iranian Journal of Public Health · doi:10.18502/ijph.v52i10.13842 · Cited by 26 · see citing works
Physical activity interventions to increase children's social and emotional learning: A systematic review and meta‐analysis based on the comprehensive school physical activity programme framework
Moon, J., Webster, C. A., Mulvey, K. L., Brian, A., Stodden, D. F., Egan, C. A., Ha, T., Merica, C. B., & Beets, M. W. (2024) · Review of Education · doi:10.1002/rev3.3455 · Cited by 28 · see citing works
A meta-review of literature reviews of disability, travel and inequalities
Mindell, J. S., Mackett, R. L., Yaffe, S., & Amin, S. (2024) · Journal of Transport & Health · doi:10.1016/j.jth.2024.101961 · Cited by 24 · see citing works
Parental social-cognitive correlates of preschoolers' oral hygiene behavior: A systematic review and meta-analysis.
Smith, S. R., Kroon, J., Schwarzer, R., & Hamilton, K. (2020) · Social Science & Medicine (1967) · doi:10.1016/j.socscimed.2020.113322 · Cited by 21 · see citing works
Metacognitive training for psychosis (MCT): a systematic meta-review of its effectiveness
Meinhart, A., Sauvé, G., Schmueser, A., Penney, D., Berna, F. S., Gawęda, Ł., Lamarca, M., Moritz, S., Ochoa, S., König, C., et al. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03344-0 · Cited by 23 · see citing works
“Meta-reviews provide a summary and grading of meta-analytic results and methodological quality in order to synthesize and identify the most credible evidence base for controversial or differentiated ﬁ ndings within the literature base [31].”
A systematic meta-review of organizational diversity and inclusion interventions and their associated outcomes
Zhao, K., Hsieh, W., Faulkner, N., & Smith, L. (2025) · Equality, Diversity and Inclusion: An International Journal · doi:10.1108/edi-02-2024-0085 · Cited by 20 · see citing works
Digital Wellness Programs in the Workplace: Meta-Review
Amirabdolahian, S., Paré, G., & Tams, S. (2025) · Journal of Medical Internet Research · doi:10.2196/70982 · Cited by 34 · see citing works
Strategies for Identification of Intimate Partner Violence in Healthcare Settings: Overview of Reviews and Realist Synthesis
Meléndez‐Torres, G. J., Dowdell, E. B., Kelley, S. J., & Lewis-O’Connor, A. (2022) · Journal of Family Violence · doi:10.1007/s10896-022-00463-w · Cited by 16 · see citing works
“Furthermore, as key research guidelines (Hennessy et al., 2019) have noted, overviews of reviews can greatly influence research, practice, and policy.”
Background
State of the art of the literature on definitions of self-criticism: a meta-review
Zaccari, V., Mancini, F., & Rogier, G. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1239696 · Cited by 16 · see citing works
Is research on ‘smart living environments’ based on unobtrusive technologies for older adults going in circles? Evidence from an umbrella review
Tannou, T., Lihoreau, T., Couture, M., Giroux, S., Wang, R. H., Spalla, G., Zarshenas, S., Gagnon‐Roy, M., Aboujaoudé, A., Yaddaden, A., et al. (2022) · Ageing Research Reviews · doi:10.1016/j.arr.2022.101830 · Cited by 18 · see citing works
Best Practices for Meta-Reviews in Physical Activity and Health Research: Insights From the Physical Activity Guidelines for Americans Advisory Committee Scientific Report
Pescatello, L. S., Hennessy, E. A., Katzmarzyk, P. T., Kraus, W. E., Fish, A. F., Craft, L. L., & Johnson, B. T. (2021) · Journal of Physical Activity and Health · doi:10.1123/jpah.2021-0243 · Cited by 15 · see citing works
Self-citation
Types and associated methodologies of overviews of reviews in health care: a methodological study with published examples
Bougioukas, K. I., Pamporis, K., Vounzoulaki, E., Karagiannis, T., & Haidich, A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.003 · Cited by 15 · see citing works
Social, economic, political, and geographical context that counts: meta-review of implementation determinants for policies promoting healthy diet and physical activity
Łobczowska, K., Banik, A., Forberger, S., Kaczmarek, K., Kubiak, T., Neumann‐Podczaska, A., Romaniuk, P., Scheidmeir, M., Scheller, D. A., Steinacker, J. M., et al. (2022) · BMC Public Health · doi:10.1186/s12889-022-13340-4 · Cited by 14 · see citing works
“The conclusions of any meta-review could be biased if an overlap exists in the original studies analyzed in the included reviews [23].”
BackgroundMethodInfluential
Non-pharmacological interventions for the management of perinatal anxiety in primary care: a meta-review of systematic reviews
Silverwood, V., Bullock, L., Jordan, J. L., Turner, K. M., Chew-Graham, C. A., Kingstone, T., & Dawson, S. (2023) · BJGP Open · doi:10.3399/bjgpo.2023.0022 · Cited by 16 · see citing works
Melatonin improves fertilization rate in assisted reproduction: Systematic review and meta-analysis
Veiga, E. C. D. A., Samama, M., Ikeda, F., Cavalcanti, G. S., Sartor, A., Parames, S. F., Baracat, E. C., Ueno, J., & Soares, J. M. (2024) · Clinics · doi:10.1016/j.clinsp.2024.100397 · Cited by 14 · see citing works
“For the systematic review, the authors drew on several articles and guidelines, including Berstock et al., 2019, 15 Hennessey et al., 2019, 16 and Page et al., 2021.”
Background
An overview of applications and trends in the use of extended reality for teaching effectiveness: an umbrella review based on 20 meta-analysis studies
Dong, W., Zhou, M., Zhou, M., Jiang, B.-H., & Lu, J. (2023) · The Electronic Library · doi:10.1108/el-11-2022-0257 · Cited by 14 · see citing works
The efficacy of psychological interventions for depressed primary caregivers of patients with Alzheimer's disease: a systematic review and meta-analysis
Liu, X., Wang, Y., & Wang, S. (2022) · Journal of Nursing Scholarship · doi:10.1111/jnu.12742 · Cited by 12 · see citing works
A meta-review of screening and treatment of electronic “addictions”
Hogan, J. N., Heyman, R. E., & Slep, A. M. S. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102468 · Cited by 15 · see citing works
Effectiveness of smart living environments to support older adults to age in place in their community: an umbrella review protocol
Tannou, T., Lihoreau, T., Gagnon‐Roy, M., Grondin, M., & Bier, N. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-054235 · Cited by 11 · see citing works
An overview of applications and trends of STEM for learning effectiveness——An umbrella review based on 22 meta-analyses
Lu, J., Si, H., Xu, J., & Xu, T.-G. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100712 · Cited by 10 · see citing works
Psychosocial determinants of alternative protein choices: a meta-review
Zaleskiewicz, H., Siwa, M., Banik, A., Szczuka, Z., Kuliś, E., Grossi, F., Chrysochou, P., Nystrand, B. T., Perrea, T., Samoggia, A., et al. (2024) · Health Psychology Review · doi:10.1080/17437199.2024.2412630 · Cited by 10 · see citing works
“The conclusions of any meta-review may be biased if there is an overlap in the original studies analysed in the included reviews (Hennessy et al., 2019).”
Influential
Applied Research in Quality of Life: A Computational Literature Review
Weismayer, C. (2021) · Applied Research in Quality of Life · doi:10.1007/s11482-021-09969-9 · Cited by 9 · see citing works
“To promote high quality SLRs, best practice guidelines have been proposed for wellbeing research (Hennessy & Johnson, 2019; White & Schmidt, 2005).”
Method
Effects of mindfulness- and acceptance-based interventions for individuals with schizophrenia spectrum disorders: A systematic meta-review.
Meinhart, A., Schmueser, A., Moritz, S., & Böge, K. (2025) · Schizophrenia Research · doi:10.1016/j.schres.2025.03.040 · Cited by 8 · see citing works
“When meta-analyses assess similar research topics and/or outcomes, a large overlap of primary studies suggests that the most recent, largest and methodologically sound meta-analysis should be favored in the case of diverging results (Hennessy et al., 2019).”
Influential
A Meta-Review of Generative AI in Education: Synthesizing Findings from Systematic Reviews
Zhang, L., Deng, X., & Shadiev, R. (2026) · Journal of Educational Computing Research · doi:10.1177/07356331261419689 · Cited by 14 · see citing works
“A systematic review of review studies is imperative to transcend isolated ﬁ ndings, comprehensively analyze cumulative knowledge, and identify future directions (Hennessy et al., 2019; Shadiev et al., 2024).”
Strategies used to manage overlap of primary study data by exercise-related overviews: protocol for a systematic methodological review.
Gutierrez-Arias, R., Pieper, D., Lunny, C., Torres-Castro, R., Aguilera-Eguía, R., & Seron, P. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-069906 · Cited by 7 · see citing works
Chronic endometritis and assisted reproduction: a systematic review and meta-analysis
Veiga, E. C. D. A., Soares, J. M., Samama, M., Ikeda, F., Francisco, L. S., Sartor, A., Urbanetz, L. A. M. L., Baracat, E. C., & Ueno, J. (2023) · Revista da Associação Médica Brasileira · doi:10.1590/1806-9282.20230792 · Cited by 8 · see citing works
“For the systematic reviews, we used examples and guidelines by Arya et al. 16 , Hennessy et al. 17 , Berstock et al. 18 , and Page et al. 19 .”
Method
A Meta-Review to Guide Military Screening and Treatment of Gambling Problems
Segura, A., Heyman, R. E., Ochshorn, J., & Slep, A. M. S. (2023) · Military Medicine · doi:10.1093/milmed/usad426 · Cited by 7 · see citing works
What we talk about when we talk about psychiatric mental health nurses' work-related distress: An umbrella review and concept mapping network analysis
Fiskeaux, M., Finley, B. A., Goldstein, D., Sender, J. S., Rogers, M. L., & Palitsky, R. (2025) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2025.105211 · Cited by 6 · see citing works
Human operators in air transport: A decade of systematic reviews
Papavasileiou, E. F., Παπαθεοδώρου, Α., & Edmunds, J. (2025) · Journal of the Air Transport Research Society · doi:10.1016/j.jatrs.2025.100059 · Cited by 9 · see citing works
Practical Approaches to Patient-Centered Care in Europe: Mixed Methods Study Developing a Conceptual Framework for Comprehensive Cancer Care Networks
Hickmann, E., Richter, P., Schlieter, H., Čemažar, M., Dudek-Godeau, D., Grapentin, N., Griesshammer, E., Jelenc, M., Liutkauskiene, S., Ravaud, A., et al. (2025) · JMIR Cancer · doi:10.2196/59683 · Cited by 6 · see citing works
Exercise training and experimental myocardial ischemia and reperfusion: A systematic review and meta-analysis
Veiga, E. C. D. A., Levy, R. F., Bocalini, D. S., Soares, J. M., Baracat, E. C., Cavalli, R. D. C., & dos SANTOS, L. (2023) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2023.101214 · Cited by 6 · see citing works
“This meta-analysis was conducted in accordance with the [8]Deeks et al, 2022 and [9]Arya et al, 2021 and for the systematic reviews we use several articles including [10]Berstock et al, 2019, [11]Hennessey et al, 2019, [12]Muka et al, 2020 and [13]Page et al, 2021.”
Method
Interventions for self-harm and suicidality in paediatric emergency departments: a meta-review
Radünz, M., Johnson, C., O’Dea, B., & Wade, T. D. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02706-9 · Cited by 6 · see citing works
“Meta-reviews, often described as ‘a review of reviews’, synthesise existing systematic reviews and meta-analyses to provide a higher-level summary of evidence, helping to inform research, practice and policy [21].”
What can we learn from 1,000 meta-analyses across 10 different disciplines?
Wu, W., Duan, J., Reed, W. R., & Tipton, E. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10035 · Cited by 5 · see citing works
“26 Many are tailored to speciﬁc disciplines, such as psychology, 27–29 health, 30,31 economics, 32,33 education, 34,35 and medicine.”
The Pervasive Identity of Knowledge Management: Consolidation or Dilution?
Bolisani, E., Scarso, E., & Kassaneh, T. C. (2023) · Knowledge management and organizational learning · doi:10.1007/978-3-031-38696-1_2 · Cited by 5 · see citing works
Considerations for Intensifying Word-Problem Interventions for Students With MD: A Qualitative Umbrella Review of Relevant Meta-Analyses
Myers, J. A., Arsenault, T. L., Powell, S. R., Witzel, B. S., Tanner, E. K., & Pigott, T. (2024) · Journal of Learning Disabilities · doi:10.1177/00222194241281293 · Cited by 4 · see citing works
A meta-analytic review of 60 years of role stressor research
Sawhney, G., McCord, M. A., Cunningham, A., Cook, P., Adjei, K., & Flinn, T. (2026) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2026.104234 · Cited by 4 · see citing works
Uncertainty in tuberculosis clinical decision-making: An umbrella review with systematic methods and thematic analysis
Basile, F. W., Sweeney, S., Singh, M. P., Bijker, E. M., Cohen, T., Menzies, N. A., Vassall, A., & Indravudh, P. P. (2024) · PLOS Global Public Health · doi:10.1371/journal.pgph.0003429 · Cited by 4 · see citing works
“Data synthesis used a systematic narrative approach for umbrella reviews [38], which involved thematic content analysis and coding of findings from each review to identify recurring themes associated with factors influencing TB clinical decision-making.”
Method
Reporting guideline for overviews of reviews of healthcare interventions: The Preferred Reporting Items for Overviews of Reviews (PRIOR) Explanation &amp; Elaboration
Gates, M., Gates, A., Pieper, D., Fernandes, R., Tricco, A., Moher, D., Brennan, S. E., Li, T., Pollock, M., Lunny, C., et al. (2022) · doi:10.31222/osf.io/23b6j · Cited by 3 · see citing works
Hospital Discharge Planning—An Investigation of Outcomes and Interventions
Imhof, L., Heber, R., Blume, K. S., Schreyögg, J., & Winter, V. (2025) · Health Services Research · doi:10.1111/1475-6773.70060 · Cited by 3 · see citing works
“The corrected covered area (CCA) [47] was 2%, indicating a minimal overlap of primary studies.”
Behaviour change techniques used in effective interventions, promoting physical activity, healthy nutrition, and healthy body mass among women with breast cancer and breast cancer survivors: a meta-review
Boberska, M., Wietrzykowska, D., Kuliś, E., Kuźmińska, J., Zalewska-Łunkiewicz, K., Karaglani, E., Mourouti, N., Μanios, Y., Łuszczyńska, A., & on behalf of MELIORA Consortium (2025) · Health Psychology Review · doi:10.1080/17437199.2025.2592667 · Cited by 3 · see citing works
“A meta-review (systematic review of reviews; Hennessy et al., 2019), integrating empirical evidence from existing systematic reviews, scoping reviews, and pragmatic reviews, was conducted.”
Influential
Technology-based suicide prevention: An umbrella review
Siadat, S., Farajzadegan, Z., Motamedi, N., Nouri, R., & Eizadi‐Mood, N. (2024) · Journal of Research in Medical Sciences · doi:10.4103/jrms.jrms_791_23 · Cited by 3 · see citing works
“Different studies recommend the authors of an umbrella review to assess the quality of each primary study of the systematic review, [27,28,46,47] although we were not able to do so.”
Background
Metacognitive Training for Psychosis (MCT): A Systematic Meta-Review of the Current Evidence Regarding the Effectiveness for Psychotic Symptom ReductionPreprint
Meinhart, A., Sauvé, G., Schmueser, A., Penney, D., Berna, F. S., Gawęda, Ł., Lamarca, M., Moritz, S., Ochoa, S., Vanessa Acuña, P., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4774474 · Cited by 3 · see citing works
Conducting evidence synthesis and developing evidence-based advice in public health and beyond: A scoping review and map of methods guidance
Movsisyan, A., Ioab, K. A., Himmels, J., Bantle, G., Dobrescu, A. I., Flottorp, S. A., Forland, F., Gadinger, A., Kien, C., Klerings, I., et al. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10051 · Cited by 3 · see citing works
The Influence of Sex, Gender, or Age on Outcomes of Digital Technologies for Treatment and Monitoring of Chronic Obstructive Pulmonary Disease: Protocol for an Overview of Systematic Reviews
Matthias, K., Honekamp, I., & Santis, K. K. D. (2022) · JMIR Research Protocols · doi:10.2196/40538 · Cited by 2 · see citing works
“So far, there are no clear recommendations as to which instrument is more suitable for overviews [54].”
Background
A meta-synthesis of automatic writing evaluation research: trends and developments over a decade
Tseng, W., Chen, S., & Dong, T. H. (2026) · Educational Technology Research and Development · doi:10.1007/s11423-026-10601-6 · Cited by 3 · see citing works
“The method follows Systematic Meta-Review Guidelines from Hennessy et al. (2019).”
An Umbrella Review of Meta-analyses of School-Based Mindfulness Based Interventions (MBIs)
Grennan, S., O’Dowd, A., Twomey, C. D., O’Connor, M., & Carr, A. (2026) · Mindfulness · doi:10.1007/s12671-026-02809-7 · Cited by 2 · see citing works
“This umbrella review and meta-analysis employed best practice methodological guidelines to maximise rigour, transparency and reproducibility (Aromataris, 2015; Hennessy et al., 2019).”
Proactive Behavior Change Techniques (ProBCTs) in Physical Activity and Healthy EatingPreprint
Schüler, J., & Bieleke, M. (2023) · Research Square · doi:10.21203/rs.3.rs-3133092/v1 · Cited by 1 · see citing works
A systematic literature review of open government data: Assessing concepts, trends, and current research gaps
Papachristou, E., & Gounopoulos, E. (2024) · AIP conference proceedings · doi:10.1063/5.0234826
A Systematic Review About Cross-Cultural Science Education Through Comparative Lenses
Lathouris, D. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-5743-9.ch008
Coronavirus-two infection among adults: A scoping review of literature published in 2023-24
Azhar, S., Ibáñez, N. C., Zamora, J., & Bueno‐Cavanillas, A. (2025) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.41.6.12201
Additional file 1 of Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · Figshare · doi:10.6084/m9.figshare.14926906
Additional file 2 of Meta-review of implementation determinants for policies promoting healthy diet and physically active lifestyle: application of the Consolidated Framework for Implementation Research
Łobczowska, K., Banik, A., Brukało, K., Forberger, S., Kubiak, T., Romaniuk, P., Scheidmeir, M., Scheller, D. A., Steinacker, J. M., Wendt, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.17982215
Additional file 1 of Social, economic, political, and geographical context that counts: meta-review of implementation determinants for policies promoting healthy diet and physical activity
Łobczowska, K., Banik, A., Forberger, S., Kaczmarek, K., Kubiak, T., Neumann‐Podczaska, A., Romaniuk, P., Scheidmeir, M., Scheller, D. A., Steinacker, J. M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19906015
Additional file 1 of Systematic review and meta-analysis of physical activity interventions to increase elementary children’s motor competence: a comprehensive school physical activity program perspective
Moon, J., Webster, C. A., Stodden, D. F., Brian, A., Mulvey, K. L., Beets, M., Egan, C. A., McIntosh, L. I. F., Merica, C. B., & Russ, L. B. (2024) · Figshare · doi:10.6084/m9.figshare.25422326
Social media self-withdrawal and its antecedents and outcomes: conceptualisation and empirical investigation
Chen, X., Chen, C., & Mou, J. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2623942
“According to the procedural guidelines for meta-reviews (Hennessy, Johnson, and Keenan 2019), inclusion and exclusion criteria were applied to the literature identified during the retrieval phase.”
Influential
Response to Commentary ‘Preventing ICU Acquired Weakness With Early Rehabilitation: An Umbrella Review of Systematic Reviews and Meta‐Analysis’
Sunaryo, E. Y. A. B., & Lee, H. (2026) · Nursing in Critical Care · doi:10.1111/nicc.70479
Applications of Internet of Things in sustainable smart city development: a bibliometric review to explore recent trends and research agenda
Kumari, A., Tiwari, M., & Raut, R. D. (2026) · Journal of Science and Technology Policy Management · doi:10.1108/jstpm-07-2025-0338
Beta-blocker therapy after myocardial infarction: an umbrella review
Cataldo-Miranda, P., Cao, P. K., Koh, H. J. W., Gašević, D., Chodapuneedi, S., Eliakundu, A. L., Romero, L., Stub, D. A., Zoungas, S., Kaye, D. M., et al. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.103990
“25”
Can consumer wearables support outpatient health monitoring for patients with post-acute infection syndromes? A systematic umbrella review of accuracy, validity, and clinical utility data
Kaplan, D. M., Kessler, N., Pozzo, N. S., Doyle, C. Y., Dickey, P., Giordano, N. A., Lehther, A., Maan, S., Mascaro, J. S., McDowall, A., et al. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001124
“As recommended by Hennessy & Johnson (2020) [27], a corrected covered area (CCA) matrix was created from all reviews that reported a complete list of included studies (k = 20), to identify the degree of overlap, and thus potentially heightened influence, in the primary studies among the reviews…”
Mindfulness-Based Programs for Perinatal Depression, Anxiety, Stress, and Psychological Well-Being: A Systematic Meta-Review
Gliske, K., Buchanan, G. J. R., Carlson, D. D., Cai, Q., Waring, M. E., & Zhang, N. (2026) · Mindfulness · doi:10.1007/s12671-026-02917-4
“To help advance this field, a meta-review (Hennessy et al., 2019) has advantages over a meta-analysis at this time to synthesize existing systematic reviews.”
Evaluating PEACHES: Pleasure-Inclusive Implementation Strategies to Enable Healthcare Workers to Address Anal Sex Stigma During HIV Service Encounters
Kutner, B. A., Huang, L. J., Kan, C. E. R., Hou, B., Xu, Y., Giguere, R., Pickett, J., Wharton, M. J., Bowen-Lasisi, S., Quintero, E., et al. (2026) · Archives of Sexual Behavior · doi:10.1007/s10508-026-03500-7
“Supplemental File 1 specifies components of PEACHES according to Proctor’s Framework (Proctor et al., 2013) This categorization aims to facilitate eventual comparison and synthesis of our findings with other studies (Hennessy et al., 2019).”
A meta-review of the evidence on addiction recovery mutual help organizations
Klein, M. R., O’Connor, J. M., Acuff, S. F., Kelly, J. F., & Hennessy, E. A. (2026) · Alcohol and Alcoholism · doi:10.1093/alcalc/agag059
“This synthesis of MHO reviews is a meta-review or over view of reviews ( Hennessy et al. 2019, Pollock et al. 2023).”
Self-citation
Which Behavior Change Techniques Are Consistently Used in Effective Obesity‐Related Interventions for Vulnerable Populations? A Meta‐Review
Krzywicka, P., Szczuka, Z., Misiakowska, J., Zaleskiewicz, H., Kornafel, A., Thiering, E., Grill, P., Reipurth, M., Kafyra, M., Dedoussis, G. V., et al. (2026) · Obesity Reviews · doi:10.1111/obr.70223

Systematic Review Essentials
Cooke, R. W. I. (2024) · Springer eBooks · doi:10.1007/978-3-031-73773-2_4 · Cited by 1 · see citing works
How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550 · see citing works
How to prepare a systematic review and meta-analysis: the methodological approach
Martimbianco, A. L. C. (2021) · Motriz Revista de Educação Física · doi:10.1590/s1980-657420210000227 · Cited by 2 · see citing works
Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses
Johnson, B. T., & Hennessy, E. A. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.05.035 · Cited by 215 · see citing works
Self-citation
A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research
Muka, T., Glišić, M., Milić, J., Verhoog, S., Bohlius, J., Bramer, W. M., Chowdhury, R., & Franco, O. H. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 682 · see citing works

Authors: Hennessy, E. A., Johnson, B. T., & Keenan, C.
Affiliations: University of Connecticut (US)
Queen's University Belfast (GB)
Corresponding author: Hennessy, Emily A.
ORCID: Hennessy, Emily A.
Johnson, Blair T.
Keenan, Ciara
Venue: Applied Psychology: Health and Well-Being
Publisher: Wiley
Published: 2019-07-09
Volume: 11
Issue: 3
Pages: 353-381
ISSN: 1758-0846 (ISSN-L)
1758-0854
DOI: 10.1111/aphw.12169
PMC: PMC6819213
OpenAlex: W2960111352
Cited by: 91
References: 63
Citations by year: 2026: 13 · 2025: 16 · 2024: 16 · 2023: 15 · 2022: 13 · 2021: 10 · 2020: 4 · 2019: 4
FWCI: 5.19
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Applied Psychology Health and Well-Being (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Research Portal (Queen's University Belfast) (submittedVersion)
Funders: National Institute on Aging (5U24AG052175)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords: meta-review, best practice guidelines, evidence synthesis, systematic review methodology, literature search strategies, review quality assessment
MeSH terms: Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Best Practice Guidelines and Essential Methodological Steps to Conduct Rigorous and Systematic Meta‐Reviews

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks