The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship.
The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
In the past two decades, a new form of scholarship has appeared in which researchers present an overview of previously conducted research syntheses on the same topic. In these efforts, research syntheses are the principal units of evidence. Overviews of reviews introduce unique problems that require unique solutions. This article describes what methods overviewers have developed or have adopted from other forms of scholarship. These methods concern how to (a) define the broader problem space of an overview, (b) conduct literature searches that specifically look for research syntheses, (c) address the overlap in evidence in related reviews, (d) evaluate the quality of both primary research and research syntheses, (e) integrate the outcomes of research syntheses, especially when they produce discordant results, (f) conduct a second-order meta-analysis, and (g) present findings. The limitations of overviews are also discussed, especially with regard to the age of the included evidence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Two non-statistical methods for resolving overlap in primary studies were identified in the MOoR framework: Select the result of one (or a subset of) systematic reviews with or without meta-analysis using a decision rule or a published algorithm [39–41]Identify systematic reviews with or without meta-analysis with 25% or more of their research in common and eliminate the one with the fewer studies”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [11]
In the citing paper
“Three statistical methods for addressing the overlap in primary study data across systematic reviews were identified in the MOoR framework: Conduct sensitivity analyses (e.g. second-order meta-analysis (MA) including all MAs irrespective of overlap compared with second-order MA including only MAs where there is no overlap in primary studies) [11]Inflate the variance of the MA estimate [42]”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [11]
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
The burden of oral disease: challenges to improving oral health in the 21st century.
Petersen, P. E. (2005) · Europe PMC (PubMed Central) · Cited by 3,575
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00160 · Cited by 2,356
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Cited by
Systematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318
Variables associated with achievement in higher education: A systematic review of meta-analyses.
Schneider, M., & Preckel, F. (2017) · Psychological Bulletin · doi:10.1037/bul0000098 · Cited by 1,083
Goldberg, S. B., Riordan, K. M., Sun, S., & Davidson, R. J. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620968771 · Cited by 520
“As noted by Cooper and Koenka (2012), no definitive, established method for this task exists.”
BackgroundEvaluating gender similarities and differences using metasynthesis.
Zell, E., Krizan, Z., & Teeter, S. R. (2015) · American Psychologist · doi:10.1037/a0038208 · Cited by 434
Steenbergen-Hu, S., Makel, M. C., & Olszewski-Kubilius, P. (2016) · Review of Educational Research · doi:10.3102/0034654316675417 · Cited by 429
Zubala, A., MacGillivray, S., Frost, H., Kroll, T., Skelton, D. A., Gavine, A., Gray, N. M., Toma, M., & Morris, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180902 · Cited by 411
A meta-review of stress, coping and interventions in dementia and dementia caregiving
Gilhooly, K. J., Gilhooly, M. L. M., Sullivan, M. P., McIntyre, A., Wilson, L., Harding, E., Woodbridge, R., & Crutch, S. (2016) · BMC Geriatrics · doi:10.1186/s12877-016-0280-8 · Cited by 410
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
Hennessy, E. A., & Johnson, B. T. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1390 · Cited by 348
“Recommendations for dealing with overlap in a metareview—which may have costs or benefits, as we elaborate below—have been proposed.(6,10,19,20) These recommendations vary based on the degree of overlap and how feasible it is to obtain additional information about the primary studies in question.”
BackgroundBusch, T., & Friede, G. (2018) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1480 · Cited by 345
The effects of technology use in postsecondary education: A meta-analysis of classroom applications
Schmid, R. F., Bernard, R. M., Borokhovski, E., Tamim, R. M., Abrami, P. C., Surkes, M. A., Wade, C. A., & Woods, J. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.11.002 · Cited by 313
Graphical Representation of Overlap for OVErviews: GROOVE tool
Bracchiglione, J., Meza, N., Bangdiwala, S. I., Niño de Guzmán, E., Urrútia, G., Bonfill, X., & Madrid, E. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1557 · Cited by 299
Researcher allegiance in psychotherapy outcome research: An overview of reviews
Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.02.002 · Cited by 260
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252
Bougioukas, K. I., Liakos, A., Tsapas, A., Ntzani, E., & Haidich, A.-B. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.002 · Cited by 251
Sedentary behaviour and adiposity in youth: a systematic review of reviews and analysis of causality
Biddle, S. J. H., García Bengoechea, E., & Wiesner, G. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0497-8 · Cited by 245
Mingebach, T., Kamp-Becker, I., Christiansen, H., & Weber, L. (2018) · PLOS ONE · doi:10.1371/journal.pone.0202855 · Cited by 238
Fifty years of parental involvement and achievement research: A second-order meta-analysis
Kim, S. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100463 · Cited by 233
Lum, A., Wakefield, C. E., Donnan, B., Burns, M. A., Fardell, J. E., & Marshall, G. M. (2017) · Child: Care, Health and Development · doi:10.1111/cch.12475 · Cited by 221
“By compiling a metareview, an examination of consistency across studies is made possible, thereby providing a more robust understanding of the research trends (Grant & Booth 2009; Cooper & Koenka 2012).”
MethodKozak, A., Schedlbauer, G., Wirth, T., von Euler, U. S., Westermann, C., & Nienhaus, A. (2015) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-015-0685-0 · Cited by 200
Gou, H., Zhong, L., Wei, Q., & Fan, Y. (2025) · Frontiers in Nutrition · doi:10.3389/fnut.2025.1683477 · Cited by 186
Overview of Meta-Analyses of the Prevention of Mental Health, Substance Use, and Conduct Problems
Sandler, I., Wolchik, S. A., Cruden, G., Mahrer, N. E., Ahn, S., Brincks, A., & Brown, C. H. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185524 · Cited by 185
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184
Thomas, A., Lubarsky, S., Varpio, L., Durning, S. J., & Young, M. E. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09932-2 · Cited by 181
Overviews in Education Research: A Systematic Review and Analysis
Polanin, J. R., Maynard, B. R., & Dell, N. A. (2017) · Review of Educational Research · doi:10.3102/0034654316631117 · Cited by 131
Big five personality traits and performance: A quantitative synthesis of 50+ meta‐analyses
Zell, E., & Lesick, T. L. (2022) · Journal of Personality · doi:10.1111/jopy.12683 · Cited by 178
Sleep Health Promotion Interventions and Their Effectiveness: An Umbrella Review
Albakri, U., Drotos, E., & Meertens, R. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18115533 · Cited by 174
Teacher–student relationships and student outcomes: A systematic second-order meta-analytic review.
Emslander, V., Holzberger, D., Ofstad, S. B., Fischbach, A., & Scherer, R. (2025) · Psychological Bulletin · doi:10.1037/bul0000461 · Cited by 171
Artificial Intelligence in the Tourism Industry: An Overview of Reviews
García-Madurga, M.-Á., & Grilló-Méndez, A.-J. (2023) · Administrative Sciences · doi:10.3390/admsci13080172 · Cited by 166
Craike, M. J., Wiesner, G., Hilland, T. A., & Bengoechea, E. G. (2018) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-018-0676-2 · Cited by 163
The Diffusion and Adoption of Public Sector Innovations: A Meta-Synthesis of the Literature
de Vries, H., Tummers, L., & Bekkers, V. (2018) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvy001 · Cited by 153
Methods for second order meta-analysis and illustrative applications
Schmidt, F. L., & Oh, I.-S. (2013) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2013.03.002 · Cited by 151
Technology-enhanced mathematics instruction: A second-order meta-analysis of 30 years of research
Young, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.07.001 · Cited by 144
Wesarg, C., Ebbes, R., Hensums, M., Wagemaker, E., Zaharieva, M. S., Staaks, J. P. C., van den Akker, A. L., Visser, I., Hoeve, M., Brummelman, E., et al. (2023) · Developmental Review · doi:10.1016/j.dr.2023.101090 · Cited by 144
Tanner-Smith, E. E., Durlak, J. A., & Marx, R. A. (2018) · Prevention Science · doi:10.1007/s11121-018-0942-1 · Cited by 140
The Effectiveness of Advertising: A Meta-Meta-Analysis of Advertising Inputs and Outcomes
Eisend, M., & Tarrahi, F. (2016) · Journal of Advertising · doi:10.1080/00913367.2016.1185981 · Cited by 140
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
“…Determine the summary approach 1.2.1 Describe and/or tabulate the characteristics of the included SRs in terms of PICO elements Becker 2008 [4]; Cooper 2012 [6]; JBI 2014 [39, 59]; Pieper 2014c [66]; Robinson 2015 [24, 69–72]; Ryan 2009 [25]; Smith 2011 [77]; Thomson 2010 [26] ▪ Matrix of…”
InfluentialBallard, M., & Montgomery, P. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1229 · Cited by 136
Overviews of systematic reviews: great promise, greater challenge
McKenzie, J. E., & Brennan, S. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0582-8 · Cited by 134
“for discordance of findings and conclusions across reviews [10].”
BackgroundPollock, M., Fernandes, R. M., Newton, A. S., Scott, S. D., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-018-0768-8 · Cited by 132
Foundations of multicultural psychology: Research to inform effective practice.
Smith, T. B., & Trimble, J. E. (2016) · doi:10.1037/14733-000 · Cited by 132
Tan, C. Y., Gao, L., & Shi, M. (2020) · Educational Management Administration & Leadership · doi:10.1177/1741143220935456 · Cited by 131
Schwartz, S. J., Syed, M., Yip, T., Knight, G. P., Umaña-Taylor, A. J., Rivas-Drake, D., Lee, R. M., & Ethnic and Racial Identity in the 21st Century Study Group (2014) · Child Development · doi:10.1111/cdev.12201 · Cited by 128
Korous, K. M., Causadías, J. M., Bradley, R. H., Luthar, S. S., & Levy, R. (2020) · Psychological Reports · doi:10.1177/0033294120984127 · Cited by 122
Weber, L., Kamp‐Becker, I., Christiansen, H., & Mingebach, T. (2018) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-018-1175-3 · Cited by 120
Determinants of Technology Acceptance: Two Model-Based Meta-Analytic Reviews
Feng, G. C., Su, X., Lin, Z. C., He, Y., Luo, N., & Zhang, Y. (2020) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699020952400 · Cited by 119
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Savvides, E. D., Karakosta, C., Diakonidis, T., Tsapas, A., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.004 · Cited by 117
“, by including the most recent, the largest, or the one with the highest quality among relevant SRs) [16].”
BackgroundCognition-Oriented Treatments for Older Adults: a Systematic Overview of Systematic Reviews
Gavelin, H. M., Lampit, A., Hallock, H., Sabatés, J., & Bahar-Fuchs, A. (2020) · Neuropsychology Review · doi:10.1007/s11065-020-09434-8 · Cited by 117
Boness, C. L., Watts, A. L., Moeller, K. N., & Sher, K. J. (2021) · Psychological Bulletin · doi:10.1037/bul0000333 · Cited by 113
Does inquiry-based learning model improve learning outcomes A second-order meta-analysis
Öztürk, B., Kaya, M., & Demir, M. (2022) · Journal of Pedagogical Research · doi:10.33902/jpr.202217481 · Cited by 111
Five-factor personality domains and job performance: A second order meta-analysis
He, Y., Donnellan, M. B., & Mendoza, A. M. (2019) · Journal of Research in Personality · doi:10.1016/j.jrp.2019.103848 · Cited by 106
Nonallergic comorbidities of atopic eczema: an overview of systematic reviews
Deckert, S., Kopkow, C., & Schmitt, J. (2014) · Allergy · doi:10.1111/all.12246 · Cited by 97
Examining research on the impact of distance and online learning: A second-order meta-analysis study
Martin, F., Sun, T., Westine, C. D., & Ritzhaupt, A. D. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100438 · Cited by 104
Treating child and adolescent anxiety effectively: Overview of systematic reviews
BENNETT, K. J., Manassis, K., Duda, S. J., Bagnell, A. L., Bernstein, G. A., Garland, E., Miller, L. D., Newton, A. S., Thabane, L., & Wilansky, P. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.006 · Cited by 102
Green Synthesis of Silver Nanoparticles Loaded Hydrogel for Wound Healing; Systematic Review
Aldakheel, F. M., Sayed, M. M. E., Mohsen, D., Fagir, M. H., & Dein, D. K. E. (2023) · Gels · doi:10.3390/gels9070530 · Cited by 93
Hennessy, E. A., Johnson, B. T., & Keenan, C. (2019) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12169 · Cited by 91
“Yet, evidence indicates that even meta-analyses are frequently opaque with regard to quantitative information and can present conflicting, incorrect, or inadequate data (Cooper & Koenka, 2012; Polanin, Hennessy, & Tsuji, 2019; Schmidt & Oh, 2013).”
BackgroundMethodQamer, S., Romli, M. H., Che-Hamzah, F., Misni, N., Joseph, N. M. S., Al-Haj, N. A. A., & Nordin, S. A. (2021) · Molecules · doi:10.3390/molecules26165057 · Cited by 88
Simonsmeier, B. A., Flaig, M., Simacek, T., & Schneider, M. (2022) · Health Psychology Review · doi:10.1080/17437199.2021.1967184 · Cited by 81
“While first order meta-analytic overviews provide valuable insights, they have been considered unsatisfactory, as an estimation of the amount of between-meta-analysis true variance is not possible (Cooper & Koenka, 2012).”
BackgroundMethodChow, J. C., & Ekholm, E. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9437-7 · Cited by 80
Advancing Science Through Collaborative Data Sharing and Synthesis
NIMH Collaborative Data Synthesis for Adolescent Depression Trials Study Team including:, Perrino, T., Howe, G., Sperling, A., Beardslee, W., Sandler, I., Shern, D., Pantin, H., Kaupert, S., Cano, N., et al. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613491579 · Cited by 80
The Effects of Teacher Relationships on Student Academic Achievement: A Second Order Meta-Analysis
Göktaş, E., & Kaya, M. (2023) · Participatory Educational Research · doi:10.17275/per.23.15.10.1 · Cited by 80
The use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78
Maqbali, M. A. H. A., Alsayed, A. R., Hughes, C., Hacker, E. D., & Dickens, G. L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302597 · Cited by 75
Kreijkes, P., & Greatorex, J. (2024) · Review of Education · doi:10.1002/rev3.3465 · Cited by 73
Varieties of Integrative Scholarship: Why Rules of Evidence, Criteria, and Standards Matter
McGaghie, W. C. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000585 · Cited by 72
Bellón, J. Á., Moreno-Peral, P., Motrico, E., Morejón, A. R., Fernández, A., Serrano‐Blanco, A., Zabaleta‐del‐Olmo, E., & Cerón, S. C. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.11.003 · Cited by 68
Pyrgidis, N., Mykoniatis, I., Haidich, A., Tirta, M., Talimtzi, P., Kalyvianakis, D., Ouranidis, A., & Hatzichristou, D. G. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.735708 · Cited by 67
Patient-reported depression measures in cancer: a meta-review
Wakefield, C. E., Butow, P. N., Aaronson, N. A., Hack, T. F., Hulbert-Williams, N. J., & Jacobsen, P. B. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00168-6 · Cited by 66
KOÇOĞLU, A., & Kanadlı, S. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100690 · Cited by 65
Literature reviews in supply chain management: a tertiary study
Hochrein, S., Glock, C. H., Bogaschewsky, R., & Heider, M. (2015) · Management Review Quarterly · doi:10.1007/s11301-015-0113-4 · Cited by 65
Güngör, F., Altunbaşak, İ., Aydın, A. T., Kaya, M., & Erdem, C. (2026) · Current Psychology · doi:10.1007/s12144-025-08943-0 · Cited by 63
The What Works Clearinghouse Single-Case Design Pilot Standards: Who Will Guard the Guards?
Hitchcock, J. H., Horner, R. H., Kratochwill, T. R., Levin, J. R., Odom, S. L., Rindskopf, D., & Shadish, W. R. (2014) · Remedial and Special Education · doi:10.1177/0741932513518979 · Cited by 58
Zell, E., & Johansson, J. S. (2024) · Social Psychological and Personality Science · doi:10.1177/19485506241229308 · Cited by 57
Bougioukas, K. I., Bouras, E., Apostolidou-Kiouti, F., Kokkali, S., Arvanitidou, M., & Haidich, A.-B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.005 · Cited by 56
Pollock, M., Fernandes, R. M., Newton, A. S., Scott, S. D., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-018-0914-3 · Cited by 52
Research Synthesis of Meta-Analyses of Preservice Teacher Preparation Practices in Higher Education
Dunst, C. J., Hamby, D. W., Howse, R. B., Wilkie, H., & Annas, K. (2019) · Higher Education Studies · doi:10.5539/hes.v10n1p29 · Cited by 51
Roe, B. H., Flanagan, L., & Maden, M. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12613 · Cited by 50
Metasynthesis of Preservice Professional Preparation and Teacher Education Research Studies
Dunst, C. J., Hamby, D. W., Howse, R. B., Wilkie, H., & Annas, K. (2019) · Education Sciences · doi:10.3390/educsci9010050 · Cited by 49
The Effect of Meditation on Health: a Metasynthesis of Randomized Controlled Trials
Rose, S., Zell, E., & Strickhouser, J. E. (2019) · Mindfulness · doi:10.1007/s12671-019-01277-6 · Cited by 49
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Papanastasiou, G. D., Savvides, E. D., Ntzani, E. E., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.019 · Cited by 46
Hew, K. F., Bai, S., Huang, W., Dawson, P., Du, J., Huang, G., Jia, C., & Thankrit, K. (2021) · Australasian Journal of Educational Technology · doi:10.14742/ajet.6475 · Cited by 46
Bennett, K., Manassis, K., Duda, S., Bagnell, A., Bernstein, G. A., Garland, E. J., Miller, L. D., Newton, A., Thabane, L., & Wilansky, P. (2015) · Depression and Anxiety · doi:10.1002/da.22400 · Cited by 45
Leslie, M. R., Beatty, L., Hulbert‐Williams, L., Pendrous, R., Cartwright, T., Jackson, R., The Finding My Way UK Trial Steering Group, & Hulbert-Williams, N. (2022) · JMIR Cancer · doi:10.2196/36255 · Cited by 42
Effects of Exercise on Sleep in Older Adults: An Overview of Systematic Reviews and Meta-Analyses
Fank, F., Pereira, F. D. S., dos Santos, L., de Mello, M. T., & Mazo, G. Z. (2022) · Journal of Aging and Physical Activity · doi:10.1123/japa.2021-0444 · Cited by 40
Methodological approaches in conducting overviews: current state in HTA agencies
Pieper, D., Antoine, S., Morfeld, J., Mathes, T., & Eikermann, M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1107 · Cited by 39
Problem-based learning and student outcomes in higher education: a second-order meta-analysis
Erdem, C., Kaya, M., Toptaş, H. T., & Altunbaşak, İ. (2025) · Studies in Higher Education · doi:10.1080/03075079.2025.2498084 · Cited by 37
Qureshı, R., Mayo-Wilson, E., Rittiphairoj, T., McAdams‐DeMarco, M., Güallar, E., & Li, T. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.025 · Cited by 35
Romli, M. H., Yunus, F. W., & Mackenzie, L. A. (2019) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12572 · Cited by 35
Effects of Different Components of Yoga: A Meta-Synthesis
Matko, K., Bringmann, H. C., & Sedlmeier, P. (2021) · OBM Integrative and Complementary Medicine · doi:10.21926/obm.icm.2103030 · Cited by 34
“The meta-synthesis was planned and conducted in accordance with the recommended procedures for research syntheses [61].”
An Integrative Review of Interprofessional Simulation in Nursing Education
Horsley, T. L., O’Rourke, J., Mariani, B. A., Doolen, J., & Pariseault, C. A. (2018) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2018.06.001 · Cited by 34
The Effect of Cooperative Learning Models on Learning Outcomes: A Second-Order Meta-Analysis
Öztürk, B. (2023) · Educational policy analysis and strategic research · doi:10.29329/epasr.2023.600.13 · Cited by 33
Multimedia glosses and second language vocabulary learning: A second-round meta-analysis
Mahdi, H. S., Mohsen, M. A., & Almanea, M. M. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104341 · Cited by 33
Bernard, R. M., Borokhovski, E., Schmid, R. F., & Tamim, R. M. (2014) · Journal of Computing in Higher Education · doi:10.1007/s12528-014-9084-z · Cited by 33
A synthesis of meta-analyses of immersive virtual reality interventions in pain
Rooney, T., Sharpe, L., Winiarski, N., Todd, J., Colagiuri, B., Ryckeghem, D. M. L. V., Crombez, G., & Michalski, S. C. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102566 · Cited by 30
Tan, C. Y., Cheung, H. S., & Lee, S. M. S. (2025) · Review of Educational Research · doi:10.3102/00346543251346792 · Cited by 30
Protogerou, C., McHugh, R. K., & Johnson, B. T. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1707104 · Cited by 30
Phillips, J. M., Harper, M. G., & DeVon, H. A. (2023) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2023.02.008 · Cited by 28
Chen, Y., Hemming, K., Chilton, P. J., Gupta, K. K., Altman, D. G., & Lilford, R. J. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.007 · Cited by 28
Knogler, M., Hetmanek, A., & Seidel, T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.873995 · Cited by 26
Sommerauer, C., Schlender, L., Krause, M., Weißbach, S., Rieckert, A., Martinez, Y. V., Reeves, D., Guiteras, A. R., Kunnamo, I., & Sönnichsen, A. C. (2017) · BMC Geriatrics · doi:10.1186/s12877-017-0573-6 · Cited by 26
Metadata
- Authors
- Cooper, H., & Koenka, A. C.
- Affiliations
- Duke University (US)
- Venue
- American Psychologist
- Published
- 2012
- Volume
- 67
- Issue
- 6
- Pages
- 446-462
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2035046761
- Cited by
- 196
- References
- 49
- Citations by year
- 2026: 13 · 2025: 16 · 2024: 13 · 2023: 17 · 2022: 18 · 2021: 21 · 2020: 13 · 2019: 15 · 2018: 13 · 2017: 17 · 2016: 10 · 2015: 10 · 2014: 13 · 2013: 7
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- overviews of reviews, literature search strategies, discordant results, evidence integration
- MeSH terms
- Humans, Psychology, Clinical, Review Literature as Topic, Meta-Analysis as Topic, Evidence-Based Medicine, Behavioral Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.