Methodological guidance paper: High-quality meta- analysis in a systematic review
The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
This methodological guidance article discusses the elements of a high-quality meta-analysis that is conducted within the context of a systematic review. Meta-analysis, a set of statistical techniques for synthesizing the results of multiple studies, is used when the guiding research question focuses on a quantitative summary of study results. In this guidance article, we discuss the systematic review methods that support high-quality meta-analyses and outline best practice meta-analysis methods for describing the distribution of effect sizes in a set of eligible studies. We also provide suggestions for transparently reporting the methods and results of meta-analyses to influence practice and policy. Given the increasing use of meta-analysis for important policy decisions, the methods and results of meta-analysis should be both transparent and reproducible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In sum, we followed the PRISMA framework and methodological guidance for research in education and psychology to report findings and reach conclusions (Page et al., 2021;Pigott & Polanin, 2020;Polanin et al., 2020).”
From The state of evidence for social and emotional learning: A contemporary meta-analysis of universal school-based SEL interventions (2023) · cites this paper as Pigott & Polanin, 2020
In the citing paper
“Random effects models were used due to the heterogeneity in the type of intervention in the studies [30].”
From Innovative Technology–Based Interventions to Reduce Stigma Toward People With Mental Illness: Systematic Review and Meta-analysis (2022) · cites this paper as [30]
In the citing paper
“As 3 of the studies included more than 1 scale that assessed levels of stigma [11,22,31], we conducted an analysis that combined them into a single effect size. In those cases, we followed the methodology suggestion for complex data structures [30].”
From Innovative Technology–Based Interventions to Reduce Stigma Toward People With Mental Illness: Systematic Review and Meta-analysis (2022) · cites this paper as [30]
In the citing paper
“the test offers the best estimate of the unbiased effect [30].”
From Innovative Technology–Based Interventions to Reduce Stigma Toward People With Mental Illness: Systematic Review and Meta-analysis (2022) · cites this paper as [30]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 6×
“Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement.”
BackgroundMethodInfluentialPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 2×
“For more general uses, the R package clubSandwich (Pustejovsky, 2019) will provide the robust variance estimates for an effect size model from the R package metafor (Viechtbauer, 2010).”
MethodBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 1×
“Our recommendations are consistent with guidelines for reporting metaanalysis from many fields (Appelbaum et al., 2018; Centre for Reviews and Dissemination, 2009; Higgins & Green, 2011; Institute of Medicine, 2011; Moher et al., 2009; Shea et al., 2017).”
MethodWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
(2000) · Cited by 9,198
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Cochrane Handbook for Systematic Reviews of Interventions
Tarsilla, M. (2010) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v6i14.284 · Cited by 5,178
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Attention to study reproducibility in psychology (Open Science Collaboration, 2015) and medicine (Ioannidis, 2005) highlights the danger in making policy decisions based on a single study.”
BackgroundThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716 · cited 1×
“As detailed in other references (Borenstein et al., 2009; Cooper, 2017; Cooper, Hedges, & Valentine, 2009; Lipsey & Wilson, 2001), the most common effect size metrics are the standardized mean difference (for continuous measures, such as in experimental or group difference studies), the correlation…”
BackgroundThe review of educational research.
(1931) · Journal of Educational Psychology · doi:10.1037/h0066448 · Cited by 1,562
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449 · cited 5×
“The MARS (Appelbaum et al., 2018) and PRISMA (Moher et al., 2009) guidelines each provide a helpful framework for meta-analysts to follow when reporting the results of the study.”
BackgroundMethodInfluentialThe Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417 · cited 1×
“Many researchers have documented the existence of publication bias in medicine and psychology (Dickersin, 1990; Ferguson & Brannick, 2012) as well as in education (Polanin et al., 2016).”
BackgroundA comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286 · cited 3×
“For this guidance, we are influenced by our long-standing work with the Campbell Collaboration (www.campbellcollaboration.org). All systematic reviews published in the Campbell library include a peer-reviewed protocol, where the review team provides the plan for the review including the rationale for the review, the g…”
MethodInfluentialmetaSEM: an R package for meta-analysis using structural equation modeling
Cheung, M. W.-L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01521 · Cited by 685 · cited 1×
“Meta-analysis of single-case studies (Moeyaert et al., 2017) and meta-analysis of structural equation models (Cheung, 2015) also account for the dependent nature of the meta-analytic data using multilevel”
MethodThe power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672 · cited 1×
“Though Hedges and Pigott (2004) discuss power analysis for effect size models, research has not been conducted on power for moderator models with Meta-Analysis Guidance multiple effect sizes.”
BackgroundSelf-citationSterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651
Parent Involvement in Homework: A Research Synthesis
Patall, E. A., Cooper, H., & Robinson, J. C. (2008) · Review of Educational Research · doi:10.3102/0034654308325185 · Cited by 602 · cited 1×
“Polanin, Pigott, Espelage, and Grotpeter (2019) provide a set of best practices that help guide the meta-analyst in conducting these processes reliably and efficiently.”
BackgroundEffect Sizes in Cluster-Randomized Designs
Hedges, L. V. (2007) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998606298043 · Cited by 567 · cited 3×
“Though Hedges and Pigott (2004) discuss power analysis for effect size models, research has not been conducted on power for moderator models with”
BackgroundMethodThe handbook of research synthesis and meta-analysis, 2nd ed.
Cooper, H. M., Hedges, L. V., & Valentine, J. C. (2009) · Cited by 541
Deploying an interactive machine learning system in an evidence-based practice center: abstrackr
Wallace, B. C., Small, K., Brodley, C. E., Lau, J., & Trikalinos, T. A. (2012) · Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium · doi:10.1145/2110363.2110464 · Cited by 532
Ferguson, C. J., & Brannick, M. T. (2012) · Psychological Methods · doi:10.1037/a0024445 · Cited by 493 · cited 1×
“Many researchers have documented the existence of publication bias in medicine and psychology (Dickersin, 1990; Ferguson & Brannick, 2012) as well as in education (Polanin et al., 2016).”
BackgroundIntroduction to systematic reviews
Rushton, K., & Price, O. (2018) · A research handbook for patient and public involvement researchers · doi:10.7765/9781526136527.00007 · Cited by 473
Pigott, T. D. (2012) · doi:10.1007/978-1-4614-2278-5 · Cited by 453 · cited 2×
“Recent decades have seen an increase in the use of meta-analysis (Williams, 2012), availability of approachable meta-analytic software (Polanin, Hennessey, & Tanner-Smith, 20171), and multiple methodological developments (Pigott, 2012).”
BackgroundSelf-citationMeta-analysis of multiple outcomes: a multilevel approach
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0527-2 · Cited by 450
A General Linear Model for Estimating Effect Size in the Presence of Publication Bias
Vevea, J. L., & Hedges, L. V. (1995) · Psychometrika · doi:10.1007/bf02294384 · Cited by 413 · cited 1×
“It is increasingly common for meta-analysts to use selection modeling strategies to explore the robustness of meta-analysis to publication bias (Citkowicz & Vevea, 2017; Vevea & Hedges, 1995).”
MethodBest practice guidelines for abstract screening large‐evidence systematic reviews and meta‐analyses
Polanin, J. R., Pigott, T. D., Espelage, D. L., & Grotpeter, J. K. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1354 · Cited by 401
Self-citationHandling Complex Meta-analytic Data Structures Using Robust Variance Estimates: a Tutorial in R
Tanner-Smith, E. E., Tipton, E., & Polanin, J. R. (2016) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-016-0026-5 · Cited by 390 · cited 1×
“Programs for implementing robust variance estimation exist in STATA and R (Tanner-Smith et al., 2016).”
MethodSelf-citationWhy prospective registration of systematic reviews makes sense
Stewart, L., Moher, D., & Shekelle, P. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-7 · Cited by 375 · cited 1×
“Tipton et al. (2019a) discuss the need for meta-analysts to distinguish between confirmatory and exploratory analyses.”
BackgroundSearching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371
Testing for funnel plot asymmetry of standardized mean differences
Pustejovsky, J. E., & Rodgers, M. A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1332 · Cited by 354 · cited 1×
“These methods, however, do not perform well particularly when there is heterogeneity among effect sizes (Macaskill, Walter, & Irwig, 2001; Pustejovsky & Rodgers, 2019).”
BackgroundPrevalence of Autism Spectrum Disorder in Preterm Infants: A Meta-analysis
Agrawal, S., Rao, S. C., Bulsara, M. K., & Patole, S. K. (2018) · Pediatrics · doi:10.1542/peds.2018-0134 · Cited by 332
Evidence & Gap Maps: A tool for promoting evidence informed policy and strategic research agendas
Snilstveit, B., Vojtkova, M., Bhavsar, A., Stevenson, J., & Gaarder, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.05.015 · Cited by 323
De La Rue, L., Polanin, J. R., Espelage, D. L., & Pigott, T. D. (2017) · Review of Educational Research · doi:10.3102/0034654316632061 · Cited by 292
Self-citationFinding What Works in Health Care: Standards for Systematic Reviews
Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Board on Health Care Services, & Institute of Medicine (2011) · doi:10.17226/13059 · Cited by 289
Dietrichson, J., Bøg, M., Filges, T., & Klint Jørgensen, A.-M. (2017) · Review of Educational Research · doi:10.3102/0034654316687036 · Cited by 288 · cited 3×
“The Dietrichson et al. (2017) meta-analysis examined the average effect of interventions for low-income students, and the variation across studies in the treatment effect.”
BackgroundInfluentialMoeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · cited 1×
“Meta-analysis of single-case studies (Moeyaert et al., 2017) and meta-analysis of structural equation models (Cheung, 2015) also account for the dependent nature of the meta-analytic data using multilevel”
MethodRESEARCH SYNTHESIS AS A SCIENTIFIC PROCESS
COOPER, H., HEDGES, L. V., & VALENTINE, J. C. (2019) · The Handbook of Research Synthesis and Meta-Analysis · doi:10.7758/9781610448864.4 · Cited by 263 · cited 1×
“The 1980s was a period of rapid development of statistical methods (Cooper & Hedges, 2009) leading to the use of meta-analysis in many fields to synthesize the results of primary studies.”
MethodEstimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234 · cited 1×
“Many researchers have documented the existence of publication bias in medicine and psychology (Dickersin, 1990; Ferguson & Brannick, 2012) as well as in education (Polanin et al., 2016).”
BackgroundSelf-citationMultiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations
Grund, S., Lüdtke, O., & Robitzsch, A. (2018) · Organizational Research Methods · doi:10.1177/1094428117703686 · Cited by 224
Enders, C. K., Mistler, S. A., & Keller, B. T. (2016) · Psychological Methods · doi:10.1037/met0000063 · Cited by 207
Multiple Imputation for Multilevel Data with Continuous and Binary Variables
Audigier, V., White, I. R., Jolani, S., Debray, T. P. A., Quartagno, M., Carpenter, J., van Buuren, S., & Resche-Rigon, M. (2018) · Statistical Science · doi:10.1214/18-sts646 · Cited by 166 · cited 1×
“Methods for missing data are in rapid development in the statistical literature (Audigier et al., 2018; Enders, Mistler, & Keller, 2016; Grund, Lüdtke, & Robitzsch, 2018), but have not been studied extensively in the context of meta-analysis.”
MethodAn Effect Size for Regression Predictors in Meta-Analysis
Aloe, A. M., & Becker, B. J. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610396901 · Cited by 154 · cited 1×
“Aloe and Becker (2012) and Aloe and Thompson (2013) discuss effect sizes computed from the results of regressions for use in meta-analyses that are interested in estimating a treatment effect or a correlation between constructs.”
BackgroundThe Synthesis of Partial Effect Sizes
Aloe, A. M., & Thompson, C. G. (2013) · Journal of the Society for Social Work and Research · doi:10.5243/jsswr.2013.24 · Cited by 152 · cited 1×
“Aloe and Becker (2012) and Aloe and Thompson (2013) discuss effect sizes computed from the results of regressions for use in meta-analyses that are interested in estimating a treatment effect or a correlation between constructs.”
BackgroundSchool-Based Interventions to Reduce Dating and Sexual Violence: A Systematic Review
Rue, L. D. L., Polanin, J. R., Espelage, D. L., & Pigott, T. (2014) · Campbell Systematic Reviews · doi:10.4073/csr.2014.7 · Cited by 148
Self-citationGenerational Differences in Academic Achievement Among Immigrant Youths: A Meta-Analytic Review
Duong, M. T., Badaly, D., Liu, F. F., Schwartz, D., & McCarty, C. A. (2015) · Review of Educational Research · doi:10.3102/0034654315577680 · Cited by 146
Current practices in meta‐regression in psychology, education, and medicine
Tipton, E., Pustejovsky, J. E., & Ahmadi, H. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1339 · Cited by 142 · cited 5×
“We expect that multilevel models for effect size data will become more commonly used in meta-analysis (Tipton et al., 2019a).”
BackgroundMethodInfluentialGardella, J. H., Fisher, B. W., & Teurbe-Tolon, A. R. (2017) · Review of Educational Research · doi:10.3102/0034654316689136 · Cited by 139 · cited 1×
“The Gardella et al. (2017) study examined how the correlation between exposure to cyber-bullying and difficulties in achievement and attendance varied by gender, race/ethnicity, and age.”
BackgroundConverting between effect sizes
Polanin, J. R., & Snilstveit, B. (2016) · Campbell Systematic Reviews · doi:10.4073/cmpn.2016.3 · Cited by 130
Self-citationTipton, E., Pustejovsky, J. E., & Ahmadi, H. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1338 · Cited by 121 · cited 5×
“We expect that multilevel models for effect size data will become more commonly used in meta-analysis (Tipton et al., 2019a).”
BackgroundMethodInfluentialA Review of Meta-Analysis Packages in R
Polanin, J. R., Hennessy, E. A., & Tanner-Smith, E. E. (2017) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998616674315 · Cited by 92 · cited 1×
“Polanin et al. (2017) provide an overview of many of the available R packages that conduct meta-analyses.”
BackgroundSelf-citationThe use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78 · cited 2×
“Computing separate analyses by outcome increases the probability that a metaanalysis will be subject to multiplicity problems, or issues with conducting too many statistical tests (Polanin & Pigott, 2015).”
BackgroundMethodSelf-citationTranslating standardized effects of education programs into more interpretable metrics
Baird, M. D., & Pane, J. F. (2019) · Educational Researcher · doi:10.3102/0013189x19848729 · Cited by 69 · cited 1×
“Baird and Pane (2019)3 discuss in more detail issues with transforming effect sizes to interpretable metrics.”
BackgroundEffect Sizes in Three-Level Cluster-Randomized Experiments
Hedges, L. V. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610376617 · Cited by 53 · cited 1×
“Hedges (2007, 2011) developed procedures to correct the standard errors of effect sizes computed from two-level and three-level cluster randomized trials.”
MethodAccounting for Missing Correlation Coefficients in Fixed-Effects MASEM
Jak, S., & Cheung, M. W. ‐. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1375886 · Cited by 53
Polanin, J. R., & Terzian, M. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.006 · Cited by 49 · cited 1×
“We expect about 40% of authors to respond, and about 20% to 25% of authors provide the requested information (Polanin & Terzian, 2019).”
BackgroundSelf-citationA parsimonious weight function for modeling publication bias.
Citkowicz, M., & Vevea, J. L. (2017) · Psychological Methods · doi:10.1037/met0000119 · Cited by 42 · cited 1×
“It is increasingly common for meta-analysts to use selection modeling strategies to explore the robustness of meta-analysis to publication bias (Citkowicz & Vevea, 2017; Vevea & Hedges, 1995).”
MethodOvercoming obstacles in obtaining individual participant data for meta‐analysis
Polanin, J. R., & Williams, R. T. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1208 · Cited by 36 · cited 1×
“Whenever an author query is sent via email, we also suggest sending a data sharing agreement (Polanin & Williams, 2016).”
MethodSelf-citationUsing robust standard errors to combine multiple regression estimates with meta-analysis
Williams, R. T. (2012) · Loyola eCommons (Loyola University of Chicago) · Cited by 23
REES: A Registry of Efficacy and Effectiveness Studies in Education
Anderson, D., Spybrook, J. K., & Maynard, R. A. (2018) · Educational Researcher · doi:10.3102/0013189x18810513 · Cited by 16 · cited 4×
“Analysis plans might be included in a preregistered protocol or as a separate preanalysis plan (Anderson et al., 2019). Polanin (2018) provides an example of a preanalysis plan for a meta-analysis. In summary, current best practice in meta-analysis is the use of meta-regression using robust variance estimation with mu…”
MethodInfluential(1903) · BMJ · doi:10.1136/bmj.2.2243.1655 · Cited by 4
Research works printed but not linked: 6
- Cheung M. W. L., 2015, Frontiers in Psychology, 5
- Cooper L. V., 2009, The handbook of research synthesis and meta-analysis
- Cordray D. S., 2009, The handbook of research synthesis and meta-analysis, 473
- Higgins J. P. T., 2011, Cochrane handbook for systematic reviews of interventions
- Wallace B. C., 2012, Proceedings of the ACM International Health Informatics Symposium, 819
- Wood W., 2009, The handbook of research synthesis and meta-analysis, 455
Cited by
Cipriano, C., Strambler, M. J., Naples, L. H., Ha, C., Kirk, M., Wood, M., Sehgal, K., Zieher, A. K., Eveleigh, A., McCarthy, M., et al. (2023) · Child Development · doi:10.1111/cdev.13968 · Cited by 636
“It is further possible this difference could be contributing to the different ES we report in this review, but in alignment with contemporary best-practice in meta-analytic review, this more conservative unbiased approach is warranted (Pigott & Polanin, 2020).”
Video Improves Learning in Higher Education: A Systematic Review
Noetel, M., Griffith, S., Delaney, O., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C. (2021) · Review of Educational Research · doi:10.3102/0034654321990713 · Cited by 378
“One reviewer searched the reference lists of included studies for papers that may have been missed by the search strategy (Pigott & Polanin, 2020).”
MethodA global meta-analysis of soil organic carbon in the Anthropocene
Beillouin, D., Corbeels, M., Demenois, J., Berre, D., Boyer, A., Fallot, A., Feder, F., & Cardinael, R. (2023) · Nature Communications · doi:10.1038/s41467-023-39338-z · Cited by 468
“A comprehensive synthesis of results of previous meta-analyses on SOC can facilitate evidence-based decision-making and priority-setting aimed at increasing SOC on a globalscale 38,39 .”
Major, L., Francis, G. A., & Tsapali, M. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13116 · Cited by 240
The potential of immersive virtual reality to enhance learning: A meta-analysis
Coban, M., Bolat, Y. I., & Goksu, I. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100452 · Cited by 354
Metadata
- Authors
- Pigott, T. D., & Polanin, J. R.
- Affiliations
- Loyola University Chicago (US)
- American Institutes for Research (US)
- Venue
- Review of Educational Research
- Published
- 2019-09-25
- Volume
- 90
- Issue
- 1
- Pages
- 24-46
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2976179866
- Cited by
- 568
- References
- 66
- Citations by year
- 2026: 73 · 2025: 117 · 2024: 96 · 2023: 107 · 2022: 87 · 2021: 67 · 2020: 19
- FWCI
- 8.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Education › Educational Research and Methods
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, systematic review methodology, effect size distribution, reporting transparency, reproducibility, evidence-based policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.