Doing Meta-Analysis with R: A Hands-On Guide
The DOI matches its Crossref record.
Abstract
Doing Meta-Analysis with R: A Hands-On Guide serves as an accessible introduction on how meta-analyses can be conducted in R. Essential steps for meta-analysis are covered, including calculation and pooling of outcome measures, forest plots, heterogeneity diagnostics, subgroup analyses, meta-regression, methods to control for publication bias, risk of bias assessments and plotting tools. Advanced but highly relevant topics such as network meta-analysis, multi-three-level meta-analyses, Bayesian meta-analysis approaches and SEM meta-analysis are also covered. A companion R package, dmetar, is introduced at the beginning of the guide. It contains data sets and several helper functions for the meta and metafor package used in the guide. The programming and statistical background covered in the book are kept at a non-expert level, making the book widely accessible. Features Contains two introductory chapters on how to set up an R environment and do basic imports/manipulations of meta-analysis data, including exercises Describes statistical concepts clearly and concisely before applying them in R Includes step-by-step guidance through the coding required to perform meta-analyses, and a companion R package for the book
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“An a priori power analysis was conducted to estimate the statistical power of the meta-analysis (Harrer et al., 2021), based on the 11 included studies and the average group sizes (n₁ = 44; n₂ = 35).Assuming a random-effects model with moderate heterogeneity, power was 61.82% for small effects (d = 0.20), 99.43% for moderate effects (d = 0.50), and 100% for large effects (d = 0.80).”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Harrer et al., 2021
In the citing paper
“Because effect sizes within studies are statistically dependent, a three-level Correlated and Hierarchical Effects (CHE) model with Robust Variance Estimation (RVE) was used.This approach estimates random effects at both the study and within-study levels and provides small-sample-adjusted standard errors and confidence intervals (Harrer et al., 2021;Pustejovsky & Tipton, 2022).”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Harrer et al., 2021
In the citing paper
“Moderator analyses were limited to single-moderator models due to the small number of clusters (k = 11), as recommended for RVE applications (Harrer et al., 2021).”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Harrer et al., 2021
In the citing paper
“Instead of aggregating the information for each sub-sample, with this multilevel analysis we were able to work with individual effect sizes while controlling dependence at the study-level, increasing statistical power as well (Harrer et al., 2021).”
From Do New Forms of Reading Pay Off? A Meta-Analysis on the Relationship Between Leisure Digital Reading Habits and Text Comprehension (2025) · cites this paper as Harrer et al., 2021
In the citing paper
“Publication bias can also be explained by other factors such as heterogeneity and risk of bias (Harrer et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Harrer et al., 2021
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cited by
Items 801–900 of 1,011
Guerrero, K. S., Horton, M. K., Choudhary, V., Bellesis, K. H., Dorin, P., Mei, J., Chinn, T., Meyers, T. J., Schaefer, C. A., & Barcellos, L. F. (2023) · Multiple Sclerosis Journal - Experimental Translational and Clinical · doi:10.1177/20552173231202638 · Cited by 13
Székely, H., Tóth, L. M., Rancz, A., Walter, A., Farkas, N., Sárközi, M. D., Váncsa, S., Erőss, B. M., Hegyi, P. J., & Miheller, P. (2023) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjad193 · Cited by 9
A meta-analysis of horizontal leadership and knowledge sharing
Yin, K., Niu, J., Dong, N., Zhang, K., & Ashok, M. (2023) · Current Psychology · doi:10.1007/s12144-023-05503-2 · Cited by 13
Neal, J. W. (2024) · Network Science · doi:10.1017/nws.2024.2 · Cited by 8
Dysphagia Prevalence in Progressive Supranuclear Palsy: A Systematic Review and Meta-Analysis
Glinzer, J., Flynn, É., Tampoukari, E., Harpur, I., & Walshe, M. (2024) · Dysphagia · doi:10.1007/s00455-024-10681-7 · Cited by 12
Burden of Antimicrobial Resistance in Japan: A Systematic Literature Review and Meta-Analysis
Matsumoto, T., Yuasa, A., Matsuda, H., Ainiwaer, D., & Yonemoto, N. (2024) · Infectious Diseases and Therapy · doi:10.1007/s40121-024-00960-z · Cited by 10
Abebe, Z., Wassie, M. M., Mekonnen, T. C., Reynolds, A. C., & Melaku, Y. A. (2024) · Nutrition Reviews · doi:10.1093/nutrit/nuae090 · Cited by 11
Respiratory disease in people with bipolar disorder: a systematic review and meta-analysis
Laguna-Muñoz, D., Jiménez-Peinado, A., Jaén‐Moreno, M. J., Camacho-Rodríguez, C., del Pozo, G. I., Vieta, E., Caballero‐Villarraso, J., Khan, M. I., Rico‐Villademoros, F., & Sarramea, F. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02793-1 · Cited by 13
Qing, T., Strauch, C., van Maanen, L., & der Stigchel, S. V. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02623-z · Cited by 13
“We therefore used the same random-effects model across all manipulations (following Harrer et al. (2021) and Hedges and Vevea (1998)).”
Johnson, C., Radünz, M., Linardon, J., Fuller‐Tyszkiewicz, M., Williamson, P., & Wade, T. D. (2025) · Psychological Medicine · doi:10.1017/s0033291725000066 · Cited by 16
Harajka, A., Hercsik, T., das Virgens, I. P. A., Máthé, I., Tornyossy, Z., AlFarwi, A., Meznerics, F. A., Kiss‐Dala, S., Fehérvári, P., Nagy, R., et al. (2025) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.15043 · Cited by 13
Abatacept and the risk of malignancy: a meta-analysis across disease indications
Zuckerman, B. P., Gibson, M., Roy, R., Hughes, M., Mehta, D., Yang, Z., Adas, M. A., Ng, K., Russell, M., Cope, A. P., et al. (2025) · Rheumatology · doi:10.1093/rheumatology/keaf114 · Cited by 10
Tagliaferri, S. D., Han, L. K. M., Khetan, M., Nguyen, J., Markulev, C., Rice, S., Cotton, S., Berk, M., Byrne, E. M., Rickwood, D., et al. (2025) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2025.03.019 · Cited by 14
Grasset, L., Bis, J. C., Frenzel, S., Kojis, D. J., Simino, J. M., Yaqub, A., Beiser, A., Berr, C., Bressler, J., Bülow, R., et al. (2025) · Alzheimer s & Dementia · doi:10.1002/alz.70148 · Cited by 8
Cuijpers, P. J., Harrer, M., Miguel, C., Donker, T., Keshen, A. R., Karyotaki, E., & Linardon, J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2495950 · Cited by 9
“We then conducted NMAs on effectiveness and acceptability using the frequentist graph-theoretical approach described by Rücker (2012; see also Harrer et al., 2021).”
Self-citationUnderstanding gender differences in delay discounting: a systematic review and meta-analysis
Lv, C., Liu, Z., Turel, O., & He, Q. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04843-7 · Cited by 11
“We implemented this multilevel meta-analysis using the rma.mv function from the metafor package in R (Harrer et al. 2021).”
van Vliet, R., van der Ploeg, R., Kretschmer, T., Kiekens, W. J., & Baams, L. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100689 · Cited by 13
Li, Y., He, Z., Liu, Z., Peng, N., Xiao, Y., Ye, Y., & Zhou, X. (2025) · Trauma Violence & Abuse · doi:10.1177/15248380251336188 · Cited by 17
“The file drawer problem refers to the issue that not all relevant research findings are published and are therefore missing in meta-analyses (Harrer et al., 2021).”
A Longitudinal Study of Adolescent‐to‐Young Adult Executive Function Development in Seven Countries
Folker, A. E., Bertrand, C. M., Hong, Y., Steinberg, L. D., Duell, N., Chang, L., Giunta, L. D., Dodge, K. A., Gurdal, S., Junla, D., et al. (2025) · Developmental Science · doi:10.1111/desc.70040 · Cited by 12
Consumer Behaviour in the Metaverse: Empirical Insights From a Meta‐Analysis
Ladeira, W. J., Santini, F. D. O., Lim, W. M., Rasul, T., Oliveira, T., & Akhtar, S. (2025) · Journal of Consumer Behaviour · doi:10.1002/cb.70027 · Cited by 13
Chan, R. C.-F., Chen, M., Chan, J. L. M., Shum, D., & Cao, Y. (2025) · Depression and Anxiety · doi:10.1155/da/1610909 · Cited by 13
A meta-analysis on mobile-assisted vocabulary learning: Do mobile applications help?
Zhou, Y., & Zhou, M. (2025) · ReCALL · doi:10.1017/s0958344025100335 · Cited by 32
Xu, K., Jukić, I., Cross, M. R., Hicks, D. S., Yin, M., Zhong, Y., Tang, W., Li, Y., Liang, Z., Wang, R., et al. (2025) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.70182 · Cited by 16
Risk of Malnutrition in Digestive System Cancers: A Systematic Review and Meta-Analysis
Budai, B. C., Martineková, P., Cai, G., Dobszai, D., Fekete, L., Normann, H. A., Németh, J., Fazekas, A., Szalai, E. Á., Szentesi, A., et al. (2025) · Cancers · doi:10.3390/cancers18010080 · Cited by 11
Coughlan, B., Duschinsky, R., Bakermans‐Kranenburg, M. J., Bakkum, L., Skinner, G. C. M., Markham, A., Beckwith, H., & van IJzendoorn, M. H. (2026) · JCPP Advances · doi:10.1002/jcv2.70081 · Cited by 14
The Effectiveness of Spaced Repetition in Medical Education: A Systematic Review and Meta‐Analysis
Maye, J. A., & Hurley, F. (2026) · The Clinical Teacher · doi:10.1111/tct.70353 · Cited by 11
Schleimer, T., Teichert, F., Henriksen, M., Döding, R., Innocenti, T., Brisby, H., Klotz, M. C. M., Korinth, M., Owen, P. J., Pieper, D., et al. (2026) · RMD Open · doi:10.1136/rmdopen-2025-006275 · Cited by 10
Trust and psychosis: a systematic review and meta-analysis
Prasannakumar, A., Kumar, V., & Rao, N. P. (2022) · Psychological Medicine · doi:10.1017/s0033291722002562 · Cited by 11
Bonnici, M., Orabi, N. A., Gannon, M., Williams, N. A., Stokes, C. M., Ramadan, H. H., Turner, M., & Makary, C. A. (2022) · Annals of Otology Rhinology & Laryngology · doi:10.1177/00034894221143187 · Cited by 8
Samacá-Samacá, D., Prieto‐Pinto, L., Yepes, A., Valderrama, C., & Hernández, F. (2023) · Lung Cancer Management · doi:10.2217/lmt-2022-0018 · Cited by 8
The Relationship Between Distributed Leadership and Academic Optimism: A Meta-Analysis Study
AKYÜREK, M. İ., & Bülbül, A. E. (2024) · Leadership and Policy in Schools · doi:10.1080/15700763.2024.2312997 · Cited by 8
“As Harrer et al. (2021) pointed out, evaluating heterogeneity in meta-analyses is crucial since high heterogeneity could be due to more subsets of studies in the dataset with distinct real impacts.”
Statistical heterogeneity in meta-analysis of hypertension and exercise training: A meta-review
Teixeira, J. M. M., Roever, L., Ramasamy, A., Pereira, R., Carneiro, I., Krustrup, P., & Póvoas, S. C. A. (2023) · Journal of Sports Sciences · doi:10.1080/02640414.2024.2309055 · Cited by 9
“…of a normal distribution of the effects across studies and its estimates can be deceptive (both wider or narrow) when the number of studies is small (e.g., less than 10) (Hardy & Thompson, 1998; Harrer et al., 2021), although non-parametric alternatives have also been developed (Wang & Lee, 2019).”
BackgroundUnderstanding Meta-Analysis Through Data Simulation With Applications to Power Analysis
Gambarota, F., & Altoè, G. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231209330 · Cited by 11
“However, for a more comprehensive overview of meta-analysis topics, the reader may refer to meta-analysis text-books (e.g., Borenstein et al., 2009; Harrer et al., 2019).”
BackgroundMethodMurrihy, S., Filia, K., Cotton, S., Phillips, L., Youn, S., Jayasinghe, A., Wrobel, A. L., Bastawy, E. M., Allott, K., & Watson, A. (2024) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae167 · Cited by 12
Adverse Obstetric Outcomes in Pregnancies With Major Fetal Congenital Heart Defects
Hedermann, G., Hedley, P. L., Gadsbøll, K., Thagaard, I. N., Krebs, L., Karlsen, M. A., Vedel, C., Rode, L., Christiansen, M., & Ekelund, C. K. (2024) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2024.5073 · Cited by 9
Borgmann, K., Muehlbauer, T., & Hill, M. W. (2025) · PLoS ONE · doi:10.1371/journal.pone.0323309 · Cited by 8
“To test whether the heterogeneity between studies was influenced by certain studies with extreme effect sizes, we additionally conducted an influence analysis using the Leave-One-Out method [19].”
Bomfim, B., Walker, A. P., McDowell, W. H., Zimmerman, J. K., Feng, Y., & Kueppers, L. M. (2022) · Global Change Biology · doi:10.1111/gcb.16223 · Cited by 9
Ganesh, V. L., Garg, K., Tandon, V., Borkar, S. A., Satyarthi, G., Singh, M., Chandra, P. S., & Kale, S. S. (2022) · Acta Neurochirurgica · doi:10.1007/s00701-022-05248-0 · Cited by 8
Tehrani, H. D., Yamini, S., & Vazsonyi, A. T. (2023) · Journal of Experimental Criminology · doi:10.1007/s11292-023-09562-0 · Cited by 15
Quenum, C. L., Ncho, C. M., Dhahbi, S., & Olowe, O. S. (2023) · Fish Physiology and Biochemistry · doi:10.1007/s10695-023-01217-1 · Cited by 8
“Besides, the results of a meta-analysis can be flawed if analysts decide to include a large number of studies of suboptimal quality (Harrer et al. 2021).”
Building a Stronger Case for Independent Reading at School
Bus, A. G., Shang, Y., & Roskos, K. (2024) · AERA Open · doi:10.1177/23328584241267843 · Cited by 7
“To fit multilevel meta-analytic models, we used the rma.mv function of the metafor package that can be extended by including moderators (Harrer et al., 2021).”
Shao, J., Zhou, Q., Jin, F., Reißfelder, C., Sigl, M., Yagublu, V., & Keese, M. A. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12237450 · Cited by 8
Rometsch, C., Cosci, F., & Martin, A. (2024) · Die Psychotherapie · doi:10.1007/s00278-024-00734-5 · Cited by 7
“…Störungen sowie se-parat nach Geschlecht (Frauen vs. Männer) unterVerwendungeinesgeneralisiertenli-nearen gemischten Effektmodells („gener-alized linear mixed-effects model“, GLMM; Lin und Chu 2020), dem eine Logit-Trans-formation zugrunde liegt (Harrer et al. 2021).”
Tian, S., Liang, Z., Qiu, F., Yu, Y., Mou, H., Zhang, G., & Zhang, H. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12573 · Cited by 11
Davies, K., Lappin, J., Gott, C., & Steel, Z. (2024) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae139 · Cited by 13
Fukaya, T., Nakamura, D., Kitayama, Y., & Nakagoshi, T. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1435758 · Cited by 25
“Additionally, Harrer et al. (2021) point out that in the (cid:277)eld of social sciences, a random-effects model is oen employed because heterogeneity in studies is always assumed; therefore, it is customary to always use a random-effects model.”
Paraskevopoulos, P., Obeidat, M., Bednárik, D. S., Martineková, P., Veres, D. S., Faluhelyi, N., Mikó, A., Mátrai, P., Hegyi, P., & Erőss, B. M. (2024) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848241273085 · Cited by 7
NPHS Mutations in Pediatric Patients with Congenital and Steroid-Resistant Nephrotic Syndrome
Lee, J. X., Tan, Y. J., & Ismail, N. A. S. (2024) · International Journal of Molecular Sciences · doi:10.3390/ijms252212275 · Cited by 7
Fifield, K., Veerakanjana, K., Hodsoll, J. P., Kuntsi, J., Tye, C., & Simblett, S. K. (2025) · Assessment · doi:10.1177/10731911241306364 · Cited by 10
“Collinearity was checked with variables correlated with r greater than 0.8 removed (Harrer et al., 2021).”
InfluentialDillon, D., Reigh, S., Rappazzo, K. M., Luben, T. J., & Weaver, A. M. (2025) · Current Environmental Health Reports · doi:10.1007/s40572-025-00476-9 · Cited by 8
Hina, N. (2025) · Journal of Agriculture and Food Research · doi:10.1016/j.jafr.2025.101722 · Cited by 10
Beyond Opt-Out: How Presumed-Consent Language Shapes Persuasion
Cadario, R., Zimmermann, J., & den Bergh, B. V. (2025) · Journal of Marketing · doi:10.1177/00222429251323885 · Cited by 7
Miranda, M. C. R., Santos, C. K. M., Barbosa, G. A., & Menezes, A. D. S. (2025) · Journal of Clinical and Experimental Hepatology · doi:10.1016/j.jceh.2025.102534 · Cited by 7
Sex distribution in psoriatic arthritis: a systematic literature review
Fırlatan, B., BAYRAM, G. S. K., Ayan, G., Karabulut, E., & Kalyoncu, U. (2025) · Scandinavian Journal of Rheumatology · doi:10.1080/03009742.2025.2465014 · Cited by 7
Abdelhay, O., Alshoubaki, R., Murad, S., Abdel-Hafez, O., Abdelhay, Q., Haddad, B. I., Alhosanie, T. N., Ajlouni, H., Ajlouni, L., Qarain, T., et al. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319583 · Cited by 8
Széles, Á. D., Kubik, A., Váncsa, S., Grünwald, V., Hadaschik, B. A., Ács, N., Hegyi, P., Nyírády, P., & Szarvas, T. (2025) · Frontiers in Immunology · doi:10.3389/fimmu.2025.1554048 · Cited by 7
What Do Australians Eat? A Systematic Review of Dietary Patterns and Adverse Health Outcomes
Zegeye, A., Dickinson, K. M., Mekonnen, T. C., Reynolds, A. C., Appleton, S., Mohammadi, L., Eckert, D. J., Adams, R., Livingstone, K. M., & Melaku, Y. A. (2025) · Nutrition Reviews · doi:10.1093/nutrit/nuaf028 · Cited by 12
Sahin, O. K., Kaya, A. G., Łajczak, P. M., Makita, L. M., Usta, H. D., Petry, I. N. S., Silva, Y. P., & Ximenes, E. N. F. (2025) · Hernia · doi:10.1007/s10029-025-03330-x · Cited by 7
Luo, Q., Zeng, X., Chen, F., & Kuang, C. (2025) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-025-06833-9 · Cited by 8
Time to control of anthrax outbreaks in Africa, 2014–2023: A systematic review and meta-analysis
Ario, A. R., Buregyeya, E., Rutebemberwa, E., Walekhwa, A. W., Akunzirwe, R., Kyamwine, I. B., Olum, R., Nuwaha, F., Serwadda, D., & Wanyenze, R. K. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0004534 · Cited by 10
“The statistical output (pooled median duration of anthrax control) was generated using the function of “metafor”, “tidyverse” [48], “ggplot2” packages [49] and the results presented in graphics and tables.”
Mohamed, A. A., Xu, X., Zhiqiang, Z., & Chen, J. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1532355 · Cited by 11
Cusiter, J., Short, K., Webb, A., & Munro, N. (2025) · Child Development · doi:10.1111/cdev.14252 · Cited by 23
Min, C., Jin, Q., Zhou, J., & Luo, X. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01255-0 · Cited by 14
Tan, Z., Castagna, C., Krustrup, P., Wong, D. P., Póvoas, S. C. A., Boullosa, D. A., Xu, K., & Čuk, I. (2025) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.70054 · Cited by 10
Jiang, Y., Kaplan, B., & Ko-Wong, L. (2025) · Review of Educational Research · doi:10.3102/00346543251339131 · Cited by 15
“This is because the heterogeneity challenges the underlying assumptions of the trim-and-fill approach, potentially resulting in an overestimation of the effect size adjustment (Harrer et al., 2021; Murano et al., 2020).”
InfluentialHe, J., Gong, Y., Yin, M., Zhang, L., & Wu, X. (2025) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-025-01787-8 · Cited by 9
Physiotherapy for endometriosis-associated pelvic pain: a systematic review and meta-analysis
Can, G., das Virgens, I. P. A., Fehér, B., Orbán, E. P., Fehérvári, P., Bánhidy, F. G., Hegyi, P. J., Mayer, Á. A., & Ács, N. (2025) · Pain Medicine · doi:10.1093/pm/pnaf083 · Cited by 24
Wang, C., Sun, J., Liang, Z., Cai, Y., Zhang, M., Tian, S., Yang, W., Cheng, S., Duan, R., & Wang, X. (2025) · European Journal of Pain · doi:10.1002/ejp.70109 · Cited by 10
“For example, if a study reported findings from several pain scales or provided pain measurements at different time points, the effect sizes were nested in a single arm (Harrer et al. 2021).”
Pang, F., & Datu, J. A. D. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100729 · Cited by 17
Ultrabrief pulse electroconvulsive therapy for depression: a systematic review and meta-analysis
Jelovac, A., & McLoughlin, D. M. (2025) · Molecular Psychiatry · doi:10.1038/s41380-025-03327-z · Cited by 9
Effects of Artificial Intelligence on Educational Functioning: A Review and Meta-Analysis
Yeo, G., & Lansford, J. E. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10085-5 · Cited by 17
“Publication bias refers to the likelihood of a study getting published due to its results (Harrer et al., 2021).”
InfluentialSchreyer, B., Leithner, C., Eilers, R., Gössmann, K., & Rosner, R. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1705578 · Cited by 18
Niyonsenga, J., Jansen, S., Rutembesa, E., Hermans, E. J., Monacelli, N., & Caricati, L. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2582455 · Cited by 8
“Sensitivity analyses included excluding outliers (studentized residual > 2), performing effect-and study-level leave-one-out (LOO) analyses, and refitting the model without flagged cases to evaluate the stability of the pooled effect (Harrer et al., 2021).”
InfluentialLiu, G., & Soyoof, A. (2026) · System · doi:10.1016/j.system.2026.104036 · Cited by 11
Mukherjee, S., Sahu, A., Ray, G. K., Maiti, R., & Prakash, S. (2022) · Vox Sanguinis · doi:10.1111/vox.13288 · Cited by 8
Marks, K. P., Aalders, J., Liu, S., Broadley, M. M., Thastum, M., Jensen, M. B., Ibfelt, E. H., Birkebæk, N., & Pouwer, F. (2023) · Current Diabetes Reviews · doi:10.2174/1573399820666230822095939 · Cited by 10
Does response inhibition occur unconsciously? A systematic review and Bayesian meta-analysis
Huang, Q., Jiang, R., Mao, X., Shi, J., & Li, A.-M. (2023) · Consciousness and Cognition · doi:10.1016/j.concog.2023.103570 · Cited by 9
Cruciani, G., Cavicchioli, M., Tanzilli, G., Tanzilli, A., Lingiardi, V., & Galli, F. (2023) · Scientific Reports · doi:10.1038/s41598-023-47982-0 · Cited by 10
Paneque, I., Pórcel‐Gálvez, A. M., Allande‐Cussó, R., & Carrión-Camacho, M. R. (2024) · International Journal of Nursing Knowledge · doi:10.1111/2047-3095.12467 · Cited by 8
“Analyses were performed using R Commander (R Core Team, 2013), package metaphor (Viechtbauer, 2010), meta (Balduzzi et al., 2019), and dmetar (Harrer et al., 2019, 2021).”
Hamar, B., Teutsch, B., Hoffmann, E., Hegyi, P., Harnos, A., Nyírády, P., Hunka, Z., Ács, N., Bánhidy, F. G., & Melczer, Z. (2024) · Cancers · doi:10.3390/cancers16081610 · Cited by 8
“To assess the difference be-tween the subgroups, a “Cochrane Q” test was used between subgroups (Harrer et al. 2021).”
MethodObeidat, M., Teutsch, B., Floria, D., Veres, D. S., Hegyi, P. J., & Erőss, B. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-61543-z · Cited by 7
Gaffney, H., Jolliffe, D., Eggins, E., Ferreira, J., Skinner, G. C. M., Ariel, B., & Strang, H. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.1403 · Cited by 21
“In addition to reporting these values of τ 2 we will also report a multilevel version of I 2 to quantify the proportion of the total variance that is attributed to non ‐ sampling error variance (Cheung, 2014; Harrer et al., 2021).”
BackgroundMethodThe Effect of Scoring Rubrics Use on Self-Efficacy and Self-Regulation
Salamanca, S. L. C., Parra-Martínez, F. A., Chang, A., Maeda, Y., & Traynor, A. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09906-w · Cited by 10
“According to Harrer et al. (2021), “it is a common finding that low-quality studies tend to show larger effect sizes because there is a higher risk of bias.”
Byrne, M. E., Shank, L. M., Lavender, J. M., Neyland, M. K. H., Rice, A. J., Sweeney, R. S., Norton, C. J., Haigney, M. C., Yanovski, J. A., & Tanofsky‐Kraff, M. (2024) · Obesity Reviews · doi:10.1111/obr.13805 · Cited by 7
The relationship between narcissism and prosocial behavior: a three-level meta-analysis
Gao, M., Qiu, X. Y., Zhu, H., & Zhang, K. (2024) · Current Psychology · doi:10.1007/s12144-024-07082-2 · Cited by 8
“The methodologies were adapted in accordance with the tutorials provided by Harrer et al. (2021) and Assink and Wibbelink ( 2016 ) for R syntax modification.”
Aguado-Barrera, M. E., Martínez-Calvo, L., Fernandez-Tajes, J. J., Calvo, P., Taboada‐Valladares, B., Lobato-Busto, R., Gómez‐Caamaño, A., & Vega, A. I. (2021) · Cancers · doi:10.3390/cancers13061447 · Cited by 7
Phan, T. T., Tran, V. T., Tran, B., Ho, T. T., Pho, S. P., Le, A. T., Le-Thuong, V., Nguyen, H. T., & Nguyen, S. T. (2021) · Cancer Reports · doi:10.1002/cnr2.1544 · Cited by 7
Early surgical approaches in pediatric epilepsy — a systematic review and meta-analysis
Frank, N. A., Greuter, L., Guzman, R. G., & Soleman, J. (2022) · Child s Nervous System · doi:10.1007/s00381-022-05699-x · Cited by 7
Transient Receptor Potential Ankyrin 1 (TRPA1) Methylation and Chronic Pain: A Systematic Review
Celsi, F., Peri, F., Cavasin, J., Zupin, L., Cozzi, G., Barbi, E., & Crovella, S. (2023) · Genes · doi:10.3390/genes14020411 · Cited by 10
Lou, X., Ng, T. K., & Siu, O. L. (2023) · The Journal of Positive Psychology · doi:10.1080/17439760.2023.2179934 · Cited by 9
“Therefore, we adopted a three-level meta-analytic model (individuals nested in measurements; measurements nested in studies; Harrer et al., 2021) to synthesize the effect sizes.”
BackgroundMethodInfluentialKubik, A., das Virgens, I. P. A., Szabó, A., Váradi, M., Csizmarik, A., Keszthelyi, A., Majoros, A., Fehérvári, P., Hegyi, P., Ács, N., et al. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24097859 · Cited by 7
A Systematic Review and Meta-Analysis of Simulated Learning’s Effects in Social Work Education
Zhang, S., & Stepteau-Watson, D. (2023) · Journal of Social Work Education · doi:10.1080/10437797.2023.2236675 · Cited by 12
“…the effect size estimation (e.g., sample size with completed cases for pre-and posttests); c The subgroup meta-analyses test the null hypothesis that all subgroup effect sizes are equal, and the test is significant when at least two subgroups, or combinations thereof, differ (Harrer et al., 2021).”
BackgroundInfluentialLua, V. Y. Q., Ooi, W. M., Najib, A., Tan, C. L. H., Majeed, N. M., Leung, A. K. ‐., & Hartanto, A. (2023) · Motivation and Emotion · doi:10.1007/s11031-023-10047-w · Cited by 8
“Hence, to account for the dependence of effect sizes included, three-level multi-level meta-analyses 3 were conducted whereby effect sizes were nested within samples (Harrer et al., 2021).”
Frank, J. W., Melnick, R. L., & Moskowitz, J. M. (2024) · Reviews on Environmental Health · doi:10.1515/reveh-2024-0069 · Cited by 9
Hand Preference in Stuttering: Meta-Analyses
Παπαδάτου-Παστού, Μ., Papadopoulou, A.-K., Samsouris, C., Mundorf, A., Valtou, M.-M., & Ocklenburg, S. (2023) · Neuropsychology Review · doi:10.1007/s11065-023-09617-z · Cited by 8
“Influential cases identification was further conducted through producing a Baujat plot, an overall influence diagnostic plot, and two leave-one-out meta-analysis plots (one sorted by effect size and the other by I 2 ) for each meta-analysis (see Harrer et al., 2021, for more details).”
MethodKolumbán, E., Szabados, M., Hernádfői, M., To, U. N. D., Nagy, R., Zolcsák, Á., Müller, K. E., Sipos, Z., Veres, D. S., Szőllősi, A., et al. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13030888 · Cited by 7
“Potential outlier publications were explored using different influence measures and plots following the recommendations of Harrer et al. [20].”
MethodOnifade, A., Vincent, E., & Tolley, N. (2023) · The Journal of Laryngology & Otology · doi:10.1017/s0022215123001950 · Cited by 6
Tarantino, G., Makopoulou, K., & Neville, R. D. (2023) · International Journal of Inclusive Education · doi:10.1080/13603116.2023.2287465 · Cited by 16
“Data were meta-analysed using the R package ‘metagen’ (Harrer et al. 2021).”
Santoso, P. H., Setiaji, B., Wahyudi, W., Syahbrudin, J., Bahri, S., Fathurrahman, F., Ananda, A. S. R., & Sodhiqin, Y. (2024) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.20.010601 · Cited by 6
Declercq, I., Leontjevas, R., Verboon, P., VRIENDT, P. D., Gerritsen, D. L., & van Hooren, S. (2024) · BMC Geriatrics · doi:10.1186/s12877-024-05117-8 · Cited by 9
Metadata
- Authors
- Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D.
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2021-07-09
- OpenAlex
- W4240484632
- Cited by
- 1,850
- References
- 0
- Citations by year
- 2026: 372 · 2025: 471 · 2024: 402 · 2023: 344 · 2022: 200 · 2021: 54
- FWCI
- 60.40
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- meta-analysis, R programming language, forest plots, subgroup analysis, meta-regression, publication bias, risk of bias assessment, network meta-analysis, Bayesian meta-analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.