The DOI matches its Crossref record; 18 of the 27 references it cites were found in a registry or an index.
Closing the Gap between Methodologists and End-Users: R as a Computational Back-End
Open accessAbstract
The R environment provides a natural platform for developing new statistical methods due to the mathematical expressiveness of the language, the large number of existing libraries, and the active developer community. One drawback to R, however, is the learning curve; programming is a deterrent to non-technical users, who typically prefer graphical user interfaces (GUIs) to command line environments. Thus, while statisticians develop new methods in R, practitioners are often behind in terms of the statistical techniques they use as they rely on GUI applications. Meta-analysis is an instructive example; cutting-edge meta-analysis methods are often ignored by the overwhelming majority of practitioners, in part because they have no easy way of applying them. This paper proposes a strategy to close the gap between the statistical state-of-the-science and what is applied in practice. We present open-source meta-analysis software that uses R as the underlying statistical engine, and Python for the GUI. We present a framework that allows methodologists to implement new methods in R that are then automatically integrated into the GUI for use by end-users, so long as the programmer conforms to our interface. Such an approach allows an intuitive interface for non-technical users while leveraging the latest advanced statistical methods implemented by methodologists.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“A striking example is the almost universal use of the DerSimonian-Laird method for random effects univariate meta-analysis (DerSimonian and Laird 1986) (the default or only method in the aforementioned programs), irrespective of good data that alternative random effect methods have better statistical…”
MethodMeta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 4×
“Line 2 is the call out to the random effects as implemented by the metafor package (Viechtbauer 2010).”
MethodInfluentialStatistical Methods for Research Workers
Kendall, M. (1937) · Nature · doi:10.1038/139737d0 · Cited by 9,676 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
BackgroundPrimary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
BackgroundBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 2×
“…random effects univariate meta-analysis (DerSimonian and Laird 1986) (the default or only method in the aforementioned programs), irrespective of good data that alternative random effect methods have better statistical properties (Turner, Omar, Yang, Goldstein, and Thompson 2000; Viechtbauer 2005).”
MethodThe R Commander: A Basic-Statistics Graphical User Interface to R
Fox, J. (2005) · Journal of Statistical Software · doi:10.18637/jss.v014.i09 · Cited by 1,098 · cited 1×
“Our approach is similar in spirit to the R Commander package ( Rcmdr ), which provides an “easy-to-use, cross-platform, extensible GUI” with enough functionality to span a basic statistics course (Fox 2005).”
MethodBax, L., Yu, L.-M., Ikeda, N., Tsuruta, H., & Moons, K. G. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-50 · Cited by 514 · cited 2×
“Currently, meta-analysis methods are implemented in many statistical packages, including Stata (Sterne 2009), SPSS (Lipsey and Wilson 2001), SAS (Arthur, Bennett, Huffcutt, Arthur, and Bennett 2001) and R (Schwarzer 2012; Lumley 2009; Viechtbauer 2010), in addition to Microsoft Excel plug-ins, such as MIX (Bax, Yu, Ike…”
MethodGurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421
Report on Certain Enteric Fever Inoculation Statistics
Simpson, L. (1904) · British medical journal · doi:10.1136/bmj.2.2288.1243 · Cited by 283 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
Background
Cited by
Sorted by citations
Clinical, laboratory and imaging features of COVID-19: A systematic review and meta-analysis
Rodriguez-Morales, A. J., Cardona-Ospina, J. A., Gutiérrez-Ocampo, E., Villamizar-Peña, R., Holguin-Rivera, Y., Escalera-Antezana, J. P., Alvarado-Arnez, L. E., Bonilla-Aldana, D. K., Franco-Paredes, C., Henao-Martinez, A. F., et al. (2020) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2020.101623 · Cited by 2,542
“The meta-analyses were performed using Stata, and the software OpenMeta[Analyst] [37] and Comprehensive Meta Analysis ve.3.3® licensed for Universidad Tecnológica de Pereira, Colombia.”
MethodInfluentialMethods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
Peri‐implant health and disease. A systematic review of current epidemiology
Derks, J., & Tomasi, C. (2015) · Journal of Clinical Periodontology · doi:10.1111/jcpe.12334 · Cited by 1,302
“Meta-analyses were performed to estimate overall prevalence of peri-implant mucositis and periimplantitis (OpenMeta[Analyst]) (Wallace et al. 2012).”
MethodBhimraj, A., Morgan, R. L., Shumaker, A. H., Baden, L. R., Cheng, V. C., Edwards, K. M., Gallagher, J. C., Gandhi, R. T., Muller, W. J., Nakamura, M., et al. (2022) · Clinical Infectious Diseases · doi:10.1093/cid/ciac724 · Cited by 240
“Where applicable, data were pooled using random effects model (fixed effects model for 2 or less trials or pooling of rates) using RevMan or OpenMeta [7].”
MethodHollocks, M. J., Lerh, J. W., Magiati, I., Meiser-Stedman, R., & Brugha, T. S. (2019) · Psychological Medicine · doi:10.1017/s0033291718002283 · Cited by 988
“OpenMeta, a tool for running metafor package in R (Viechtbauer, 2010), was used to conduct the meta-analysis (Wallace et al., 2012).”
Suurmond, R., van Rhee, H., & Hak, T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1260 · Cited by 881
Sex differences in healthy human heart rate variability: A meta-analysis
Koenig, J., & Thayer, J. F. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.007 · Cited by 860
Comparative Short-term Benefits of Laparoscopic Liver Resection
Ciria, R., Cherqui, D., Geller, D. A., Briceño, J., & Wakabayashi, G. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000001413 · Cited by 766
“OpenMEE software based on OpenMetaAnalyst Software was used for statistical analyses.(20,21) To perform meta-analyses, mean and standard deviation (SD) were needed, and estimations of mean and SD were performed to avoid discarding important studies.”
MethodIs diabetes mellitus associated with mortality and severity of COVID-19? A meta-analysis
Kumar, A., Arora, A., Sharma, P., Anikhindi, S. A., Bansal, N. K., Singla, V., Khare, S., & Srivastava, A. (2020) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2020.04.044 · Cited by 814
Garrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400
Open MEE : Intuitive, open‐source software for meta‐analysis in ecology and evolutionary biology
Wallace, B. C., Lajeunesse, M. J., Dietz, G., Dahabreh, I. J., Trikalinos, T. A., Schmid, C. H., & Gurevitch, J. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12708 · Cited by 421
“Other disciplines in the medical and social sciences have their own dedicated GUI-based software, such as Comprehensive Meta-Analysis (Borenstein et al. 2005), MetaAnalyst (Wallace et al. 2009), OpenMeta-analyst (Wallace et al. 2012), and Rev-Man (Bero & Rennie 1995; Nordic Cochrane Centre 2014).”
MethodSelf-citationCigarette smoking and telomere length: A systematic review of 84 studies and meta-analysis
Astuti, Y., Wardhana, A. P., Watkins, J. A., & Wulaningsih, W. (2017) · Environmental Research · doi:10.1016/j.envres.2017.06.038 · Cited by 341
“…were performed using the package metafor and dosresmeta in R version 3.3.2 (R Foundation for Statistical Computing, Vienna, Austria Foundation for R Foundation for Statistical Computing, Vienna, Austriatatistical Computing, Vienna, Austria) and OpenMetaAnalyst software (Wallace et al., 2012).”
MethodInfluentialSmoking and Dental Implants: A Systematic Review and Meta-Analysis
Mustapha, A., Salame, Z., & Chrcanovic, B. R. (2021) · Medicina · doi:10.3390/medicina58010039 · Cited by 120
“14 (Tufts University, Boston, MA, USA) [18].”
InfluentialGlobal prevalence of childhood cataract: a systematic review
Sheeladevi, S., Lawrenson, J., Fielder, A., & Suttle, C. M. (2016) · Eye · doi:10.1038/eye.2016.156 · Cited by 290
Theory of mind in major depressive disorder: A meta-analysis
Bora, E., & Berk, M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.11.023 · Cited by 330
Bora, E., & Pantelis, C. (2015) · Psychological Medicine · doi:10.1017/s0033291715002573 · Cited by 360
Elhassan, Y. S., Alahdab, F., Prete, A., Delivanis, D. A., Khanna, A., Prokop, L., Murad, M. H., O'Reilly, M. W., Arlt, W., & Bancos, I. (2019) · Annals of Internal Medicine · doi:10.7326/m18-3630 · Cited by 263
Bhimraj, A., Morgan, R. L., Shumaker, A. H., Lavergne, V., Baden, L. R., Cheng, V. C., Edwards, K. M., Gandhi, R. T., Muller, W. J., O’Horo, J. C., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa478 · Cited by 1,045
“Where applicable, data were pooled using random effects model (fixed effects model for 2 or less trials or pooling of rates) using RevMan or OpenMeta [7].”
Maraka, S., Ospina, N., Rodríguez-Gutiérrez, R., Davidge-Pitts, C. J., Nippoldt, T., Prokop, L., & Murad, H. (2017) · Journal of Clinical Endocrinology and Metabolism · doi:10.1210/jc.2017-01643 · Cited by 248
“Open Meta-Analyst was used for statistical analyses (14).”
MethodCalzetta, L., Rogliani, P., Matera, M. G., & Cazzola, M. (2016) · CHEST Journal · doi:10.1016/j.chest.2016.02.646 · Cited by 251
Overweight and obesity epidemic in Ghana—a systematic review and meta-analysis
Ofori‐Asenso, R., Agyeman, A. A., Laar, A. K., & Boateng, D. (2016) · BMC Public Health · doi:10.1186/s12889-016-3901-4 · Cited by 266
“Statistical analysis and meta-analysis proportions were carried out using OpenMeta (analyst) software, an opensource, cross-platform software for advanced metaanalysis [38] and StatsDirect statistical software (Version 3.”
MethodDiffusion tensor imaging in Parkinson's disease: Review and meta-analysis
Atkinson-Clément, C., Pinto, S., Eusébio, A., & Coulon, O. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.07.011 · Cited by 277
“The quantitative statistical meta-analysis was performed using the OpenMeta[Analyst] software (MetaAnalyst, Tufts Medical Center (Wallace et al., 2012)).”
Survival and Complications of Zygomatic Implants: An Updated Systematic Review.
Chrcanovic, B., Albrektsson, T., & Wennerberg, A. (2016) · Journal of oral and maxillofacial surgery · doi:10.1016/j.joms.2016.06.166 · Cited by 238
Veroniki, A. A., Jackson, D., Bender, R., Kuss, O., Langan, D., Higgins, J. P. T., Knapp, G., & Salanti, G. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1319 · Cited by 236
García-Martínez, E., Gil, G. L., Benito, A. C., González-Billalabeitia, E., Conesa, M. V., García, T., García-Garre, E., Vicente, V., & de la Peña, F. A. (2014) · Breast Cancer Research · doi:10.1186/s13058-014-0488-5 · Cited by 236
“For external validation in public datasets, after individual calculation of the odds ratio (OR) for each dataset, we performed a pooled analysis (random-effects model) using the R-based software OpenMetaAnalyst [35].”
MethodVarghese, A., George, G., Kondaguli, S. V., Naser, A. Y., Khakha, D. C., & Chatterji, R. (2021) · Journal of Global Health · doi:10.7189/jogh.11.05009 · Cited by 234
Structure‐Tuned Lead Halide Perovskite Nanocrystals
Hassan, Y. A., Song, Y., Pensack, R. D., Abdelrahman, A. I., Kobayashi, Y., Winnik, M. A., & Scholes, G. D. (2015) · Advanced Materials · doi:10.1002/adma.201503461 · Cited by 247
Pimenta-Melo, A. R., Monteiro‐Soares, M., Libânio, D., & Dinis-Ribeiro, M. J. (2016) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000000657 · Cited by 250
Asogwa, O. A., Boateng, D., Marzà-Florensa, A., Peters, S., Levitt, N., van Olmen, J., & Klipstein-Grobusch, K. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-049133 · Cited by 221
Bora, E., Akdede, B. B., & Alptekin, K. (2017) · Psychological Medicine · doi:10.1017/s0033291716003366 · Cited by 219
“Meta-analyses were performed using packages in the R environment (OpenMetaAnalyst, Metafor) (Viechtbauer, 2010; Wallace et al. 2012).”
MethodMeta-analysis of Theory of Mind (ToM) impairment in bipolar disorder
Bora, E., Bartholomeusz, C., & Pantelis, C. (2016) · Psychological Medicine · doi:10.1017/s0033291715001993 · Cited by 216
“2006) and in R environment (OpenMetaAnalyst, Metafor) (Viechtbauer, 2010; Wallace et al. 2012).”
InfluentialVaquer, S., de Haro, C., Peruga, P., Oliva, J. C., & Artigas, A. (2017) · Annals of Intensive Care · doi:10.1186/s13613-017-0275-4 · Cited by 241
Vocabulary Knowledge of Children With Cochlear Implants: A Meta-Analysis
Lund, E. (2015) · The Journal of Deaf Studies and Deaf Education · doi:10.1093/deafed/env060 · Cited by 258
Influence of N-acetylcysteine on chronic bronchitis or COPD exacerbations: a meta-analysis
Cazzola, M., Calzetta, L., Page, C., Jardim, J., Chuchalin, A., Rogliani, P., & Matera, M. G. (2015) · European Respiratory Review · doi:10.1183/16000617.00002215 · Cited by 208
An update of stabilisation exercises for low back pain: a systematic review with meta-analysis
Smith, B. E., Littlewood, C., & May, S. (2014) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-15-416 · Cited by 207
“All data analyses were performed using the OpenMetaAnalyst software [53].”
Diagnosis and Evaluation of Hypersensitivity Pneumonitis
Pérez, E. R. F., Travis, W. D., Lynch, D. A., Brown, K. M., Johannson, K. A., Selman, M., Ryu, J. H., Wells, A. U., Huang, Y.-C. T., Pereira, C. A. C., et al. (2021) · CHEST Journal · doi:10.1016/j.chest.2021.03.066 · Cited by 261
Sehgal, I., Dhooria, S., Ram, B., Singh, N., Aggarwal, A., Gupta, D., Behera, D., & Agarwal, R. (2015) · Respiratory care · doi:10.4187/respcare.03976 · Cited by 207
Elshazli, R. M., Toraih, E. A., Elgaml, A., El‐Mowafy, M., El‐Mesery, M., Amin, M. N., Hussein, M. H., Killackey, M. T., Fawzy, M. S., & Kandil, E. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238160 · Cited by 261
Pivetta, B., Chen, L., Nagappa, M., Saripella, A., Waseem, R., Englesakis, M. F., & Chung, F. F. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1009 · Cited by 229
Ross, R. M., McKay, R., Coltheart, M., & Langdon, R. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu187 · Cited by 198
How frequent does peri-implantitis occur? A systematic review and meta-analysis
Rakić, M., Galindo‐Moreno, P., Monje, A., Radovanović, S., Wang, H., Cochran, D. L., Sculean, A., & Canullo, L. (2017) · Clinical Oral Investigations · doi:10.1007/s00784-017-2276-y · Cited by 234
“The OpenMetaAnalyst [22] software was used to estimate the prevalence rate of peri-implantitis and the potential effects of the different function time, study design, and implant surfaces on the prevalence.”
MethodDeep learning for cephalometric landmark detection: systematic review and meta-analysis
Schwendicke, F., Chaurasia, A., Arsiwala-Scheppach, L. T., Lee, J., Elhennawy, K., Jost‐Brinkmann, P., Demarco, F. F., & Krois, J. (2021) · Clinical Oral Investigations · doi:10.1007/s00784-021-03990-w · Cited by 217
D'Souza, R., Ostro, J., Shah, P., Silversides, C., Malinowski, A., Murphy, K., Sermer, M., & Shehata, N. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehx032 · Cited by 191
Vijayvargiya, P., Jameie‐Oskooei, S., Camilleri, M., Chedid, V. G., Erwin, P. J., & Murad, M. H. (2018) · Gut · doi:10.1136/gutjnl-2018-316405 · Cited by 223
“27 OR and 95% CIs were either extracted or calculated from the binary data from each study.”
Screening to Prevent Osteoporotic Fractures
Viswanathan, M., Reddy, S., Berkman, N. D., Cullen, K., Middleton, J. C., Nicholson, W. K., & Kahwati, L. C. (2018) · JAMA · doi:10.1001/jama.2018.6537 · Cited by 223
Fernando, S. M., Tran, A., Cheng, W., Rochwerg, B. N., Taljaard, M., Kyeremanteng, K., English, S. W., Sekhon, M. S., Griesdale, D. E. G., Dowlatshahi, D. D., et al. (2019) · BMJ · doi:10.1136/bmj.l4225 · Cited by 219
Transbronchial Cryobiopsy for the Diagnosis of Interstitial Lung Diseases
Maldonado, F., Danoff, S. K., Wells, A. U., Colby, T. V., Ryu, J. H., Liberman, M., Wahidi, M. M., Frazer-Green, L., Hetzel, J., Rickman, O. B., et al. (2019) · CHEST Journal · doi:10.1016/j.chest.2019.10.048 · Cited by 204
Sharifov, O. F., Schiros, C. G., Aban, I., Denney, T. S., & Gupta, H. (2016) · Journal of the American Heart Association · doi:10.1161/jaha.115.002530 · Cited by 215
Neurocognitive features in clinical subgroups of bipolar disorder: A meta-analysis
Bora, E. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.12.057 · Cited by 201
Risk factors of neonatal sepsis in India: A systematic review and meta-analysis
Murthy, S., Godinho, M. A., Guddattu, V., Lewis, L. E. S., & Nair, N. S. (2019) · PLOS ONE · doi:10.1371/journal.pone.0215683 · Cited by 140
Vitamin D insufficiency as a potential culprit in critical COVID‐19 patients
Munshi, R., Hussein, M. H., Toraih, E. A., Elshazli, R. M., Jardak, C., Sultana, N., Youssef, M. R., Omar, M., Attia, A. S., Fawzy, M. S., et al. (2020) · Journal of Medical Virology · doi:10.1002/jmv.26360 · Cited by 223
Preventing pharyngo‐cutaneous fistula in total laryngectomy: A systematic review and meta‐analysis
Sayles, M., & Grant, D. G. (2014) · The Laryngoscope · doi:10.1002/lary.24448 · Cited by 176
“edu/open_meta.(34,35) Statistical significance of”
Ethnic Differences in Resting Heart Rate Variability
Hill, L. K., Hu, D. D., Koenig, J., Sollers, J. J., Kapuku, G. K., Wang, X., Snieder, H., & Thayer, J. F. (2015) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000133 · Cited by 203
“conjunction with OpenMetaAnalyst software (55).”
MethodAcute Kidney Injury After Computed Tomography: A Meta‐analysis
Aycock, R. D., Westafer, L., Boxen, J. L., Majlesi, N., Schoenfeld, E. M., & Bannuru, R. (2018) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2017.06.041 · Cited by 172
Thrombectomy Outcomes of Intracranial Atherosclerosis-Related Occlusions.
Tsang, A., Orru', E., Klostranec, J., Yang, I.-H., Lau, K.-K., Tsang, F. C., Wai, M.-L., Pereira, V., & Krings, T. (2019) · Stroke · doi:10.1161/strokeaha.119.024889 · Cited by 171
“Meta-analysis and statistical analysis were performed with OpenMeta-Analyst.(8)”
MethodThe erring brain: Error‐related negativity as an endophenotype for OCD—A review and meta‐analysis
Riesel, A. (2019) · Psychophysiology · doi:10.1111/psyp.13348 · Cited by 170
Rogliani, P., Calzetta, L., Cavalli, F., Matera, M. G., & Cazzola, M. (2016) · Pulmonary Pharmacology & Therapeutics · doi:10.1016/j.pupt.2016.07.009 · Cited by 168
Clamor, A., Lincoln, T. M., Thayer, J. F., & Koenig, J. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.160762 · Cited by 167
Lajeunesse, M. (2013) · Princeton University Press eBooks · doi:10.1515/9781400846184-015 · Cited by 164
Tariq, R., Pardi, D. S., Bartlett, M. G., & Khanna, S. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/ciy721 · Cited by 180
Stellingwerf, M., van Praag, E. V., Tozer, P., Bemelman, W., & Buskens, C. (2019) · BJS Open · doi:10.1002/bjs5.50129 · Cited by 160
Bellolio, M., Gilani, W. I., Barrionuevo, P., Murad, M., Erwin, P., Anderson, J. R., Miner, J., & Hess, E. (2016) · Academic Emergency Medicine · doi:10.1111/acem.12875 · Cited by 159
Paul, S., Dickstein, A. M., Saxena, A., Terrin, N., Viveiros, K., Balk, E., & Wong, J. B. (2017) · Hepatology · doi:10.1002/hep.29082 · Cited by 154
“Statistical analyses were performed with OpenMetaAnalyst(18) and the metafor package in R, version 3.2.1 (R Foundation for Statistical Computing).”
MethodInfluentialBora, E., & Özerdem, A. (2017) · Psychological Medicine · doi:10.1017/s0033291717001490 · Cited by 179
“Meta-analyses were performed using packages in R environment (OpenMetaAnalyst, Metafor) (Viechtbauer, 2010; Wallace et al. 2012).”
MethodSocial cognition in schizophrenia in comparison to bipolar disorder: A meta-analysis
Bora, E., & Pantelis, C. (2016) · Schizophrenia Research · doi:10.1016/j.schres.2016.04.018 · Cited by 165
“7 on a Windows platform (Bax et al., 2006; Viechtbauer, 2010; Wallace et al., 2012).”
MethodMaternal body mass index and pregnancy outcomes: a systematic review and metaanalysis
D’Souza, R., Horyn, I., Pavalagantharajah, S., Zaffar, N., & Jacob, C.-E. (2019) · American Journal of Obstetrics & Gynecology MFM · doi:10.1016/j.ajogmf.2019.100041 · Cited by 150
Vijayvargiya, P., Camilleri, M., Chedid, V. G., Mandawat, A., Erwin, P. J., & Murad, M. H. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.01.249 · Cited by 169
Social cognition in alcohol use disorder: a meta-analysis
Bora, E., & Zorlu, N. (2016) · Addiction · doi:10.1111/add.13486 · Cited by 168
“Meta-analyses were performed using packages in the R environment (OpenMetaAnalyst, Metafor) [52,53].”
MethodBulluck, H., Chan, M., Paradies, V., Yellon, R., Ho, H., Chan, M., Chin, C., Tan, J. W., & Hausenloy, D. (2018) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/s12968-018-0494-3 · Cited by 142
Sensitivity of Early Brain Computed Tomography to Exclude Aneurysmal Subarachnoid Hemorrhage
Dubosh, N. M., Bellolio, F., Rabinstein, A. A., & Edlow, J. A. (2016) · Stroke · doi:10.1161/strokeaha.115.011386 · Cited by 158
Memory and executive functions in persons with type 2 diabetes: a meta‐analysis
Sadanand, S., Balachandar, R., & Bharath, S. (2015) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.2664 · Cited by 157
“Using ‘OpenMetaAnalyst’ [40,41], combined d values were calculated for each sub-domain using continuous random effects model.”
MethodInfluentialBora, E., & Köse, S. (2016) · International Journal of Eating Disorders · doi:10.1002/eat.22572 · Cited by 152
Salmasi, S., Loewen, P. S., Tandun, R., Andrade, J. G., & Vera, M. A. D. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034778 · Cited by 166
Social cognition in Huntington's disease: A meta-analysis.
Bora, E., Velakoulis, D., & Walterfang, M. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.10.001 · Cited by 138
Smith, B. E., Hendrick, P. A., Smith, T. O., Bateman, M., Moffatt, F., Rathleff, M. S., Selfe, J., & Logan, P. (2017) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-097383 · Cited by 180
Libânio, D., Costa, M., Pimentel-Nunes, P., & Dinis-Ribeiro, M. (2016) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2016.06.033 · Cited by 134
Tomşa, R., Guțu, S., Cojocaru, D., Gutiérrez-Bermejo, B., Flores, N., & Río, C. J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041980 · Cited by 236
“We used OpenMeta-Analyst [58] and Jamovi software [59] and a Bayesian random-effects model with a 95% credible interval (95% CI).”
MethodThe Impact of SARS‐CoV ‐2 on Stroke Epidemiology and Care: A Meta‐Analysis
Katsanos, A. H., Palaiodimou, L., Zand, R., Yaghi, S. R., Kamel, H., Navi, B. B., Turc, G., Romoli, M., Sharma, V. K., Mavridis, D., et al. (2020) · Annals of Neurology · doi:10.1002/ana.25967 · Cited by 138
Bellolio, M., Puls, H., Anderson, J. L., Gilani, W. I., Murad, M., Barrionuevo, P., Erwin, P., Wang, Z., & Hess, E. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011384 · Cited by 132
Meta-analysis of cognitive performance in fibromyalgia
Bell, T. R., Trost, Z., Buelow, M. T., Clay, O. J., Younger, J., Moore, D., & Crowe, M. G. (2018) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2017.1422699 · Cited by 170
Varghese, A., Joseph, J., Vijay, V., Khakha, D. C., Dhandapani, M., Gigini, G., & Kaimal, R. (2021) · Journal of Clinical Nursing · doi:10.1111/jocn.15987 · Cited by 129
Cazzola, M., Rogliani, P., Calzetta, L., & Matera, M. (2018) · European Respiratory Journal · doi:10.1183/13993003.01586-2018 · Cited by 127
Cham, C. Q., Ibrahim, N., Siau, C. S., Kalaman, C. R., Ho, M. C., Yahya, A. N., Visvalingam, U., Roslan, S. B., Rahman, F. N. A., & Lee, K. W. (2022) · Healthcare · doi:10.3390/healthcare10122423 · Cited by 166
“Open Meta (Analyst) [38] was used to conduct the meta-analysis for this study.”
MethodLee, J. K. H., Lam, G., Shin, T., Kim, J., Krishnan, A., Greenberg, D. P., & Chit, A. (2018) · Expert Review of Vaccines · doi:10.1080/14760584.2018.1471989 · Cited by 143
Ospina, N. S., Rodríguez-Gutiérrez, R., Maraka, S., Ycaza, A. E. E. D., Jasim, S., Castañeda-Guarderas, A., Gionfriddo, M., Nofal, A. A., Brito, J. P., Erwin, P., et al. (2016) · World Journal of Surgery · doi:10.1007/s00268-016-3514-1 · Cited by 124
“All statistical analyses were performed using Open-Meta [16].”
MethodBeckwée, D., Leysen, L., Meuwis, K., & Adriaenssens, N. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-017-3613-z · Cited by 123
The effects of ketamine on the mismatch negativity (MMN) in humans - A meta-analysis.
Rosburg, T., & Kreitschmann-Andermahr, I. (2016) · Clinical Neurophysiology · doi:10.1016/j.clinph.2015.10.062 · Cited by 123
“For the analysis of the drug effects, the mean amplitude and latencies (± SD) of each study were entered into OpenMeta Analyst (Brown University, Wallace et al., 2012) and effects sizes of the ketamine effects were calculated.”
Treatment of Thyroid Dysfunction and Serum Lipids: A Systematic Review and Meta-analysis
Kotwal, A., CORTES, T. M., Genere, N., Hamidi, O., Jasim, S., Newman, C. B., Prokop, L. J., Murad, M. H., & Alahdab, F. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa672 · Cited by 168
Jiritano, F., Serraino, G. F., Cate, H. T., Fina, D., Matteucci, M., Mastroroberto, P., & Lorusso, R. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06031-4 · Cited by 159
Frequency of self-reported drug allergy: A systematic review and meta-analysis with meta-regression.
Sousa-Pinto, B., Fonseca, J., & Gomes, E. (2017) · Annals of Allergy, Asthma & Immunology · doi:10.1016/j.anai.2017.07.009 · Cited by 122
Ali, N., Tian, H., Thabane, L., Ma, J., Wu, H., Zhong, Q., Gao, Y., Sun, C., Zhu, Y., & Wang, T. (2022) · The journal of prevention of Alzheimer's disease · doi:10.14283/jpad.2022.16 · Cited by 121
“10), was used for data processing (31), while RevMan V5.”
MethodKishita, N., Hammond, L., Dietrich, C. M., Mioshi, E., Haapala, I., Biggs, S., & Kurrle, S. (2018) · International Psychogeriatrics · doi:10.1017/s1041610218000947 · Cited by 130
“All data were analyzed using the Open MetaAnalyst (Wallace et al., 2012).”
MethodPalaiodimou, L., Stefanou, M., Katsanos, A. H., Fragkou, P. C., Papadopoulou, Μ., Moschovos, C., Michopoulos, I., Kokotis, P., Bakirtzis, C., Naska, A., et al. (2021) · European Journal of Neurology · doi:10.1111/ene.14860 · Cited by 134
“All statistical analyses were conducted using the OpenMetaAnalyst [23] and Stata Statistical Software Release 13 for Windows (StataCorp LP).”
MethodChrcanovic, B., Albrektsson, T., & Wennerberg, A. (2015) · E -journal of dentistry · doi:10.1016/j.jdent.2014.11.007 · Cited by 115
“The data were analyzed using OpenMeta[Analyst] [9].”
Willcutts, K. F., Chung, M. C., Erenberg, C. L., Finn, K. L., Schirmer, B. D., & Byham-Gray, L. D. (2016) · Annals of Surgery · doi:10.1097/sla.0000000000001644 · Cited by 115
“The data for each study were exported to OpenMeta-Analyst (Brown University, RI) for statistical analysis.(23) If there were 2 or more studies and the degree of clinical heterogeneity was determined to be logical by the research team, the overall pooled odds ratios (ORs) for dichotomous outcomes and difference in mean…”
MethodAlahdab, F., Arwani, R., Pasha, A. K., Razouki, Z. A., Prokop, L. J., Huber, T. S., & Murad, M. H. (2018) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2017.12.046 · Cited by 114
“Statistical analyses were conducted using OpenMeta[Analyst].(14) All values were two tailed, and a P < .”
MethodKrivicich, L. M., Kunze, K., Parvaresh, K. C., Jan, K., Devinney, A., Vadhera, A. S., LaPrade, R., & Chahla, J. (2021) · American Journal of Sports Medicine · doi:10.1177/03635465211017514 · Cited by 114
Prevalence, awareness and control of hypertension in Ghana: A systematic review and meta-analysis
Bosu, W., & Bosu, D. K. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248137 · Cited by 114
“Except for the leave-one-out influence analysis performed with OpenMeta (analyst) software [38], all statistical analyses were performed in Stata version 15 for windows [39].”
MethodBora, E., Velakoulis, D., & Walterfang, M. (2016) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/0891988716640375 · Cited by 110
“7 on a Windows platform andpackages in R environment (OpenMetaAnalyst, Metafor).(39-41) Effect sizes were weighted using the inverse variance method, and a random effects model (DerSimonian–Laird estimate) was used because the distributions of effect sizes were heterogeneous for the number of variables.”
MethodInfluentialHealth Literacy and Outcomes Among Patients With Heart Failure
Fabbri, M., Murad, M. H., Wennberg, A. M. V., Turcano, P., Erwin, P. J., Alahdab, F., Berti, A., Manemann, S. M., Yost, K. J., Rutten, L. J. F., et al. (2020) · JACC Heart Failure · doi:10.1016/j.jchf.2019.11.007 · Cited by 143
“All the analyses were performed with Open-meta (30).”
Method
Metadata
- Authors
- Wallace, B. C., Dahabreh, I. J., Trikalinos, T. A., Lau, J., Trow, P., & Schmid, C. H.
- Affiliations
- Tufts University (US)
- Venue
- Journal of Statistical Software
- Publisher
- Foundation for Open Access Statistic
- Published
- 2012
- Volume
- 49
- Issue
- 5
- ISSN
- 1548-7660 (ISSN-L)
- OpenAlex
- W2120771911
- Cited by
- 1,125
- References
- 27
- Citations by year
- 2026: 50 · 2025: 89 · 2024: 115 · 2023: 105 · 2022: 127 · 2021: 143 · 2020: 133 · 2019: 94 · 2018: 76 · 2017: 68 · 2016: 65 · 2015: 37 · 2014: 17 · 2013: 4 · 2012: 1
- FWCI
- 18.44
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Journal of Statistical Software (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- R, meta-analysis software, graphical user interface, Python, open source software, software integration, statistical software development, non-technical users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
