The DOI matches its Crossref record; 18 of the 27 references it cites were found in a registry or an index.
Closing the Gap between Methodologists and End-Users: R as a Computational Back-End
Open accessAbstract
The R environment provides a natural platform for developing new statistical methods due to the mathematical expressiveness of the language, the large number of existing libraries, and the active developer community. One drawback to R, however, is the learning curve; programming is a deterrent to non-technical users, who typically prefer graphical user interfaces (GUIs) to command line environments. Thus, while statisticians develop new methods in R, practitioners are often behind in terms of the statistical techniques they use as they rely on GUI applications. Meta-analysis is an instructive example; cutting-edge meta-analysis methods are often ignored by the overwhelming majority of practitioners, in part because they have no easy way of applying them. This paper proposes a strategy to close the gap between the statistical state-of-the-science and what is applied in practice. We present open-source meta-analysis software that uses R as the underlying statistical engine, and Python for the GUI. We present a framework that allows methodologists to implement new methods in R that are then automatically integrated into the GUI for use by end-users, so long as the programmer conforms to our interface. Such an approach allows an intuitive interface for non-technical users while leveraging the latest advanced statistical methods implemented by methodologists.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“A striking example is the almost universal use of the DerSimonian-Laird method for random effects univariate meta-analysis (DerSimonian and Laird 1986) (the default or only method in the aforementioned programs), irrespective of good data that alternative random effect methods have better statistical…”
MethodMeta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 4×
“Line 2 is the call out to the random effects as implemented by the metafor package (Viechtbauer 2010).”
MethodInfluentialStatistical Methods for Research Workers
Kendall, M. (1937) · Nature · doi:10.1038/139737d0 · Cited by 9,676 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
BackgroundPrimary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
BackgroundBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 2×
“…random effects univariate meta-analysis (DerSimonian and Laird 1986) (the default or only method in the aforementioned programs), irrespective of good data that alternative random effect methods have better statistical properties (Turner, Omar, Yang, Goldstein, and Thompson 2000; Viechtbauer 2005).”
MethodThe R Commander: A Basic-Statistics Graphical User Interface to R
Fox, J. (2005) · Journal of Statistical Software · doi:10.18637/jss.v014.i09 · Cited by 1,098 · cited 1×
“Our approach is similar in spirit to the R Commander package ( Rcmdr ), which provides an “easy-to-use, cross-platform, extensible GUI” with enough functionality to span a basic statistics course (Fox 2005).”
MethodBax, L., Yu, L.-M., Ikeda, N., Tsuruta, H., & Moons, K. G. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-50 · Cited by 514 · cited 2×
“Currently, meta-analysis methods are implemented in many statistical packages, including Stata (Sterne 2009), SPSS (Lipsey and Wilson 2001), SAS (Arthur, Bennett, Huffcutt, Arthur, and Bennett 2001) and R (Schwarzer 2012; Lumley 2009; Viechtbauer 2010), in addition to Microsoft Excel plug-ins, such as MIX (Bax, Yu, Ike…”
MethodGurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421
Report on Certain Enteric Fever Inoculation Statistics
Simpson, L. (1904) · British medical journal · doi:10.1136/bmj.2.2288.1243 · Cited by 283 · cited 1×
“…disciplines, including the natural sciences, such as physics, astronomy (Airy 1875) and ecology (Osenberg, Sarnelle, and Goldberg 1999), as well as medicine (Simpson and Pearson 1904; Fisher 1925), epidemiology (Stroup et al. 2000), psychology (Glass 1976), and education (Kulik and Kulik 1989).”
Background
Flagged first, then by citations
9 of the 27 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–200 of 1,000
Compliance With Guideline-Directed Medical Therapy in Contemporary Coronary Revascularization Trials
Pinho‐Gomes, A., Azevedo, L. F., Ahn, J., Park, S., Hamza, T. H., Farkouh, M. E., Serruys, P. W. J. C., Milojevic, M., Kappetein, A. P., Stone, G. W., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.11.068 · Cited by 125
“All statistical analyses were performed using the software Open MetaAnalyst (13).”
MethodCiria, R., Berardi, G., Alconchel, F., Briceño, J., Choi, G.-H., Wu, Y.-M., Sugioka, A., Troisi, R., Salloum, C., Soubrane, O., et al. (2020) · Journal of hepato-biliary-pancreatic sciences · doi:10.1002/jhbp.869 · Cited by 109
Risk factors for severe perineal trauma during childbirth: An updated meta-analysis.
Pergialiotis, V., Bellos, I., Fanaki, M., Vrachnis, N., & Doumouchtsis, S. (2020) · European Journal of Obstetrics, Gynecology, and Reproductive Biology · doi:10.1016/j.ejogrb.2020.02.025 · Cited by 107
Ciria, R., Gómez-Luque, I., Ocaña, S., Cipriani, F., Halls, M., Briceño, J., Okuda, Y., Troisi, R., Rotellar, F., Soubrane, O., et al. (2018) · Annals of Surgical Oncology · doi:10.1245/s10434-018-6926-3 · Cited by 107
Prediction Models of Mortality in Acute Pancreatitis in Adults
Di, M., Liu, H., Yang, Z., Bonis, P. A., Tang, J.-L., & Lau, J. W. Y. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0650 · Cited by 103
Self-citationLee, K. W., Loh, H. C., Ching, S. M., Devaraj, N. K., & Hoo, F. K. (2020) · Nutrients · doi:10.3390/nu12061604 · Cited by 105
“Meta-analyses were conducted using Open Meta Analyst software [27].”
Pacha, H. M., Alahdab, F., Al-khadra, Y., Idris, A., Rabbat, F., Darmoch, F., Soud, M., Zaitoun, A., Kaki, A., Rao, S. V., et al. (2018) · American Heart Journal · doi:10.1016/j.ahj.2018.06.007 · Cited by 105
Guimarães‐Pereira, L., Reis, P., Abelha, F., Azevedo, L. F., & Castro‐Lopes, J. M. (2017) · Pain · doi:10.1097/j.pain.0000000000000997 · Cited by 123
Social cognition in temporal lobe epilepsy: A systematic review and meta-analysis.
Bora, E., & Meletti, S. (2016) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2016.04.024 · Cited by 105
Bouzid, M., Kintz, E. N., & Hunter, P. R. (2018) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0006553 · Cited by 111
Kintz, E., Brainard, J., Hooper, L., & Hunter, P. (2017) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2016.10.011 · Cited by 103
Baral, R., Tsampasian, V., Dębski, M., Moran, B., Garg, P., Clark, A., & Vassiliou, V. S. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.3594 · Cited by 127
Hossain, M. M., Rahman, M., Trisha, N. F., Tasnim, S., Nuzhath, T., Hasan, N. T., Clark, H., Das, A., McKyer, E. L. J., Ahmed, H. U., et al. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e06677 · Cited by 125
“We performed meta-analyses using Open Meta Analyst [43] and StatsDirect [44] software packages.”
Vitamin D deficiency in Saudi Arabians: A reality or simply hype: A meta-analysis (2008–2015)
Al-Alyani, H. S., AlTurki, H., Al-Essa, O. N., Alani, F. M., & Sadat-Ali, M. (2018) · Journal of Family and Community Medicine · doi:10.4103/jfcm.jfcm_73_17 · Cited by 102
“Heterogeneity test is used to assess the significance of heterogeneity among studies.[25,26]”
MethodImpact of Mucolytic Agents on COPD Exacerbations: A Pair-wise and Network Meta-analysis
Cazzola, M., Rogliani, P., Calzetta, L., Hanania, N., & Matera, M. (2017) · COPD · doi:10.1080/15412555.2017.1347918 · Cited by 102
“OpenMetaAnalyst (41) and GeMTC (36) software were used for performing the meta-analysis, SPSS Statistics (NY, US) for meta-regression, GraphPad Prism (CA, US) software for graphing the data, and GRADEpro for assessing the quality of evidence (24).”
MethodRecurrence probability for keratocystic odontogenic tumors: An analysis of 6427 cases.
Chrcanovic, B., & Gomez, R. (2017) · Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery · doi:10.1016/j.jcms.2016.11.010 · Cited by 102
“The data were analyzed using the softwares OpenMeta[Analyst] (Wallace et al., 2012) and Review Manager (version 5.3.3, The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen, Denmark, 2014).”
MethodInfluentialKanejima, Y., Shimogai, T., Kitamura, M., Ishihara, K., & Izawa, K. P. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.11.021 · Cited by 126
Abdullah, A. B., Liew, S. M., Salim, H. S., Ng, C. J., & Chinna, K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216402 · Cited by 117
Lee, J. K. H., Lam, G., Shin, T., Samson, S., Greenberg, D. P., & Chit, A. (2021) · Vaccine · doi:10.1016/j.vaccine.2020.09.004 · Cited by 128
Huang, C., Zhou, Z., Peng, C. H., Teng, M., & Wang, P. (2018) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2018.08.320 · Cited by 111
Neurocognitive impairment in deficit and non-deficit schizophrenia: a meta-analysis
Bora, E., Akdede, B. B., & Alptekın, K. (2017) · Psychological Medicine · doi:10.1017/s0033291717000952 · Cited by 125
“Meta-analyses were performed using packages in R environment (OpenMetaAnalyst,Metafor) (Viechtbauer, 2010;Wallace et al.2012).”
MethodPrevalence of root canal treatment worldwide: A systematic review and meta‐analysis
León‐López, M., Cabanillas‐Balsera, D., Martín-González, J., Montero‐Miralles, P., Saúco‐Márquez, J. J., & Segura-Egea, J. J. (2022) · International Endodontic Journal · doi:10.1111/iej.13822 · Cited by 110
“To determine the global prevalence of RFT, a metaanalysis was performed with the OpenMeta Analyst version 10.10 software (Wallace et al., 2012), using the binary random effects model.”
MethodInfluentialCastaldelli-Maia, J. M., Marziali, M. E., Lu, Z., & Martins, S. S. (2021) · Psychological Medicine · doi:10.1017/s0033291721000933 · Cited by 138
Meco, M., Montisci, A., Miceli, A., Panisi, P., Donatelli, F., Cirri, S., Ferrarini, M., Lio, A., & Glauber, M. (2018) · Journal of the American Heart Association : Cardiovascular and Cerebrovascular Disease · doi:10.1161/jaha.117.006091 · Cited by 96
“All analyses were conducted using Review Manager 5.1 software (Nordic Cochrane Centre) and Open Meta Analyst.6 Kaplan–Meier curves were digitized using a dedicated software (Plot Digitizer; Free Software Foundation Europe).”
BackgroundMethodInfluentialSanchez, C., Sundermeier, B. A., Gray, K., & Calin-Jageman, R. J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172636 · Cited by 104
Cognitive stimulation and cognitive results in older adults: A systematic review and meta-analysis
Gómez‐Soria, I., Iguacel, I., Aguilar‐Latorre, A., Peralta, P., Latorre, E., Cuenca‐Zaldívar, J. N., & Calatayud, E. (2022) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2022.104807 · Cited by 111
The Effect of Perioperative Music on Medication Requirement and Hospital Length of Stay
Fu, V. X., Oomens, P., Klimek, M., Verhofstad, M. H. J., & Jeekel, J. J. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003506 · Cited by 119
“Statistical Analysis Data were analyzed with the open-source, meta-analysis software OpenMeta-Analyst, which uses R as the underlying statistical engine.(19) Random effect models were used, because heterogeneity between the included studies was assumed to be present.”
MethodRecent Advances in Preventing and Managing Postoperative Delirium
Vlisides, P. E., & Avidan, M. S. (2019) · F1000Research · doi:10.12688/f1000research.16780.1 · Cited by 102
Ferreira, M. G., Mariano, L. I., Rezende, J. V. D., Caramelli, P., & Kishita, N. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.04.134 · Cited by 94
Badawi, A. F., & Ryoo, S. G. (2016) · Journal of Public Health Research · doi:10.4081/jphr.2016.733 · Cited by 94
Serafin, Z., Białecki, M., Białecka, A., Sconfienza, L. M., & Kłopocka, M. (2015) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjv196 · Cited by 91
Platform switch and dental implants: A meta-analysis.
Chrcanovic, B., Albrektsson, T., & Wennerberg, A. (2015) · E -journal of dentistry · doi:10.1016/j.jdent.2014.12.013 · Cited by 93
“Meta-regressions (when possible) were performed by using the software OpenMeta[Analyst].13 3.”
MethodKim, J.-H., Park, Y., Ha, C., Roh, Y., & Park, J. (2021) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671211011948 · Cited by 92
Ventilator-Associated Pneumonia in Patients with COVID-19: A Systematic Review and Meta-Analysis
Ippolito, M., Misseri, G., Catalisano, G., Marino, C., Ingoglia, G., Alessi, M., Consiglio, E., Gregoretti, C., Giarratano, A., & Cortegiani, A. (2021) · Antibiotics · doi:10.3390/antibiotics10050545 · Cited by 92
Mitaka, H., Kuno, T., Takagi, H., & Patrawalla, P. (2021) · Mycoses (Berlin) · doi:10.1111/myc.13292 · Cited by 92
“Permpalung et al 396 39 15 (9– 23) 12 (3– 22) 26 (67) 9 (23) 19 (49)”
Hamstra-Wright, K., Bliven, K. C. H., Bay, R., & Aydemir, B. (2021) · Sports health · doi:10.1177/1941738120970976 · Cited by 92
“OpenMeta[Analyst] was used to estimate pooled effect sizes, 95% CIs, and heterogeneity.(29)”
MethodMullins, P. G. (2018) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12411 · Cited by 101
Zoratti, M. J., Siddiqua, A., Morassut, R. E., Zeraatkar, D., Chou, R., van Holten, J., Xie, F., & Druyts, E. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.12.007 · Cited by 101
“Analyses were performed in OpenMeta[analyst] based on the Metafor package [11,12].”
MethodHepatitis B Virus Reactivation and Prophylaxis During Solid Tumor Chemotherapy
Paul, S., Saxena, A., Terrin, N., Viveiros, K., Balk, E., & Wong, J. (2015) · Annals of Internal Medicine · doi:10.7326/m15-1121 · Cited by 91
“Statistical analyses were performed with OpenMetaAnalyst (27) and the meta and metafor packages in R, version 3.”
MethodInfluentialBehavioral treatments for speech in Parkinson's disease: meta-analyses and review of the literature.
Atkinson-Clement, C., Sadat, J., & Pinto, S. (2015) · Neurodegenerative Disease Management · doi:10.2217/nmt.15.16 · Cited by 91
Elsenousi, A., Aletich, V., & Alaraj, A. (2014) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2014-011427 · Cited by 91
Tacelli, M., Celsa, C., Magro, B., Barchiesi, M., Barresi, L., Capurso, G., Arcidiacono, P. G., Cammà, C., & Crinò, S. F. (2020) · Digestive Endoscopy · doi:10.1111/den.13626 · Cited by 109
Verpalen, I., Anneveldt, K., Nijholt, I., Schutte, J., Dijkstra, J., Franx, A., Bartels, L., Moonen, C., Edens, M., & Boomsma, M. (2019) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.108700 · Cited by 90
Carter, H. M., Littlewood, C., Webster, K. E., & Smith, B. E. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-03676-6 · Cited by 101
Vitamin D Receptor polymorphisms and risk of enveloped virus infection: A meta-analysis
Laplana, M., Royo, J. L., & Fibla, J. (2018) · Gene · doi:10.1016/j.gene.2018.08.017 · Cited by 90
Baral, R., White, M., & Vassiliou, V. S. (2020) · Current Atherosclerosis Reports · doi:10.1007/s11883-020-00880-6 · Cited by 98
Prevalence of Comorbidities in COVID-19 Patients: A Systematic Review and Meta-Analysis.
Baradaran, A., Ebrahimzadeh, M., Baradaran, A., & Kachooei, A. (2020) · The Archives of Bone & Joint Surgery · doi:10.22038/abjs.2020.47754.2346 · Cited by 87
Preoperative localization of colorectal cancer: a systematic review and meta-analysis
Acuna, S., Elmi, M., Shah, P., Coburn, N., & Quereshy, F. (2017) · Surgical Endoscopy · doi:10.1007/s00464-016-5236-8 · Cited by 87
Avgerinos, K. I., Egan, J. M., Mattson, M. P., & Kapogiannis, D. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.101001 · Cited by 96
“For calculations of MDs/SMDs, statistical syntheses and forest plots’ generation we used the OpenMeta[Analyst] statistical software (Wallace et al., 2012).”
MethodReljic, D., Lampe, D., Wolf, F., Zopf, Y., Herrmann, H. J., & Fischer, J. E. (2019) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.13452 · Cited by 106
Oh, the things you don’t know: awe promotes awareness of knowledge gaps and science interest
McPhetres, J. (2019) · Cognition & Emotion · doi:10.1080/02699931.2019.1585331 · Cited by 99
“Using Open Meta-analyst (Wallace et al., 2012), I computed a fixed-effects model using science interest and awareness of knowledge gaps as the outcomes across Studies 1a, 1b, 1c, and 2.”
MethodA meta-analysis on pain sensitivity in self-injury
Koenig, J., Thayer, J. F., & Kaess, M. (2016) · Psychological Medicine · doi:10.1017/s0033291716000301 · Cited by 117
“Computations for meta-regression were performed using the OpenMetaAnalyst software (Wallace et al. 2012).”
MethodThe incubation period during the pandemic of COVID-19: a systematic review and meta-analysis
Dhouib, W., Maatoug, J., Ayouni, I., Zammit, N., Ghammem, R., Fredj, S. B., & Ghannem, H. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01648-y · Cited by 83
“A random effects meta-analysis was conducted in the Open Meta Analyst software [19], of the calculated and estimated mean of the log-normal distribution.”
MethodRogliani, P., Matera, M., Page, C., Puxeddu, E., Cazzola, M., & Calzetta, L. (2019) · Respiratory Research · doi:10.1186/s12931-019-1078-y · Cited by 84
Hiremath, S. S., Fergusson, D. A., Fergusson, N. A., Bennett, A., & Knoll, G. A. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.08.018 · Cited by 88
Social Cognition in Multiple Sclerosis: a Meta-Analysis
Bora, E., Özakbaş, S., Velakoulis, D., & Walterfang, M. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9320-6 · Cited by 83
“Meta-analyses were performed using packages in the R environment (OpenMetaAnalyst, Metafor) and MIX software version 1.7 on a Windows platform (Bax et al 2006; Viechtbauer , 2010; Wallace et al 2012).”
BackgroundMethodInfluentialInterventions To Prevent Retinopathy of Prematurity: A Meta-analysis
Fang, J. L., Sorita, A., Carey, W. A., Colby, C. E., Murad, M. H., & Alahdab, F. (2016) · PEDIATRICS · doi:10.1542/peds.2015-3387 · Cited by 88
Tandon, P., Govardhanam, V., Leung, K. K., Maxwell, C. V., & Huang, V. (2020) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.15587 · Cited by 92
Heterogeneity in Unclassifiable Interstitial Lung Disease. A Systematic Review and Meta‐Analysis
Guler, S., Ellison, K., Algamdi, M., Collard, H., & Ryerson, C. (2018) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201801-067oc · Cited by 81
Garip, M., Dessel, J. V., Grosjean, L., Politis, C., & Bila, M. (2020) · British Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.bjoms.2020.07.020 · Cited by 80
Alsaied, T., Baskar, S., Fares, M., Alahdab, F., Czosek, R., Murad, M., Prokop, L., & Divanovic, A. (2017) · Journal of the American Heart Association : Cardiovascular and Cerebrovascular Disease · doi:10.1161/jaha.117.007164 · Cited by 80
“conducted through OpenMeta.(18) All values are 2-tailed, and P<0.”
MethodInfluentialA meta-analysis of neurocognition in youth with familial high risk for bipolar disorder
Bora, E., & Özerdem, A. (2017) · European psychiatry · doi:10.1016/j.eurpsy.2017.02.483 · Cited by 80
“Meta-analyses were performed using packages in R environment (OpenMetaAnalyst, Metafor) [28,29].”
MethodRozema, J. J., Wouters, K., Mathysen, D. G. P., & Tassignon, M. (2014) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2014.08.014 · Cited by 76
Ro, K., Kim, J.-H., Heo, J., & Lee, D.-H. (2020) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967120962078 · Cited by 79
“The standardized mean difference and standardized variance were calculated from the weighted estimate, standard error, and sample size of each cohort with the use of the logit method.(42) Summary ORs and 95% CIs were calculated from the standardized mean difference and standardized variance (George Mason University).”
MethodHypothalamic-pituitary-adrenal axis functioning in borderline personality disorder: A meta-analysis
Drews, E., Fertuck, E. A., Koenig, J., Kaess, M., & Arntz, A. R. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.11.008 · Cited by 106
Westermann, R., Duchman, K. R., Amendola, A., Glass, N., & Wolf, B. (2017) · American Journal of Sports Medicine · doi:10.1177/0363546516642220 · Cited by 78
The use of inhaled prostaglandins in patients with ARDS: a systematic review and meta-analysis.
Fuller, B., Mohr, N., Skrupky, L., Fowler, S., Kollef, M., & Carpenter, C. (2015) · Chest · doi:10.1378/chest.14-3161 · Cited by 78
Jeyaraman, M., Muthu, S., & Ganie, P. A. (2020) · Cartilage · doi:10.1177/1947603520951623 · Cited by 83
Lin, A., Roth, H. F., Anyane‐Yeboa, A., Rubin, D. T., & Paul, S. (2020) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izaa189 · Cited by 91
Abda, A., Bolduc, M.-È., Tsimicalis, A., Rennick, J. E., Vatcher, D., & Brossard‐Racine, M. (2018) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsy085 · Cited by 101
“Statistical analysis examining the presence of psychosocial difficulties in children with CHD was performed using OpenMeta[Analyst] software (Wallace et al., 2012).”
MethodMuthu, S., Ramakrishnan, E., & Chellamuthu, G. (2020) · Global Spine Journal · doi:10.1177/2192568220948814 · Cited by 96
“Meta-analysis was conducted in R platform with OpenMeta [Analyst].(13) For dichotomous variable outcomes, odds ratio (OR) with 95% confidence interval (CI) was used and for continuous variable outcomes, weighted mean difference (WMD) with 95% CI was used.”
MethodEffect of cross‐linked vs non‐cross‐linked collagen membranes on bone: A systematic review
Garcia, J. J., Berghezan, S., Caramês, J., Dard, M., & Marques, D. N. D. S. (2017) · Journal of Periodontal Research · doi:10.1111/jre.12470 · Cited by 75
Lazarides, A. L., Duchman, K. R., Ledbetter, L., Riboh, J. C., & Garrigues, G. (2019) · Arthroscopy: The Journal of Arthroscopy And Related · doi:10.1016/j.arthro.2018.09.029 · Cited by 74
Meta-Analysis of Social Cognition in Mild Cognitive Impairment
Bora, E., & Yener, G. (2017) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/0891988717710337 · Cited by 88
“Meta-analyses were performed using packages in the R environment (OpenMetaAnalyst, Metafor).(33,34) Effect sizes were weighted using the inverse variance method.”
MethodMelo, C., Ruano, L., Jorge, J. C., Ribeiro, T. P., Oliveira, G., Azevedo, L. F., & Temudo, T. P. (2019) · Autism · doi:10.1177/1362361319869118 · Cited by 108
“Meta-analysis was conducted using the Open Meta [Analyst] software (Wallace et al., 2012).”
MethodSuurmond, R., Wynstra, F., & Dul, J. (2020) · Journal of Supply Chain Management · doi:10.1111/jscm.12221 · Cited by 85
Lewis, A. S., van Schalkwyk, G. I., & Bloch, M. H. (2017) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.01.001 · Cited by 80
“Effect sizes of drug treatment were calculated as Cohen's d using Open Meta-Analyst, freely available web tools for ES calculation (Lipsey and Wilson, 2001; Wilson, 2010), and Microsoft Excel.”
Lemmens, L. H. J. M., Arntz, A. R., Peeters, F. P. M. L., Hollon, S. D., Roefs, A., & Huibers, M. J. H. (2015) · Psychological Medicine · doi:10.1017/s0033291715000033 · Cited by 73
“2008; current study) using the statistical program Open Meta Analysis (Wallace et al. 2012).”
Tsivgoulis, G. K., Katsanos, A. H., Köhrmann, M., Caso, V., Perren, F., Palaiodimou, L., Deftereos, S. G., Giannopoulos, S., Ellul, J., Krogias, C., et al. (2019) · Journal of Stroke · doi:10.5853/jos.2019.01067 · Cited by 82
Rathbone, A., Grosman-Rimon, L., & Kumbhare, D. (2017) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000459 · Cited by 71
Rahman, M. N., Barua, N., Tin, M. C. F., Dharmaratne, P., Wong, S. H., & Ip, M. (2024) · Gut Microbes · doi:10.1080/19490976.2024.2356279 · Cited by 77
“23 Statistical heterogeneity between the studies included in the meta-analysis was described using I 2 statistic.”
MethodAl-Musawe, L., Martins, A., Raposo, J., & Torre, C. (2019) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2019.107804 · Cited by 69
Malhotra, K., Ahmed, N., Filippatou, A., Katsanos, A., Goyal, N., Tsioufis, K., Manios, E., Pikilidou, M., Schellinger, P., Alexandrov, A., et al. (2019) · Journal of Stroke · doi:10.5853/jos.2018.02369 · Cited by 69
Bury, J., West, M., Chamorro-Moriana, G., & Littlewood, C. (2016) · Manual Therapy · doi:10.1016/j.math.2016.05.337 · Cited by 94
“Meta-analysis was conducted using OpenMetaAnalyst software (28).”
Management of phyllodes tumor: A systematic review and meta-analysis of real-world evidence
Yu, C.-Y., Huang, T., & Tam, K. (2022) · International Journal of Surgery · doi:10.1016/j.ijsu.2022.106969 · Cited by 70
SARS-CoV-2 Neutralizing Antibodies: A Network Meta-Analysis across Vaccines
Rogliani, P., Chetta, A. A., Cazzola, M., & Calzetta, L. (2021) · Vaccines · doi:10.3390/vaccines9030227 · Cited by 62
“The GeMTC software and OpenMetaAnalyst (CEBM, Brown University, Rhode Island, USA) were used to perform the meta-analysis [55,59], GraphPad Prism (San Diego, CA, USA) software to graph the data, GRADEpro GDT (McMaster University and Evidence Prime Inc., Hamilton, Canada) to assess the quality of…”
Yadav, U., Kumar, P., Gupta, S., & Rai, V. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2016.02.002 · Cited by 68
“All statistical analyses were undertaken by Open Meta-Analyst (Wallace et al., 2013) and MIX version 1.”
MethodReturn to Sport After Operative Management of Osteochondritis Dissecans of the Capitellum
Westermann, R., Hancock, K. J., Buckwalter, J., Kopp, B., Glass, N., & Wolf, B. (2016) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967116654651 · Cited by 66
LABA/LAMA combination in COPD: a meta-analysis on the duration of treatment
Calzetta, L., Rogliani, P., Ora, J., Puxeddu, E., Cazzola, M., & Matera, M. G. (2017) · European Respiratory Review · doi:10.1183/16000617.0043-2016 · Cited by 71
Feinberg, A. E., Chesney, T., Acuna, S., Sammour, T., & Quereshy, F. (2017) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000000641 · Cited by 65
Hwang, M., Nagappa, M., Guluzade, N. A., Saripella, A., Englesakis, M. F., & Chung, F. F. (2022) · BMC Anesthesiology · doi:10.1186/s12871-022-01912-1 · Cited by 88
“Meta-regression and sensitivity analysis were performed for moderate-to-severe and severe OSA using Open Meta Analyst software [24] for categorical variables (validation tools and study type) and continuous variables (age, male gender, BMI, neck circumference, prevalence, and sample size).”
MethodTolkachjov, S. N., Kelley, B., Alahdab, F., Erwin, P., & Brewer, J. (2018) · Journal of American Academy of Dermatology · doi:10.1016/j.jaad.2018.06.048 · Cited by 64
“8 (6-94) 1 5 1 Leibovitch, 2006(26) 1993-2002 2 2 2/0/0 FF 60 (NR) 3 0 0 Limmer, 1997(27) NR 6 6 5/0/1 FF 23.”
InfluentialTsang, C., Cheung, I., Lau, K.-K., Brinjikji, W., Kallmes, D., & Krings, T. (2018) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5825 · Cited by 64
Formal thought disorder in schizophrenia and bipolar disorder: A systematic review and meta-analysis
Yalınçetin, B., Bora, E., Binbay, T., Ulaş, H., Akdede, B., & Alptekin, K. (2017) · European psychiatry · doi:10.1016/j.eurpsy.2017.01.2102 · Cited by 64
“Meta-analyses were performed using packages in the R environment (OpenMetaAnalyst, Metafor) (Viechtbauer, 2010; Wallace et al., 2012).”
MethodKreeftenberg, H., Pouwels, S., Bindels, A., de Bie, A., & van der Voort, P. V. D. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003667 · Cited by 63
Bora, E., McIntyre, R., & Özerdem, A. (2018) · Psychological Medicine · doi:10.1017/s0033291718003008 · Cited by 63
Paiella, S., Salvia, R., Pastena, M. D., Pollini, T., Casetti, L., Landoni, L., Esposito, A., Marchegiani, G., Malleo, G., Marchi, G. D., et al. (2018) · Pancreatology · doi:10.1016/j.pan.2018.04.002 · Cited by 71
Meske, D. S., Lawal, O., Elder, H., Langberg, V., Paillard, F., & Katz, N. (2018) · Journal of Pain Research · doi:10.2147/jpr.s160255 · Cited by 63
“The statistical analysis was performed using the OpenMetaAnalyst Software.(13)”
Abayomi, S. N., Sritharan, P., Yan, E., Saripella, A., Alhamdah, Y., Englesakis, M. F., Tartaglia, M. C., He, D., & Chung, F. F. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298686 · Cited by 70
COVID-19 in People Living with HIV: A Systematic Review and Meta-Analysis
Lee, K. W., Yap, S. F., Ngeow, Y. F., & Lye, M. S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073554 · Cited by 93
“Meta-analysis was performed with Open Meta (Analyst)® [22] using a random-effect model (DerSimonian and Laird method) to produce the pooled incidence proportion (PIP) or prevalence and their respective 95% CIs.”
Method
Metadata
- Authors
- Wallace, B. C., Dahabreh, I. J., Trikalinos, T. A., Lau, J., Trow, P., & Schmid, C. H.
- Affiliations
- Tufts University (US)
- Venue
- Journal of Statistical Software
- Publisher
- Foundation for Open Access Statistic
- Published
- 2012
- Volume
- 49
- Issue
- 5
- ISSN
- 1548-7660 (ISSN-L)
- OpenAlex
- W2120771911
- Cited by
- 1,125
- References
- 27
- Citations by year
- 2026: 50 · 2025: 89 · 2024: 115 · 2023: 105 · 2022: 127 · 2021: 143 · 2020: 133 · 2019: 94 · 2018: 76 · 2017: 68 · 2016: 65 · 2015: 37 · 2014: 17 · 2013: 4 · 2012: 1
- FWCI
- 18.44
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Journal of Statistical Software (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- R, meta-analysis software, graphical user interface, Python, open source software, software integration, statistical software development, non-technical users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
