metaumbrella: the first comprehensive suite to perform data analysis in umbrella reviews with stratification of the evidence
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Objective: Umbrella reviews are a new form of literature review that summarises the strength and/or quality of the evidence from all systematic reviews and meta-analyses conducted on a broad topic. This type of review thus provides an exhaustive examination of a vast body of information, providing the highest synthesis of knowledge. A critical strength of umbrella reviews is recalculating the meta-analytic estimates within a uniform framework to allow a consistent evidence stratification. To our best knowledge, there is no comprehensive package or software to conduct umbrella reviews. Methods: The R package metaumbrella accomplishes this aim by building on three core functions that (1) automatically perform all required calculations in an umbrella review (including but not limited to pairwise meta-analyses), (2) stratify evidence according to various classification criteria and (3) generate a visual representation of the results. In addition, this package allows flexible inputs for each review or meta-analysis analysed (eg, means plus SD, or effect size estimate and CI) and customisation (eg, stratification criteria following Ioannidis, algorithmic GRADE or personalised classification). Results: The R package metaumbrella thus provides the first comprehensive range of facilities to perform umbrella reviews with stratification of the evidence. Conclusion: To facilitate the use of this package, even for researchers unfamiliar with R, we also provide a JAMOVI module and an open-access, browser-based graphical interface that allow use of the core functions of the package with a few mouse clicks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Basics of meta‐analysis: I 2 is not an absolute measure of heterogeneity
Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1230 · Cited by 1,848
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016) · Evidence Based Medicine · doi:10.1136/ebmed-2016-110401 · Cited by 1,388
Atkins, D., Eccles, M., Flottorp, S., Guyatt, G. H., Henry, D., Hill, S., Liberati, A., O'Connell, D., Oxman, A. D., Phillips, B., et al. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-38 · Cited by 1,235 · cited 1×
“27 28 Importantly, this algorithmic approach should not be taken as an equivalent to the approach underlying the standard GRADE criteria.”
MethodTheodoratou, E., Tzoulaki, I., Zgaga, L., & Ioannidis, J. P. A. (2014) · BMJ · doi:10.1136/bmj.g2035 · Cited by 956
Ten simple rules for conducting umbrella reviews
Fusar-Poli, P., & Radua, J. (2018) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300014 · Cited by 724
Self-citationIoannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Cited by
Lane, M. M., Gamage, E., Du, S., Ashtree, D. N., McGuinness, A. J., Gauci, S., Baker, P., Lawrence, M., Rebholz, C. M., Srour, B., et al. (2024) · BMJ · doi:10.1136/bmj-2023-077310 · Cited by 1,153
Dragioti, E., Radua, J., Solmi, M., Gosling, C. J., Oliver, D., Lascialfari, F., Ahmed, M., Cortese, S., Estradé, A., Arrondo, G., et al. (2023) · World Psychiatry · doi:10.1002/wps.21068 · Cited by 130
Self-citationJahrami, H., AlKaabi, J., Trabelsi, K., Pandi-Perumal, S. R., Saif, Z., Seeman, M. V., & Vitiello, M. V. (2023) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2023.111479 · Cited by 72
Metadata
- Authors
- Gosling, C. J., Solanes, A., Fusar-Poli, P., & Radua, J.
- Venue
- BMJ Mental Health
- Publisher
- BMJ
- Published
- 2023-02
- Volume
- 26
- Issue
- 1
- Pages
- e300534
- ISSN
- 2755-9734 (ISSN-L)
- OpenAlex
- W4320915200
- Cited by
- 100
- References
- 17
- FWCI
- 18.36
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: metaumbrella: the first comprehensive suite to perform data analysis in umbrella reviews with stratification of the evidence. https://app.cochat.ai/papers/10.1136/bmjment-2022-300534
- The paper
- Gosling, C. J., Solanes, A., Fusar-Poli, P., & Radua, J. (2023). metaumbrella: the first comprehensive suite to perform data analysis in umbrella reviews with stratification of the evidence. BMJ Mental Health. https://doi.org/10.1136/bmjment-2022-300534
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.