Meta-Analytic Methodology for Basic Research: A Practical Guide
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Basic life science literature is rich with information, however methodically quantitative attempts to organize this information are rare. Unlike clinical research, where consolidation efforts are facilitated by systematic review and meta-analysis, the basic sciences seldom use such rigorous quantitative methods. The goal of this study is to present a brief theoretical foundation, computational resources and workflow outline along with a working example for performing systematic or rapid reviews of basic research followed by meta-analysis. Conventional meta-analytic techniques are extended to accommodate methods and practices found in basic research. Emphasis is placed on handling heterogeneity that is inherently prevalent in studies that use diverse experimental designs and models. We introduce MetaLab, a meta-analytic toolbox developed in MATLAB R2016b which implements the methods described in this methodology and is provided for researchers and statisticians at Git repository (https://github.com/NMikolajewicz/MetaLab). Through the course of the manuscript, a rapid review of intracellular ATP concentrations in osteoblasts is used as an example to demonstrate workflow, intermediate and final outcomes of basic research meta-analyses. In addition, the features pertaining to larger datasets are illustrated with a systematic review of mechanically-stimulated ATP release kinetics in mammalian cells. We discuss the criteria required to ensure outcome validity, as well as exploratory methods to identify influential experimental and biological factors. Thus, meta-analyses provide informed estimates for biological outcomes and the range of their variability, which are critical for the hypothesis generation and evidence-driven design of translational studies, as well as development of computational models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 2×
“, 2005)], JASP (JASP Team, 2018) and MetaFOR library for R (Viechtbauer, 2010).”
BackgroundMethodInfluentialLeast squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · cited 1×
“In the past, funnel plot asymmetries have been attributed solely to publication bias, however they should be interpreted more broadly as a general presence of bias or heterogeneity (Sterne et al., 2011).”
BackgroundAssessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
The chi-square test of independence
McHugh, M. L. (2013) · Biochemia Medica · doi:10.11613/bm.2013.018 · Cited by 2,828
De-duplication of database search results for systematic reviews in EndNote
Bramer, W. M., Giustini, D., de Jonge, G. B., Holland, L., & Bekhuis, T. (2016) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.104.3.014 · Cited by 2,103
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685 · cited 1×
“An overview of the various τ 2 estimators along with recommendations on their use can be found elsewhere (Veroniki et al., 2016).”
BackgroundThe heterogeneity statistic I2 can be biased in small meta-analyses
von Hippel, P. T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0024-z · Cited by 1,229
Cited by
Extracellular matrix composition of connective tissues: a systematic review and meta-analysis
McKee, T. J., Perlman, G., Morris, M., & Komarova, S. V. (2019) · Scientific Reports · doi:10.1038/s41598-019-46896-0 · Cited by 266
Self-citationA systematic review and meta-analysis of bone loss in space travelers
Stavnichuk, M., Mikolajewicz, N., Corlett, T., Morris, M., & Komarova, S. V. (2020) · npj Microgravity · doi:10.1038/s41526-020-0103-2 · Cited by 217
Self-citationHan, A., Yuen, H. K., Lee, H. Y., & Zhou, X. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.10.004 · Cited by 39
Han, A. (2021) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2021.03.011 · Cited by 29
Goh, X. X., Tang, P. Y., & Tee, S. F. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114429 · Cited by 25
Kamaruddin, I. K., Ma’rof, A. M., Mohd Nazan, A. I. N., & Ab Jalil, H. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1014258 · Cited by 15
Metadata
- Authors
- Mikolajewicz, N., & Komarova, S. V.
- Venue
- Frontiers in Physiology
- Publisher
- Frontiers Media SA
- Published
- 2019-03-27
- Volume
- 10
- Pages
- 203-203
- ISSN
- 1664-042X (ISSN-L)
- OpenAlex
- W2924426490
- Cited by
- 234
- References
- 21
- FWCI
- 15.69
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.