The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
On the meta-analysis of response ratios for studies with correlated and multi-group designs
Abstract
A common effect size metric used to quantify the outcome of experiments for ecological meta-analysis is the response ratio (RR): the log proportional change in the means of a treatment and control group. Estimates of the variance of RR are also important for meta-analysis because they serve as weights when effect sizes are averaged and compared. The variance of an effect size is typically a function of sampling error; however, it can also be influenced by study design. Here, I derive new variances and covariances for RR for several often-encountered experimental designs: when the treatment and control means are correlated; when multiple treatments have a common control; when means are based on repeated measures; and when the study has a correlated factorial design, or is multivariate. These developments are useful for improving the quality of data extracted from studies for meta-analysis and help address some of the common challenges meta-analysts face when quantifying a diversity of experimental designs with the response ratio.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
The meta-analysis of response ratios in experimental ecology
Hedges, L. V., Gurevitch, J., & Curtis, P. S. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1150:tmaorr]2.0.co;2 · Cited by 4,704
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Ainsworth, E. A., & Long, S. P. (2005) · New Phytologist · doi:10.1111/j.1469-8137.2004.01224.x · Cited by 3,624
The evolution of polyandry: multiple mating and female fitness in insects
Arnqvist, G., & Nilsson, T. (2000) · Animal Behaviour · doi:10.1006/anbe.2000.1446 · Cited by 1,545
A meta-analysis of elevated CO 2 effects on woody plant mass, form, and physiology
Curtis, P. S., & Wang, X. (1998) · Oecologia · doi:10.1007/s004420050381 · Cited by 1,349
STATISTICAL ISSUES IN ECOLOGICAL META-ANALYSES
Gurevitch, J., & Hedges, L. V. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1142:siiema]2.0.co;2 · Cited by 1,081
Trophic Cascades in Terrestrial Systems: A Review of the Effects of Carnivore Removals on Plants
Schmitz, O. J., Hambäck, P. A., & Beckerman, A. P. (2000) · The American Naturalist · doi:10.1086/303311 · Cited by 981
Elements of Large-Sample Theory
Strawderman, W. E., Lehmann, E. L., & Holmes, S. P. (2012) · Selected Works of E. L. Lehmann · doi:10.1007/978-1-4614-1412-4_97 · Cited by 818
Cited by
Methodological issues and advances in biological meta-analysis
Nakagawa, S., & Santos, E. S. A. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9555-5 · Cited by 1,032
Diversification practices reduce organic to conventional yield gap
Ponisio, L. C., M'Gonigle, L. K., Mace, K. C., Palomino, J., de Valpine, P., & Kremen, C. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2014.1396 · Cited by 871
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793
The impact of hunting on tropical mammal and bird populations
Benítez-López, A., Alkemade, R., Schipper, A. M., Ingram, D. J., Verweij, P. A., Eikelboom, J. A. J., & Huijbregts, M. A. J. (2017) · Science · doi:10.1126/science.aaj1891 · Cited by 663
Global meta-analysis reveals no net change in local-scale plant biodiversity over time
Vellend, M., Baeten, L., Myers-Smith, I. H., Elmendorf, S. C., Beauséjour, R., Brown, C. D., De Frenne, P., Verheyen, K., & Wipf, S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312779110 · Cited by 628
Meta-evaluation of meta-analysis: ten appraisal questions for biologists
Nakagawa, S., Noble, D. W. A., Senior, A. M., & Lagisz, M. (2017) · BMC Biology · doi:10.1186/s12915-017-0357-7 · Cited by 579
Positive but variable effects of crop diversification on biodiversity and ecosystem services
Beillouin, D., Ben‐Ari, T., Malézieux, E., Seufert, V., & Makowski, D. (2021) · Global Change Biology · doi:10.1111/gcb.15747 · Cited by 590
Song, J., Wan, S., Piao, S., Knapp, A. K., Classen, A. T., Vicca, S., Ciais, P., Hovenden, M. J., Leuzinger, S., Beier, C., et al. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-0958-3 · Cited by 596
A global synthesis of animal phenological responses to climate change
Cohen, J. M., Lajeunesse, M. J., & Rohr, J. R. (2018) · Nature Climate Change · doi:10.1038/s41558-018-0067-3 · Cited by 550
Self-citationA global meta-analysis of yield stability in organic and conservation agriculture
Knapp, S., & van der Heijden, M. G. A. (2018) · Nature Communications · doi:10.1038/s41467-018-05956-1 · Cited by 530
Scheper, J., Holzschuh, A., Kuussaari, M., Potts, S. G., Rundlöf, M., Smith, H. G., & Kleijn, D. (2013) · Ecology Letters · doi:10.1111/ele.12128 · Cited by 502
A global meta-analysis of soil organic carbon in the Anthropocene
Beillouin, D., Corbeels, M., Demenois, J., Berre, D., Boyer, A., Fallot, A., Feder, F., & Cardinael, R. (2023) · Nature Communications · doi:10.1038/s41467-023-39338-z · Cited by 468
Impacts of nitrogen addition on plant species richness and abundance: A global meta‐analysis
Midolo, G., Alkemade, R., Schipper, A. M., Benítez‐López, A., Perring, M. P., & De Vries, W. (2019) · Global Ecology and Biogeography · doi:10.1111/geb.12856 · Cited by 430
Leifheit, E. F., Veresoglou, S. D., Lehmann, A., Morris, E. K., & Rillig, M. C. (2014) · Plant and Soil · doi:10.1007/s11104-013-1899-2 · Cited by 386
Cover Crops Reduce Nitrate Leaching in Agroecosystems:A Global Meta‐Analysis
Thapa, R., Mirsky, S. B., & Tully, K. L. (2018) · Journal of Environmental Quality · doi:10.2134/jeq2018.03.0107 · Cited by 377
“Similarly, multiple cover crop treatments sharing the same control (no cover crop) treatment may lead to dependent effect sizes (Lajeunesse, 2011).”
BackgroundFacilitating systematic reviews, data extraction and meta‐analysis with the metagear package for r
Lajeunesse, M. J. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12472 · Cited by 341
Self-citationBiodiversity promotes ecosystem functioning despite environmental change
Hong, P., Schmid, B., De Laender, F., Eisenhauer, N., Zhang, X., Chen, H., Craven, D., De Boeck, H. J., Hautier, Y., Petchey, O. L., et al. (2022) · Ecology Letters · doi:10.1111/ele.13936 · Cited by 326
The effects of livestock grazing on biodiversity are multi‐trophic: a meta‐analysis
Filazzola, A., Brown, C., Dettlaff, M. A., Batbaatar, A., Grenke, J., Bao, T., Peetoom Heida, I., & Cahill, J. F. (2020) · Ecology Letters · doi:10.1111/ele.13527 · Cited by 311
Lehmann, A., & Rillig, M. C. (2015) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2014.11.013 · Cited by 286
Accurately measuring willingness to pay for consumer goods: a meta-analysis of the hypothetical bias
Schmidt, J., & Bijmolt, T. H. A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00666-6 · Cited by 285
Yang, Y., Chen, X., Liu, L., Li, T., Dou, Y., Qiao, J., Wang, Y., An, S., & Chang, S. X. (2022) · Global Change Biology · doi:10.1111/gcb.16361 · Cited by 279
Negative effects of multiple global change factors on soil microbial diversity
Yang, Y., Li, T., Wang, Y., Cheng, H., Chang, S. X., Liang, C., & An, S. (2021) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2021.108229 · Cited by 269
Nonindependence and sensitivity analyses in ecological and evolutionary meta‐analyses
Noble, D. W. A., Lagisz, M., O'dea, R. E., & Nakagawa, S. (2017) · Molecular Ecology · doi:10.1111/mec.14031 · Cited by 267
Plant growth promoting rhizobacteria are more effective under drought: a meta-analysis
Rubin, R. L., van Groenigen, K. J., & Hungate, B. A. (2017) · Plant and Soil · doi:10.1007/s11104-017-3199-8 · Cited by 256
Soil carbon stock change following afforestation in Northern Europe: a meta‐analysis
Bárcena, T. G., Kiær, L. P., Vesterdal, L., Stefánsdóttir, H. M., Gundersen, P., & Sigurdsson, B. D. (2014) · Global Change Biology · doi:10.1111/gcb.12576 · Cited by 254
Bias and correction for the log response ratio in ecological meta‐analysis
Lajeunesse, M. J. (2015) · Ecology · doi:10.1890/14-2402.1 · Cited by 244
Self-citationChen, M., Chang, L., Zhang, J., Guo, F., Vymazal, J., He, Q., & Chen, Y. (2020) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2020.100063 · Cited by 143
An assessment of statistical methods for nonindependent data in ecological meta‐analyses
Song, C., Peacor, S. D., Osenberg, C. W., & Bence, J. R. (2020) · Ecology · doi:10.1002/ecy.3184 · Cited by 71
Robinson, Z. P., Pelland, J. C., Remmert, J. F., Refalo, M. C., Jukic, I., Steele, J., & Zourdos, M. C. (2024) · Sports Medicine · doi:10.1007/s40279-024-02069-2 · Cited by 63
“Models were constructed with effect sizes, and variances thereof, calculated as both standardized mean change and response ratio using the escalc function [93, 94].”
Kane, J. L., Schartiger, R. G., Daniels, N. K., Freedman, Z. B., McDonald, L. M., Skousen, J. G., & Morrissey, E. M. (2023) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2023.109178 · Cited by 59
Use of meta-analysis in forest biodiversity research: key challenges and considerations
Spake, R., & Doncaster, C. P. (2017) · Forest Ecology and Management · doi:10.1016/j.foreco.2017.05.059 · Cited by 60
“A matched-pair (i.e., randomizedblock) design requires a further subtraction from this estimate, of an amount equal to 2rs1s2=ð x1 x2nÞ, where r is the coefficient of correlation between treatment and control observations and n is the number of matched pairs (Lajeunesse, 2011).”
BackgroundMethodCait, J., Winder, C. B., & Mason, G. J. (2024) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2024.106361 · Cited by 21
Pelland, J. C., Remmert, J. F., Robinson, Z. P., Hinson, S. R., & Zourdos, M. C. (2026) · Sports Medicine · doi:10.1007/s40279-025-02344-w · Cited by 18
Metadata
- Authors
- Lajeunesse, M. J.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 2011-11
- Volume
- 92
- Issue
- 11
- Pages
- 2049-2055
- ISSN
- 0012-9658 (ISSN-L)
- OpenAlex
- W2080255336
- Cited by
- 432
- References
- 33
- FWCI
- 1.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.