The DOI matches its Crossref record; 273 of the 273 references it cites were found in a registry or an index.
Preferred reporting items for systematic reviews and meta‐analyses in ecology and evolutionary biology: a PRISMA extension
Open accessAbstract
Since the early 1990s, ecologists and evolutionary biologists have aggregated primary research using meta‐analytic methods to understand ecological and evolutionary phenomena. Meta‐analyses can resolve long‐standing disputes, dispel spurious claims, and generate new research questions. At their worst, however, meta‐analysis publications are wolves in sheep's clothing: subjective with biased conclusions, hidden under coats of objective authority. Conclusions can be rendered unreliable by inappropriate statistical methods, problems with the methods used to select primary research, or problems within the primary research itself. Because of these risks, meta‐analyses are increasingly conducted as part of systematic reviews, which use structured, transparent, and reproducible methods to collate and summarise evidence. For readers to determine whether the conclusions from a systematic review or meta‐analysis should be trusted – and to be able to build upon the review – authors need to report what they did, why they did it, and what they found. Complete, transparent, and reproducible reporting is measured by ‘reporting quality’. To assess perceptions and standards of reporting quality of systematic reviews and meta‐analyses published in ecology and evolutionary biology, we surveyed 208 researchers with relevant experience (as authors, reviewers, or editors), and conducted detailed evaluations of 102 systematic review and meta‐analysis papers published between 2010 and 2019. Reporting quality was far below optimal and approximately normally distributed. Measured reporting quality was lower than what the community perceived, particularly for the systematic review methods required to measure trustworthiness. The minority of assessed papers that referenced a guideline (~16%) showed substantially higher reporting quality than average, and surveyed researchers showed interest in using a reporting guideline to improve reporting quality. The leading guideline for improving reporting quality of systematic reviews is the Preferred Reporting Items for Systematic reviews and Meta‐Analyses (PRISMA) statement. Here we unveil an extension of PRISMA to serve the meta‐analysis community in ecology and evolutionary biology: PRISMA‐EcoEvo (version 1.0). PRISMA‐EcoEvo is a checklist of 27 main items that, when applicable, should be reported in systematic review and meta‐analysis publications summarising primary research in ecology and evolutionary biology. In this explanation and elaboration document, we provide guidance for authors, reviewers, and editors, with explanations for each item on the checklist, including supplementary examples from published papers. Authors can consult this PRISMA‐EcoEvo guideline both in the planning and writing stages of a systematic review and meta‐analysis, to increase reporting quality of submitted manuscripts. Reviewers and editors can use the checklist to assess reporting quality in the manuscripts they review. Overall, PRISMA‐EcoEvo is a resource for the ecology and evolutionary biology community to facilitate transparent and comprehensively reported systematic reviews and meta‐analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–273 of 273
The role of reporting standards in producing robust literature reviews
Haddaway, N., & Macura, B. (2018) · Nature Climate Change · doi:10.1038/s41558-018-0180-3 · Cited by 92
Do animals generally flush early and avoid the rush? A meta-analysis
Samia, D. S. M., Nomura, F., & Blumstein, D. T. (2013) · Biology Letters · doi:10.1098/rsbl.2013.0016 · Cited by 91
Barrio, I. C., Hik, D. S., Bueno, C. G., & Cahill, J. F. (2012) · Oikos · doi:10.1111/j.1600-0706.2012.00355.x · Cited by 88
Nutrient loading alters the performance of key nutrient exchange mutualisms
Shantz, A. A., Lemoine, N. P., & Burkepile, D. E. (2015) · Ecology Letters · doi:10.1111/ele.12538 · Cited by 88
The effect of dietary restriction on reproduction: a meta-analytic perspective
Moatt, J. P., Nakagawa, S., Lagisz, M., & Walling, C. A. (2016) · BMC Evolutionary Biology · doi:10.1186/s12862-016-0768-z · Cited by 83
Self-citationMultiscale Evaluation of Thermal Dependence in the Glucocorticoid Response of Vertebrates
Jessop, T. S., Lane, M., Teasdale, L. C., Stuart-Fox, D. M., Wilson, R. S., Careau, V., & Moore, I. T. (2016) · The American Naturalist · doi:10.1086/687588 · Cited by 81
Developmental temperature affects phenotypic means and variability: A meta‐analysis of fish data
O’Dea, R. E., Lagisz, M., Hendry, A. P., & Nakagawa, S. (2019) · Fish and Fisheries · doi:10.1111/faf.12394 · Cited by 79
Self-citationErrors in Statistical Inference Under Model Misspecification: Evidence, Hypothesis Testing, and AIC
Dennis, B., Ponciano, J. M., Taper, M. L., & Lele, S. R. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00372 · Cited by 79
Conord, C., Gurevitch, J., & Fady, B. (2012) · Ecology and Evolution · doi:10.1002/ece3.350 · Cited by 77
Self-citationThe genetic consequences of selection in natural populations
Thurman, T. J., & Barrett, R. D. H. (2016) · Molecular Ecology · doi:10.1111/mec.13559 · Cited by 77
Ma, C., Li, S., Pu, Z., Tan, J., Liu, M., Zhou, J., Li, H., & Jiang, L. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.0663 · Cited by 77
Using multiple imputation to estimate missing data in meta‐regression
Ellington, E. H., Bastille‐Rousseau, G., Austin, C., Landolt, K. N., Pond, B. A., Rees, E. E., Robar, N., & Murray, D. L. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12322 · Cited by 75
Systematic reviews and maps as tools for applying behavioral ecology to management and policy
Berger‐Tal, O., Greggor, A. L., Macura, B., Adams, C. A., Blumenthal, A., Bouskila, A., Candolin, U., Doran, C., Fernández‐Juricic, E., Gotanda, K. M., et al. (2018) · Behavioral Ecology · doi:10.1093/beheco/ary130 · Cited by 75
Edwards, K. F., Aquilino, K. M., Best, R. J., Sellheim, K. L., & Stachowicz, J. J. (2009) · Ecology Letters · doi:10.1111/j.1461-0248.2009.01417.x · Cited by 73
The effect of resveratrol on longevity across species: a meta-analysis
Hector, K. L., Lagisz, M., & Nakagawa, S. (2012) · Biology Letters · doi:10.1098/rsbl.2012.0316 · Cited by 65
Self-citationNakagawa, S., & de Villemereuil, P. (2018) · Systematic Biology · doi:10.1093/sysbio/syy089 · Cited by 62
Self-citationPalpacuer, C., Hammas, K., Duprez, R., Laviolle, B., Ioannidis, J. P. A., & Naudet, F. (2019) · BMC Medicine · doi:10.1186/s12916-019-1409-3 · Cited by 62
Why researchers should share their analytic code
Goldacre, B., Morton, C. E., & DeVito, N. J. (2019) · BMJ · doi:10.1136/bmj.l6365 · Cited by 61
Sorenson, G. H., Dey, C. J., Madliger, C. L., & Love, O. P. (2016) · Oecologia · doi:10.1007/s00442-016-3774-3 · Cited by 60
What can aquatic gastropods tell us about phenotypic plasticity? A review and meta-analysis
Bourdeau, P. E., Butlin, R. K., Brönmark, C., Edgell, T. C., Hoverman, J. T., & Hollander, J. (2015) · Heredity · doi:10.1038/hdy.2015.58 · Cited by 58
Enforcing public data archiving policies in academic publishing: A study of ecology journals
Sholler, D., Ram, K., Boettiger, C., & Katz, D. S. (2019) · Big Data & Society · doi:10.1177/2053951719836258 · Cited by 58
Making conservation science more reliable with preregistration and registered reports
Parker, T., Fraser, H. S., & Nakagawa, S. (2019) · Conservation Biology · doi:10.1111/cobi.13342 · Cited by 57
Self-citationResearch Culture and Reproducibility
Munafo, M. R., Chambers, C., Collins, A., Fortunato, L., & Macleod, M. R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.12.002 · Cited by 56
Zhang, L., & Lü, X. (2012) · Biological Journal of the Linnean Society · doi:10.1111/j.1095-8312.2012.01876.x · Cited by 55
Bhurke, S., Kwok, C. S., Pang, C. L., Hooper, L., Loke, Y. K., Ryder, J. J., Sutton, A. J., Hing, C. B., Harvey, I. M., & Song, F. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.022 · Cited by 54
Response of insect parasitism to elevation depends on host and parasitoid life-history strategies
Péré, C., Jactel, H., & Kenis, M. (2013) · Biology Letters · doi:10.1098/rsbl.2013.0028 · Cited by 53
Pombi, M., Kengne, P., Gimonneau, G., Fossog, B. T., Ayala, D., Kamdem, C., Santolamazza, F., Guelbeogo, M. W., Sagnon, N., Petrarca, V., et al. (2017) · Evolutionary Applications · doi:10.1111/eva.12517 · Cited by 50
Kort, H. D., Vandepitte, K., & Honnay, O. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9624-9 · Cited by 49
Effects of herbivory on leaf life span in woody plants: a meta‐analysis
Zvereva, E. L., & Kozlov, M. V. (2014) · Journal of Ecology · doi:10.1111/1365-2745.12252 · Cited by 49
All eggs are made equal: meta‐analysis of egg sexual size dimorphism in birds
Rutkowska, J., Dubiec, A., & Nakagawa, S. (2013) · Journal of Evolutionary Biology · doi:10.1111/jeb.12282 · Cited by 49
Self-citationThe sign and magnitude of tree–grass interaction along a global environmental gradient
Mazia, N. C., Moyano, J., Pérez, L. I., Aguiar, S., Garibaldi, L. A., & Schlichter, T. (2016) · Global Ecology and Biogeography · doi:10.1111/geb.12518 · Cited by 49
How to perform a systematic search
Bartels, E. M. (2013) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2013.02.001 · Cited by 48
Greggor, A. L., Price, C. J., & Shier, D. M. (2019) · Environmental Evidence · doi:10.1186/s13750-019-0154-6 · Cited by 48
Büttner, F., Winters, M., Delahunt, E., Elbers, R., Lura, C. B., Khan, K. M., Weir, A., & Ardern, C. L. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-100806 · Cited by 47
Implications of Macroalgal Isolation by Distance for Networks of Marine Protected Areas
Durrant, H. M. S., Burridge, C. P., Kelaher, B. P., Barrett, N. S., Edgar, G. J., & Coleman, M. A. (2013) · Conservation Biology · doi:10.1111/cobi.12203 · Cited by 45
A Meta-Analysis of Community Response Predictability to Anthropogenic Disturbances
Murphy, G. E. P., & Romanuk, T. N. (2012) · The American Naturalist · doi:10.1086/666986 · Cited by 44
A model to estimate seabird field metabolic rates
Dunn, R. E., White, C. R., & Green, J. A. (2018) · Biology Letters · doi:10.1098/rsbl.2018.0190 · Cited by 44
Empowering peer reviewers with a checklist to improve transparency
Parker, T. H., Griffith, S. C., Bronstein, J. L., Fidler, F. M., Foster, S., Fraser, H. S., Forstmeier, W., Gurevitch, J., Koricheva, J., Seppelt, R., et al. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-018-0545-z · Cited by 43
Self-citationGreenfield, M. D., Alem, S., Limousin, D., & Bailey, N. W. (2014) · Evolution · doi:10.1111/evo.12542 · Cited by 42
The strength of sex‐specific selection in the wild
Singh, A., & Punzalan, D. (2018) · Evolution · doi:10.1111/evo.13625 · Cited by 40
Fame, glory and neglect in meta-analyses
Kueffer, C., Niinemets, Ü., Drenovsky, R. E., Kattge, J., Milberg, P., Poorter, H., Reich, P. B., Werner, C., Westoby, M., & Wright, I. J. (2011) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2011.07.007 · Cited by 38
Moment and Least-Squares Based Approaches to Meta-analytic Inference
Rosenberg, M. S. (2013) · Princeton University Press eBooks · doi:10.23943/princeton/9780691137285.003.0009 · Cited by 38
Reporting standards in experimental studies
Hillebrand, H., & Gurevitch, J. (2013) · Ecology Letters · doi:10.1111/ele.12190 · Cited by 35
Self-citationDoes early-life diet affect longevity? A meta-analysis across experimental studies
English, S., & Uller, T. (2016) · Biology Letters · doi:10.1098/rsbl.2016.0291 · Cited by 35
Moore, M. P., Riesch, R., & Martin, R. A. (2016) · Ecology Letters · doi:10.1111/ele.12576 · Cited by 33
Ma, C., Li, S., Pu, Z., Tan, J., Liu, M., Zhou, J., Li, H., & Jiang, L. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.1992 · Cited by 32
Borries, C., Sandel, A., Koenig, A., Fernández-Duque, E., Kamilar, J., Amoroso, C., Barton, R., Bray, J., Fiore, A. D., Gilby, I., et al. (2016) · Evolutionary Anthropology (print) · doi:10.1002/evan.21502 · Cited by 30
Parker, T. H., Greig, E. I., Nakagawa, S., Parra, M., & Dalisio, A. C. (2018) · Animal Behaviour · doi:10.1016/j.anbehav.2018.05.023 · Cited by 29
Self-citationMcLean, M. J., Bishop, P. J., & Nakagawa, S. (2012) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2012.02533.x · Cited by 28
Self-citationRarity of Size-Assortative Mating in Animals: Assessing the Evidence with Anuran Amphibians
Green, D. M. (2018) · The American Naturalist · doi:10.1086/701124 · Cited by 28
The response of amphibian larvae to environmental change is both consistent and variable
Edge, C. B., Houlahan, J. E., Jackson, D. A., & Fortin, M. (2016) · Oikos · doi:10.1111/oik.03166 · Cited by 27
Promoting transparency in evolutionary biology and ecology
Parker, T. H., Nakagawa, S., Gurevitch, J., & participants, I. (. I. I. E. B. A. E. W. (2016) · Ecology Letters · doi:10.1111/ele.12610 · Cited by 25
Self-citationDoes predation result in adult sex ratio skew in a sexually dimorphic insect genus?
Wehi, P. M., Nakagawa, S., Trewick, S. A., & Morgan‐Richards, M. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2011.02366.x · Cited by 23
Self-citationDoes source population size affect performance in new environments?
Yates, M. C., & Fraser, D. J. (2014) · Evolutionary Applications · doi:10.1111/eva.12181 · Cited by 23
Curtailing the Use of Preregistration : A Misused Term
Rice, D. B., & Moher, D. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619858427 · Cited by 22
Self-citationDo female parasitoid wasps recognize and adjust sex ratios to build cooperative relationships?
ABE, J., & Kamimura, Y. (2012) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2012.02532.x · Cited by 20
2. The Procedure of Meta-analysis in a Nutshell
Côté, I. M., & Jennions, M. D. (2013) · Princeton University Press eBooks · doi:10.1515/9781400846184-004 · Cited by 20
Self-citationMundim, F. M., & Bruna, E. M. (2016) · The American Naturalist · doi:10.1086/687530 · Cited by 20
Maternal Testosterone and Offspring Sex-Ratio in Birds and Mammals: A Meta-Analysis
Merkling, T., Nakagawa, S., Lagisz, M., & Schwanz, L. E. (2017) · Evolutionary Biology · doi:10.1007/s11692-017-9432-9 · Cited by 20
Self-citationEthics in Statistical Practice and Communication: Five Recommendations
Gelman, A. (2018) · Significance · doi:10.1111/j.1740-9713.2018.01193.x · Cited by 20
Extraction and Critical Appraisal of Data
Curtis, P. S., Mengersen, K. L., Lajeunesse, M. J., Rothstein, H. R., & Stewart, G. B. (2013) · Princeton University Press eBooks · doi:10.23943/princeton/9780691137285.003.0005 · Cited by 20
Self-citationVisualizing unbiased and biased unweighted meta‐analyses
Nakagawa, S., & Lagisz, M. (2016) · Journal of Evolutionary Biology · doi:10.1111/jeb.12945 · Cited by 19
Self-citation3. First Steps in Beginning a Meta-analysis
(2013) · Handbook of Meta-analysis in Ecology and Evolution · doi:10.1515/9781400846184-005 · Cited by 18
Self-citation7. Using Other Metrics of Effect Size in Meta-analysis
Mengersen, K. L., & Gurevitch, J. (2013) · Princeton University Press eBooks · doi:10.1515/9781400846184-009 · Cited by 14
Self-citationSpecies richness alters spatial nutrient heterogeneity effects on above-ground plant biomass
Xi, N., Zhang, C., & Bloor, J. (2017) · Biology Letters · doi:10.1098/rsbl.2017.0510 · Cited by 13
A comparative analysis of experimental selection on the stickleback pelvis
Miller, S. E., Barrueto, M., & Schluter, D. (2017) · Journal of Evolutionary Biology · doi:10.1111/jeb.13085 · Cited by 12
Separate authorship categories to recognize data collectors and code developers
Ewers, R. M., Barlow, J., Banks-Leite, C., & Rahbek, C. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-1033-9 · Cited by 10
The Texas sharpshooter fallacy
Evers, J. L. H. (2017) · Human Reproduction · doi:10.1093/humrep/dex103 · Cited by 7
Gorné, L. D., & Díaz, S. M. (2017) · Ecology and Evolution · doi:10.1002/ece3.3116 · Cited by 7
How good does our map of knowledge have to be?: a comment on Berger-Tal et al.
Nakagawa, S., & Lagisz, M. (2018) · Behavioral Ecology · doi:10.1093/beheco/ary137 · Cited by 4
Self-citationLane, P. W., Anzures‐Cabrera, J., Lewis, S. C., & Tomlinson, J. (2012) · Springer eBooks · doi:10.1007/978-1-4614-5329-1_15 · Cited by 2
Promoting Transparency in Evolutionary Biology and Ecology
Smith, J. F., Parker, T. H., Nakagawa, S., Gurevitch, J., & Group5, T. (. F. T. I. E. A. E. W. (2016) · Systematic Botany · doi:10.1600/036364416x692262 · Cited by 2
Self-citation
Cited by
Human–nature connectedness as a pathway to sustainability: A global meta‐analysis
Barragan‐Jason, G., de Mazancourt, C., Parmesan, C., Singer, M. C., & Loreau, M. (2022) · Conservation Letters · doi:10.1111/conl.12852 · Cited by 286
Introduction to PRISMA 2020 and implications for research synthesis methodologists
Page, M. J., Moher, D., & McKenzie, J. E. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1535 · Cited by 270
Self-citationMbunge, E., Muchemwa, B., & Batani, J. (2022) · Sensors International · doi:10.1016/j.sintl.2021.100152 · Cited by 90
Factors affecting healthcare workers burnout and their conceptual models: scoping review
Nagle, E., Griskevica, I., Rajevska, O., Ivanovs, A., Mihailova, S., & Skruzkalne, I. (2024) · BMC Psychology · doi:10.1186/s40359-024-02130-9 · Cited by 85
Downie, A. T., Wu, N. C., Cramp, R. L., & Franklin, C. E. (2023) · Global Change Biology · doi:10.1111/gcb.16848 · Cited by 34
Metadata
- Authors
- O'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., & Nakagawa, S.
- Venue
- Biological Reviews
- Publisher
- Wiley
- Published
- 2021-05-07
- Volume
- 96
- Issue
- 5
- Pages
- 1695-1722
- ISSN
- 0006-3231 (ISSN-L)
- 1464-7931
- 1469-185X
- OpenAlex
- W3158015415
- Cited by
- 697
- References
- 273
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.