Methods for Comparing Data across Differently Designed Agronomic Studies: Examples of Different Meta-analysis Methods Used to Compare Relative Composition of Plant Foods Grown Using Organic or Conventional Production Methods and a Protocol for a Systematic Review
Open accessAbstract
Meta-analyses are methods to combine outcomes from different studies to investigate consistent effects of relatively small magnitude, which are difficult to distinguish from random variation within a single study. Several published meta-analyses addressed whether organic and conventional production methods affect the composition of plant foods differently. The meta-analyses were carried out using different options for the methodology and resulted in different conclusions. The types of designs of field trials and farm comparisons widely used in horticultural and agronomic research differ substantially from the clinical trials and epidemiological studies that most meta-analysis methodologies were developed for. Therefore, it is proposed that a systematic review and meta-analysis be carried out with the aim of developing a consolidated methodology. If successful, this methodology can then be used to determine effects of different production systems on plant food composition as well as other comparable factors with small but systematic effects across studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
The meta-analysis of response ratios in experimental ecology
Hedges, L. V., Gurevitch, J., & Curtis, P. S. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1150:tmaorr]2.0.co;2 · Cited by 4,704 · see citing works
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,074 · see citing works
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586 · see citing works
Comparing the yields of organic and conventional agriculture
Seufert, V., Ramankutty, N., & Foley, J. A. (2012) · Nature · doi:10.1038/nature11069 · Cited by 2,165 · see citing works
Nutritional Quality of Organic Versus Conventional Fruits, Vegetables, and Grains
Worthington, V. (2001) · Journal of Alternative and Complementary Medicine · doi:10.1089/107555301750164244 · Cited by 778 · see citing works
Are Organic Foods Safer or Healthier Than Conventional Alternatives?: A Systematic Review
Smith-Spangler, C., Brandeau, M. L., Hunter, G. E., Bavinger, J. C., Pearson, M., Eschbach, P. J., Sundaram, V., Liu, H., Schirmer, P., Stave, C., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-5-201209040-00007 · Cited by 602 · see citing works
Nutritional quality of organic foods: a systematic review
Dangour, A. D., Dodhia, S. K., Hayter, A., Allen, E., Lock, K., & Uauy, R. (2009) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.2009.28041 · Cited by 438 · see citing works
Brandt, K., Leifert, C., Sanderson, R., & Seal, C. J. (2011) · Critical Reviews in Plant Sciences · doi:10.1080/07352689.2011.554417 · Cited by 253 · see citing works
Self-citationPoiroux-Gonord, F., Bidel, L., Fanciullino, A., Gautier, H., Lopez, F., & Urban, L. (2010) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf1037745 · Cited by 242 · see citing works
Assessing the effect of elevated carbon dioxide on soil carbon: a comparison of four meta‐analyses
Hungate, B. A., van Groenigen, K. J., Six, J., JASTROW, J. D., Luo, Y., de Graaff, M., van Kessel, C., & Osenberg, C. W. (2009) · Global Change Biology · doi:10.1111/j.1365-2486.2009.01866.x · Cited by 212 · see citing works
Leimu, R., & Koricheva, J. (2004) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2004.2828 · Cited by 156 · see citing works
Hunter, D. G., Foster, M. J., McArthur, J. O., Ojha, R. J., Petocz, P., & Samman, S. (2011) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408391003721701 · Cited by 156 · see citing works
Hoefkens, C., Vandekinderen, I., Meulenaer, B. D., Devlieghere, F., Baert, K., Sioen, I., Henauw, S. D., Verbeke, W., & Camp, J. V. (2009) · British Food Journal · doi:10.1108/00070700910992934 · Cited by 74 · see citing works
Reply to DL Gibbon and C Benbrook et al
Dangour, A. D., Allen, E., Lock, K., & Uauy, R. D. (2009) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.2009.28755 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [1](1) Stroup, D. F.; Berlin, J. A.; Morton, S. C.; Olkin, I.; Williamson, G. D.; Rennie, D.; Moher, D.; Becker, B. J.; Sipe, T. A.; Thacker, S. B., Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. Jama 2000, 283 , 2008-12.
- [8](8) Heaton, S. Organic farming, food quality and human health. A review of the evidence. ; Soil Association: 2001, pp 88. -
- [16](16) Quemada, M.; Baranski, M.; Nobel-de Lange, M. N. J.; Vallejo, A.; Cooper, J. M., Meta-analysis of strategies to control nitrate leaching in irrigated agricultural systems and their effects on crop yield. Agriculture, Ecosystems and Environment 2013, In press, accepted 15 April 2013 . -
Cited by
Sorted by citations
Barański, M., Średnicka-Tober, D., Volakakis, N., Seal, C., Sanderson, R., Stewart, G. B., Benbrook, C., Biavati, B., Markellou, E., Giotis, C., et al. (2014) · British Journal of Nutrition · doi:10.1017/s0007114514001366 · Cited by 684 · see citing works
“The literature search strategy and meta-analysis protocols used were based on those previously published by Brandt et al.((27)), and flow diagrams of the protocols used are shown in Figs.”
InfluentialSelf-citationThe influence of organic production on food quality – research findings, gaps and future challenges
Załęcka, A., Bügel, S., Paoletti, F., Kahl, J., Bonanno, A., Dostalova, A., & Rahmann, G. (2014) · Journal of the Science of Food and Agriculture · doi:10.1002/jsfa.6578 · Cited by 38 · see citing works
- Authors
- Brandt, K., Średnicka-Tober, D., Barański, M., Sanderson, R., Leifert, C., & Seal, C.
- Affiliations
- Newcastle University (GB)
- Corresponding author
- Brandt, Kirsten
- ORCID
- Venue
- Journal of Agricultural and Food Chemistry
- Publisher
- American Chemical Society (ACS)
- Published
- 2013-07-22
- Volume
- 61
- Issue
- 30
- Pages
- 7173-7180
- ISSN
- 0021-8561 (ISSN-L)
- 1520-5118
- OpenAlex
- W2076299700
- Cited by
- 37
- References
- 17
- Citations by year
- 2024: 3 · 2023: 1 · 2022: 15 · 2021: 4 · 2019: 1 · 2018: 1 · 2017: 4 · 2016: 3 · 2015: 3 · 2014: 2
- FWCI
- 0.54
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc
- Locations
- Journal of Agricultural and Food Chemistry (publishedVersion)
- PubMed (publishedVersion)
- Newcastle University ePrints (Newcastle Univesity) (cc-by-nc)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Organic Food and Agriculture
- Life Sciences › Agricultural and Biological Sciences › Soil Science › Plant Growth and Agriculture Techniques
- Keywords
- organic farming, conventional farming, meta-analysis methodology, field trial design, horticultural research, small effect sizes
- MeSH terms
- Systematic Reviews as Topic, Agriculture, Food Analysis, Meta-Analysis as Topic, Crops, Agricultural, Data Mining, Food Quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
