Cited by 41Genetically Modified Organisms ResearchInsect Resistance and GeneticsInsect-Plant Interactions and Control

Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review

Open access
Meissle, Michael, Naranjo, Steven E., Romeis, Jörg·2022·Environmental Evidence

Abstract

Background: Hundreds of studies on environmental effects of genetically modified (GM) crops became available over the past 25 years. For maize producing insecticidal proteins from Bacillus thuringiensis (Bt), potential adverse effects on non-target organisms are a major area of concern and addressed in risk assessments. Reviews and meta-analyses have helped various stakeholders to address uncertainties regarding environmental impacts of the technology. Many field studies from Europe and other parts of the world have been published in the last decade, and those data are often not covered by previous meta-analyses. Therefore, we conducted a systematic review to answer the question: “Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize?” Methods: Literature published until August 2019 was searched systematically in 12 bibliographic databases, 17 specialized webpages, and reference sections of 78 review articles. Defined eligibility criteria were applied to screen titles, abstracts, and full texts of the retrieved references. A custom-made database was developed with quantitative data on invertebrate abundance, activity density, or predation/parasitism rates. Eligible data that did not fit the quantitative database were captured in detailed tables and summarized narratively. For the first time, a critical appraisal scheme for field studies on non-targets in GM crops was developed to estimate the risk of bias (internal validity) and the suitability to answer the review question (external validity) of all primary data. Meta-analyses on different taxonomic levels, functional groups, and types of Bt maize were conducted. Untreated Bt maize was either compared with untreated non-Bt maize, or with insecticide-treated non-Bt maize. The influence of contributions by private sector product developers on reported effects was investigated. Review findings: The database on non-target effects of Bt maize field trials contains more than 7200 records from 233 experiments and 120 articles. Meta-analyses on different taxonomic levels revealed only few and often non-robust significant effect sizes when both Bt maize and non-Bt maize were untreated. Bt maize harboured fewer parasitoids (Braconidae, Tachinidae) of the European corn borer, the main target pest of Lepidoptera-active Bt maize, compared with non-Bt maize. Similarly, sap beetles (Nitidulidae), that are associated with Lepidoptera damage, were recorded less in Bt maize. In some analyses, a negative effect of Bt maize was observed for rove beetles (Staphylinidae) and hoverflies (Syrphidae) and a positive effect for ladybeetles (Coccinellidae), flower bugs (Anthocoridae), and lacewings (Neuroptera). However, those effects were not consistent for different analyses and often related to individual articles. When untreated Bt maize was compared with pyrethroid-treated non-Bt maize, more effect sizes were significant. In particular, populations of predators were reduced after pyrethroid treatment, while few data were available for other insecticides. Funnel plots showed no evidence for publication bias and the analyses of private sector contribution revealed no evidence for influence of vested interests. Conclusions about potential effects of Bt maize on vertebrates or on animals inhabiting off-crop habitats were not possible, because only few such studies fitting the format of direct Bt/non-Bt comparisons on plot or field level were identified. Conclusions: The current work largely confirmed previously published results. The effects of Bt maize on the community of non-target invertebrates inhabiting maize fields were small and mostly neutral, especially when compared with the effects of broad-spectrum pyrethroid insecticide treatments.

AI snapshot

Written from the paper’s full text.

TL;DR

This systematic review and meta-analysis found that growing Bt maize had small, mostly neutral effects on non-target invertebrate abundance and ecological function compared with non-Bt maize, with few significant and often non-robust differences. Effects were more pronounced when untreated Bt maize was compared with insecticide-treated non-Bt maize, where broad-spectrum pyrethroids reduced predator populations.

Key findings

  • The database contained 7,279 invertebrate records from 233 experiments and 120 articles; 12,967 references were screened, and 166 articles were used. In untreated Bt vs untreated non-Bt comparisons, 36 of 39 analyzed taxa showed no significant effect; significant negative effects were found for Staphylinidae, Tachinidae, and Braconidae, while some analyses showed positive effects for Coccinellidae, Anthocoridae, and Neuroptera that were inconsistent across analyses.
  • Lepidoptera-active Bt maize showed lower Nitidulidae, Tachinidae, and Braconidae and higher Anthocoridae; effects on Tachinidae/Diptera and Braconidae/Hymenoptera were mainly associated with Cry1Ab. Coleoptera-active Bt maize showed no effects on any taxon, while stacked Lepidoptera- and Coleoptera-active maize showed negative effects on Diptera and herbivores.
  • When untreated Bt maize was compared with insecticide-treated non-Bt maize, 8 of 20 taxa showed significant effects; untreated Bt maize had higher populations of Araneae, Cantharidae, Coccinellidae, Anthocoridae, Cicadellidae, Coleoptera, Hemiptera, all taxa combined, and predators compared with pyrethroid-treated non-Bt maize, but lower Nitidulidae, Aphididae, and Formicidae. Funnel plots showed no evidence of publication bias (Egger’s test, z = −0.8608, p = 0.39), and private-sector contribution analyses did not support vested-interest influence.
  • Robustness checks showed most untreated/untreated significant effects were not robust by fail-safe numbers except Braconidae; leave-one-out analyses found 34 significant effects turned non-significant when at least one article was removed, while only 5 remained significantly negative.

Methods

  • Systematic review following CEE and GRACE guidance; literature searched until August 2019 in 12 bibliographic databases, 17 specialized webpages, and reference sections of 78 review articles, with defined eligibility criteria applied to titles, abstracts, and full texts.
  • A custom database captured quantitative data on invertebrate abundance, activity density, predation, and parasitism; 7,279 records from 233 experiments and 120 articles were included, and a 16-question critical appraisal scheme assessed internal and external validity. Non-quantitative data were summarized narratively.
  • Meta-analyses used Hedges’ d with random-effects models (REML) in R package metafor, comparing untreated Bt maize with untreated non-Bt maize or with insecticide-treated non-Bt maize; moderator analyses covered taxa, functional groups, Bt proteins, plot size, years of Bt maize, and private-sector contribution, with a minimum of 5 records from 3 articles per analysis.

Limitations

  • Stated: no commonly agreed critical appraisal scheme exists for such field studies, and some cut-off values may be arbitrary; data independence was imperfect because control plots were reused and some articles contributed many records; geographic coverage was mostly North America and Europe, with South America underrepresented; data availability was poor; private-sector influence remains unclear; the review is limited to in-crop invertebrates; multiple statistical tests were conducted without correction; and plot-size extrapolation to farm scale is uncertain.
  • Evident from the text: many significant effects were non-robust and often driven by individual articles, as shown by fail-safe numbers and leave-one-out analyses; heterogeneity was present in several analyses; and few data were available for vertebrates, off-crop habitats, or pollinators.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13750-022-00272-0

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

0 of 108 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    In some analyses, a positive effect of Bt maize was observed for flower bugs (Anthocoridae).

    “and a positive effect for ladybeetles (Coccinellidae), flower bugs (Anthocoridae), and lacewings (Neuroptera).”
    Quote in the paperNot a substantial claim
  • Findingnone given

    The database on non-target effects of Bt maize field trials contains more than 7200 records from 233 experiments and 120 articles.

    “The database on non-target effects of Bt maize field trials contains more than 7200 records from 233 experiments and 120 articles.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Few data were available for insecticides other than pyrethroids.

    “In particular, populations of predators were reduced after pyrethroid treatment, while few data were available for other insecticides.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Syrphidae showed a negative effect size with an upper boundary of exact zero.

    “Syrphidae showed a negative effect size with an upper boundary of exact zero.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: For plot and split-field designs, the history of management was equal between Bt and non-Bt plots because plots were installed within the same field.
    • The authors state this as an assumption: For meta-analyses, when authors did not mention pesticide treatments or when Bt and non-Bt plots received similar treatments, no pesticides were applied.
    • The authors state this as an assumption: If commercial seeds were used, sufficient Bt protein expression was assumed.
    • The authors state this as an assumption: If no information on insecticides before the start of the study was provided, no insecticides were applied.
  • Findingown data

    Significant heterogeneity was observed for Lathrididae (Coleoptera) and Otitidae (Diptera).

    “Significant heterogeneity was observed for Lathrididae (Coleoptera) and Otitidae (Diptera), but both groups were represented by records from only 4 and 3 articles (8 and 21 experiments), respectively.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: For plot and split-field designs, the history of management was equal between Bt and non-Bt plots because plots were installed within the same field.
    • The authors state this as an assumption: For meta-analyses, when authors did not mention pesticide treatments or when Bt and non-Bt plots received similar treatments, no pesticides were applied.
    • The authors state this as an assumption: If commercial seeds were used, sufficient Bt protein expression was assumed.
    • The authors state this as an assumption: If no information on insecticides before the start of the study was provided, no insecticides were applied.
  • May combine two claims. 99
  • Classified as probably not a substantial claim. 127
  • The quote only partly states this claim. 3
  • May combine two claims.

    Findingown data

    Those effects were not consistent for different analyses and often related to individual articles.

    “However, those effects were not consistent for different analyses and often related to individual articles.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Additional Lepidoptera-active proteins were Cry1A.105, Cry1Ac, Cry1F, Cry1Ie, Cry2Ab, and VIP3A.

    “Additional Lepidoptera-active proteins were Cry1A.105, Cry1Ac, Cry1F, Cry1Ie, Cry2Ab, and VIP3A.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingown data

    Heterogeneity was generally low in the performed analyses, so further exploration of potential causes of heterogeneity was not necessary.

    “Heterogeneity was generally low in the performed analyses, so further exploration of potential causes of heterogeneity was not necessary.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The number of records extracted from each experiment varied from 1 to 379 with a median of 18 records.

    “The number of records extracted from each article varied from 1 to 428 with a median of 30 records (Fig. 4A), and from each experiment from 1 to 379 with a median of 18 records (Fig. 4B).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The data in the database were derived from 233 experiments (defined as field or plot setup in one location and one year).

    “The data in the database were derived from 233 experiments (defined as field or plot setup in one location and one year).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Lathrididae (Coleoptera) and Otitidae (Diptera) were represented by records from only 4 and 3 articles (8 and 21 experiments), respectively.

    “Significant heterogeneity was observed for Lathrididae (Coleoptera) and Otitidae (Diptera), but both groups were represented by records from only 4 and 3 articles (8 and 21 experiments), respectively.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: For plot and split-field designs, the history of management was equal between Bt and non-Bt plots because plots were installed within the same field.
    • The authors state this as an assumption: For meta-analyses, when authors did not mention pesticide treatments or when Bt and non-Bt plots received similar treatments, no pesticides were applied.
    • The authors state this as an assumption: If commercial seeds were used, sufficient Bt protein expression was assumed.
    • The authors state this as an assumption: If no information on insecticides before the start of the study was provided, no insecticides were applied.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The most studied Bt proteins were Lepidoptera-active (4505 records, 178 experiments), led by Cry1Ab.

    “The most studied Bt proteins were Lepidoptera-active (4505 records, 178 experiments) led by Cry1Ab (Fig. 4C).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    No differences between Bt and non-Bt maize were evident for the other 35 analyzed taxa as well as for the higher level analyses of Coleoptera, Hemiptera, and all taxa.

    “No differences between Bt and non-Bt maize were evident for the other 35 analyzed taxa as well as for the higher level analyses of Coleoptera, Hemiptera, and all taxa.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: For plot and split-field designs, the history of management was equal between Bt and non-Bt plots because plots were installed within the same field.
    • The authors state this as an assumption: For meta-analyses, when authors did not mention pesticide treatments or when Bt and non-Bt plots received similar treatments, no pesticides were applied.
    • The authors state this as an assumption: If commercial seeds were used, sufficient Bt protein expression was assumed.
    • The authors state this as an assumption: If no information on insecticides before the start of the study was provided, no insecticides were applied.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The final database contains 7279 invertebrate records extracted from 120 articles.

    “Altogether, the final database contains 7279 invertebrate records (lines in the database), extracted from 120 articles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Coleoptera-active Bt proteins (2078 records, 47 experiments) were mainly represented by Cry3Bb.

    “Coleoptera-active Bt proteins (2078 records, 47 experiments) were mainly represented by Cry3Bb.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In 263 records (18 experiments), multiple Lepidoptera-active Bt proteins were pyramided.

    “In 263 records (18 experiments), multiple Lepidoptera-active Bt proteins were pyramided.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The number of records extracted from each article varied from 1 to 428 with a median of 30 records.

    “The number of records extracted from each article varied from 1 to 428 with a median of 30 records (Fig. 4A), and from each experiment from 1 to 379 with a median of 18 records (Fig. 4B).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In 696 records (30 experiments), Lepidoptera-active Bt proteins were stacked with Coleoptera-active ones.

    “In 696 records (30 experiments), Lepidoptera-active Bt proteins were stacked with Coleoptera-active ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Coleoptera-active proteins also included mCry3A and Cry34Ab1/Cry35Ab1.

    “Coleoptera-active proteins also included mCry3A and Cry34Ab1/Cry35Ab1.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Some data also are available for oxadiazine.

    “Some data also are available for oxadiazine.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    When analysing functional groups, predators dominated with 55% of all records (213 experiments).

    “When analysing functional groups, predators dominated with 55% of all records (213 experiments) (Fig. 6C).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Soil insecticides are represented by pyrethroids, organophosphates, and carbamates.

    “Soil insecticides are represented by pyrethroids, organophosphates, and carbamates.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Records of higher taxonomic units that comprise species with different modes of feeding were assigned 'not specified' (5.6%, 87 experiments).

    “Records of higher taxonomic units that comprise species with different modes of feeding, were assigned “not specified”. (5.6%, 87 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Most data were generated between 2000 and 2003.

    “Most data, however, were generated between 2000 and 2003.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In 23% of the records (82 experiments), the authors did not specify if Bt maize was grown in the plots before the start of the experiment.

    “In 23% of the records (82 experiments), however, the authors did not specify if Bt maize was grown in the plots before the start of the experiment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some nematode records were assigned to the functional group of bacterivores or fungivores (together 1.4%, 11 experiments).

    “Some nematode records were assigned to the functional group of bacterivores or fungivores (together 1.4%, 11 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Insecticides were either applied to the plants, the soil, or the seeds.

    “Insecticides were either applied to the plants, the soil, or the seeds (Fig. 5F).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The functional groups of herbivores, decomposers, parasitoids, and omnivores represented 20%, 12%, 4.4%, and 2.3% of the records (152, 83, 106, 51 experiments), respectively.

    “The functional groups of herbivores, decomposers, parasitoids, and omnivores represented 20%, 12%, 4.4%, and 2.3% of the records (152, 83, 106, 51 experiments), respectively.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    A few records showed other issues that indicated that the data might not be plausible (e.g., very low SEs for all taxa).

    “Finally, a few records showed other issues that indicated that the data might not be plausible (e.g., very low SEs for all taxa) (DP).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The majority of the remaining records (3434) represented European experiments (98), with most data generated in Germany (1291 records, 26 experiments).

    “The majority of the remaining records (3434) represented European experiments (98) with most data generated in Germany (1291 records, 26 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Seeds were mostly coated with chloro-nicotinyl insecticides.

    “Finally, seeds were mostly coated with chloro-nicotinyl insecticides.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Aggregated higher taxa represent 8% of the total records, while 57% of the records are unique (210 experiments).

    “Those aggregated higher taxa represent 8% of the total records, while 57% of the records are unique (data of the taxon not used for aggregated records, 210 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Almost half of the records (2839) represented 75 experiments from the USA.

    “Almost half of the records (2839) represented 75 experiments from the USA (Fig. 4D).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Plot sizes ranged from 0.001 ha to 27 ha.

    “Plot sizes ranged from 0.001 ha to 27 ha (Fig. 5D).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Data were available from field studies conducted from 1994 to 2017.

    “Data were available from field studies conducted from 1994 to 2017 (Fig. 5B).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The second most studied order was Hemiptera (19% of all records, 165 experiments).

    “The second most studied order was Hemiptera (19% of all records, 165 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Hemiptera were represented by Anthocoridae, Aphididae, Cicadellidae, Nabidae, Miridae, and 8 other families.

    “Hemiptera were represented by Anthocoridae, Aphididae, Cicadellidae, Nabidae, Miridae, and 8 other families.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Parasitism and predation rates were determined with visual observations, plant removal, or sentinel prey (egg cards or artificial prey).

    “Parasitism and predation rates were determined with visual observations, plant removal, or sentinel prey (egg cards or artificial prey).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Most invertebrates were collected in plots that were not planted to Bt maize in the year(s) before the experiment (49% of the records, 103 experiments).

    “Most invertebrates were collected in plots that were not planted to Bt maize in the year(s) before the experiment (49% of the records, 103 experiments) (Fig. 5C).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Malaise traps, baited traps, and stem eclectors were used.

    “In addition, Malaise traps, baited traps, and stem eclectors were used (“others” in Fig. 6A).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The response variables used in most studies were activity density (53% of records, 151 experiments) and abundance (46%, 176 experiments).

    “The response variables used in most studies were activity density (53% of records, 151 experiments) and abundance (46%, 176 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Authors often did not specify how they calculated SDs or SEs.

    “One problem that occurred when extracting data was that authors often did not specify how they calculated SDs or SEs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Parasitism and predation rates were only reported in a total of 54 records (0.8%, 19 experiments).

    “Parasitism and predation rates were only reported in a total of 54 records (0.8%, 19 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In one third of the records (66 experiments), invertebrates recorded in untreated Bt maize were compared to those from insecticide-treated non-Bt maize.

    “In one third of the records (66 experiments), invertebrates recorded in untreated Bt maize were compared to those from insecticide-treated non-Bt maize (black bar right).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The 82 records from studies where Bt and non-Bt plots were treated with the same insecticide comprised 60 records with seed treatment, 19 with foliar spray (carbamate), and 3 with soil insecticides.

    “60 records with seed treatment (26 chloro-nicotinyl, 7 chloro-nicotinyl or organophosphorous, 1 organophosphorous, 26 not specified), 19 with foliar spray (carbamate), and 3 with soil insecticides (2 carbamate, 1 organophosphorous).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Various invertebrate orders were collected in Bt and non-Bt maize.

    “Various invertebrate orders were collected in Bt and non-Bt maize (Fig. 6B).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    In the yellow category, the main problems were the lack of reported Bt protein expression, a low number of sampling dates over the season, and uncertainty in the calculation of variation.

    “In the yellow category (moderate issues in validity), the main problems were the lack of reported Bt protein expression, a low number of sampling dates over the season, and uncertainty in the calculation of variation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Similarly, 8% of the records (45 experiments) represent individual life stages that also have been used for additional records with aggregated life stages (2%), while 90% of the records are unique (229 experiments).

    “Similarly, 8% of the records (45 experiments) represent individual life stages, which also have been used for additional records with aggregated life stages (2%), while 90% of the records are unique (life stage only once in the database, 229 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Activity density was mainly recorded with pitfall traps, sticky traps, and pan traps.

    “Activity density was mainly recorded with pitfall traps, sticky traps, and pan traps.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The most studied order was Coleoptera (35% of all records, 178 experiments).

    “The most studied order was Coleoptera (35% of all records, 178 experiments).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Invertebrates were collected with a range of different sampling methods.

    “Invertebrates were collected with a range of different sampling methods (Fig. 6A).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Approximately 18% of the records showed uncertainty in the calculation of variation.

    “Approximately 18% of the records showed such uncertainty in the calculation of variation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    In 16% of the records, Bt maize was grown for 1 year before the sampling season (29 experiments), 11% for 2 years (15), and 1% for 3 years (4).

    “In 16% of the records, Bt maize was grown for 1 year before the sampling season (29 experiments), 11% for 2 years (15), and 1% for 3 years (4).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Of all records in the database, 35% (144 experiments) represent data of lower taxonomic groups that also have been used to generate records for aggregated, higher taxonomic units.

    “Of all records in the database, 35% (144 experiments) represent data of lower taxonomic groups (e.g., species), which also have been used to generate records for aggregated, higher taxonomic units (e.g., families or orders) (Fig. 6D).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Abundance was recorded with visual observations, plant or root removals followed by sorting in the laboratory, soil extraction, sweep nets, beat cloths, litter extractions, and aspirators.

    “Abundance was recorded with visual observations (either counting in the field or removing specimens), plant or root removals followed by sorting in the laboratory, soil extraction, sweep nets, beat cloths, litter extractions, and aspirators.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Ten records (0.1%, 6 experiments) were available from experiments where both Bt and non-Bt plots received the same insecticides, but non-Bt maize received additional insecticide treatments.

    “Ten records (0.1%, 6 experiments) were available from experiments where both Bt and non-Bt plots received the same insecticides (seed treatments or foliar sprays), but non-Bt maize received additional insecticide treatments (grey top bar right).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Almost 80% of the records derived from plots larger than 0.016 ha and almost 50% from plots greater than 0.06 ha.

    “Almost 80% of the records derived from plots larger than 0.016 ha (e.g., 13 × 13 m plots) and almost 50% from plots greater than 0.06 ha (e.g., 25 × 25 m plots).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Foliar sprays were mainly conducted using pyrethroids or microbial Bt or spinosad formulations.

    “Foliar sprays were mainly conducted using pyrethroids or microbial Bt or spinosad formulations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In 6 records (2 experiments), insecticide treatment was mentioned, but not specified further.

    “In 6 records (2 experiments), insecticide treatment was mentioned, but not specified further.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In 8% of the records (28 experiments), Bt and non-Bt maize received the same insecticide treatment.

    “In 8% of the records (28 experiments), Bt and non-Bt maize received the same insecticide treatment (e.g., seed treatments or treatments against pests other than the targets of the Bt maize) (grey top bar left).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Split-field designs and designs where different fields served as replicates represented the remaining 5% and 3% of the records (22 and 18 experiments), respectively.

    “Split-field designs and designs where different fields served as replicates represented the remaining 5% and 3% of the records (22 and 18 experiments), respectively.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The experimental design for 92% of the records (193 experiments) consisted of replicated plots in one or two fields.

    “The experimental design for 92% of the records (193 experiments) consisted of replicated plots in one or two fields (Fig. 5A).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The families of Coccinellidae and Carabidae together represented 64% of all Coleoptera records, followed by Staphylinidae, Chrysomelidae, Nitidulidae Elateridae, and 16 other families.

    “The families of Coccinellidae and Carabidae together represented 64% of all Coleoptera records, followed by Staphylinidae, Chrysomelidae, Nitidulidae Elateridae, and 16 other families.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Moderator analyses indicated significantly positive effect sizes in Cry1Ac-producing maize compared with non-Bt maize in the public-sector-only analysis.

    “However, moderator analyses indicated significantly positive effect sizes in Cry1Ac-producing maize compared with non-Bt maize”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Heterogeneity was significant for half of the analysed taxa and all functional groups in the pyrethroid-treatment comparison.

    “Heterogeneity was significant for half of the analysed taxa and all functional groups.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Only 371 records were available for analyses restricted to records flagged green in all critical appraisal criteria, compared with 2220 total records and 1976 when only red-flagged records were excluded.

    “Relatively few records were available for these analyses (371) compared to 2220 in total and 1976 when only red flagged records were excluded.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    For the different taxa, 61 analyses were possible with at least 5 records from 3 articles.

    “For the different taxa, 61 analyses were possible with at least 5 records from 3 articles”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Moderator analyses for different target orders of Bt proteins revealed no significant effects except that Alticini (Col: Chrysomelidae) were less abundant in Coleoptera-active Bt maize.

    “None of these analyses revealed significant effects, except for Alticini (Col: Chrysomelidae), which were less abundant in Coleoptera-active Bt maize.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Parasitoids showed lower populations in Bt maize in the analysis with Lepidoptera-active Bt maize, with significant heterogeneity.

    “Parasitoids showed lower populations in Bt maize (negative effect size) in the analysis with all Bt proteins (and significant heterogeneity), and in the analysis with Lepidoptera-active Bt maize (significant heterogeneity; moderator analysis significant for Cry1Ab).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    When at least one article was removed, 34 significant effect sizes turned non-significant, while only 5 effect sizes remained significantly negative (including Diptera, Tachinidae, and M. cingulum).

    “When at least one article was removed, 34 significant effect sizes turned to non-significant, while only 5 effect sizes remained significantly negative (including Diptera, Tachinidae, and M. cingulum).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Findingown data

    Articles [34] and [35] contributed the highest number of records to the overall private-sector analysis (124 and 353 of 874 records, respectively).

    “The articles [34] and [35] contributed the highest number of records to the overall analysis (124 and 353 of 874 records, respectively).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [34] Pilcher CD. Phenological, physiological, and ecological influences of transgenic Bt corn on European corn borer management. Ph.D. thesis. Iowa State University, Ames, USA. 1999.

      Not checked in the free run.

    • cites [35] Madrid JLC, Carrillo JLM, Martinez MBO, Pompa HAD, Escobedo JA, Quinones FJ, et al. Transportability of non-target arthropod field data for the use in environmental risk assessment of genetically modified maize in Northern Mexico. J Appl Entomol. 2018;142:525–38. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Organophosphorous and microbial insecticides could only be analysed for Coleoptera, the functional group of predators, and all taxa combined.

    “Organophosphorous insecticides and microbial insecticides could only be analysed for Coleoptera, the functional group of predators, and all taxa combined”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Parasitoids showed lower populations in Bt maize in the analysis with all Bt proteins, with significant heterogeneity.

    “Parasitoids showed lower populations in Bt maize (negative effect size) in the analysis with all Bt proteins (and significant heterogeneity), and in the analysis with Lepidoptera-active Bt maize (significant heterogeneity; moderator analysis significant for Cry1Ab).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The funnel plot with records from all taxa and all Bt proteins (red-flagged records excluded) shows a symmetrical distribution of data points, suggesting a lack of publication bias (Egger's test, z = −0.8608, p = 0.39).

    “The funnel plot with records from all taxa and all Bt proteins (with red flagged records excluded) shows a symmetrical distribution of data points, thus suggesting a lack of publication bias (Egger’s test, z = − 0.8608, p = 0.39)”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    Studies conducted in off-crop habitats and on vertebrates were rare.

    “Studies conducted in off-crop habitats and on vertebrates, however, were rare.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    When one article was removed in the pyrethroid comparison, 4 analyses turned non-significant, while 7 effect sizes remained significantly positive (all taxa, Araneae, Cantharidae, Hemiptera, Anthocoridae, Cicadellidae, and predators) and one effect size remained significantly negative (Nitidulidae).

    “When one article was removed, 4 analyses turned to non-significant, while 7 effect sizes remained significantly positive (all taxa, Araneae, Cantharidae, Hemiptera, Anthocoridae, Cicadellidae, and predators) and one effect size significantly negative (Nitidulidae).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Authors' conclusions for experiments summarized narratively were similar to the results of the statistical meta-analyses.

    “Authors’ conclusions for experiments summarized narratively (Additional file 3) were similar to the results of our statistical meta-analyses.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    In Lepidoptera-active Bt maize, pitfall traps and plant samples recorded less Nitidulidae than in non-Bt maize [37, 49], and Bt sweet corn showed less kernels damaged by Nitidulidae [50, 51], resulting in a negative effect size in the meta-analyses.

    “In Lepidoptera-active Bt maize, pitfall traps and plant samples recorded less Nitidulidae than in non-Bt maize [37, 49], and Bt sweet corn showed less kernels damaged by Nitidulidae [50, 51], resulting in a negative effect size in our meta-analyses.”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [37] Bruck DJ, Lopez MD, Lewis LC, Prasifka JR, Gunnarson RD. Effects of transgenic Bacillus thuringiensis corn and permethrin on nontarget arthropods. J Agr Urban Entomol. 2006;23:111–24.

      Not checked in the free run.

    • cites [49] Daly T, Buntin GD. Effect of Bacillus thuringiensis transgenic corn for lepidopteran control on nontarget arthropods. Environ Entomol. 2005;34:1292–301. source

      Not checked in the free run.

    • cites [50] Dively GP. Impact of transgenic VIP3A x Cry1Ab Lepidopteran-resistant field corn on the nontarget arthropod community. Environ Entomol. 2005;34:1267–91. source

      Not checked in the free run.

    • cites [51] Dowd PF. Suitability of commercially available insect traps and pheromones for monitoring dusky sap beetles (Coleoptera: Nitidulidae) and related insects in Bt sweet corn. J Econ Entomol. 2005;98:856–61. source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    Leave-one-out analyses showed non-significant effects in 2 of 5 cases when one record was removed, and 4 cases when one experiment or one article was removed.

    “The “leave one out” analyses showed non-significant effects in 2 of 5 cases when one record was removed, and 4 cases when one experiment or one article was removed.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    For the analysis on all taxa and Bt proteins with no records excluded, Ref. [35] contributed 358, Ref. [36] 158, and Ref. [34] 126 of 2220 total records.

    “For example, for the analysis on all taxa and Bt proteins with no records excluded, Ref. [35] contributed 358, Ref. [36] 158, and Ref. [34] 126 of 2220 total records”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [35] Madrid JLC, Carrillo JLM, Martinez MBO, Pompa HAD, Escobedo JA, Quinones FJ, et al. Transportability of non-target arthropod field data for the use in environmental risk assessment of genetically modified maize in Northern Mexico. J Appl Entomol. 2018;142:525–38. source

      Not checked in the free run.

    • cites [36] Szenasi A, Palinkas Z, Zalai M, Schmitz OJ, Balog A. Short-term effects of different genetically modified maize varieties on arthropod food web properties: an experimental field assessment. Sci Rep. 2014;4:5315. source

      Not checked in the free run.

    • cites [34] Pilcher CD. Phenological, physiological, and ecological influences of transgenic Bt corn on European corn borer management. Ph.D. thesis. Iowa State University, Ames, USA. 1999.

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    No heterogeneity was found in the Staphylinidae dataset and no individual studies with many or high weighted observations were obvious that could be associated with the observed effect.

    “In addition, no heterogeneity was found in the dataset and no individual studies with many or high weighted observations were obvious that could be associated with the observed effect.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Leave-one-out analyses with pyrethroid-treated non-Bt maize revealed that 2 of 12 significant analyses turned non-significant when at least one record was removed and 3 when one experiment was removed.

    “The “leave one out” analyses with pyrethroid-treated non-Bt maize revealed that 2 out of 12 significant analyses turned to non-significant when at least one record was removed and 3 when one experiment was removed.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    In both studies with M. cingulum, adults were collected with sticky traps.

    “In both studies, M. cingulum adults were collected with sticky traps.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The observed effect size on Braconidae can be considered robust according to fail safe numbers, but the analyses turned non-significant when article [34] was removed.

    “The observed effect size on Braconidae in several analyses can be considered robust according to fail safe numbers, but the analyses turned to non-significant when article [34] was removed”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [34] Pilcher CD. Phenological, physiological, and ecological influences of transgenic Bt corn on European corn borer management. Ph.D. thesis. Iowa State University, Ames, USA. 1999.

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    No significance was present for Staphylinidae when each Bt maize type was analyzed separately, or when records with only green flags were analyzed.

    “No significance was present when each Bt maize type was analyzed separately (Fig. 9), or when records with only green flags were analyzed (Fig. 10B).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation

    No effects on M. cingulum were reported from Coleoptera-active maize [48] and no overall effect of Coleoptera-active maize on parasitoids was observed in the meta-analyses.

    “In contrast, no effects on M. cingulum were reported from Coleoptera-active maize [48] and no overall effect of Coleoptera-active maize on parasitoids was observed in our meta-analyses.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [48] Bhatti MA, Duan J, Head GP, Jiang CJ, McKee MJ, Nickson TE, et al. Field evaluation of the impact of corn rootworm (Coleoptera : Chrysomelidae)-protected Bt corn on foliage-dwelling arthropods. Environ Entomol. 2005;34:1336–45. source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    When sampling methods were analyzed separately, a significant but non-robust negative effect size was shown for Staphylinidae with sticky traps (17 records), but not for pitfall traps (61 records) or litter extraction (8 records).

    “When sampling methods were analyzed separately, a significant, but non-robust negative effect size was shown for sticky traps (17 records), but not for pitfall traps (61 records), or litter extraction (8 records).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The funnel plot for records of all taxa combined revealed a balanced distribution of effect sizes, providing no evidence that non-significant results are not being published.

    “The funnel plot for records of all taxa combined (Additional file 7: Figure S7.1), however, revealed a balanced distribution of effect sizes, providing no evidence that non-significant results are not being published [29].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [29] Viechtbauer W. Conducting meta-analyses in R with the metaphor package. J Stat Softw. 2010;36:3. source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    Coccinellidae showed higher populations in Bt maize (non-robust positive effect size) when records with all green flags were analyzed and in specific analyses with sticky trap data.

    “In contrast to Staphylinidae, Coccinellidae (lady beetles) showed higher populations in Bt maize (non-robust positive effect size) when records with all green flags were analyzed (Fig. 10B) and in specific analyses with sticky trap data.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    A weak (non-robust) negative effect of stacked Bt maize on the herbivore functional group was observed, but no such effect was evident for Lepidoptera-active or Coleoptera-active maize.

    “A weak (non-robust) negative effect of stacked Bt maize on the herbivore functional group was observed, but no such effect was evident for Lepidoptera-active or Coleoptera-active maize (Fig. 11).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Positive effect sizes robust according to fail safe numbers and leave-one-out analyses were observed for all taxa combined, spiders (Araneae), Hemiptera, and the functional group of predators.

    “Positive effect sizes (higher populations in untreated Bt maize compared with treated non-Bt maize) that were robust according to fail safe numbers and “leave one out” analyses were observed for all taxa combined, spiders (Araneae), Hemiptera, and the functional group of predators.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Insecticides from other classes, such as organophosphorous, microbial, carbamate, or oxadiazine, were only used in few studies and the required minimum numbers of records (5) and articles (3) for meta-analyses were not available in most cases.

    “Insecticides from other classes, such as organophosphorous, microbial, carbamate, or oxadiazine insecticides were only used in few studies and the required minimum numbers of records (5) and articles (3) for meta-analyses were not available in most cases.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Taxonomic subgroup analyses revealed reduced numbers of Alticini (flea beetles) in Coleoptera-active Bt maize, which might reflect toxicity of Cry3Bb-producing Bt maize because Alticini belong to the target group of Chrysomelidae.

    “Taxonomic subgroup analyses revealed reduced numbers of Alticini (flea beetles) in Coleoptera-active Bt maize, which might reflect toxicity of Cry3Bb-producing Bt maize, because Alticini belong to the target group of Chrysomelidae.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Approximately half of the analysed taxa and all functional groups showed significant heterogeneity in the pyrethroid treatments, demonstrating that within those taxa some studies showed more effects than others and/or the direction of effect sizes was variable.

    “Approximately half of the analysed taxa and all functional groups (Fig. 14) showed significant heterogeneity in the pyrethroid treatments, which demonstrates that within those taxa, some studies showed more effects than others and/or the direction of effect sizes was variable.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Higher populations of Neuroptera were recorded in Bt maize with visual counts (of all stages) and when only eggs were analyzed.

    “In contrast, higher populations of Anthocoridae (flower bugs) were recorded in Lepidoptera-active Bt maize (Cry1Ab, visual counts) and higher populations of Neuroptera (lacewings) were recorded in Bt maize with visual counts (of all stages) and when only eggs were analyzed.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    A borderline, non-robust negative effect of Bt maize on Syrphidae was present when all records (including red-flagged ones) were analysed, when only green-flagged records were analysed, and when sticky trap data were analysed while red-flagged records were excluded.

    “A borderline, non-robust negative effect of Bt maize on Syrphidae was present when all records (including red-flagged ones) were analysed, when only green-flagged records were analysed, and when sticky trap data were analysed, while red-flagged records were excluded (Fig. 10, Additional file 7: Table S7.11).”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingreasoning

    Organophosphorous and microbial insecticides similarly affected predators, resulting in higher populations in untreated Bt maize.

    “Organophosphorous and microbial insecticides similarly affected predators.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Overall, comparisons of insecticide-treated non-Bt maize with untreated Bt maize resulted in more significant effect sizes, higher robustness, and higher heterogeneity than analyses of untreated non-Bt and Bt maize.

    “Overall, comparisons of insecticide-treated non-Bt maize with untreated Bt maize resulted in more significant effect sizes, higher robustness, but also higher heterogeneity than analyses of untreated non-Bt and Bt maize.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Confidence intervals for Coccinellidae included zero in main analyses with all records, with red-flagged records excluded, or in analyses of Bt maize targeting different orders.

    “Confidence intervals included zero, however, in main analyses with all records (Fig. 10A), with red flagged records excluded (Fig. 8), or in analyses of Bt maize targeting different orders (Fig. 9).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Those effects were not robust and significant only in some analyses.

    “Those effects, however, were not robust and significant only in some analyses.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Community measures, such as biodiversity indices, were captured in tables and summarized narratively, but were quite inconsistent among studies in terms of taxonomic inclusion and reporting of outcomes.

    “Community measures, such as biodiversity indices were captured in tables and summarized narratively (Additional file 3), but were quite inconsistent among studies in terms of taxonomic inclusion and reporting of outcomes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    Those estimated SDs were generally higher than the calculated ones and thus more conservative, reflecting the uncertainty of this estimation.

    “Those estimated SDs were generally higher than the calculated ones and thus more conservative, reflecting the uncertainty of this estimation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    Of all records in the present database, 39% are from studies published later than 2008, so the meta-analyses are based on a substantially larger dataset compared with others.

    “Of all records in the present database, 39% are from studies published later than 2008, so our meta-analyses are based on a substantially larger dataset compared with others [14].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [14] Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    Most data included in this review derived from field studies conducted in North America and Europe, while only few datasets were available from South America, Africa, and Asia.

    “Most data included in this review derived from field studies conducted in North America and Europe, while only few datasets were available from South America, Africa, and Asia.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    For a large number of studies, authors had to be contacted because detailed data or some crucial information was lacking in the articles, and in several cases the attempt to get this information was fruitless.

    “For a large number of studies, authors had to be contacted because detailed data or some crucial information was lacking in the articles and in several cases our attempt to get this information was fruitless.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationnone given

    The current work largely confirmed previously published results.

    “The current work largely confirmed previously published results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    A reduction of populations of valued organisms may lead to environmental harm, no matter if the underlying effects are direct or indirect, anticipated or unanticipated.

    “The review covers field data of non-target animals, because a reduction of populations of valued organisms may lead to environmental harm, no matter if the underlying effects are direct or indirect, anticipated or unanticipated [9].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [9] Meissle M, Naranjo SE, Kohl C, Riedel J, Romeis J. Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review protocol. Environ Evid. 2014;3:7. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Decisions regarding inclusion or validity assessment of studies co-authored by a review team member were made by other team members that were not authors of the study.

    “Decisions regarding inclusion or validity assessment of studies co-authored by a review team member were made by other team members that were not authors of the study.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Articles excluded on full text level were all double checked and discrepancies were solved within the team.

    “In addition, articles excluded on full text level were all double checked and descrepancies were solved within the team.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    The questions and cut-off values were developed within the review team and discussed with external experts during a workshop at the 13th ISBGMO meeting in Cape Town in November 2014 and bilaterally with one expert on critical appraisal in systematic reviews and one expert on maize arthropods.

    “The questions and cut-off values were developed within the review team and discussed with external experts during a workshop at the 13th ISBGMO meeting in Cape Town (South Africa) in November 2014 [27] and bilaterally with one expert on critical appraisal in systematic reviews and one expert on maize arthropods.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [27] ISBR. 13th International symposium on the biosafety of genetically modified organisms (ISBGMO13), Westin, Cape Town, South Africa. 9–13 November 2014. https://isbr.info/ISBGMO13_. Accessed 26 Apr 2022.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    For the initial literature search in 2014, approximately 1000 references were screened twice, while for the updates in 2019, all references (approximately 3000) were screened twice.

    “For the initial literature search in 2014, approximately 1000 references were screened twice, while for the updates in 2019, all references (approximately 3000) were screened twice.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The same critical appraisal criteria were also applied to the articles included in the summary tables.

    “The same critical appraisal criteria were also applied to the articles included in the summary tables (Additional file 3: Tables S3.1–S3.5).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In addition to toxicity of the introduced Bt proteins, effects may include food web effects as a result of the missing target species in Bt crops and effects resulting from changes in plant physiology or changes in crop management practices.

    “In addition to toxicity of the introduced Bt proteins, effects also may include food web effects as a result of the missing target species in Bt crops and effects resulting from changes in plant physiology or changes in crop management practices [9].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [9] Meissle M, Naranjo SE, Kohl C, Riedel J, Romeis J. Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review protocol. Environ Evid. 2014;3:7. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Defined eligibility criteria were applied to screen titles, abstracts, and full texts of the retrieved references.

    “Defined eligibility criteria were applied to screen titles, abstracts, and full texts of the retrieved references.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    For the final review, those criteria were further refined to 16 specific questions that were applied to each record in the database.

    “For the final review, those criteria were further refined to 16 specific questions that were applied to each record in the database (data file 3 of Ref. [25], 10.5281/zenodo.6517033).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    This systematic review follows the protocol previously published by Meissle et al.

    “This systematic review follows the protocol previously published by Meissle et al. [9].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [9] Meissle M, Naranjo SE, Kohl C, Riedel J, Romeis J. Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review protocol. Environ Evid. 2014;3:7. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    For 27 articles the authors replied but could not provide the requested data and for 17 articles, we did not get a reply to our request, not even after a reminder was sent.

    “For 27 articles the authors replied but could not provide the requested data and for 17 articles, we did not get a reply to our request, not even after a reminder was sent.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Datasets from articles eligible for quantitative data extraction that were used previously in the meta-analysis of Naranjo (43 articles) were checked and transferred to the current database by one team member.

    “Datasets from articles eligible for quantitative data extraction that were used previously in the meta-analysis of Naranjo [14] (43 articles) were checked and transferred to the current database by one team member.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [14] Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    The effects of Bt maize on the community of non-target invertebrates inhabiting maize fields were small and mostly neutral, especially when compared with the effects of broad-spectrum pyrethroid insecticide treatments.

    “The effects of Bt maize on the community of non-target invertebrates inhabiting maize fields were small and mostly neutral, especially when compared with the effects of broad-spectrum pyrethroid insecticide treatments.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Literature published until August 2019 was searched systematically in 12 bibliographic databases, 17 specialized webpages, and reference sections of 78 review articles.

    “Literature published until August 2019 was searched systematically in 12 bibliographic databases, 17 specialized webpages, and reference sections of 78 review articles.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies.

    “Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [22] Gurevitch J, Curtis PS, Jones MH. Meta-analysis in ecology. Adv Ecol Res. 2001;32:199–247. source

      Not checked in the free run.

    • cites [23] Gurevitch J, Koricheva J, Nakagawa S, Stewart G. Meta-analysis and the science of research synthesis. Nature. 2018;555:175–82. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Reporting bias was addressed with statistical tools (funnel plot and meta-analyses on studies with private sector contribution compared with studies conducted by the public sector only) rather than in the critical appraisal.

    “Reporting bias was addressed with statistical tools rather than in the critical appraisal (funnel plot and meta-analyses on studies with private sector contribution compared with studies conducted by the public sector only).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The search string was tested in 4 different bibliographic databases and the results were compared with the references known from a previous meta-analysis by Naranjo.

    “In the development of the review protocol [9], the string was tested in 4 different bibliographic databases and the results were compared with the references known from a previous meta-analysis by Naranjo [14].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [14] Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    All records in the database were assessed for both external validity and internal validity.

    “All records in the database (Fig. 1 and Ref. [25]) were assessed for both external validity (the degree to which the study records are appropriate or applicable for answering the review question) and internal validity (risk of selection, performance, detection, and attrition bias).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Commercial production of GM crops in Europe is restricted to one single-gene product, event MON810, which is corn borer resistant maize expressing the cry1Ab gene from Bt.

    “In contrast, commercial production in Europe is restricted to one single-gene product, event MON810, which is corn borer resistant maize expressing the cry1Ab gene from Bt [2, 3].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [2] ISAAA. GM approval database. International service for the acquisition of agri-biotech applications (ISAAA). 2019. www.isaaa.org/gmapprovaldatabase. Accessed 26 Apr 2022.

      Not checked in the free run.

    • cites [3] Meissle M, Romeis J, Bigler F. Bt maize and integrated pest management—a European perspective. Pest Manage Sci. 2011;67:1049–58. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    No relevant disagreements occurred in the consistency check, so no further consistency checks were done.

    “As no relevant disagreements occurred, we decided to do no further consistency checks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Meissle et al. translated the general guidance for critical appraisal provided by CEE to more specific criteria applicable to the present review question.

    “Meissle et al. [9] translated the general guidance for critical appraisal provided by CEE to more specific criteria applicable to the present review question.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [9] Meissle M, Naranjo SE, Kohl C, Riedel J, Romeis J. Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review protocol. Environ Evid. 2014;3:7. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The references obtained in the updates in January and August 2019 were all screened by both reviewers at the title/abstract level (2933 references).

    “The references obtained in the updates in January and August 2019 were all screened by both reviewers at the title/abstract level (2933 references).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    For 95 articles we tried to contact the authors and for 51 articles, we received the requested information or at least parts of the full request.

    “For 95 articles we tried to contact the authors and for 51 articles, we received the requested information or at least parts of the full request.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    From the 77 articles unique to the present database, a subset of 20 articles was double checked by a second member of the review team and uncertainties were discussed until an agreement was reached.

    “From the 77 articles unique to the present database, a subset of 20 articles was double checked by a second member of the review team and uncertainties were discussed until an agreement was reached.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    A subset of randomly selected 10% of the references obtained in the first literature search in 2014 were screened by a second reviewer at the title/abstract level (1006 references).

    “In addition, a subset of randomly selected 10% of the references obtained in the first literature search in 2014 were screened by a second reviewer at the title/abstract level (1006 references).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    For the first time, a critical appraisal scheme for field studies on non-targets in GM crops was developed to estimate the risk of bias (internal validity) and the suitability to answer the review question (external validity) of all primary data.

    “For the first time, a critical appraisal scheme for field studies on non-targets in GM crops was developed to estimate the risk of bias (internal validity) and the suitability to answer the review question (external validity) of all primary data.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Such a critical appraisal has not been done for previous meta-analyses or reviews of non-target field data of GM crops.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Bibliographic database searches were not conducted in languages other than English, but documents in other languages were included when identified on webpages or in reference lists of articles.

    “We did not conduct bibliographic database searches in languages other than English, but we included documents in other languages, such as Spanish, French, German, and Chinese when we identified them on webpages or in reference lists of articles.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Many articles in other languages have at least an English title and abstract.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The influence of contributions by private sector product developers on reported effects was investigated.

    “The influence of contributions by private sector product developers on reported effects was investigated.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Decisions on full text level were double-checked.

    “We also double-checked decisions on full text level.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Titles and abstracts that were excluded by the main reviewer but included by the second reviewer were checked again by both reviewers at full text level and a common decision was made after discussion between both reviewers.

    “Titles and abstracts that were excluded by the main reviewer but included by the second reviewer were checked again by both reviewers at full text level and a common decision was made after discussion between both reviewers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    All references and full texts were screened by one experienced main reviewer.

    “All references and full texts were screened by one experienced main reviewer.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The sampling procedure was sufficiently described in most cases.

    “The sampling procedure was sufficiently described in most cases (SP).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    In most cases no insecticides were applied before the start of the study.

    “In most cases no insecticides were applied before the start of the study (IB).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Plot size and years of Bt maize cultivation had no influence on absolute effect sizes between Bt and non-Bt maize.

    “This indicates that plot size and years of Bt maize cultivation had no influence on absolute effect sizes between Bt and non-Bt maize.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    By default, records with any red-flagged critical appraisal criterion were excluded from meta-analyses to avoid potential bias.

    “By default, we excluded records with any “red” flagged critical appraisal criteria for meta-analyses to avoid potential bias.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Analyses with only green-flagged records showed broader confidence limits because of the low number of available records, but results were qualitatively similar except for Coccinellidae.

    “Overall, analyses with only green flagged records showed broader confidence limits because of the low number of available records compared to the other two analyses, but results were qualitatively similar with the exception of Coccinellidae.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Studies with Dalotia coriaria indicated no effects on different life table parameters when beetles were fed spider mites reared on Cry1Ab- or Cry3Bb-producing maize or when purified Cry3Aa and Cry1Ab was provided in artificial diet.

    “Studies with Dalotia coriaria (Col.: Staphylinidae) indicated no effects on different life table parameters when beetles were fed spider mites reared on Cry1Ab-[53] or Cry3Bb-producing maize [54] or when purified Cry3Aa and Cry1Ab was provided in artificial diet [55].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [53] Garcia M, Ortego F, Castañera P, Farinós G. Effects of exposure to the toxin Cry1Ab through Bt maize fed-prey on the performance and digestive physiology of the predatory rove beetle Atheta coriaria. Biol Control. 2010;55:225–33. source

      Not checked in the free run.

    • cites [54] García M, Ortego F, Castañera P, Farinós G. Assessment of prey-mediated effects of the coleopteran-specific toxin Cry3Bb1 on the generalist predator Atheta coriaria (Coleoptera: Staphylinidae). Bull Ent Res. 2012;102:293–302. source

      Not checked in the free run.

    • cites [55] Porcar M, García-Robles I, Domínguez-Escribà L, Latorre A. Effects of Bt Cry1Ab and Cry3Aa endotoxins on predatory Coleoptera tested thourgh artificial diet incorporation assays. Bull Ent Res. 2010;100:297–302. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Venditti and Steffey [40] reported that M. cingulum parasitism of first-generation O. nubilalis larvae did not differ among maize types, but a significant effect was present for the second generation, mainly because in one of two years no parasitized larva was collected in Bt maize while 8.6% of larvae were parasitized in non-Bt maize.

    “Venditti and Steffey [40] reported that M. cingulum parasitism of first generation O. nubilalis larvae did not differ among maize types (non-Bt and Bt), but a significant effect was present for the second generation, mainly because in one of two years, no parasitized larva was collected in Bt maize, while 8.6% of the larvae were parasitized in non-Bt maize”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Venditti and Steffey [40] Venditti ME, Steffey KL. Field effects of Bt corn on the impact of parasitoids and pathogens on European corn borer in Illinois. In: Van Driesche RG, editor. 1st International symposium on biological control of arthropods; 14–18 January 2002; Honolulu, Hawaii, USA. Washington: Department of Agriculture, Forest Service; 2003. p. 278–83.

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    When meta-analyses on Hymenoptera, Diptera, and parasitoids were repeated for Lepidoptera-active Bt maize without records of Braconidae (M. cingulum) and Tachinidae, no effect was observed and heterogeneity disappeared, indicating that parasitoids were only affected when specialized on O. nubilalis larvae.

    “When we repeated the meta-analyses on these groups for Lepidoptera-active Bt maize without records of Braconidae (M. cingulum) and Tachinidae, no effect was observed and heterogeneity disappeared, indicating that parasitoids were only affected when specialized on O. nubilalis larvae.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Braconidae are parasitoids of insect larvae and M. cingulum is a parasitoid specialized to corn borer larvae of the genus Ostrinia, the target pests of Lepidoptera-active Bt maize.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Effects of Lepidoptera-active Bt maize on M. cingulum have also been reported in previous meta-analyses [13, 14, 16].

    “Effects of Lepidoptera-active Bt maize on M. cingulum also have been reported in previous meta-analyses [13, 14, 16].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [13] Wolfenbarger LL, Naranjo SE, Lundgren JG, Bitzer RJ, Watrud LS. Bt crop effects on functional guilds of non-target arthropods: a meta-analysis. PLoS ONE. 2008;3: e2118. source

      Not checked in the free run.

    • cites [14] Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.

      Not checked in the free run.

    • cites [16] Pellegrino E, Bedini S, Nuti M, Ercoli L. Impact of genetically engineered maize on agronomic, environmental and toxicological traits: a meta-analysis of 21 years of field data. Sci Rep. 2018;8:3113. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Effects on abundance and parasitism by Tachinidae in Italy were confirmed [43-45].

    “Effects on abundance and parasitism by Tachinidae in Italy were confirmed [43–45].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [43] Delrio G, Verdinelli M, Serra G. Monitoring of pest and beneficial insect populations in summer sown Bt maize. IOBC WPRS Bull. 2004;27(3):43–8.

      Not checked in the free run.

    • cites [44] Manachini B. Effects of transgenic corn on Lydella thompsoni Herting (Diptera: Tachinidae) parasitoid of Ostrinia nubilalis Hb. (Lepidoptera: Crambidae). Boll Zool Agraria Bachic. 2003;35:111–25.

      Not checked in the free run.

    • cites [45] Manachini B, Lozzia GC. Studies on the effects of Bt corn expressing Cry1Ab on two parasitoids of Ostrinia nubilalis Hb. (Lepidoptera: Crambidae). IOBC-WPRS Bull. 2004;27(3):109–16.

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Orr & Landis [39] found no overall effect on the parasitism rate of O. nubilalis in event 176 maize; most recovered parasitoids were E. terebrans, while few M. cingulum were collected in non-Bt maize (0-25% of parasitized larvae) and none in Bt maize.

    “No overall effect on the parasitism rate of O. nubilalis in event 176 maize was found by Orr & Landis [39]; most of the recovered parasitoids, however, were E. terebrans, while only few specimens of M. cingulum were collected in non-Bt maize (0–25% of parasitized larvae, depending on plot) and none in Bt maize.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Orr & Landis [39] Orr DB, Landis DA. Oviposition of European corn borer (Lepidoptera: Pyralidae) and impact of natural enemy populations in transgenic versus isogenic corn. J Econ Entomol. 1997;90:905–9. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    The overall negative effect of Bt maize on Braconidae can be tracked down to Lepidoptera-active maize producing Cry1Ab and to the species M. cingulum.

    “The overall negative effect of Bt maize on Braconidae (Hymenoptera) (Fig. 8) can be tracked down to Lepidoptera-active maize producing Cry1Ab (Fig. 9), and to the species M. cingulum (Fig. 13).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Braconidae are parasitoids of insect larvae and M. cingulum is a parasitoid specialized to corn borer larvae of the genus Ostrinia, the target pests of Lepidoptera-active Bt maize.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Effects on Nitidulidae might be linked to reduced Lepidoptera damage and thus to the reduction of attractive cues for the beetles [37, 49].

    “Effects on Nitidulidae might be linked to the reduced Lepidoptera damage and thus to the reduction of attractive cues for the beetles [37, 49].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [37] Bruck DJ, Lopez MD, Lewis LC, Prasifka JR, Gunnarson RD. Effects of transgenic Bacillus thuringiensis corn and permethrin on nontarget arthropods. J Agr Urban Entomol. 2006;23:111–24.

      Not checked in the free run.

    • cites [49] Daly T, Buntin GD. Effect of Bacillus thuringiensis transgenic corn for lepidopteran control on nontarget arthropods. Environ Entomol. 2005;34:1292–301. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Reduced numbers of target pests, reduced nutritional quality of the remaining ones, and lack of host-derived or induced attractant cues may particularly affect parasitoids specialized to target pests, such as M. cingulum or Tachinidae [34, 47].

    “Reduced numbers of target pests, reduced nutritional quality of the remaining ones, and lack of host-derived or induced attractant cues may particularly affect parasitoids specialized to target pests, such as M. cingulum or Tachinidae [34, 47].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [34] Pilcher CD. Phenological, physiological, and ecological influences of transgenic Bt corn on European corn borer management. Ph.D. thesis. Iowa State University, Ames, USA. 1999.

      Not checked in the free run.

    • cites [47] Romeis J, Meissle M, Bigler F. Transgenic crops expressing Bacillus thuringiensis toxins and biological control. Nat Biotechnol. 2006;24:63–71. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Many Nitidulidae (sap beetles) are fungivores or herbivores attracted to maize plants with corn borer tunnels, other damage, or exposed kernels, where they can feed on fungi growing on plant wound exudates or directly on kernels [37, 49].

    “Many Nitidulidae (sap beetles) are fungivores or herbivores that are attracted to maize plants with corn borer tunnels, other damage, or exposed kernels, where they can feed on fungi growing on the plant wound exudates or directly on the kernels [37, 49].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [37] Bruck DJ, Lopez MD, Lewis LC, Prasifka JR, Gunnarson RD. Effects of transgenic Bacillus thuringiensis corn and permethrin on nontarget arthropods. J Agr Urban Entomol. 2006;23:111–24.

      Not checked in the free run.

    • cites [49] Daly T, Buntin GD. Effect of Bacillus thuringiensis transgenic corn for lepidopteran control on nontarget arthropods. Environ Entomol. 2005;34:1292–301. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    The reasons for the positive effect sizes on Anthocoridae and Neuroptera remain unclear, but the effects were not robust according to fail safe numbers and leave-one-out analyses.

    “The reasons for those positive effect sizes remain unclear, but effects were not robust according to fail safe numbers and “leave one out” analyses.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Interpretationreasoning

    It can be hypothesized that the taxa with positive effect sizes were negatively affected by the insecticide applied to non-Bt maize and therefore higher populations were recorded in untreated Bt maize.

    “It can be hypothesized that those taxa were negatively affected by the insecticide applied to non-Bt maize and therefore, higher populations were recorded in untreated Bt maize.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    For aphid populations, it has been reported frequently that they recover quickly after insecticide sprays, while their natural enemies need more time to recover or to recolonize the fields [57].

    “For aphid populations, it has been reported frequently that they recover quickly after insecticide sprays, while their natural enemies need more time to recover or to recolonize the fields [57].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [57] Dutcher J. A review of resurgence and replacement causing pest outbreaks in IPM. In: Ciancio A, Mukerji KG, editors. General concepts in integrated pest and disease management. Dordrecht: Springer; 2007. p. 27–43. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Conflicts of interest in GM crop research have been suggested for studies on Bt crop efficacy and durability and for studies on health risks and nutritional value of GM crops.

    “Such conflicts of interest have been suggested, for example, for studies on Bt crop efficacy and durability [59] and for studies on health risks and nutritional value of GM crops [60].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [59] Guillemaud T, Lombaert E, Bourguet D. Conflicts of interest in GM Bt crop efficacy and durability studies. PLoS ONE. 2016;11: e0167777. source

      Not checked in the free run.

    • cites [60] Diels J, Cunha M, Manaia C, Sabugosa-Madeira B, Silva M. Association of financial or professional conflict of interest to research outcomes on health risks or nutritional assessment studies of genetically modified products. Food Policy. 2011;36:197–203. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Similar to Staphylinidae, indirect, food web or other ecological effects, or chance may have caused the weak negative effect sizes for Syrphidae.

    “Similar to the group of Staphylinidae, indirect, food web or other ecological effects, or chance may have caused the weak negative effect sizes.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Euxista spp. (Otitidae) are sweet maize pests in the Americas; the flies prefer damaged tissue or the silk at the tip of the ears for oviposition, so a connection between damage caused by Lepidoptera target pests of Bt maize and Otitidae is possible, similar to the case of Nitidulidae [56].

    “Euxista spp. (Otitidae) are sweet maize pests in the Americas. The flies prefer damaged tissue or the silk at the tip of the ears for oviposition, so a connection between damage caused by Lepidoptera target pests of Bt maize and Otitidae is possible, similar to the case of Nitidulidae [56].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [56] Nuessly GS, Capinera JL. Cornsilk fly (suggested common name), Euxesta stigmatias Loew (Insecta: Diptera: Otitidae). University of Florida, IFAS Extension; 2017. https://edis.ifas.ufl.edu/publication/IN381. Accessed 26 Apr 2022.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    The relationship of Nitidulidae with damaged maize was discussed previously, and perhaps this relationship was present despite the pyrethroid sprays.

    “The relationship of Nitidulidae with damaged maize was discussed previously, and perhaps this relationship was present despite the pyrethroid sprays.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The mechanisms behind the Coccinellidae patterns remain uncertain, but a positive effect does not support a hypothesis of toxicity of Bt proteins to lady beetles.

    “The mechanisms behind these patterns remain uncertain, but a positive effect does not support a hypothesis of toxicity of Bt proteins to lady beetles.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In Cry1Ab-producing maize, significantly fewer invertebrates were recorded compared with untreated non-Bt maize, largely attributed to reduced parasitic wasps.

    “In Cry1Ab producing maize, significantly fewer invertebrates were recorded compared with untreated non-Bt maize and this effect was largely attributed to a reduced number of parasitic wasps (Hymenoptera).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [10] Marvier M, McCreedy C, Regetz J, Kareiva P. A meta-analysis of effects of Bt cotton and maize on nontarget invertebrates. Science. 2007;316:1475–7. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The negative effect of stacked Bt maize on herbivores might derive from data on Otitidae (Diptera), but this needs to be interpreted with caution because the data come from a single study [35].

    “The negative effect might derive from data on Otitidae (Diptera), but this needs to be interpreted with caution, because the data come from a single study [35].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [35] Madrid JLC, Carrillo JLM, Martinez MBO, Pompa HAD, Escobedo JA, Quinones FJ, et al. Transportability of non-target arthropod field data for the use in environmental risk assessment of genetically modified maize in Northern Mexico. J Appl Entomol. 2018;142:525–38. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The critical appraisal was used to filter out potentially problematic studies, and analyses were also conducted with all records as well as with only-green-flagged records.

    “The critical appraisal was used to filter out potentially problematic studies, but we also conducted analyses with all records as well as with only-green-flagged records (Fig. 10).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Pellegrino et al.'s meta-analysis found no significant effect sizes on several taxa, a strong negative effect on Braconidae, and a weak positive effect on Cicadellidae.

    “Analyses (Lepidoptera- and Coleoptera-active Bt maize combined) revealed no significant effect sizes on Anthocoridae, Aphididae, Araneae, Carabidae, Chrysopidae (larvae and adults), Coccinellidae (larvae and adults), Nabidae, Nitidulidae, a strong negative effect of Bt maize on Braconidae, and a weak positive effect on Cicadellidae.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [16] Pellegrino E, Bedini S, Nuti M, Ercoli L. Impact of genetically engineered maize on agronomic, environmental and toxicological traits: a meta-analysis of 21 years of field data. Sci Rep. 2018;8:3113. source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning

    In this review, all lower taxa were aggregated to 39 taxa on family, order, or higher level for main meta-analyses, so each record represented data from a unique plot, location, and year.

    “In the current work, we thus aggregated all lower taxa (mainly species) to a total of 39 taxa on family, order, or higher level for our main meta-analyses (Fig. 8) so that each record in the meta-analyses represented data from a unique plot, location, and year.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Several meta-analyses of laboratory data also concluded that Cry1/Cry2 proteins are specific to Lepidoptera and Cry3 to Chrysomelidae.

    “This also has been concluded from several meta-analyses of laboratory data [11, 12, 14].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [11] Duan JJ, Marvier M, Huesing JE, Dively G, Huang ZY. A meta-analysis of effects of Bt crops on honey bees (Hymenoptera: Apidae). PLoS ONE. 2008;3: e1415.

      Not checked in the free run.

    • cites [12] Duan JJ, Lundgren JG, Naranjo S, Marvier M. Extrapolating non-target risk of Bt crops from laboratory to field. Biol Lett. 2010;6:74–7. source

      Not checked in the free run.

    • cites [14] Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The individual critical appraisal questions and specific cut-off values were designed starting from generic schemes often used for systematic reviews and further refined and discussed with other scientists.

    “The individual critical appraisal questions and specific cut-off values were designed starting from generic schemes often used for systematic reviews and further refined and discussed with other scientists.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Numerous laboratory studies have demonstrated that Cry1- and Cry2-class Bt proteins are specific to Lepidoptera and Cry3-class proteins to Chrysomelidae.

    “numerous non-target laboratory studies with a wide range of taxa using purified Bt proteins, plant material, or prey that had consumed Bt proteins have demonstrated the specificity of Cry1- and Cry2-class proteins to Lepidoptera and Cry3-class proteins to Chrysomelidae (Coleoptera) [47, 61–63].”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [47] Romeis J, Meissle M, Bigler F. Transgenic crops expressing Bacillus thuringiensis toxins and biological control. Nat Biotechnol. 2006;24:63–71. source

      Not checked in the free run.

    • cites [61] Romeis J, Naranjo SE, Meissle M, Shelton AM. Genetically engineered crops help support conservation biological control. Biol Control. 2019;130:136–54. source

      Not checked in the free run.

    • cites [62] NASEM (National Academies of Sciences, Engineering, and Medicine). Genetically engineered crops: experiences and prospects. Washington, DC: The National Academies Press. 2016; https://doi.org/10.17226/23395. Accessed 26 Apr 2022. source

      Not checked in the free run.

    • cites [63] Romeis J, Meissle M. Stacked Bt proteins pose no new risks to nontarget arthropods. Trends Biotechnol. 2020;38:234–6. source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductown data

    This review provides more in-depth meta-analyses on a much larger dataset and with consideration of validity issues than previous work.

    “Our work, however, provides more in depth meta-analyses (e.g., higher taxonomic resolution and separate analyses for different target orders of Bt maize) on a much larger dataset and with consideration of validity issues.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Criteria for critical appraisal were developed and applied to all datasets in the database.

    “Criteria for critical appraisal were developed and applied to all datasets in the database.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    When experiments included several sampling methods that recorded the same taxa, one method with the lowest CV was selected to avoid data-duplication in a given meta-analysis.

    “When experiments included several sampling methods that recorded the same taxa, we selected one method with the lowest CV to avoid data-duplication in a given meta-analysis.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    When compared to pyrethroid-treated non-Bt maize, untreated Bt maize revealed higher numbers of predators, herbivores, and mixed feeders and lower numbers of omnivores and detritivores.

    “When compared to pyrethroid-treated non-Bt maize, untreated Bt maize revealed higher numbers of predators, herbivores, and mixed feeders and lower numbers of omnivores and detritivores [13].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [13] Wolfenbarger LL, Naranjo SE, Lundgren JG, Bitzer RJ, Watrud LS. Bt crop effects on functional guilds of non-target arthropods: a meta-analysis. PLoS ONE. 2008;3: e2118. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    There is no commonly agreed critical appraisal scheme for animals collected in GE field studies, and some cut-off values may be arbitrary.

    “Nevertheless, there is no commonly agreed critical appraisal scheme for animals collected in GE field studies and one might argue that some of our cut-off values are arbitrary.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Blinding or masking treatment information for staff recording data in the field was not reported by study authors and therefore not assessed.

    “Blinding or masking treatment information for the staff recording data in the field, as it is common in medical science, was not reported by study authors and therefore not assessed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The lack of correlation of plot size and effect size in this review may be explained by the general lack of substantial effects of Bt proteins on non-target invertebrates.

    “The fact that there was no correlation of plot size and effect size in our review may be explained by the general lack of substantial effects of Bt proteins on non-target invertebrates.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The actual influence of the private sector and other institutions or funding bodies on study results and the completeness of the authors' self-declarations remain unclear.

    “The actual influence of the private sector and other institutions or funding bodies on study results and the completeness of the authors’ self-declarations, however, remain unclear.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    Because many tests were conducted without correction, some significant effect sizes might be due to chance, especially when effects are not robust and a confidence limit is close to zero.

    “While this ensures a high probability for detecting potential effects, some significant effect sizes (negative or positive) might be a product of chance, especially when the observed effects are not robust and one boundary of the confidence limit is close to zero, because for 95% confidence intervals, there is a chance of 5% that the true effect size is outside the estimated interval.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Specific analyses for different sampling methods were also conducted because different methods may not be identical in the proportion of recorded species and life stages.

    “Because we acknowledge that different methods may not be identical in the proportion of recorded species and life stages, we also conducted specific analyses for the different sampling methods (Additional file 7: Table S7.11, S7.12)”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    This review is limited to direct comparisons of animals recorded in Bt and non-Bt maize fields and their adjacent habitats.

    “This review is limited to direct comparisons of animals recorded in Bt and non-Bt maize fields and their adjacent habitats.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Study design and conductreasoning

    Analyses included experiments with all transformation events and planting years because the principal mechanisms and spectrum of activity of the produced Bt proteins (Cry1, Cry2, or Cry3 type proteins) remained the same.

    “Our analyses include experiments with all transformation events and planting years, because the principal mechanisms and spectrum of activity of the produced Bt proteins (Cry1, Cry2, or Cry3 type proteins) remained the same.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The principal mechanisms and spectrum of activity of the produced Bt proteins (Cry1, Cry2, or Cry3 type proteins) remained the same over the period covered.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Overrepresentation of particular batches of seeds, experimental fields or regions may lead to local effects that may not be representative for Bt maize cultivation in general.

    “Furthermore, overrepresentation of particular batches of seeds, experimental fields or regions may lead to local effects that may not be representative for Bt maize cultivation in general.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Within one article, potentially the same crew of people used the same batches of seeds and the same data recording and processing methodology, which may introduce bias due to records not being independent.

    “Within one article, potentially the same crew of people used the same batches of seeds and the same data recording and processing methodology, which may introduce bias due to records not being independent.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Prior meta-analyses have emphasized data availability limitations, but the problem persists.

    “These limitations have been emphasized in prior meta-analyses [13], but the problem persists.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Wolfenbarger LL, Naranjo SE, Lundgren JG, Bitzer RJ, Watrud LS. Bt crop effects on functional guilds of non-target arthropods: a meta-analysis. PLoS ONE. 2008;3: e2118. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Such potential limited validity is not captured in our meta-analyses that use individual records as the unit of analysis.

    “Such potential limited validity, however, is not captured in our meta-analyses that use individual records as the unit of analysis.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    This review provides evidence that Bt maize represents a highly selective pest control technology with relatively few negative consequences on a wide array of taxa associated with maize production, especially when compared with the alternative use of broad-spectrum insecticides for managing Bt-targeted pests.

    “Our review provides evidence that Bt maize represents a highly selective pest control technology with relatively few negative consequences on a wide array of taxa associated with maize production, especially when compared with the alternative use of broad-spectrum insecticides for managing Bt-targeted pests.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    We cannot exclude the possibility of plot size effects on particular taxa and life stages.

    “However, we cannot exclude the possibility of plot size effects on particular taxa and life stages.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Study design and conductnone given

    The robust approach ameliorates many of the shortcomings of prior analyses, such as level of analysis, data-dependence issues, and consideration of internal and external validity.

    “The robust approach ameliorates many of the shortcomings of prior analyses, such as level of analysis, data-dependence issues, and consideration of internal and external validity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Our results largely agreed with prior meta-analyses focused on or including Bt maize.

    “Our results largely agreed with prior meta-analyses focused on or including Bt maize.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Lack of independence may occur when multiple records are derived from the same article.

    “Lack of independence also may occur when multiple records are derived from the same article.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Some SD values had to be estimated by averaging rather than by exact calculations.

    “Another limitation is the fact that some SD values had to be estimated by averaging rather than by exact calculations.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data

    To address the issue of high influence of individual articles, information on which article contributed how many records to each analysis was provided and "leave one out" analyses were performed.

    “To address the issue of high influence of individual articles, we provide information on which article contributed how many records to each analysis and we performed “leave one out” analyses (Additional file 7).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Experiments for those groups may comprise specimens or colonies placed in fields, landscape studies, experiments in cages in the glasshouse or in the laboratory, modelling studies, or feeding studies with harvested plant material.

    “Experiments for those groups may comprise specimens or colonies placed in fields, landscape studies, experiments in cages in the glasshouse or in the laboratory, modelling studies, or feeding studies with harvested plant material [11, 70–72].”
    Quote in the paperNot a substantial claim0 of 4 sources checked
    • cites [11] Duan JJ, Marvier M, Huesing JE, Dively G, Huang ZY. A meta-analysis of effects of Bt crops on honey bees (Hymenoptera: Apidae). PLoS ONE. 2008;3: e1415.

      Not checked in the free run.

    • cites [70] Malone LA, Burgess EPJ. Impact of genetically modified crops on pollinators. In: Gatehouse AMR, Ferry N, editors. Environmental impact of genetically modified crops. Wallingford: CABI; 2009. p. 199–224. source

      Not checked in the free run.

    • cites [71] Venter HJ, Bøhn T. Interactions between Bt crops and aquatic ecosystems: a review. Environ Toxicol Chem. 2016;35:2891–902. source

      Not checked in the free run.

    • cites [72] Lang A, Otto M. A synthesis of laboratory and field studies on the effects of transgenic Bacillus thuringiensis (Bt) maize on non-target Lepidoptera. Entomol Exp Appl. 2010;135:121–34. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    This review focused on population measures, such as abundance and activity density.

    “Furthermore, we focused on population measures, such as abundance and activity density.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Some evidence suggests small changes in abundance do not impact biological control function in Bt cotton.

    “For example, some evidence suggests small changes in abundance do not impact biological control function in Bt cotton [75].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [75] Naranjo SE. Long-term assessment of the effects of transgenic Bt cotton on the function of the natural enemy community. Environ Entomol. 2005;34:1211–23. source

      Not checked in the free run.

189 of 189
  • The paper relies on this without support.

    Bt maize is the most widely grown insect-resistant GM crop worldwide.

    “The current review focuses on Bt maize because (1) this crop is the most widely grown insect-resistant GM crop worldwide;”
  • The paper relies on this without support.

    Bt maize was among the first GM crops grown commercially and therefore was subject to many scientific studies.

    “(2) Bt maize was among the first GM crops grown commercially and therefore was subject to many scientific studies;”
  • The paper relies on this without support.

    Many data from European field studies have been published in the last decade, and those data are not covered by earlier works.

    “Many data from European field studies have been published in the last decade, and those data are not covered by earlier works.”
  • The paper relies on this without support.

    Transparency and availability of data and protocols was not always provided in previous reviews and meta-analyses.

    “Transparency and availability of data and protocols was not always provided in previous reviews and meta-analyses.”
  • The paper relies on this without support.

    Such a critical appraisal has not been done for previous meta-analyses or reviews of non-target field data of GM crops.

    “To our knowledge, such a critical appraisal has not been done for previous meta-analyses or reviews of non-target field data of GM crops and so no predefined scheme of how to evaluate validity was available.”
  • The paper relies on this without support.

    No established guidelines exist for specific threshold values for plot size.

    “Plot size was not covered in the critical appraisal because no established guidelines exist for specific threshold values.”
  • The paper relies on this without support.

    It was not possible to judge objectively which sampling method is suitable or unsuitable for recording a specific taxon.

    “We also did not include type and application of sampling methods in the critical appraisal because it was not possible to judge objectively which method is suitable or unsuitable for recording a specific taxon.”
  • The paper relies on this without support.

    Many articles in other languages have at least an English title and abstract.

    “All database searches were conducted with English terms only, because many articles in other languages have at least an English title and abstract.”
  • The authors state this as an assumption.

    For plot and split-field designs, the history of management was equal between Bt and non-Bt plots because plots were installed within the same field.

    “For plot and split-field designs, the history of management was assumed to be equal as plots were installed within the same field.”
  • The authors state this as an assumption.

    For meta-analyses, when authors did not mention pesticide treatments or when Bt and non-Bt plots received similar treatments, no pesticides were applied.

    “For meta-analyses, we assumed that no pesticides were applied when authors did not mention such treatments or that Bt and non-Bt plots received similar treatments.”
  • The authors state this as an assumption.

    If commercial seeds were used, sufficient Bt protein expression was assumed.

    “If commercial seeds were used, however, sufficient expression was assumed (green label).”
  • The authors state this as an assumption.

    If no information on insecticides before the start of the study was provided, no insecticides were applied.

    “If no information was provided (36% of the records, hatched area in Fig. 7), we assumed that no insecticides were applied and treated the record for this criterion as “green” for meta-analyses.”
  • The paper relies on this without support.

    Braconidae are parasitoids of insect larvae and M. cingulum is a parasitoid specialized to corn borer larvae of the genus Ostrinia, the target pests of Lepidoptera-active Bt maize.

    “Braconidae are parasitoids of insect larvae and M. cingulum is a parasitoid specialized to corn borer larvae of the genus Ostrinia, the target pests of Lepidoptera-active Bt maize.”
  • The paper relies on this without support.

    Ecological studies are not pre-registered, so it is impossible to know what proportion of conducted studies is published.

    “It has to be noted that ecological studies are not pre-registered (as common in medical science), so it is impossible to know which proportion of conducted studies is being published.”
  • The authors state this as an assumption.

    No mentioning of interventions, such as pesticide applications, indicates the lack of such interventions.

    “we decided to assume that no mentioning of interventions, such as pesticide applications, indicates the lack of such interventions.”
  • The paper relies on this without support.

    The principal mechanisms and spectrum of activity of the produced Bt proteins (Cry1, Cry2, or Cry3 type proteins) remained the same over the period covered.

    “because the principal mechanisms and spectrum of activity of the produced Bt proteins (Cry1, Cry2, or Cry3 type proteins) remained the same.”
16 of 16

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Given these caveats, the available evidence suggests that, for the species tested, risks posed by direct and immediate contact with GM crops under field-realistic conditions appear small or non-existent.

    “Given these caveats, the available evidence suggests that, for the species tested, risks posed by direct and immediate contact with GM crops under field-realistic conditions appear small or non-existent ( 5 ).”

    From Environmental impacts of genetically modified crops (2024) · cites this paper as [5]

    The Review findings report no significant effects for 36 of 39 analyzed taxa in untreated Bt-maize versus non-Bt-maize field comparisons, and the Conclusions describe effects on non-target invertebrates as small and mostly neutral. But the review concerns Bt maize and field-level outcomes that may be direct or indirect; it does not establish the risk from direct, immediate contact with GM crops generally. The indexed passages provide section labels but no page numbers. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentz = -0.8608reported p = .39 · recomputed p = .389

    “z = − 0.8608, p = .39”

1 of 1

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Significant species analysis uses fewer articles than the stated minimum

    Minor

    The paper reports an individual meta-analysis showing a significant effect for M. cingulum, but says the data came from only two articles. Its stated minimum for an individual meta-analysis is three articles.

1 of 1

Cites

Flagged first, then by citations

2 of the 61 references couldn’t be matched to a known paper.

Research works printed but not linked: 11

  1. Naranjo SE. Impact of Bt crops on non-target invertebrates and insecticide use patterns. CAB Rev. 2009;4:11.
  2. Kohl C, Craig W, Frampton GK, Garcia-Yi J, van Herck K, Kleter GA, et al. Developing a good practive for the review of evidence relevant to GMO risk assessment. IOBC WPRS Bull. 2013;97:49–56.
  3. EFSA. Explanatory note on literature searching conducted in the context of GMO applications for (renewed) market authorisation and annual post-market environmental monitoring reports on GMOs authorised in the EU market. EFSA Supp Publ. 2019;16:1614E.
  4. ISBR. 13th International symposium on the biosafety of genetically modified organisms (ISBGMO13), Westin, Cape Town, South Africa. 9–13 November 2014. https://isbr.info/ISBGMO13_. Accessed 26 Apr 2022.
  5. EC. Regulation (EC) No 1049/2001 of the European Parliament and of the Council of 30 May 2001 regarding public access to European Parliament, Council and Commission documents. Off J Eur Commun. 2001;145:43–8.
  6. Pilcher CD. Phenological, physiological, and ecological influences of transgenic Bt corn on European corn borer management. Ph.D. thesis. Iowa State University, Ames, USA. 1999.
  7. Bruck DJ, Lopez MD, Lewis LC, Prasifka JR, Gunnarson RD. Effects of transgenic Bacillus thuringiensis corn and permethrin on nontarget arthropods. J Agr Urban Entomol. 2006;23:111–24.
  8. Venditti ME, Steffey KL. Field effects of Bt corn on the impact of parasitoids and pathogens on European corn borer in Illinois. In: Van Driesche RG, editor. 1st International symposium on biological control of arthropods; 14–18 January 2002; Honolulu, Hawaii, USA. Washington: Department of Agriculture, Forest Service; 2003. p. 278–83.
  9. Delrio G, Verdinelli M, Serra G. Monitoring of pest and beneficial insect populations in summer sown Bt maize. IOBC WPRS Bull. 2004;27(3):43–8.
  10. Manachini B. Effects of transgenic corn on Lydella thompsoni Herting (Diptera: Tachinidae) parasitoid of Ostrinia nubilalis Hb. (Lepidoptera: Crambidae). Boll Zool Agraria Bachic. 2003;35:111–25.
  11. Manachini B, Lozzia GC. Studies on the effects of Bt corn expressing Cry1Ab on two parasitoids of Ostrinia nubilalis Hb. (Lepidoptera: Crambidae). IOBC-WPRS Bull. 2004;27(3):109–16.

Cited by

Sorted by citations

Authors
Meissle, M., Naranjo, S. E., & Romeis, J.
Affiliations
  • Agroscope (CH)
  • U.S. Arid Land Agricultural Research Center (US)
Corresponding author
Meissle, Michael
Venue
Environmental Evidence
Published
2022-06-06
Volume
11
Issue
1
Pages
21-21
ISSN
2047-2382 (ISSN-L)
OpenAlex
W4281658438
Cited by
41
References
61
Citations by year
2026: 8 · 2025: 12 · 2024: 10 · 2023: 7 · 2022: 4
FWCI
0.76
Type
journal article
Language
en
Open access
Locations
  • Environmental Evidence (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
Funders
Seventh Framework Programme (KBBE-2011-6-311957)
Topics
  • Life Sciences › Agricultural and Biological Sciences › Plant Science › Genetically Modified Organisms Research
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Insect Resistance and Genetics
  • Life Sciences › Agricultural and Biological Sciences › Insect Science › Insect-Plant Interactions and Control
Keywords
Bt maize, non-target organisms, insecticidal proteins, Bacillus thuringiensis, parasitoids, Ostrinia nubilalis, Nitidulidae, invertebrate abundance, predation rate, parasite prevalence, risk of bias, field trials, Lepidoptera, Braconidae

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review