Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study
Open accessThe DOI matches its Crossref record; 65 of the 67 references it cites were found in a registry or an index, and 1 are not checked yet; 7 of the 16 sources its claims cite were checked for support.
Abstract
Agroecological transition requires that innovative and diversified cropping systems be developed. Conducting system experiments is an approach well-suited to the analysis of performance of cropping systems when subjected to soil, weather and biotic stresses. Conducting system experiments nevertheless gives rise to methodological challenges. Using the Syppre network of experiments, consisting of five sites in France, we present an original case study that provides valuable methodological and agronomic lessons on system experiments. The innovative cropping systems tested there are based on crop diversification (including oilseeds and protein crops), as well as flexible tillage, technical innovations and optimized crop management. From a methodological standpoint, we show that (i) mixed models are adapted to a range of experimental questions and constraints; (ii) multifactorial analysis enables the characterization of relationships between performance indicators; (iii) a multisite experimental network is an efficient approach not only for answering agronomic questions, but also for addressing methodological issues. From an agronomic standpoint, we showed that reconciling multiple indicators of performance is still challenging. Overall, innovative and diversified systems improved the performance of input utilization and environmental impacts, but with lower productivity and profitability. Introducing legume crops is a promising strategy because this contributes significantly to reductions in mineral N fertilizer use, energy consumption and greenhouse gas emissions, without major trade-offs against other performance indicators. Finally, we showed that the nature of the production situation had a major influence on the performance profile. This led us to be cautious in making overall analyses especially with regard to general conclusions.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
Using the five-site French Syppre network, this paper identifies methodological issues in cropping-system experiments and applies mixed models, PCA, and clustering to compare innovative diversified systems with controls. The innovative systems generally reduced nitrogen, energy use, and GHG emissions but did not improve productivity or profitability over the first four analyzed years.
Key findings
- Productivity and profitability were generally worse in innovative systems: gross energy production was significantly lower (p<1e-03, F=17.1716), and EBITDA per human work unit was significantly lower (p=0.029, F=15.9577); direct margins with aid did not differ significantly (p=0.090), and energy efficiency and total working time were equivalent (p=0.640 and p=0.472).
- Input use and environmental impact indicators improved overall: mineral nitrogen fertilizer, total primary energy used, and total GHG emissions were significantly lower in innovative systems (p<1e-06, F=39.8222; p=0.030, F=35.2472; p<1.e-05, F=35.6729), while TFI and quantity of active pesticide ingredients were not significantly lower (p=0.101 and p=0.820).
- TFI was lower in four of five innovative systems but higher in Lauragais, where the control was a short sunflower–durum wheat rotation with low TFI; pesticide active ingredient performance was worse than TFI in some platforms.
- PCA did not link overall diversification level to a particular performance profile; production situation had a major impact. Legume proportion correlated with lower mineral nitrogen, lower primary energy, lower GHG emissions, and low TFI, but oilseed proportion could not be interpreted due to the strong production-situation effect.
Methods
- The Syppre network began in 2014 across five French locations (Picardie, Champagne, Berry, Lauragais, Béarn), each with an innovative system containing oilseed or protein crops and a control system; Béarn had three systems but only one innovative system (I2) was retained. Blocks were repeated two or three times, all crops of the rotation were present each year, and plots were 12–24 m wide and 45–75 m long.
- Experiments started in 2016, but 2016 was excluded from analysis; the four years analyzed were 2017–2020. Data were collected with SYSTERRE, and the overall dataset had no missing values.
- Mixed models tested system, year, and their interaction as fixed effects with platform and block as random effects; PCA and hierarchical clustering used 53 indicators at plot level and 47 indicators at block level, with 126 additional variables for describing classes.
Limitations
- The paper states that the analysis covers only the first four years, no system had completed its rotation, and definitive conclusions on long-term processes such as weed infestation or soil carbon sequestration require at least one rotation length; innovative systems also need time for technical learning.
- The paper reports that ex-post results differed from ex-ante evaluation: ex-ante showed an economic benefit for all five innovative systems, which was not observed here, and no progressive improvement effect was detected because year × system interaction was never significant.
- The paper states many methodological issues remain unresolved, including preceding-crop effects, missing yearly measurements, two harvests per year, biodiversity measurements, decision rules, and systems without all crops each year or without replicates; it also notes oilseed proportion could not be interpreted due to the strong production-situation effect.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures













Verification
Claims the paper makes
5 Valid · 0 Not valid · 5 Not checked · 68 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Zampieri et al. (2020) found that at country-level scale (France), production resilience increased with crop diversity but levelled-off at six crops.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Supportedcites Zampieri et al. (2020) source
The Abstract reports that the resilience indicator for French production data increases steeply with crop diversity until six crops are considered, then levels off. The Results section identifies the national-scale French analysis and describes resilience beginning to level off as the fifth and sixth crops are added. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These studies showed that the most diverse mixtures (more than 5 to 10 species) were never the best performing.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Partly supportedcites Florence et al., 2019 sourceExperimental — accuracy not yet measured
The Discussion (Diversity-stability hypothesis; page unavailable) describes cover-crop studies in which the most diverse mixture was neither the most productive nor the most stable. The paper’s Conclusions likewise find no benefit from mixing over a productive single species. Neither passage establishes that mixtures with more than 5 to 10 species were *never* the best performing across the studies invoked by the citing sentence. (LLM, conf=0.85)
- Partly supportedcites Florence and McGuire, 2020 sourceExperimental — accuracy not yet measured
Section 3.1 says the reviewed mixtures ranged from 3 to 18 species, and the Conclusions report that mixtures rarely outperformed the best monoculture. But the review compares the best mixture with the best monoculture; it does not establish that mixtures with more than 5 to 10 species were never the best-performing treatments. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites Smith et al., 2020 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Numerous studies have failed to show any benefit of species diversification in cover crops to the average performance of a range of criteria, or even on the stability of that performance (Florence et al., 2019;Florence and McGuire, 2020;Smith et al., 2020).”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Partly supportedcites Florence et al., 2019 sourceExperimental — accuracy not yet measured
The Conclusions report little evidence of a diversity benefit for weed suppression or biomass stability after controlling for biomass, and no advantage over a productive single species. But they also report that increasing diversity was associated with increased average cover crop biomass productivity. The claim's unqualified statement about no benefit to average performance therefore overstates what this paper found. (LLM, conf=0.88)
- Partly supportedcites Florence and McGuire, 2020 sourceExperimental — accuracy not yet measured
The Conclusions (p. not available) report that mixtures rarely outperformed the best monocultures across several measures, including biomass stability. However, Data analysis (p. not available) explicitly says the review compared the best-performing mixture with the best-performing monoculture, not their average performance. It therefore does not establish the claim as phrased for average performance. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites Smith et al., 2020 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Four types of methodological issues were identified: i) data entry and presentation (between agronomic question and design, Fig. 1); ii) specificity of the agronomic and statistical vocabularies (between agronomic question and analyses, Fig. 1); iii) planning of experiments; iv) specificities of system experiments.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Identification of methodological issues and methods to overcome them
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The energy efficiency of the innovative systems was not significantly different to that of the control systems.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
32 more claims
Create a free account to see all 78 claims and every source verdict.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 32
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > The planning of experiments is the key stage in answering agronomic questions
“Fig. 11.Correlation circle crossing the first two components of the principal component analysis performed on the result indicators (53 in total) averaged by blocks.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
“A second principal component analysis was conducted to study performance, using blocks as statistical units.It was based on 47 selected result indicators.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Description of the Syppre experimental network
“In each site (Fig. 2), two cropping systems were implemented: one innovative containing at least one oilseed or protein crop in the rotation; the other a control.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
“The Béarn platform tests three cropping systems (one control and two innovative) whereas other platforms only consider two.”
Citations
Cites
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Food Security: The Challenge of Feeding 9 Billion People
Godfray, H. C. J., Beddington, J. R., Crute, I. R., Haddad, L., Lawrence, D., Muir, J. F., Pretty, J., Robinson, S., Thomas, S. M., & Toulmin, C. (2010) · Science · doi:10.1126/science.1185383 · Cited by 11,943 · cited 1×
“It must ensure an adequate supply of healthy food (FAO, 2019) and feed (Godfray et al. , 2010; Foley et al. , 2011), while ensuring that farmers receive a satisfactory income.”
BackgroundMixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · cited 1×
“…representing the identi fi cation key of possible analytical methods (Gomez and Gomez, 1984; Siegel and Castellan Jr, 1988; Cady, 1991; Federer, 1999; De ’ ath, 2002; Baayen et al. , 2008; Zuur et al. , 200; 9; Dagnelie, 2012; Payne, 2015) based on three generic experimental questions (column 1).”
MethodSolutions for a cultivated planet
Foley, J. A., Ramankutty, N., Brauman, K. A., Cassidy, E. S., Gerber, J. S., Johnston, M., Mueller, N. D., O’Connell, C., Ray, D. K., West, P. C., et al. (2011) · Nature · doi:10.1038/nature10452 · Cited by 8,476 · cited 1×
“It must ensure an adequate supply of healthy food (FAO, 2019) and feed (Godfray et al. , 2010; Foley et al. , 2011), while ensuring that farmers receive a satisfactory income.”
BackgroundAgricultural sustainability and intensive production practices
Tilman, D., Cassman, K. G., Matson, P. A., Naylor, R., & Polasky, S. (2002) · Nature · doi:10.1038/nature01014 · Cited by 7,957 · cited 1×
“There is a general consensus in the literature that agroecology is the way for reconciling multiple indicators of performance in production systems (Tilman et al. , 2002; Robertson et Swinton, 2005; Malézieux, 2012; Duru et al. , 2015).”
BackgroundGlobal food demand and the sustainable intensification of agriculture
Tilman, D., Balzer, C., Hill, J., & Befort, B. L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116437108 · Cited by 7,692 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Colman (2022) · doi:10.1073/pnas · Cited by 4,370
More than 75 percent decline over 27 years in total flying insect biomass in protected areas
Hallmann, C. A., Sorg, M., Jongejans, E., Siepel, H., Hofland, N., Schwan, H., Stenmans, W., Müller, A., Sumser, H., Hörren, T., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0185809 · Cited by 3,499 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Global Water Pollution and Human Health
Schwarzenbach, R. P., Egli, T., Hofstetter, T. B., von Gunten, U., & Wehrli, B. (2010) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-100809-125342 · Cited by 2,076 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Ecosystem services and dis-services to agriculture
Zhang, W., Ricketts, T. H., Kremen, C., Carney, K., & Swinton, S. M. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2007.02.024 · Cited by 1,590 · cited 1×
“The agroecological transition is a major process, one that calls for an in-depth review of management systems, in particular for strengthening ecosystem services (Zhang et al. , 2007; Lescourret et al. , 2015; Duru et al. , 2015; Lechenet et al. , 2017).”
Background
Research works printed but not linked: 14
- Cadoux S, Sauzet G, Pruvot T, Flénet F. Diversification of cropping systems in a context of shallow soils : implementation and performances of both on-station and on-farm systems. In Messéan A, Drexler D, Heim I, Paresys L, Stilmant D, Willer H, eds. European Conference on Crop Diversification. INRA and ÖMKI Budapest, Hungary, 2019, pp. 39–40.
- De’ath, 2002, Ecology, 83, 1105
- (1) 73-86. 2009. Iterative design and evaluation of rule-based cropping systems: methodology and case studies. A review. https://doi.org/10.1051/agro:2008050 · DOI
- Dubois S, Tailleur A, Cadoux S, et al. Evaluation multicritère a priori pour aider à la conception de systèmes Syppre: Répondre aux défis de l’agriculture Concilier agronomie et écologie pour produire. In Colbach N, Angevin F, Bockstaller C, et al., eds. Projet COSAC Colloque final. hal-02791468, Paris, France 2019, pp. 36-38.
- FAO. 2019. Sustainable food and agriculture: an integrated approach, Academic Press.
- Federer WT. 1999. Statistical design and analysis for intercropping experiments volume II: three or more crops, New York: Springer.
- Gac, 2010, Version, 1, 2
- Gac, 2011, Innovations Agronomiques, INRAE, 17, 83
- Gomez KA, Gomez AA. 1984. Statistical procedure for agricultural research, 2nd ed. New York: John Wiley & Sons.
- Joly, 2010, CyberGeo : Eur J Geogr, 501, 1
- Keichinger, 2021, AE&S, 11-1, 1
- Sebillotte, 1974, Cahiers de l’ORSTOM, 24, 3
- Toqué C, Cadoux S, Pierson P, et al., SYPPRE: a project to promote innovations in arable crop prodoction mobilizing farmers and stakeholders and including co-design, ex-ante evaluation and experimentation of multiservice farming systems matching with regional challenges. In: 5th International Symposium for Farming Systems Design. Agro2015, Montpellier, France, 2015.
- Weber S, Jouy L, Angevin F, et al., SYSTERRE ®, an online tool to describe diversified cropping systems, to calculate their performances, and assess their sustainability. In Messéan A, Drexler D,Heim I, Paresys L, Stilmant D, Willer H, eds. European Conference on Crop Diversification. INRA and ÖMKI Budapest, Hungary, 2019, pp. 337–338.
Cited by
Leclère, M., Gorissen, L., Cuijpers, Y., Colombo, L., Schoonhoven-Speijer, M., & Rossing, W. A. H. (2024) · Agricultural Systems · doi:10.1016/j.agsy.2024.103985 · Cited by 18
Cimarelli, S., Goglio, P., Serpa, D., Quagliolo, C., Dorca-Preda, T., Sadhu, A., Rai, K., Roebeling, P. C., Nemecek, T., Cipolla, A. M., et al. (2025) · Ecological Indicators · doi:10.1016/j.ecolind.2025.114462 · Cited by 3
Buresi, S., Cordeau, S., Adeux, G., Deytieux, V., Amiot, R., Mosa, B., Farcy, P., Marget, P., Malleron, B., Maupetit, D., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6502446
Lefèvre, A., Husson, L., Pares, L., & Perrin, B. (2026) · Agronomy for Sustainable Development · doi:10.1007/s13593-026-01144-4
“…agroecological systems, and in setting up an experimental design that respects the coherence of these systems and the available experimental resources, and that allows the use of rigorous statistical methods to discriminate between them (Bianconi et al. 2013; Longis et al. 2024; Magne et al. 2024).”
Metadata
- Authors
- Longis, S., Cadoux, S., Toupet de Cordoue, A.-L., Tauvel, P., Estienne, M., Onzon, P., Lescourret, F., Rouillon, C., & Aubertot, J.-N.
- Affiliations
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR)
- Terres Inovia (FR)
- Arvalis - Institut du Végétal (FR)
- Plantes et systèmes de culture horticoles (FR)
- Venue
- OCL
- Publisher
- EDP Sciences
- Published
- 2024
- Volume
- 31
- Issue
- 2
- Pages
- 2
- ISSN
- 2257-6614 (ISSN-L)
- 2272-6977
- OpenAlex
- W4390961679
- Cited by
- 4
- References
- 59
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- OCL (publishedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- Springer Link (Chiba Institute of Technology) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement
- Topics
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Agronomic Practices and Intercropping Systems
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Sustainable Agricultural Systems Analysis
- Life Sciences › Agricultural and Biological Sciences › Soil Science › Soil Management and Crop Yield
- Keywords
- diversified cropping systems, crop diversification, oilseed crops, protein crops, Fabaceae, agroecological transition, mixed models, multifactorial analysis, performance indicators, nitrogen fertilizer use, greenhouse gas emissions, energy consumption, production conditions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study. https://app.cochat.ai/papers/10.1051/ocl/2023022
- The paper
- Longis, S., Cadoux, S., Toupet de Cordoue, A.-L., Tauvel, P., Estienne, M., Onzon, P., Lescourret, F., Rouillon, C., & Aubertot, J.-N. (2024). Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study. OCL. https://doi.org/10.1051/ocl/2023022
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.