Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study
Open accessThe DOI matches its Crossref record; 65 of the 67 references it cites were found in a registry or an index; 7 of the 16 sources its claims cite were checked for support.
Abstract
Agroecological transition requires that innovative and diversified cropping systems be developed. Conducting system experiments is an approach well-suited to the analysis of performance of cropping systems when subjected to soil, weather and biotic stresses. Conducting system experiments nevertheless gives rise to methodological challenges. Using the Syppre network of experiments, consisting of five sites in France, we present an original case study that provides valuable methodological and agronomic lessons on system experiments. The innovative cropping systems tested there are based on crop diversification (including oilseeds and protein crops), as well as flexible tillage, technical innovations and optimized crop management. From a methodological standpoint, we show that (i) mixed models are adapted to a range of experimental questions and constraints; (ii) multifactorial analysis enables the characterization of relationships between performance indicators; (iii) a multisite experimental network is an efficient approach not only for answering agronomic questions, but also for addressing methodological issues. From an agronomic standpoint, we showed that reconciling multiple indicators of performance is still challenging. Overall, innovative and diversified systems improved the performance of input utilization and environmental impacts, but with lower productivity and profitability. Introducing legume crops is a promising strategy because this contributes significantly to reductions in mineral N fertilizer use, energy consumption and greenhouse gas emissions, without major trade-offs against other performance indicators. Finally, we showed that the nature of the production situation had a major influence on the performance profile. This led us to be cautious in making overall analyses especially with regard to general conclusions.
Overview
CoChat Summary
TL;DR
Using the five-site French Syppre network, this paper identifies methodological issues in cropping-system experiments and applies mixed models, PCA, and clustering to compare innovative diversified systems with controls. The innovative systems generally reduced nitrogen, energy use, and GHG emissions but did not improve productivity or profitability over the first four analyzed years.
Key findings
- Productivity and profitability were generally worse in innovative systems: gross energy production was significantly lower (p<1e-03, F=17.1716), and EBITDA per human work unit was significantly lower (p=0.029, F=15.9577); direct margins with aid did not differ significantly (p=0.090), and energy efficiency and total working time were equivalent (p=0.640 and p=0.472).
- Input use and environmental impact indicators improved overall: mineral nitrogen fertilizer, total primary energy used, and total GHG emissions were significantly lower in innovative systems (p<1e-06, F=39.8222; p=0.030, F=35.2472; p<1.e-05, F=35.6729), while TFI and quantity of active pesticide ingredients were not significantly lower (p=0.101 and p=0.820).
- TFI was lower in four of five innovative systems but higher in Lauragais, where the control was a short sunflower–durum wheat rotation with low TFI; pesticide active ingredient performance was worse than TFI in some platforms.
- PCA did not link overall diversification level to a particular performance profile; production situation had a major impact. Legume proportion correlated with lower mineral nitrogen, lower primary energy, lower GHG emissions, and low TFI, but oilseed proportion could not be interpreted due to the strong production-situation effect.
Methods
- The Syppre network began in 2014 across five French locations (Picardie, Champagne, Berry, Lauragais, Béarn), each with an innovative system containing oilseed or protein crops and a control system; Béarn had three systems but only one innovative system (I2) was retained. Blocks were repeated two or three times, all crops of the rotation were present each year, and plots were 12–24 m wide and 45–75 m long.
- Experiments started in 2016, but 2016 was excluded from analysis; the four years analyzed were 2017–2020. Data were collected with SYSTERRE, and the overall dataset had no missing values.
- Mixed models tested system, year, and their interaction as fixed effects with platform and block as random effects; PCA and hierarchical clustering used 53 indicators at plot level and 47 indicators at block level, with 126 additional variables for describing classes.
Limitations
- The paper states that the analysis covers only the first four years, no system had completed its rotation, and definitive conclusions on long-term processes such as weed infestation or soil carbon sequestration require at least one rotation length; innovative systems also need time for technical learning.
- The paper reports that ex-post results differed from ex-ante evaluation: ex-ante showed an economic benefit for all five innovative systems, which was not observed here, and no progressive improvement effect was detected because year × system interaction was never significant.
- The paper states many methodological issues remain unresolved, including preceding-crop effects, missing yearly measurements, two harvests per year, biodiversity measurements, decision rules, and systems without all crops each year or without replicates; it also notes oilseed proportion could not be interpreted due to the strong production-situation effect.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures













Verification
Claims the paper makes
5 Valid · 0 Not valid · 5 Not checked · 68 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Zampieri et al. (2020) found that at country-level scale (France), production resilience increased with crop diversity but levelled-off at six crops.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Supportedcites Zampieri et al. (2020) matched to “Estimating resilience of crop production systems: From theory to practice” (2020) source
The Abstract reports that the resilience indicator for French production data increases steeply with crop diversity until six crops are considered, then levels off. The Results section identifies the national-scale French analysis and describes resilience beginning to level off as the fifth and sixth crops are added. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These studies showed that the most diverse mixtures (more than 5 to 10 species) were never the best performing.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Partly supportedcites Florence et al., 2019 matched to “Cover crop mixture diversity, biomass productivity, weed suppression, and stability” (2019) sourceExperimental — accuracy not yet measured
The Discussion (Diversity-stability hypothesis; page unavailable) describes cover-crop studies in which the most diverse mixture was neither the most productive nor the most stable. The paper’s Conclusions likewise find no benefit from mixing over a productive single species. Neither passage establishes that mixtures with more than 5 to 10 species were *never* the best performing across the studies invoked by the citing sentence. (LLM, conf=0.85)
- Partly supportedcites Florence and McGuire, 2020 matched to “Do diverse cover crop mixtures perform better than monocultures? A systematic review” (2020) sourceExperimental — accuracy not yet measured
Section 3.1 says the reviewed mixtures ranged from 3 to 18 species, and the Conclusions report that mixtures rarely outperformed the best monoculture. But the review compares the best mixture with the best monoculture; it does not establish that mixtures with more than 5 to 10 species were never the best-performing treatments. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites Smith et al., 2020 matched to “Are cover crop mixtures better at suppressing weeds than cover crop monocultures?” (2020) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Numerous studies have failed to show any benefit of species diversification in cover crops to the average performance of a range of criteria, or even on the stability of that performance (Florence et al., 2019;Florence and McGuire, 2020;Smith et al., 2020).”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Impact of diversification strategies on performance
What the sources say
- Partly supportedcites Florence et al., 2019 matched to “Cover crop mixture diversity, biomass productivity, weed suppression, and stability” (2019) sourceExperimental — accuracy not yet measured
The Conclusions report little evidence of a diversity benefit for weed suppression or biomass stability after controlling for biomass, and no advantage over a productive single species. But they also report that increasing diversity was associated with increased average cover crop biomass productivity. The claim's unqualified statement about no benefit to average performance therefore overstates what this paper found. (LLM, conf=0.88)
- Partly supportedcites Florence and McGuire, 2020 matched to “Do diverse cover crop mixtures perform better than monocultures? A systematic review” (2020) sourceExperimental — accuracy not yet measured
The Conclusions (p. not available) report that mixtures rarely outperformed the best monocultures across several measures, including biomass stability. However, Data analysis (p. not available) explicitly says the review compared the best-performing mixture with the best-performing monoculture, not their average performance. It therefore does not establish the claim as phrased for average performance. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites Smith et al., 2020 matched to “Are cover crop mixtures better at suppressing weeds than cover crop monocultures?” (2020) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Four types of methodological issues were identified: i) data entry and presentation (between agronomic question and design, Fig. 1); ii) specificity of the agronomic and statistical vocabularies (between agronomic question and analyses, Fig. 1); iii) planning of experiments; iv) specificities of system experiments.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Identification of methodological issues and methods to overcome them
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The energy efficiency of the innovative systems was not significantly different to that of the control systems.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
32 more claims
Create a free account to see all 78 claims and every source verdict.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 32
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > The planning of experiments is the key stage in answering agronomic questions
“Fig. 11.Correlation circle crossing the first two components of the principal component analysis performed on the result indicators (53 in total) averaged by blocks.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
“A second principal component analysis was conducted to study performance, using blocks as statistical units.It was based on 47 selected result indicators.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Description of the Syppre experimental network
“In each site (Fig. 2), two cropping systems were implemented: one innovative containing at least one oilseed or protein crop in the rotation; the other a control.”
§ Performance of innovative cropping systems diversified with oilseeds and protein crops: identification and resolution of methodological issues, using the Syppre experimental network as a case study > Methodological issues Solutions Actions
“The Béarn platform tests three cropping systems (one control and two innovative) whereas other platforms only consider two.”
Citations
Cites
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Food Security: The Challenge of Feeding 9 Billion People
Godfray, H. C. J., Beddington, J. R., Crute, I. R., Haddad, L., Lawrence, D., Muir, J. F., Pretty, J., Robinson, S., Thomas, S. M., & Toulmin, C. (2010) · Science · doi:10.1126/science.1185383 · Cited by 11,943 · cited 1×
“It must ensure an adequate supply of healthy food (FAO, 2019) and feed (Godfray et al. , 2010; Foley et al. , 2011), while ensuring that farmers receive a satisfactory income.”
BackgroundMixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · cited 1×
“…representing the identi fi cation key of possible analytical methods (Gomez and Gomez, 1984; Siegel and Castellan Jr, 1988; Cady, 1991; Federer, 1999; De ’ ath, 2002; Baayen et al. , 2008; Zuur et al. , 200; 9; Dagnelie, 2012; Payne, 2015) based on three generic experimental questions (column 1).”
MethodSolutions for a cultivated planet
Foley, J. A., Ramankutty, N., Brauman, K. A., Cassidy, E. S., Gerber, J. S., Johnston, M., Mueller, N. D., O’Connell, C., Ray, D. K., West, P. C., et al. (2011) · Nature · doi:10.1038/nature10452 · Cited by 8,476 · cited 1×
“It must ensure an adequate supply of healthy food (FAO, 2019) and feed (Godfray et al. , 2010; Foley et al. , 2011), while ensuring that farmers receive a satisfactory income.”
BackgroundAgricultural sustainability and intensive production practices
Tilman, D., Cassman, K. G., Matson, P. A., Naylor, R., & Polasky, S. (2002) · Nature · doi:10.1038/nature01014 · Cited by 7,957 · cited 1×
“There is a general consensus in the literature that agroecology is the way for reconciling multiple indicators of performance in production systems (Tilman et al. , 2002; Robertson et Swinton, 2005; Malézieux, 2012; Duru et al. , 2015).”
BackgroundGlobal food demand and the sustainable intensification of agriculture
Tilman, D., Balzer, C., Hill, J., & Befort, B. L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116437108 · Cited by 7,692 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Colman (2022) · doi:10.1073/pnas · Cited by 4,370
More than 75 percent decline over 27 years in total flying insect biomass in protected areas
Hallmann, C. A., Sorg, M., Jongejans, E., Siepel, H., Hofland, N., Schwan, H., Stenmans, W., Müller, A., Sumser, H., Hörren, T., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0185809 · Cited by 3,499 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Global Water Pollution and Human Health
Schwarzenbach, R. P., Egli, T., Hofstetter, T. B., von Gunten, U., & Wehrli, B. (2010) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-100809-125342 · Cited by 2,076 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Ecosystem services and dis-services to agriculture
Zhang, W., Ricketts, T. H., Kremen, C., Carney, K., & Swinton, S. M. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2007.02.024 · Cited by 1,590 · cited 1×
“The agroecological transition is a major process, one that calls for an in-depth review of management systems, in particular for strengthening ecosystem services (Zhang et al. , 2007; Lescourret et al. , 2015; Duru et al. , 2015; Lechenet et al. , 2017).”
BackgroundResilience in Agriculture through Crop Diversification: Adaptive Management for Environmental Change
Lin, B. B. (2011) · BioScience · doi:10.1525/bio.2011.61.3.4 · Cited by 1,570 · cited 3×
“…of energy and GHG emission indicators was based on emission factors, taking into account direct and indirect emissions/consumptions, de fi ned within the framework of the GESTIM project (Gac et al. , 2010, 2011), then a conversion into CO2 equivalent, all according to IPCC guidelines (IPCC, 2006).”
MethodResultLegume-based cropping systems have reduced carbon and nitrogen losses
Drinkwater, L. E., Wagoner, P., & Sarrantonio, M. (1998) · Nature · doi:10.1038/24376 · Cited by 1,186 · cited 2×
“One of these is crop diversi fi cation across time and space (Gaba et al. , 2014), for example by introducing legumes into the crop sequence (Drinkwater et al. , 1998; Plaza-Bonilla et al. , 2017) through intercropping (Duchene et al. , 2017) or maximizing soil cover (Elhakeem et al. , 2021)with…”
BackgroundPesticide residues in European agricultural soils – a hidden reality unfolded
Silva, V., Mol, H. G. J., Zomer, P., Tienstra, M., Ritsema, C. J., & Geissen, V. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.10.441 · Cited by 1,153 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Jensen, E. S., Peoples, M. B., Boddey, R. M., Gresshoff, P. M., Hauggaard-Nielsen, H., J.R. Alves, B., & Morrison, M. J. (2012) · Agronomy for Sustainable Development · doi:10.1007/s13593-011-0056-7 · Cited by 779 · cited 1×
“This con fi rms the results from numerous studies on the bene fi ts related to cropping systems that result from the introduction of legumes (Drinkwater et al. , 1998; Jensen et al. , 2012; Reckling et al. , 2016 ; Liu et al. , 2022).”
BackgroundRatnadass, A., Fernandes, P., Avelino, J., & Habib, R. (2012) · Agronomy for Sustainable Development · doi:10.1007/s13593-011-0022-4 · Cited by 775 · cited 1×
“While diversi fi cation is often considered as a major way to reconcile multiple indicators of performance (Lin, 2011; Ratnadass et al. , 2012; Gaba et al. , 2014), our results were not as de fi nitive.”
ResultDuchene, O., Vian, J.-F., & Celette, F. (2017) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2017.02.019 · Cited by 727 · cited 1×
“…time and space (Gaba et al. , 2014), for example by introducing legumes into the crop sequence (Drinkwater et al. , 1998; Plaza-Bonilla et al. , 2017) through intercropping (Duchene et al. , 2017) or maximizing soil cover (Elhakeem et al. , 2021)with cover crops (Plaza-Bonilla et al. , 2017).”
BackgroundHow to implement biodiversity-based agriculture to enhance ecosystem services: A review
Duru, M., Therond, O., Martin, G., Martin-Clouaire, R., Magne, M.-A., Justes, E., Journet, E.-P., Aubertot, J.-N., Savary, S., Bergez, J.-E., et al. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0306-1 · Cited by 659 · cited 5×
“There is a general consensus in the literature that agroecology is the way for reconciling multiple indicators of performance in production systems (Tilman et al. , 2002; Robertson et Swinton, 2005; Malézieux, 2012; Duru et al. , 2015).”
BackgroundInfluentialSelf-citationReconciling agricultural productivity and environmental integrity: a grand challenge for agriculture
Robertson, G. P., & Swinton, S. M. (2005) · Frontiers in Ecology and the Environment · doi:10.1890/1540-9295(2005)003[0038:rapaei]2.0.co;2 · Cited by 582 · cited 1×
“There is a general consensus in the literature that agroecology is the way for reconciling multiple indicators of performance in production systems (Tilman et al. , 2002; Robertson et Swinton, 2005; Malézieux, 2012; Duru et al. , 2015).”
BackgroundAnalysis of trends and agricultural drivers of farmland bird declines in North America: A review
Stanton, R. L., Morrissey, C. A., & Clark, R. G. (2018) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2017.11.028 · Cited by 537 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Farming Systems Research into the 21st Century: The New Dynamic
(2012) · Springer eBooks · doi:10.1007/978-94-007-4503-2 · Cited by 501
Rangeland Productivity and Exploitation in the Sahel
Breman, H., & de Wit, C. T. (1983) · Science · doi:10.1126/science.221.4618.1341 · Cited by 475 · cited 1×
“…of particular combinations of levers (Duru, 2013; Rosa-Schleich et al. , 2019) in different production situations, a concept that includes notably soil, climate, and landscape characteristics (see the de fi nitionproposed by Aubertot and Robin, 2013, adapted from Breman and de Wit, 1983).”
BackgroundEcological-economic trade-offs of Diversified Farming Systems – A review
Rosa-Schleich, J., Loos, J., Mußhoff, O., & Tscharntke, T. (2019) · Ecological Economics · doi:10.1016/j.ecolecon.2019.03.002 · Cited by 397 · cited 4×
“Rosa-Schleich et al. (2019) showed that the trade-off between ecological and economic indicators of performance was frequent in the short term and reported many examples of improved productivity and pro fi tability over the longer term.”
BackgroundMethodInfluentialGaba, S., Lescourret, F., Boudsocq, S., Enjalbert, J., Hinsinger, P., Journet, E.-P., Navas, M.-L., Wery, J., Louarn, G., Malézieux, E., et al. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-014-0272-z · Cited by 366 · cited 2×
“One of these is crop diversi fi cation across time and space (Gaba et al. , 2014), for example by introducing legumes into the crop sequence (Drinkwater et al. , 1998; Plaza-Bonilla et al. , 2017) through intercropping (Duchene et al. , 2017) or maximizing soil cover (Elhakeem et al. , 2021)with…”
BackgroundResultSelf-citationBrühl, C. A., & Zaller, J. G. (2019) · Frontiers in Environmental Science · doi:10.3389/fenvs.2019.00177 · Cited by 345 · cited 1×
“Itmustalsolimititsimpactsontheenvironment(Tilman et al. , 2011; Silva et al. , 2019), biodiversity (Hallmann et al. , 2017; Stanton et al. , 2018; Brühl and Zaller, 2019) and health (Schwarzenbach et al. , 2010).”
Designing cropping systems from nature
Malézieux, E. (2012) · Agronomy for Sustainable Development · doi:10.1007/s13593-011-0027-z · Cited by 295 · cited 1×
“There is a general consensus in the literature that agroecology is the way for reconciling multiple indicators of performance in production systems (Tilman et al. , 2002; Robertson et Swinton, 2005; Malézieux, 2012; Duru et al. , 2015).”
BackgroundThe Hidden and External Costs of Pesticide Use
Bourguet, D., & Guillemaud, T. (2016) · Sustainable Agriculture Reviews · doi:10.1007/978-3-319-26777-7_2 · Cited by 265 · cited 1×
“Furthermore, economic performance should be analyzed to take into account: (i) their variability; (ii) a wider range of economic drivers, not only input prices, agricultural product prices, labor costs, but also the costs of all negative externalities (Bourguet and Guillemaud, 2016).”
BackgroundLes types de climats en France, une construction spatiale
Joly, D., Brossard, T., Cardot, H., Cavailhes, J., Hilal, M., & Wavresky, P. (2010) · Cybergeo · doi:10.4000/cybergeo.23155 · Cited by 253
Vereijken, P. (1997) · European Journal of Agronomy · doi:10.1016/s1161-0301(97)00039-7 · Cited by 252 · cited 1×
“Regarding the innovative cropping systems, their design was carried out according to the de novo design method (Meynard et al. , 2012), based on a prototyping process (Vereijken, 1997) conducted in workshops.”
MethodLe Gal, P.-Y., Dugué, P., Faure, G., & Novak, S. (2011) · Agricultural Systems · doi:10.1016/j.agsy.2011.07.007 · Cited by 230 · cited 1×
“There is a need to develop support approaches based on scienti fi c knowledge to support farmers in the re-design of tailor-made systems adapted to their own situations (Le Gal et al. , 2011; Duru et al. , 2015).”
BackgroundNilin, J., Pestana, J. L. T., Ferreira, N. G., et al. (2012) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.1016/j.scitotenv · Cited by 208
Trade-Offs between Economic and Environmental Impacts of Introducing Legumes into Cropping Systems
Reckling, M., Bergkvist, G., Watson, C. A., Stoddard, F. L., Zander, P. M., Walker, R. L., Pristeri, A., Toncea, I., & Bachinger, J. (2016) · Frontiers in Plant Science · doi:10.3389/fpls.2016.00669 · Cited by 197 · cited 1×
“This con fi rms the results from numerous studies on the bene fi ts related to cropping systems that result from the introduction of legumes (Drinkwater et al. , 1998; Jensen et al. , 2012; Reckling et al. , 2016 ; Liu et al. , 2022).”
BackgroundRe-design and co-design of farming systems. An overview of methods and practices
Meynard, J.-M., Dedieu, B., & Bos, A. P. (2012) · Farming Systems Research into the 21st Century: The New Dynamic · doi:10.1007/978-94-007-4503-2_18 · Cited by 187 · cited 3×
“…agroecosystem is available (Lamanda et al. , 2012) and the design of cropping and/or livestock systems is now well documented (Boif fi n et al. , 2001; Meynard et al. , 2012; Martin et al. , 2013), there is little information in the literature on the design of experimental plans for system…”
BackgroundMethodReconciling Pesticide Reduction with Economic and Environmental Sustainability in Arable Farming
Lechenet, M., Bretagnolle, V., Bockstaller, C., Boissinot, F., Petit, M.-S., Petit, S., & Munier-Jolain, N. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0097922 · Cited by 183 · cited 1×
“In their study, Lechenet et al. (2014) did not detect any correlation between the intensity of pesticide use and either productivity or pro fi tability.”
BackgroundDiversifying crop rotations enhances agroecosystem services and resilience
Liu, C., Plaza‐Bonilla, D., Coulter, J. A., Kutcher, H. R., Beckie, H. J., Wang, L., Floc’h, J.-B., Hamel, C., Siddique, K. H. M., Li, L., et al. (2022) · Advances in agronomy · doi:10.1016/bs.agron.2022.02.007 · Cited by 171
Pesticide Load—A new Danish pesticide risk indicator with multiple applications
Kudsk, P., Jørgensen, L. N., & Ørum, J. E. (2018) · Land Use Policy · doi:10.1016/j.landusepol.2017.11.010 · Cited by 145 · cited 1×
“TFI expresses the frequency of pesticide treatments and is often considered as a proxy for a pesticide risk indicator (Kudsk et al. , 2018).”
BackgroundFarming system design to feed the changing world. A review
Martin, G., Martin-Clouaire, R., & Duru, M. (2013) · Agronomy for Sustainable Development · doi:10.1007/s13593-011-0075-4 · Cited by 144 · cited 2×
“Research and development activities do consider these challenges (Schiere et al. , 1999; Martin et al. , 2013).”
BackgroundPlaza‐Bonilla, D., Nolot, J., Raffaillac, D., & Justes, É. (2016) · European Journal of Agronomy · doi:10.1016/j.eja.2016.05.010 · Cited by 136 · cited 2×
“…time and space (Gaba et al. , 2014), for example by introducing legumes into the crop sequence (Drinkwater et al. , 1998; Plaza-Bonilla et al. , 2017) through intercropping (Duchene et al. , 2017) or maximizing soil cover (Elhakeem et al. , 2021)with cover crops (Plaza-Bonilla et al. , 2017).”
BackgroundDo diverse cover crop mixtures perform better than monocultures? A systematic review
Florence, A. M., & McGuire, A. M. (2020) · Agronomy Journal · doi:10.1002/agj2.20340 · Cited by 122 · cited 1×
“Numerous studies have failed to show any bene fi t of species diversi fi cation in cover crops to the average performance of a range of criteria, or even on the stability of that performance (Florence et al. , 2019; Florence and McGuire, 2020; Smith et al. , 2020).”
BackgroundDebaeke, P., Munier-Jolain, N. M., Bertrand, M., Guichard, L., Nolot, J., Faloya, V., & Saulas, P. (2008) · Agronomy for Sustainable Development · doi:10.1051/agro:2008050 · Cited by 121 · cited 1×
“Following Debaeke et al. (2009), once a consistent set of decision rules to trigger technical operations had been formulated, the two cropping systems were implemented in each of the fi ve experiments.”
MethodEstimating resilience of crop production systems: From theory to practice
Zampieri, M., Weissteiner, C. J., Grizzetti, B., Toreti, A., van den Berg, M., & Dentener, F. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.139378 · Cited by 113 · cited 1×
“Zampieri et al. (2020) found that at country-level scale (France), production resilience increased with crop diversity but levelled-off at six crops.”
BackgroundCover crop mixture diversity, biomass productivity, weed suppression, and stability
Florence, A. M., Higley, L. G., Drijber, R. A., Francis, C. A., & Lindquist, J. L. (2019) · PLOS ONE · doi:10.1371/journal.pone.0206195 · Cited by 99 · cited 1×
“Numerous studies have failed to show any bene fi t of species diversi fi cation in cover crops to the average performance of a range of criteria, or even on the stability of that performance (Florence et al. , 2019; Florence and McGuire, 2020; Smith et al. , 2020).”
BackgroundAre cover crop mixtures better at suppressing weeds than cover crop monocultures?
Smith, R. G., Warren, N. D., & Cordeau, S. (2020) · Weed Science · doi:10.1017/wsc.2020.12 · Cited by 89 · cited 2×
“Smith et al. (2020) explained these results by the fact that the more diverse the mixture, the more the share of the best performing species is reduced, at the expense of the overall performance of the mixture.”
BackgroundZuur, A. F., Ieno, E. N., Walker, N. J., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for biology and health · doi:10.1007/978-0-387-87458-6_1 · Cited by 85
Aubertot, J., & Robin, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073202 · Cited by 69 · cited 1×
“…of particular combinations of levers (Duru, 2013; Rosa-Schleich et al. , 2019) in different production situations, a concept that includes notably soil, climate, and landscape characteristics (see the de fi nitionproposed by Aubertot and Robin, 2013, adapted from Breman and de Wit, 1983).”
BackgroundSelf-citationBonnet, C., Gaudio, N., Alletto, L., Raffaillac, D., Bergez, J.-É., Debaeke, P., Gavaland, A., Willaume, M., Bedoussac, L., & Justes, É. (2021) · Agronomy for Sustainable Development · doi:10.1007/s13593-021-00719-7 · Cited by 62 · cited 2×
“The innovative cropping systems being tested were very diversi fi ed in comparison to those in other studies ( e.g. , Bonnet et al. , 2021) and relative to the control systems.”
MethodResultCombining diversification practices to enhance the sustainability of conventional cropping systems
Viguier, L., Cavan, N., Bockstaller, C., Cadoux, S., Corre-Hellou, G., Dubois, S., Duval, R., Keichinger, O., Toqué, C., Toupet de Cordoue, A.-L., et al. (2021) · European Journal of Agronomy · doi:10.1016/j.eja.2021.126279 · Cited by 61 · cited 2×
“Inordertoaddressboththeagronomicandthe methodologicalissues,thispaperusesacasestudybased onadatasetobtainedfromamultisitenetworksystem experimentimplementedwithintheFrenchprojectnamed Syppre(Tauvel et al. , 2019; Viguier et al. , 2021).”
BackgroundResultSelf-citationPunctuated equilibrium: reconciling theory of revolutionary and incremental change
Wollin, A. (1999) · Systems Research and Behavioral Science · doi:10.1002/(sici)1099-1743(199907/08)16:4<375::aid-sres254>3.0.co;2-q · Cited by 57
Lechenet, M., Deytieux, V., Antichi, D., Aubertot, J.-N., Bàrberi, P., Bertrand, M., Cellier, V., Charles, R., Colnenne-David, C., Dachbrodt-Saaydeh, S., et al. (2017) · European Journal of Agronomy · doi:10.1016/j.eja.2016.09.012 · Cited by 57 · cited 2×
“Due to lack of space, cropping systems are often tested solely in terms of their temporal dimension (Lechenet et al. , 2017), which requires experimenters to wait until the end of a rotation to conclude on the performance of the cropping systems being tested.”
BackgroundSelf-citationA dataset of meta-analyses on crop diversification at the global scale
Beillouin, D., Ari, T. B., & Makowski, D. (2019) · Data in Brief · doi:10.1016/j.dib.2019.103898 · Cited by 54 · cited 1×
“This result underlines the importance of considering local production conditions when explaining performance and the capacity of systems to reconcile multiple indicators of performance, as already highlighted by Beillouin et al. (2019) and Duru et al. (2015).”
BackgroundCropping systems for the future.
Boiffin, J., Malézieux, É., & Picard, D. (2001) · CABI Publishing eBooks · doi:10.1079/9780851995304.0261 · Cited by 41 · cited 1×
“…conceptualizing the agroecosystem is available (Lamanda et al. , 2012) and the design of cropping and/or livestock systems is now well documented (Boif fi n et al. , 2001; Meynard et al. , 2012; Martin et al. , 2013), there is little information in the literature on the design of experimental…”
BackgroundLamanda, N., Roux, S., Delmotte, S., Mérot, A., Rapidel, B., Adam, M., & Wéry, J. (2011) · European Journal of Agronomy · doi:10.1016/j.eja.2011.07.004 · Cited by 41 · cited 1×
“However, although a method for conceptualizing the agroecosystem is available (Lamanda et al. , 2012) and the design of cropping and/or livestock systems is now well documented (Boif fi n et al. , 2001; Meynard et al. , 2012; Martin et al. , 2013), there is little information in the literature on…”
MethodExperimental Design and Data Management of Rotation Experiments
Cady, F. B. (1991) · Agronomy Journal · doi:10.2134/agronj1991.00021962008300010014x · Cited by 39 · cited 1×
“Simpli fi ed table representing the identi fi cation key of possible analytical methods (Gomez and Gomez, 1984; Siegel and Castellan Jr, 1988; Cady, 1991; Federer, 1999; De ’ ath, 2002; Baayen et al. , 2008; Zuur et al. , 200; 9; Dagnelie, 2012; Payne, 2015) based on three generic experimental…”
MethodAgroecological Crop Protection
Deguine, J.-P. (. )., Gloanec, C. (. )., Laurent, P. (. )., et al. (2017) · Springer eBooks · doi:10.1007/978-94-024-1185-0 · Cited by 39 · cited 1×
“Indeed, innovative systems require time for technical learning (Colnenne-David et al. , 2017) and the effects of strategies implemented to suppress weeds, animal pests and diseases are only gradual (Deguine et al. , 2017; Liu et al. , 2022).”
BackgroundSelf-citationVereijken, P. (1997) · Developments in crop science · doi:10.1016/s0378-519x(97)80029-3 · Cited by 33
Radiation interception and radiation use efficiency in mixtures of winter cover crops
Elhakeem, A., van der Werf, W., & Bastiaans, L. (2021) · Field Crops Research · doi:10.1016/j.fcr.2020.108034 · Cited by 28 · cited 1×
“…time and space (Gaba et al. , 2014), for example by introducing legumes into the crop sequence (Drinkwater et al. , 1998; Plaza-Bonilla et al. , 2017) through intercropping (Duchene et al. , 2017) or maximizing soil cover (Elhakeem et al. , 2021)with cover crops (Plaza-Bonilla et al. , 2017).”
BackgroundLescourret, F., Dutoit, T., Rey, F., Côté, F., Hamelin, M., & Lichtfouse, É. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0335-9 · Cited by 28 · cited 1×
“The agroecological transition is a major process, one that calls for an in-depth review of management systems, in particular for strengthening ecosystem services (Zhang et al. , 2007; Lescourret et al. , 2015; Duru et al. , 2015; Lechenet et al. , 2017).”
BackgroundSelf-citationColnenne‐David, C., Grandeau, G., Jeuffroy, M., & Doré, T. (2017) · Field Crops Research · doi:10.1016/j.fcr.2017.05.009 · Cited by 22 · cited 2×
“…as previously detailed, by the time needed to attain mastery of innovative cropping systems and bene fi ts from their cumulative effects, as well as by a tendency to overestimate the performance of diversi fi cation crops in the ex-ante hypotheses, as observed by Colnenne-David et al. (2017).”
BackgroundPractical lessons for successful long-term cropping systems experiments
Schillinger, W. F. (2011) · Renewable Agriculture and Food Systems · doi:10.1017/s1742170510000359 · Cited by 15 · cited 2×
“System experimenters encounter methodological problems (Schillinger 2011; Bianconi et al. , 2013) that are not well formalized and which can hamper experiments.”
BackgroundSysteme de culture, un concept operatoire pour les agronomes.
Sébillotte, M. (1990) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 12
Methodological Difficulties of Conducting Agroecological Studies from a Statistical Perspective
Bianconi, A., Dalgaard, T., Manly, B. F. J., Govone, J. S., Watts, M. J., Nkala, P., Habermann, G., Huang, Y., & Serapião, A. B. S. (2013) · Agroecology and Sustainable Food Systems · doi:10.1080/10440046.2012.712941 · Cited by 8 · cited 2×
“System experimenters encounter methodological problems (Schillinger 2011; Bianconi et al. , 2013) that are not well formalized and which can hamper experiments.”
BackgroundThe origins of the European IFSA: the first meetings and the agenda renewal
Brossier, J., Contini, C., Zorini, L. O., & Cristóvão, A. (2012) · Farming Systems Research into the 21st Century: The New Dynamic · doi:10.1007/978-94-007-4503-2_2 · Cited by 7 · cited 1×
“Sincethe1960s,systemapproachhasbeenusedinagricultural sciences to assess the feasibility and performance of complete management systems (Brossier et al. , 2012), sometimes also with the objective of better understanding the interactions within agroecosystems(Doré etal.”
BackgroundCros, M., Aubertot, J., Gaba, S., et al. (2021) · Theoretical Population Biology · doi:10.1016/j.tpb.2021.06.002 · Cited by 7
Self-citationCover crop mixture diversity, biomass productivity, weed suppression, and stabilityPreprint
Florence, A. M., Higley, L. G., Drijber, R. A., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/440180 · Cited by 6
Keichinger, O., Viguier, L., Corre-Hellou, G., Messéan, A., Angevin, F., & Bockstaller, C. (2021) · Zenodo · doi:10.5281/zenodo.5549720 · Cited by 3
Agroecological Transition Keys
Deguine, J., Gloanec, C., Laurent, P., Ratnadass, A., & Aubertot, J. (2017) · Springer eBooks · doi:10.1007/978-94-024-1185-0_5 · Cited by 2
Self-citationPesticides in the Environment and Harmonized Risk Indicators
Vasilachi, I. C., Tapciuc, L., Chelaru, G.-M. F., Asiminicesei, D.-M., Rsca, M., Cozma, P., Comanta-Ungureanu, E.-D., Smaranda, C., Hlihor, R. M., Ferţu, D. I., et al. (2020) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb50910.2020.9280252 · Cited by 2
Tauvel, P., Cordoue, D., Cadoux, S., Duval, R., Toqué, C., & Tailleur, A. (2019) · Unpublished · doi:10.13140/rg.2.2.19714.63681 · Cited by 2
Self-citation
Research works printed but not linked: 13
- 13. Cadoux S, Sauzet G, Pruvot T, Flénet F. Diversification of cropping systems in a context of shallow soils : implementation and performances of both on-station and on-farm systems. In Messéan A, Drexler D, Heim I, Paresys L, Stilmant D, Willer H, eds. European Conference on Crop Diversification. INRA and ÖMKI Budapest, Hungary, 2019, pp. 39-40.
- 17. Dagnelie P. 2012. Principes d'expérimentation. Planification des expériences et analyse de leurs résultats. Gembloux, Belgique: Les Presses agronomiques de Gembloux, A.S.B.L. De'ath G. 2002. Multivariate regression trees: a new technique for modeling species-environment relationships. Ecology 83: 1105- 1117.
- 18. Debaeke P, Munier-Jolain N, Bertrand M, Guichard L, Nolot JM, Saulas P. 2009. Agronony for Sustainable Development 29 (1) 73- 86. 2009. Iterative design and evaluation of rule-based cropping systems: methodology and case studies. A review. https://doi.org/ 10.1051/agro:2008050 · DOI
- 24. Dubois S, Tailleur A, Cadoux S, et al. Evaluation multicritère a priori pour aider à la conception de systèmes Syppre: Répondre aux défis de l'agriculture Concilier agronomie et écologie pour produire. In Colbach N, Angevin F, Bockstaller C, et al., eds. Projet COSAC Colloque final. hal-02791468, Paris, France 2019, pp. 36-38.
- FAO. 2019. Sustainable food and agriculture: an integrated approach, Academic Press.
- 28. Federer WT. 1999. Statistical design and analysis for intercropping experiments volume II: three or more crops, New York: Springer.
- 33. Gac A, Deltour L, Cariolle M, et al., 2010. GES'TIM. Guide méthodologique pour l'estimation des impacts des activités agricoles sur l'effet de serre. Version 1. 2. Gac A, Cariolle M, Deltour L, et al., 2011. GES'TIM À des apports pour l'évaluation environnementale des activités agricoles. Innovations Agronomiques, INRAE 17: 83-94.
- Gac, 2011, Innovations Agronomiques, INRAE, 17, 83
- 35. Gomez KA, Gomez AA. 1984. Statistical procedure for agricultural research, 2nd ed. New York: John Wiley & Sons.
- 59. Schiere JB, Lyklema J, Schakel J, Rickert KG. 1999. Evolution of farming systems and system philosophy. Syst Res Behav Sci 16.4: 375-390. https://doi.org/10.1002/(SICI)1099-1743(199907/08) 16:4%3 C375: :AID-SRES254%3 E3. 0.CO;2-Q. · doi:10.1002/(sici)1099-1743(199907/08
- 62. Sebillotte M. 1974. Agronomie et agriculture. Essai d'analyse des tâches de l'agronome. Cahiers de l'ORSTOM 24 : 3-25.
- 72. Toqué C, Cadoux S, Pierson P, et al., SYPPRE: a project to promote innovations in arable crop prodoction mobilizing farmers and stakeholders and including co-design, ex-ante evaluation and experimentation of multiservice farming systems matching with regional challenges. In: 5 th International Symposium for Farming Systems Design. Agro2015, Montpellier, France, 2015.
- 76. Weber S, Jouy L, Angevin F, et al., SYSTERRE ® , an online tool to describe diversified cropping systems, to calculate their perfor- mances, and assess their sustainability. In Messéan A, Drexler D, Heim I, Paresys L, Stilmant D, Willer H, eds. European Conference on Crop Diversification. INRA and ÖMKI Budapest, Hungary, 2019, pp. 337-338.
Cited by
Leclère, M., Gorissen, L., Cuijpers, Y., Colombo, L., Schoonhoven-Speijer, M., & Rossing, W. A. H. (2024) · Agricultural Systems · doi:10.1016/j.agsy.2024.103985 · Cited by 18
Cimarelli, S., Goglio, P., Serpa, D., Quagliolo, C., Dorca-Preda, T., Sadhu, A., Rai, K., Roebeling, P. C., Nemecek, T., Cipolla, A. M., et al. (2025) · Ecological Indicators · doi:10.1016/j.ecolind.2025.114462 · Cited by 3
Buresi, S., Cordeau, S., Adeux, G., Deytieux, V., Amiot, R., Mosa, B., Farcy, P., Marget, P., Malleron, B., Maupetit, D., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6502446
Lefèvre, A., Husson, L., Pares, L., & Perrin, B. (2026) · Agronomy for Sustainable Development · doi:10.1007/s13593-026-01144-4
“…agroecological systems, and in setting up an experimental design that respects the coherence of these systems and the available experimental resources, and that allows the use of rigorous statistical methods to discriminate between them (Bianconi et al. 2013; Longis et al. 2024; Magne et al. 2024).”
Metadata
- Authors
- Longis, S., Cadoux, S., Toupet de Cordoue, A.-L., Tauvel, P., Estienne, M., Onzon, P., Lescourret, F., Rouillon, C., & Aubertot, J.-N.
- Affiliations
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR)
- Terres Inovia (FR)
- Arvalis - Institut du Végétal (FR)
- Plantes et systèmes de culture horticoles (FR)
- Venue
- OCL
- Publisher
- EDP Sciences
- Published
- 2024
- Volume
- 31
- Issue
- 2
- Pages
- 2
- ISSN
- 2257-6614 (ISSN-L)
- 2272-6977
- OpenAlex
- W4390961679
- Cited by
- 4
- References
- 59
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- OCL (publishedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- Springer Link (Chiba Institute of Technology) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement
- Topics
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Agronomic Practices and Intercropping Systems
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Sustainable Agricultural Systems Analysis
- Life Sciences › Agricultural and Biological Sciences › Soil Science › Soil Management and Crop Yield
- Keywords
- diversified cropping systems, crop diversification, oilseed crops, protein crops, Fabaceae, agroecological transition, mixed models, multifactorial analysis, performance indicators, nitrogen fertilizer use, greenhouse gas emissions, energy consumption, production conditions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.