The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; 13 of the 34 sources its claims cite were checked for support.
An Actor-Oriented Multi-Criteria Assessment Framework to Support a Transition towards Sustainable Agricultural Systems Based on Crop Diversification
Open accessAbstract
Crop diversification represents a key lever to support the development of sustainable agri-food systems. Knowledge on trade-offs and carry over effects from different crop diversification strategies is essential to inform agricultural stakeholders of potential costs and benefits. This knowledge is limited by existing data and performance measures predominantly focused on single crops, rather than complete rotations. Moreover, sustainability performance indicators are often used for assessment purposes, rather than supporting stakeholder learning and actions. A new set of 32 indicators was developed to address these needs, and used to evaluate the environmental, economic and social sustainability of the diversified agricultural systems highlighted in the case studies, which are often characterized by data availability constraints. This approach was tested in France, Germany and Italy to determine a critical ex-post diagnosis of the existing systems, and for the assessment of ex-ante innovative scenarios. The results will be used to support these case studies in the identification and design of more sustainable agricultural systems. Although the framework is based on feasible and proxy indicators, the assessment outcomes have allowed local actors to reflect on the effects generated by the implemented crop diversification strategies. Key issues include trade-offs occurring between optimizing economic and environmental performance.
Overview
CoChat Summary
TL;DR
This paper develops an actor-oriented multi-criteria framework of 32 indicators to assess environmental, economic, and social sustainability of crop diversification strategies, co-designed in the DiverIMPACTS project using FAO-SAFA and stakeholder workshops. It applies the framework in three European case studies (France, Germany, Italy), finding context-dependent trade-offs, including economic gains with environmental costs, environmental gains with economic costs, and a win-win case.
Key findings
- The final framework comprises 19 criteria (6 economic, 11 environmental, 2 social) and 32 performance indicators, linked to FAO-SAFA themes/sub-themes and designed to capture trade-offs and carry-over effects over rotation length and space.
- In Pays de la Loire (France), the diversified “After 2016” system improved economic indicators (EY +12.95%, RGM +8.04%, SCCPcust +45.06%, SCCPsuppl +22.40%) but had environmental and social drawbacks: ACI fell to 0.39 vs 0.50 t C/ha, NBAL rose to +52.00 vs +39.60 kg N/ha, QAI rose to 2.59 vs 2.10 kg/ha, and TFI worsened (change of 58.19%).
- In Lower Saxony (Germany), the ex ante “Planned diversified system” lowered EY (130,432.50 vs 156,710.00 MJ/ha) and RGM (846.27 vs 1884.23 €/ha) but improved CDI (+33.93%), LEG (+20.00%), NWHC (+66.67%), BSOleach (+35.71%), BSOeros (+19.03%), VolAI (+70.41%), LeachAI (+26.63%), MNUGHG (+11.69%), MNUNRJ (+11.76%), FCFGHG/FCFNRJ (+50.16%), and TFI (+15.3%); QAI fell to 0.82 vs 2.85 kg/ha.
- In Sicily (Italy), the ex post organic “Wheat-hemp system” raised EY (55,936.76 vs 45,506.72 MJ/ha) and RGM (5211.71 vs 2078.58 €/ha), increased PSC (+167.92%), CDI (+70.59%), CCD (+67.00%), NWHC (+100%), PLWR (+100%), TFI (+100%), and WOL (+47.57%), but reduced ACI (0.06 vs 0.13 t C/ha) and left an N deficit (NBAL = -25.6 kg N/ha); the ex ante sulla clover scenario reduced EY (44,812.90 MJ/ha) and RGM (3,029.42 €/ha) but improved ACI to 0.11 t/ha and NBAL to -19.1 kg N/ha.
Methods
- Framework co-designed in DiverIMPACTS (2017–2022) network of 25 case studies, combining top-down FAO SAFA structure (4 pillars, 21 themes, 58 sub-themes) with bottom-up Co-Innovation Workshops; indicators selected for relevance, non-redundancy, scientific value, feasibility, indicator type, and system boundaries, with literature values, causal/proxy indicators, and qualitative information used under data constraints.
- Three case studies tested the framework: Pays de la Loire, France (63.7 ha; ex post reference before 2016 vs diversified after 2016), Lower Saxony, Germany (50 ha; ex ante current 4-year rotation vs planned 6-year diversified system), and Sicily, Italy (10 ha; ex post conventional vs organic wheat-hemp, plus ex ante sulla clover scenario).
- Data were collected via an Excel file, farmer interviews, records, and field observations; seven indicators were calculated with SYSTERRE software; results were presented as radar charts showing percentage change from the reference system, with a trade-off summary table.
Limitations
- Stated: the framework required substantial data collection, and its proxy/feasible indicators provide estimations rather than exact measures; validation with controlled field experiments (e.g., GHG emissions, soil organic carbon, N leaching) is needed. Some social aspects (life satisfaction, positive emotions) were excluded as too subjective/difficult to quantify, and actors noted WOL does not fully cover farmers’ quality of life.
- Stated: longer datasets are needed to account for annual variability, and further case studies are required to validate generality; LER and YCV could not be computed in the assessed case studies because intercropping was absent or fewer than three years of data were available. N leaching/cover crop effectiveness varies by site and requires local validation.
- Evident from the text: only three case studies were used, so findings are context-specific; ex post reference systems may be absent or rely on historical data, and some effect indicators were omitted due to data constraints, limiting coverage of certain criteria.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
9 Valid · 2 Not valid · 13 Not checked · 90 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This knowledge is limited by existing data and performance measures predominantly focused on single crops, rather than complete rotations.”
- Also stated in: § 1. Introduction · plain
“Furthermore, there is still limited knowledge relating to the synergies and trade-offs resulting from the implementation of crop diversification strategies [4,11].”
What the sources say
- Partly supportedcites [4] Kremen, 2012, Ecosystem services in biologically diversified versus conventional farming systems: Benefits, externalities, and trade-offs, Ecol. Soc. sourceExperimental — accuracy not yet measured
The Crop yield section (page unavailable) calls for comparisons of the entire basket of crops over a complete rotation rather than yield ratios from single crops, supporting the stated limitation in yield assessment. It does not specifically say that single-crop measures limit knowledge of carry-over effects or trade-offs across diversification strategies more generally. (LLM, conf=0.81)
- Partly supportedcites [11] Iverson, 2014, REVIEW: Do Polycultures Promote Win-Wins or Trade-Offs in Agricultural Ecosystem Services? A Meta-Analysis, J. Appl. Ecol. sourceExperimental — accuracy not yet measured
The Limitations section says missing secondary-crop yield data forced the analysis to use primary-crop yield, and Data Collection says crop rotations were excluded. These passages support a limitation of this meta-analysis, but they do not establish that performance measures across crop-diversification research predominantly focus on single crops rather than complete rotations, or address carry-over effects. Page numbers are not available in our copy. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Many of these problems are specifically linked to highly specialized and simplified industrial agri-food systems dominating farming landscapes in many world regions [4,5].”
What the sources say
- Supportedcites [4] Kremen, 2012, Ecosystem services in biologically diversified versus conventional farming systems: Benefits, externalities, and trade-offs, Ecol. Soc. source
The Introduction states that diversified farming systems have been replaced by highly simplified industrial monocultures across much of the Global North and increasingly in the Global South. It links this simplification to biodiversity loss and reduced ecosystem services, and describes environmental and social harms associated with industrialized agriculture. (LLM, conf=0.93)
- Not checked yetcites [5] Robinson, 2018, Globalization of Agriculture, Annu. Rev. Resour. Econ. source
Checked before — its earlier verdict is held back until a new check runs.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Crop diversification represents a key lever to support the development of sustainable agri-food systems.”
- Also stated in: § 1. Introduction · plain
“Crop diversification has been highlighted as a key lever to promote the re-design and the sustainable development of agricultural systems [6].”
What the sources say
- Supportedcites [6] Kremen, 2012, Diversified farming systems: An agroecological, systems-based alternative to modern industrial agriculture, Ecol. Soc. source
The Introduction frames diversified farming systems as a way to contribute to a more sustainable food system. The 'Diversified Farming Systems Defined' section identifies multiple crops and crop rotations as components of those systems. Box 2 cautions that crop diversification alone may not deliver the full benefits, but the claim calls it a lever, not a sufficient solution. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Moreover, sustainability performance indicators are often used for assessment purposes, rather than supporting stakeholder learning and actions.”
- Also stated in: § 1. Introduction · plain
“Furthermore, many indicators developed for sustainability studies have been conceived and utilized for evaluation and assessment purposes (e.g., Agri-Environmental Indicators [17]), rather than to support stakeholder learning and drive their actions during the sustainability transition [18].”
What the sources say
- Not checked — no full text of the sourcecites [17] Bockstaller, 2008, Agri-Environmental Indicators to Assess Cropping and Farming Systems. A Review, Agron. Sust. Dev. source
- Supportedcites [18] Toffolini, 2016, Indicators used by farmers to design agricultural systems: A survey, Agron. Sust. Dev. source
The Introduction says indicators are mainly dedicated to impact assessment and that little is known about how they can serve farmers’ action and learning. Section 3.3.1 likewise argues that indicators are needed for learning, not assessment and evaluation alone. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, they often generate a range of negative outcomes on multiple fronts, including the widespread degradation of land, water and ecosystems, high greenhouse gas emissions, the depletion of non-renewable resources and resulting in livelihood stress for farmers around the world [1,2].”
What the sources say
- Not checked — no full text of the sourcecites [1] Frison, E. (2016). From Uniformity to Diversity: A Paradigm Shift from Industrial Agriculture to Diversified Agroecological Systems, iPES Food, International Panel of Expert on Sustainable Food Systems. source
- Partly supportedcites [2] Stehle, 2015, Agricultural insecticides threaten surface waters at the global scale, Proc. Natl. Acad. Sci. USA sourceExperimental — accuracy not yet measured
The Significance passage says agricultural systems drive global environmental degradation and documents a threat from insecticide pollution to surface waters and aquatic biodiversity. The Results and Discussion also mentions habitat degradation, but our copy does not support the attributed claims about high greenhouse gas emissions, depletion of non-renewable resources, or livelihood stress for farmers. Page numbers are not provided in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims · 1 with their cited sources checked
Create a free account to see all 114 claims and to verify the 5 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 35
- The quote only partly states this claim. 2
Citations
Cites
Indicators for Monitoring Biodiversity: A Hierarchical Approach
NOSS, R. F. (1990) · Conservation Biology · doi:10.1111/j.1523-1739.1990.tb00309.x · Cited by 3,151 · cited 1×
“The three fundamental biodiversity hierarchic categories [30] were included in the framework: the Ecosystem/landscape Diversity (EcosDiv) criterion, the Crop diversification (or diversity between species —CropDiv) criterion and the Genetic diversification (diversity within species—GenDiv) criterion.”
Transdisciplinary research in sustainability science: Practice, principles, and challenges
Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., Swilling, M., & Thomas, C. J. (2012) · Sustainability Science · doi:10.1007/s11625-011-0149-x · Cited by 2,925 · cited 1×
“The list of indicators was co-designed in the DiverIMPACTS project by the scientific community and CSs actors, and aimed to create a learning environment to gain insights and knowledge for both parties [44] Actors were engaged from the beginning of the design process, in order to include different viewpoints and knowl…”
MethodThe Concept of a ‘Land Equivalent Ratio’ and Advantages in Yields from Intercropping
Mead, R., & Willey, R. W. (1980) · Experimental Agriculture · doi:10.1017/s0014479700010978 · Cited by 1,267 · cited 4×
“Productivity (Prod) 1.1 Energy yield (EY) EY = ∑n t = 1 ∑c i = 1 YtiKtiSti nS Yti = Yield (kg/ha d.m.) of crop i in year t; Kti = energy content (MJ/kg) in crop i in year t; Sti = area (ha) where crop i is cropped in year t; c = number of crops per year (considering all assessed fields) 1.2 Land Equivalent Ratio (LER)…”
BackgroundInfluentialAgriculture production as a major driver of the Earth system exceeding planetary boundaries
Campbell, B. M., Beare, D. J., Bennett, E. M., Hall-Spencer, J. M., Ingram, J. S. I., Jaramillo, F., Ortiz, R., Ramankutty, N., Sayer, J. A., & Shindell, D. (2017) · Ecology and Society · doi:10.5751/es-09595-220408 · Cited by 1,197 · cited 1×
“As a result, agriculture plays a major role in pushing the biosphere beyond planetary boundaries in terms of biodiversity and biogeochemical flows of nitrogen and phosphorus, and is a major contributor to climate change [3].”
BackgroundAgroecology: the science of natural resource management for poor farmers in marginal environments
Altieri, M. A. (2002) · Agriculture, Ecosystems & Environment · doi:10.1016/s0167-8809(02)00085-3 · Cited by 1,136
Kremen, C., & Miles, A. (2012) · Ecology and Society · doi:10.5751/es-05035-170440 · Cited by 1,126
Agroecology: The Ecology of Sustainable Food Systems
Gliessman, S. R. (2007) · Andalas University Repository (Andalas University) · Cited by 1,061
Tonitto, C., David, M. B., & Drinkwater, L. E. (2006) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2005.07.003 · Cited by 884 · cited 1×
“Validation in relation to local soil, climate and crop management factors is required [53,54].”
BackgroundEstimating the soil erosion cover-management factor at the European scale
Panagos, P., Borrelli, P., Meusburger, K., Alewell, C., Lugato, E., & Montanarella, L. (2015) · Land Use Policy · doi:10.1016/j.landusepol.2015.05.021 · Cited by 882
Boulay, A.-M., Bare, J., Benini, L., Berger, M., Lathuillière, M. J., Manzardo, A., Margni, M., Motoshita, M., Núñez, M., Pastor, A. V., et al. (2018) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-017-1333-8 · Cited by 849 · cited 1×
“Water withdrawal (WatWit) was measured by an indicator from the LCA community (Pressure on local water resources—PLWR), which assesses the relative pressure of water use for irrigation on local water resource in a watershed as a function of the total water use in the region [34].”
Method
Research works printed but not linked: 2
- Magurran, A.E. (2013). Measuring Biological Diversity, John Wiley & Sons.
- Sabourin, G. (2017). Etablissement d’une Liste Minimale d’Indicateurs pour l’Évaluation de la Durabilité des Systèmes de Grandes Cultures. [Bachelor’s Thesis, Université de Lorraine].
Cited by
A Systematic Review of Agricultural Sustainability Indicators
Bathaei, A., & Štreimikienė, D. (2023) · Agriculture · doi:10.3390/agriculture13020241 · Cited by 213
Silvestri, C., Silvestri, L., Piccarozzi, M., & Ruggieri, A. (2022) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-022-02032-1 · Cited by 141
“Also, Iocola et al. (2020) proposed a valuation framework based on the multi-criteria approach proposing a set of 32 indicators to support companies transitioning to a sustainable agri-food system.”
The Impact of Crop Diversification on the Economic Efficiency of Small Farms in Poland
Kurdyś-Kujawska, A., Strzelecka, A. M., & Zawadzka, D. (2021) · Agriculture · doi:10.3390/agriculture11030250 · Cited by 124
Prost, L., Martin, G., Ballot, R., Benoît, M., Bergez, J.-É., Bockstaller, C., Cerf, M., Deytieux, V., Hossard, L., Jeuffroy, M., et al. (2023) · Agronomy for Sustainable Development · doi:10.1007/s13593-022-00855-8 · Cited by 152
Self-citationSpatio-temporal design of strip cropping systems
Juventia, S. D., Norén, I. S., van Apeldoorn, D. F., Ditzler, L., & Rossing, W. A. H. (2022) · Agricultural Systems · doi:10.1016/j.agsy.2022.103455 · Cited by 84
Metadata
- Authors
- Iocola, I., Angevin, F., Bockstaller, C., Catarino, R., Curran, M., Messéan, A., Schader, C., Stilmant, D., Van Stappen, F., Vanhove, P., Ahnemann, H., Berthomier, J., Colombo, L., Dara Guccione, G., Mérot, E., Palumbo, M., Virzì, N., & Canali, S.
- Affiliations
- Consiglio per la ricerca in agricoltura e l’analisi dell’economia agraria (IT)
- INRAE-Eco-Innov, F-78850 Thiverval, Grignon, France
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR)
- Forschungsinstitut für Biologischen Landbau (CH)
- Walloon Agricultural Research Centre (BE)
- Centre wallon de Recherches agronomiques, CRA-W, 9 Rue de Liroux, 5030 Gembloux, Belgium
- Landwirtschaftskammer Niedersachsen (DE)
- Chambre Régionale d’Agriculture des Pays de la Loire CRA-PDL 9, Rue André Brouard 49000 Angers, France
- Fondazione Italiana per la Ricerca in Agricoltura Biologica e Biodinamica (IT)
- Fondazione italiana per la ricerca in agricoltura biologica e biodinamica, FIRAB, Via Pio Molajoni 76, 00159 Rome, Italy
- Research Centre for Cereal and Industrial Crops (IT)
- Corresponding author
- Iocola, Ileana
- ORCID
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2020-07-06
- Volume
- 12
- Issue
- 13
- Pages
- 5434
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W3038558466
- Cited by
- 47
- References
- 55
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 7 · 2023: 10 · 2022: 9 · 2021: 4 · 2020: 2
- FWCI
- 2.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sustainability (publishedVersion, cc-by)
- Organic Eprints (International Centre for Research in Organic Food Systems, and Research Institute of Organic Agriculture) (acceptedVersion)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- European Union’s Horizon 2020 research and innovation programme (N. 727482)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Sustainable Agricultural Systems Analysis
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Agronomic Practices and Intercropping Systems
- Physical Sciences › Environmental Science › Ecology › Agriculture Sustainability and Environmental Impact
- Keywords
- crop diversification, sustainable agriculture, multi-criteria decision making, sustainability indicators, crop rotation, agri-food systems, environmental sustainability, economic sustainability, social sustainability, trade-offs, stakeholder learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Actor-Oriented Multi-Criteria Assessment Framework to Support a Transition towards Sustainable Agricultural Systems Based on Crop Diversification. https://app.cochat.ai/papers/10.3390/su12135434
- The paper
- Iocola, I., Angevin, F., Bockstaller, C., Catarino, R., Curran, M., Messéan, A., Schader, C., Stilmant, D., Van Stappen, F., Vanhove, P., Ahnemann, H., Berthomier, J., Colombo, L., Dara Guccione, G., Mérot, E., Palumbo, M., Virzì, N., & Canali, S. (2020). An Actor-Oriented Multi-Criteria Assessment Framework to Support a Transition towards Sustainable Agricultural Systems Based on Crop Diversification. Sustainability. https://doi.org/10.3390/su12135434
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.