An Actor-Oriented Multi-Criteria Assessment Framework to Support a Transition towards Sustainable Agricultural Systems Based on Crop Diversification
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; 14 of the 34 sources its claims cite were checked for support.
Abstract
Crop diversification represents a key lever to support the development of sustainable agri-food systems. Knowledge on trade-offs and carry over effects from different crop diversification strategies is essential to inform agricultural stakeholders of potential costs and benefits. This knowledge is limited by existing data and performance measures predominantly focused on single crops, rather than complete rotations. Moreover, sustainability performance indicators are often used for assessment purposes, rather than supporting stakeholder learning and actions. A new set of 32 indicators was developed to address these needs, and used to evaluate the environmental, economic and social sustainability of the diversified agricultural systems highlighted in the case studies, which are often characterized by data availability constraints. This approach was tested in France, Germany and Italy to determine a critical ex-post diagnosis of the existing systems, and for the assessment of ex-ante innovative scenarios. The results will be used to support these case studies in the identification and design of more sustainable agricultural systems. Although the framework is based on feasible and proxy indicators, the assessment outcomes have allowed local actors to reflect on the effects generated by the implemented crop diversification strategies. Key issues include trade-offs occurring between optimizing economic and environmental performance.
Overview
CoChat Summary
TL;DR
This paper develops an actor-oriented multi-criteria framework of 32 indicators to assess environmental, economic, and social sustainability of crop diversification strategies, co-designed in the DiverIMPACTS project using FAO-SAFA and stakeholder workshops. It applies the framework in three European case studies (France, Germany, Italy), finding context-dependent trade-offs, including economic gains with environmental costs, environmental gains with economic costs, and a win-win case.
Key findings
- The final framework comprises 19 criteria (6 economic, 11 environmental, 2 social) and 32 performance indicators, linked to FAO-SAFA themes/sub-themes and designed to capture trade-offs and carry-over effects over rotation length and space.
- In Pays de la Loire (France), the diversified “After 2016” system improved economic indicators (EY +12.95%, RGM +8.04%, SCCPcust +45.06%, SCCPsuppl +22.40%) but had environmental and social drawbacks: ACI fell to 0.39 vs 0.50 t C/ha, NBAL rose to +52.00 vs +39.60 kg N/ha, QAI rose to 2.59 vs 2.10 kg/ha, and TFI worsened (change of 58.19%).
- In Lower Saxony (Germany), the ex ante “Planned diversified system” lowered EY (130,432.50 vs 156,710.00 MJ/ha) and RGM (846.27 vs 1884.23 €/ha) but improved CDI (+33.93%), LEG (+20.00%), NWHC (+66.67%), BSOleach (+35.71%), BSOeros (+19.03%), VolAI (+70.41%), LeachAI (+26.63%), MNUGHG (+11.69%), MNUNRJ (+11.76%), FCFGHG/FCFNRJ (+50.16%), and TFI (+15.3%); QAI fell to 0.82 vs 2.85 kg/ha.
- In Sicily (Italy), the ex post organic “Wheat-hemp system” raised EY (55,936.76 vs 45,506.72 MJ/ha) and RGM (5211.71 vs 2078.58 €/ha), increased PSC (+167.92%), CDI (+70.59%), CCD (+67.00%), NWHC (+100%), PLWR (+100%), TFI (+100%), and WOL (+47.57%), but reduced ACI (0.06 vs 0.13 t C/ha) and left an N deficit (NBAL = -25.6 kg N/ha); the ex ante sulla clover scenario reduced EY (44,812.90 MJ/ha) and RGM (3,029.42 €/ha) but improved ACI to 0.11 t/ha and NBAL to -19.1 kg N/ha.
Methods
- Framework co-designed in DiverIMPACTS (2017–2022) network of 25 case studies, combining top-down FAO SAFA structure (4 pillars, 21 themes, 58 sub-themes) with bottom-up Co-Innovation Workshops; indicators selected for relevance, non-redundancy, scientific value, feasibility, indicator type, and system boundaries, with literature values, causal/proxy indicators, and qualitative information used under data constraints.
- Three case studies tested the framework: Pays de la Loire, France (63.7 ha; ex post reference before 2016 vs diversified after 2016), Lower Saxony, Germany (50 ha; ex ante current 4-year rotation vs planned 6-year diversified system), and Sicily, Italy (10 ha; ex post conventional vs organic wheat-hemp, plus ex ante sulla clover scenario).
- Data were collected via an Excel file, farmer interviews, records, and field observations; seven indicators were calculated with SYSTERRE software; results were presented as radar charts showing percentage change from the reference system, with a trade-off summary table.
Limitations
- Stated: the framework required substantial data collection, and its proxy/feasible indicators provide estimations rather than exact measures; validation with controlled field experiments (e.g., GHG emissions, soil organic carbon, N leaching) is needed. Some social aspects (life satisfaction, positive emotions) were excluded as too subjective/difficult to quantify, and actors noted WOL does not fully cover farmers’ quality of life.
- Stated: longer datasets are needed to account for annual variability, and further case studies are required to validate generality; LER and YCV could not be computed in the assessed case studies because intercropping was absent or fewer than three years of data were available. N leaching/cover crop effectiveness varies by site and requires local validation.
- Evident from the text: only three case studies were used, so findings are context-specific; ex post reference systems may be absent or rely on historical data, and some effect indicators were omitted due to data constraints, limiting coverage of certain criteria.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
9 Valid · 2 Not valid · 13 Not checked · 90 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This knowledge is limited by existing data and performance measures predominantly focused on single crops, rather than complete rotations.”
- Also stated in: § 1. Introduction · plain
“Furthermore, there is still limited knowledge relating to the synergies and trade-offs resulting from the implementation of crop diversification strategies [4,11].”
What the sources say
- Partly supportedcites [4] Kremen, 2012, Ecosystem services in biologically diversified versus conventional farming systems: Benefits, externalities, and trade-offs, Ecol. Soc. sourceExperimental — accuracy not yet measured
The Crop yield section (page unavailable) calls for comparisons of the entire basket of crops over a complete rotation rather than yield ratios from single crops, supporting the stated limitation in yield assessment. It does not specifically say that single-crop measures limit knowledge of carry-over effects or trade-offs across diversification strategies more generally. (LLM, conf=0.81)
- Partly supportedcites [11] Iverson, 2014, REVIEW: Do Polycultures Promote Win-Wins or Trade-Offs in Agricultural Ecosystem Services? A Meta-Analysis, J. Appl. Ecol. sourceExperimental — accuracy not yet measured
The Limitations section says missing secondary-crop yield data forced the analysis to use primary-crop yield, and Data Collection says crop rotations were excluded. These passages support a limitation of this meta-analysis, but they do not establish that performance measures across crop-diversification research predominantly focus on single crops rather than complete rotations, or address carry-over effects. Page numbers are not available in our copy. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“Many of these problems are specifically linked to highly specialized and simplified industrial agri-food systems dominating farming landscapes in many world regions [4,5].”
What the sources say
- Supportedcites [4] Kremen, 2012, Ecosystem services in biologically diversified versus conventional farming systems: Benefits, externalities, and trade-offs, Ecol. Soc. source
The Introduction states that diversified farming systems have been replaced by highly simplified industrial monocultures across much of the Global North and increasingly in the Global South. It links this simplification to biodiversity loss and reduced ecosystem services, and describes environmental and social harms associated with industrialized agriculture. (LLM, conf=0.93)
- Supportedcites [5] Robinson, 2018, Globalization of Agriculture, Annu. Rev. Resour. Econ. source
Section 5 (Globalized Agriculture) states that larger, well-capitalized producers 'increasingly became associated with environmental problems through degradation of traditional agricultural landscapes as a by-product of farm-based industrial processes and specialization,' listing eutrophication, soil erosion and landscape destruction plus animal-welfare and food-quality concerns. The Afterword reinforces this ('intensive monocultures produce large negative externalities that many regard as unacceptable'), and Section 6.1 links greater specialization to loss of the diversity benefits of traditional systems. The Abstract frames the paper as addressing 'the worldwide spread of productivist, specialized, industrial-style farming methods and their consequences, both positive and negative,' covering the dominance-in-many-regions element. As a review, the paper reports these findings in its own voice (crediting Foley et al. 2005 and others for the specifics), which supports the paraphrase. (LLM, conf=0.85)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Crop diversification represents a key lever to support the development of sustainable agri-food systems.”
- Also stated in: § 1. Introduction · plain
“Crop diversification has been highlighted as a key lever to promote the re-design and the sustainable development of agricultural systems [6].”
What the sources say
- Supportedcites [6] Kremen, 2012, Diversified farming systems: An agroecological, systems-based alternative to modern industrial agriculture, Ecol. Soc. source
The Introduction frames diversified farming systems as a way to contribute to a more sustainable food system. The 'Diversified Farming Systems Defined' section identifies multiple crops and crop rotations as components of those systems. Box 2 cautions that crop diversification alone may not deliver the full benefits, but the claim calls it a lever, not a sufficient solution. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Moreover, sustainability performance indicators are often used for assessment purposes, rather than supporting stakeholder learning and actions.”
- Also stated in: § 1. Introduction · plain
“Furthermore, many indicators developed for sustainability studies have been conceived and utilized for evaluation and assessment purposes (e.g., Agri-Environmental Indicators [17]), rather than to support stakeholder learning and drive their actions during the sustainability transition [18].”
What the sources say
- Not checked — no full text of the sourcecites [17] Bockstaller, 2008, Agri-Environmental Indicators to Assess Cropping and Farming Systems. A Review, Agron. Sust. Dev. source
- Supportedcites [18] Toffolini, 2016, Indicators used by farmers to design agricultural systems: A survey, Agron. Sust. Dev. source
The Introduction says indicators are mainly dedicated to impact assessment and that little is known about how they can serve farmers’ action and learning. Section 3.3.1 likewise argues that indicators are needed for learning, not assessment and evaluation alone. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, they often generate a range of negative outcomes on multiple fronts, including the widespread degradation of land, water and ecosystems, high greenhouse gas emissions, the depletion of non-renewable resources and resulting in livelihood stress for farmers around the world [1,2].”
What the sources say
- Not checked — no full text of the sourcecites [1] Frison, E. (2016). From Uniformity to Diversity: A Paradigm Shift from Industrial Agriculture to Diversified Agroecological Systems, iPES Food, International Panel of Expert on Sustainable Food Systems. source
- Partly supportedcites [2] Stehle, 2015, Agricultural insecticides threaten surface waters at the global scale, Proc. Natl. Acad. Sci. USA sourceExperimental — accuracy not yet measured
The Significance passage says agricultural systems drive global environmental degradation and documents a threat from insecticide pollution to surface waters and aquatic biodiversity. The Results and Discussion also mentions habitat degradation, but our copy does not support the attributed claims about high greenhouse gas emissions, depletion of non-renewable resources, or livelihood stress for farmers. Page numbers are not provided in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims · 1 with their cited sources checked
Create a free account to see all 114 claims and to verify the 4 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 35
- The quote only partly states this claim. 2
Citations
Cites
Indicators for Monitoring Biodiversity: A Hierarchical Approach
NOSS, R. F. (1990) · Conservation Biology · doi:10.1111/j.1523-1739.1990.tb00309.x · Cited by 3,151 · cited 1×
“The three fundamental biodiversity hierarchic categories [30] were included in the framework: the Ecosystem/landscape Diversity (EcosDiv) criterion, the Crop diversification (or diversity between species —CropDiv) criterion and the Genetic diversification (diversity within species—GenDiv) criterion.”
Transdisciplinary research in sustainability science: Practice, principles, and challenges
Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., Swilling, M., & Thomas, C. J. (2012) · Sustainability Science · doi:10.1007/s11625-011-0149-x · Cited by 2,925 · cited 1×
“The list of indicators was co-designed in the DiverIMPACTS project by the scientific community and CSs actors, and aimed to create a learning environment to gain insights and knowledge for both parties [44] Actors were engaged from the beginning of the design process, in order to include different viewpoints and knowl…”
MethodThe Concept of a ‘Land Equivalent Ratio’ and Advantages in Yields from Intercropping
Mead, R., & Willey, R. W. (1980) · Experimental Agriculture · doi:10.1017/s0014479700010978 · Cited by 1,267 · cited 4×
“Productivity (Prod) 1.1 Energy yield (EY) EY = ∑n t = 1 ∑c i = 1 YtiKtiSti nS Yti = Yield (kg/ha d.m.) of crop i in year t; Kti = energy content (MJ/kg) in crop i in year t; Sti = area (ha) where crop i is cropped in year t; c = number of crops per year (considering all assessed fields) 1.2 Land Equivalent Ratio (LER)…”
BackgroundInfluentialAgriculture production as a major driver of the Earth system exceeding planetary boundaries
Campbell, B. M., Beare, D. J., Bennett, E. M., Hall-Spencer, J. M., Ingram, J. S. I., Jaramillo, F., Ortiz, R., Ramankutty, N., Sayer, J. A., & Shindell, D. (2017) · Ecology and Society · doi:10.5751/es-09595-220408 · Cited by 1,197 · cited 1×
“As a result, agriculture plays a major role in pushing the biosphere beyond planetary boundaries in terms of biodiversity and biogeochemical flows of nitrogen and phosphorus, and is a major contributor to climate change [3].”
BackgroundAgroecology: the science of natural resource management for poor farmers in marginal environments
Altieri, M. A. (2002) · Agriculture, Ecosystems & Environment · doi:10.1016/s0167-8809(02)00085-3 · Cited by 1,136
Kremen, C., & Miles, A. (2012) · Ecology and Society · doi:10.5751/es-05035-170440 · Cited by 1,126
Agroecology: The Ecology of Sustainable Food Systems
Gliessman, S. R. (2007) · Andalas University Repository (Andalas University) · Cited by 1,061
Tonitto, C., David, M. B., & Drinkwater, L. E. (2006) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2005.07.003 · Cited by 884 · cited 1×
“Validation in relation to local soil, climate and crop management factors is required [53,54].”
BackgroundEstimating the soil erosion cover-management factor at the European scale
Panagos, P., Borrelli, P., Meusburger, K., Alewell, C., Lugato, E., & Montanarella, L. (2015) · Land Use Policy · doi:10.1016/j.landusepol.2015.05.021 · Cited by 882
Boulay, A.-M., Bare, J., Benini, L., Berger, M., Lathuillière, M. J., Manzardo, A., Margni, M., Motoshita, M., Núñez, M., Pastor, A. V., et al. (2018) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-017-1333-8 · Cited by 849 · cited 1×
“Water withdrawal (WatWit) was measured by an indicator from the LCA community (Pressure on local water resources—PLWR), which assesses the relative pressure of water use for irrigation on local water resource in a watershed as a function of the total water use in the region [34].”
MethodAgricultural insecticides threaten surface waters at the global scale
Stehle, S., & Schulz, R. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1500232112 · Cited by 782 · cited 1×
“However, they often generate a range of negative outcomes on multiple fronts, including the widespread degradation of land, water and ecosystems, high greenhouse gas emissions, the depletion of non-renewable resources and resulting in livelihood stress for farmers around the world [1,2].”
BackgroundA Systemic Framework for Sustainability Assessment
Sala, S., Ciuffo, B., & Nijkamp, P. (2015) · Ecological Economics · doi:10.1016/j.ecolecon.2015.09.015 · Cited by 743 · cited 1×
“Broad interest in sustainability has led to a proliferation of indicators [12,13] that are often integrated in sustainability frameworks [14,15].”
BackgroundIndicators for biodiversity in agricultural landscapes: a pan‐European study
Billeter, R., Liira, J., Bailey, D., Bugter, R., Arens, P., Augenstein, I., Aviron, S., Baudry, J., Bukacek, R., Burel, F., et al. (2008) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2007.01393.x · Cited by 741 · cited 1×
“, bees, bugs) at the landscape scale [31].”
BackgroundKremen, C., Iles, A., & Bacon, C. (2012) · Ecology and Society · doi:10.5751/es-05103-170444 · Cited by 732 · cited 1×
“Crop diversification has been highlighted as a key lever to promote the re-design and the sustainable development of agricultural systems [6].”
BackgroundEcological Intensification: Bridging the Gap between Science and Practice
Kleijn, D., Bommarco, R., Fijen, T. P. M., Garibaldi, L. A., Potts, S. G., & van der Putten, W. H. (2019) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2018.11.002 · Cited by 548 · cited 1×
“However, in spite of potential ecological and economic benefits provided by crop diversification, multiple barriers to its implementation have emerged, linked to the overall functioning of the dominant agro-industrial system [9,10].”
BackgroundSAFE—A hierarchical framework for assessing the sustainability of agricultural systems
Van Cauwenbergh, N., Biala, K., Bielders, C., Brouckaert, V., Franchois, L., Garcia Cidad, V., Hermy, M., Mathijs, E., Muys, B., Reijnders, J., et al. (2007) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2006.09.006 · Cited by 513
Agronomy of fibre hemp (Cannabis sativa L.) in Europe.
Struik, P. C., Amaducci, S., Bullard, M. J., Stutterheim, N. C., Venturi, G., & Cromack, H. T. H. (2000) · Industrial Crops and Products · doi:10.1016/s0926-6690(99)00048-5 · Cited by 402 · cited 1×
“The introduction of hemp already supports farmers in this direction, thanks to the ability of this crop to suppress weeds [51,52].”
BackgroundAgroecology: The Ecology of Sustainable Food Systems, Third Edition
Gliessman, S. R. (2014) · doi:10.1201/b17881 · Cited by 401
Towards better representation of organic agriculture in life cycle assessment
van der Werf, H. M. G., Knudsen, M. T., & Cederberg, C. (2020) · Nature Sustainability · doi:10.1038/s41893-020-0489-6 · Cited by 394
Ecological services of faba bean
Köpke, U., & Nemecek, T. (2010) · Field Crops Research · doi:10.1016/j.fcr.2009.10.012 · Cited by 390
Conceptual Framework for the Transition from Conventional to Sustainable Agriculture
Hill, S. B., & MacRae, R. J. (1996) · Journal of Sustainable Agriculture · doi:10.1300/j064v07n01_07 · Cited by 331 · cited 1×
“The involved farmer already reached, in his transition pathway, an adequate input substitution level [55,56] in the organic conversion.”
BackgroundAgri-Environmental Indicators to Assess Cropping and Farming Systems. A Review
Bockstaller, C., Guichard, L., Makowski, D., Aveline, A., Girardin, P., & Plantureux, S. (2008) · Agronomy for Sustainable Development · doi:10.1051/agro:2007052 · Cited by 266 · cited 2×
“Furthermore, many indicators developed for sustainability studies have been conceived and utilized for evaluation and assessment purposes (e.g., Agri-Environmental Indicators [17]), rather than to support stakeholder learning and drive their actions during the sustainability transition [18].”
BackgroundSelf-citationBossel, H. (2002) · Conservation Ecology · doi:10.5751/es-00332-050212 · Cited by 215 · cited 1×
“According to Bossel [38], the identification of an ‘essential’ set of indicators to consider trade-offs is a difficult task.”
BackgroundIverson, A. L., Marín, L. E., Ennis, K. K., Gonthier, D. J., Connor‐Barrie, B. T., Remfert, J. L., Cardinale, B. J., & Perfecto, I. (2014) · Journal of Applied Ecology · doi:10.1111/1365-2664.12334 · Cited by 214 · cited 1×
“Furthermore, there is still limited knowledge relating to the synergies and trade-offs resulting from the implementation of crop diversification strategies [4,11].”
BackgroundComparison of methods to assess the sustainability of agricultural systems. A review
Bockstaller, C., Guichard, L., Keichinger, O., Girardin, P., Galan, M.-B., & Gaillard, G. (2009) · Agronomy for Sustainable Development · doi:10.1051/agro:2008058 · Cited by 204
Self-citationEvidence map of crop diversification strategies at the global scale
Beillouin, D., Ben-Ari, T., & Makowski, D. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4449 · Cited by 192 · cited 1×
“The temporal and spatial diversification of crops in the field and complimentary rotations can fulfil the need to produce multiple outputs while enhancing ecosystem services [7,8].”
BackgroundPrinciples of Agronomy for Sustainable Agriculture
(2016) · Springer eBooks · doi:10.1007/978-3-319-46116-8 · Cited by 190 · cited 1×
“[26] were used for the computation of this indicator.”
MethodAn indicator of pesticide environmental impact based on a fuzzy expert system
van der Werf, H. M. G., & Zimmer, C. (1998) · Chemosphere · doi:10.1016/s0045-6535(97)10194-1 · Cited by 188 · cited 3×
“1 Volatilization risk of active ingredients (VolAI) VolAI = ∑n t = 1 ∑c i = 1 ∑m j = 1 f(QAItij VRtij)S tij nS f () = aggregation function of risk and amount of active ingredient derived from Lindahl and Bockstaller [24]; QAItij = Amount of sprayed active ingredient j (g/ha) on crop i in year t = VAItik X CAItijk wher…”
BackgroundMethodAgricultural Sustainability: A Review of Concepts and Methods
Lampridi, M., Sørensen, C., & Bochtis, D. (2019) · Sustainability · doi:10.3390/su11185120 · Cited by 184 · cited 1×
“Broad interest in sustainability has led to a proliferation of indicators [12,13] that are often integrated in sustainability frameworks [14,15].”
BackgroundAssessment of potential impacts of agricultural practices on the environment
Girardin, P., Bockstaller, C., & van der Werf, H. M. G. (2000) · Environmental Impact Assessment Review · doi:10.1016/s0195-9255(99)00036-0 · Cited by 144 · cited 1×
“Experience has shown that long lists of indicators are high-performing [39,40] but impractical for real-world use in farm case studies with limited resources.”
BackgroundSelf-citationGerman, R. N., Thompson, C. E., & Benton, T. G. (2017) · Biological Reviews · doi:10.1111/brv.12251 · Cited by 144 · cited 1×
“[43] with an expert/stakeholders survey.”
Steam pretreatment of dry and ensiled industrial hemp for ethanol production
Sipos, B., Kreuger, E., Svensson, S.-E., Réczey, K., Björnsson, L., & Zacchi, G. (2010) · Biomass and Bioenergy · doi:10.1016/j.biombioe.2010.07.003 · Cited by 139 · cited 1×
“The introduction of hemp already supports farmers in this direction, thanks to the ability of this crop to suppress weeds [51,52].”
BackgroundPhosphorus indices as risk‐assessment tools in the U.S.A. and Europe—a review
Buczko, U., & Kuchenbuch, R. O. (2007) · Journal of Plant Nutrition and Soil Science · doi:10.1002/jpln.200725134 · Cited by 128 · cited 1×
“Moreover, for a better evaluation of the risks related to N leaching and P runoff to surface waters, indicators assessing soil cover during the leaching period (BSO leach) and evaluating soil erosion (BSOeros) were associated with the surface nutrient balances of N [35] and P [36].”
BackgroundPalomo-Campesino, S., González, J. A., & García-Llorente, M. (2018) · Sustainability · doi:10.3390/su10124339 · Cited by 116 · cited 1×
“The temporal and spatial diversification of crops in the field and complimentary rotations can fulfil the need to produce multiple outputs while enhancing ecosystem services [7,8].”
BackgroundAlkan Olsson, J., Bockstaller, C., Stapleton, L. M., Ewert, F., Knapen, R., Therond, O., Geniaux, G., Bellon, S., Correira, T. P., Turpin, N., et al. (2009) · Environmental Science & Policy · doi:10.1016/j.envsci.2009.01.012 · Cited by 102
Self-citationSustainability assessment framework for scenarios – SAFS
Arushanyan, Y., Ekener, E., & Moberg, Å. (2016) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2016.11.001 · Cited by 94 · cited 1×
“The list of indicators was co-designed in the DiverIMPACTS project by the scientific community and CSs actors, and aimed to create a learning environment to gain insights and knowledge for both parties [44] Actors were engaged from the beginning of the design process, in order to include different viewpoints and knowl…”
MethodSources of variability in the effectiveness of winter cover crops for mitigating N leaching
Teixeira, E. I., Johnstone, P., Chakwizira, E., de Ruiter, J. M., Malcolm, B. J., Shaw, N., Zyskowski, R. F., Khaembah, E. N., Sharp, J. M., Meenken, E. D., et al. (2016) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2016.01.019 · Cited by 93 · cited 1×
“Validation in relation to local soil, climate and crop management factors is required [53,54].”
BackgroundRobinson, G. M. (2018) · Annual Review of Resource Economics · doi:10.1146/annurev-resource-100517-023303 · Cited by 88 · cited 1×
“Many of these problems are specifically linked to highly specialized and simplified industrial agri-food systems dominating farming landscapes in many world regions [4,5].”
BackgroundIssues in evaluating sustainability of farming systems with indicators
Bockstaller, C., Feschet, P., & Angevin, F. (2015) · OCL · doi:10.1051/ocl/2014052 · Cited by 86 · cited 2×
“, VolAI; LeachAI) can be used for analysing cause–effect relations [21].”
BackgroundSelf-citationCraheix, D., Bergez, J.-É., Angevin, F., Bockstaller, C., Bohanec, M., Colomb, B., Doré, T., Fortino, G., Guichard, L., Pelzer, E., et al. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0315-0 · Cited by 70 · cited 1×
“To ensure sufficient uptake and policy impact, the relevance of such indicators to key stakeholders (farmers and other agri-food actors) should be ensured via participatory and actor-lead processes of indicator identification [19].”
BackgroundSelf-citationNoll, H.-H. (2013) · Social Indicators Research · doi:10.1007/s11205-013-0379-7 · Cited by 69 · cited 1×
“For example, the usefulness of happiness, cited by some CS actors in the course of the co-innovation workshops, or other generally subjective social indicators is still controversial in the scientific community [48].”
BackgroundTriste, L., Marchand, F., Debruyne, L., Meul, M., & Lauwers, L. (2014) · Ecology and Society · doi:10.5751/es-06789-190347 · Cited by 69
Indicators used by farmers to design agricultural systems: A survey
Toffolini, Q., Jeuffroy, M.-H., & Prost, L. (2016) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0340-z · Cited by 59 · cited 1×
“, Agri-Environmental Indicators [17]), rather than to support stakeholder learning and drive their actions during the sustainability transition [18].”
BackgroundA framework for guiding sustainability assessment and on-farm strategic decision making
Coteur, I., Marchand, F., Debruyne, L., Dalemans, F., & Lauwers, L. (2016) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2016.04.003 · Cited by 59 · cited 1×
“In any case, bringing together different types of knowledge is still challenging, as both stakeholders and researchers have to alter their way of thinking [50].”
Backgroundde Mey, K., D'Haene, K., Marchand, F., Meul, M., & Lauwers, L. (2011) · International Journal of Agricultural Sustainability · doi:10.1080/14735903.2011.582355 · Cited by 55 · cited 1×
“This stimulates awareness and process ownership [46], facilitating the acceptance of a shared and holistic concept of sustainability and interpretation of results [47].”
BackgroundFrom Industrial Agriculture to Diversified Agroecological Systems
Frison, E. (2016) · Indian Journal of Plant Genetic Resources · doi:10.5958/0976-1926.2016.00033.4 · Cited by 52
Agri-Environmental Indicators to Assess Cropping and Farming Systems: A Review
Bockstaller, C., Guichard, L., Makowski, D., Aveline, A., Girardin, P., & Plantureux, S. (2009) · Springer eBooks · doi:10.1007/978-90-481-2666-8_44 · Cited by 49
Self-citationAn indicator of pesticide leaching risk to groundwater
Lindahl, A. M. L., & Bockstaller, C. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2012.03.014 · Cited by 39 · cited 5×
“Air quality (AirQual) 15.1 Volatilization risk of active ingredients (VolAI) VolAI = ∑n t = 1 ∑c i = 1 ∑m j = 1 f(QAItij VRtij)S tij nS f () = aggregation function of risk and amount of active ingredient derived from Lindahl and Bockstaller [24]; QAItij = Amount of sprayed active ingredient j (g/ha) on crop i in year…”
MethodInfluentialSelf-citationComparison of Methods to Assess the Sustainability of Agricultural Systems: A Review
Bockstaller, C., Guichard, L., Keichinger, O., Girardin, P., Galan, M.-B., & Gaillard, G. (2009) · Springer eBooks · doi:10.1007/978-90-481-2666-8_47 · Cited by 25
Self-citationBarbier, C., Cerf, M., & Lusson, J.-M. (2015) · Activites · doi:10.4000/activites.1081 · Cited by 23
Aveline, A., Rousseau, M., Guichard, L., Laurent, M., & Bockstaller, C. (2009) · Agricultural Systems · doi:10.1016/j.agsy.2008.12.001 · Cited by 22
Self-citationUthes, S., Heyer, I., Kaiser, A., Zander, P., Bockstaller, C., Desjeux, Y., Keszthelyi, S., Kis-Csatári, E., Molnar, A., Wrzaszcz, W., et al. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2019.05.028 · Cited by 12 · cited 2×
“For the first criterion, the Treatment Frequency Index (TFI) was identified to assess indirectly the human health risks resulting from pesticide use [37].”
BackgroundSelf-citationCraheix, D., Angevin, F., Bergez, J.-É., Bockstaller, C., Colomb, B., Guichard, L., Reau, R., & Doré, T. (2012) · INRA · doi:10.17180/bx81-1x20 · Cited by 12
Self-citationVillalobos, F. J., Testi, L., Mateos, L., et al. (2016) · Springer eBooks · doi:10.1007/978-3-319-46116-8_7 · Cited by 6
ECOFARM : a research/development method for the implementation of a sustainable agriculture
Bol, V. V., & Peeters, A. (2000) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · Cited by 4
Crop diversification: obstacles and levers Study of farms and supply chains
Meynard, J.-M., Messéan, A., Charlier, A., Charrier, F., Fares, M., Bail, M. L., Savini, M.-B. M. I., & Réchauchère, O. (2013) · Unpublished · doi:10.13140/rg.2.1.3473.3287
Self-citation
Research works printed but not linked: 2
- Magurran, A.E. (2013). Measuring Biological Diversity, John Wiley & Sons.
- Sabourin, G. (2017). Etablissement d’une Liste Minimale d’Indicateurs pour l’Évaluation de la Durabilité des Systèmes de Grandes Cultures. [Bachelor’s Thesis, Université de Lorraine].
Cited by
A Systematic Review of Agricultural Sustainability Indicators
Bathaei, A., & Štreimikienė, D. (2023) · Agriculture · doi:10.3390/agriculture13020241 · Cited by 213
Silvestri, C., Silvestri, L., Piccarozzi, M., & Ruggieri, A. (2022) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-022-02032-1 · Cited by 141
“Also, Iocola et al. (2020) proposed a valuation framework based on the multi-criteria approach proposing a set of 32 indicators to support companies transitioning to a sustainable agri-food system.”
The Impact of Crop Diversification on the Economic Efficiency of Small Farms in Poland
Kurdyś-Kujawska, A., Strzelecka, A. M., & Zawadzka, D. (2021) · Agriculture · doi:10.3390/agriculture11030250 · Cited by 124
Prost, L., Martin, G., Ballot, R., Benoît, M., Bergez, J.-É., Bockstaller, C., Cerf, M., Deytieux, V., Hossard, L., Jeuffroy, M., et al. (2023) · Agronomy for Sustainable Development · doi:10.1007/s13593-022-00855-8 · Cited by 153
Self-citationSpatio-temporal design of strip cropping systems
Juventia, S. D., Norén, I. S., van Apeldoorn, D. F., Ditzler, L., & Rossing, W. A. H. (2022) · Agricultural Systems · doi:10.1016/j.agsy.2022.103455 · Cited by 84
Metadata
- Authors
- Iocola, I., Angevin, F., Bockstaller, C., Catarino, R., Curran, M., Messéan, A., Schader, C., Stilmant, D., Van Stappen, F., Vanhove, P., Ahnemann, H., Berthomier, J., Colombo, L., Dara Guccione, G., Mérot, E., Palumbo, M., Virzì, N., & Canali, S.
- Affiliations
- Consiglio per la ricerca in agricoltura e l’analisi dell’economia agraria (IT)
- INRAE-Eco-Innov, F-78850 Thiverval, Grignon, France
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR)
- Forschungsinstitut für Biologischen Landbau (CH)
- Walloon Agricultural Research Centre (BE)
- Centre wallon de Recherches agronomiques, CRA-W, 9 Rue de Liroux, 5030 Gembloux, Belgium
- Landwirtschaftskammer Niedersachsen (DE)
- Chambre Régionale d’Agriculture des Pays de la Loire CRA-PDL 9, Rue André Brouard 49000 Angers, France
- Fondazione Italiana per la Ricerca in Agricoltura Biologica e Biodinamica (IT)
- Fondazione italiana per la ricerca in agricoltura biologica e biodinamica, FIRAB, Via Pio Molajoni 76, 00159 Rome, Italy
- Research Centre for Cereal and Industrial Crops (IT)
- Corresponding author
- Iocola, Ileana
- ORCID
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2020-07-06
- Volume
- 12
- Issue
- 13
- Pages
- 5434
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W3038558466
- Cited by
- 47
- References
- 55
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 7 · 2023: 10 · 2022: 9 · 2021: 4 · 2020: 2
- FWCI
- 2.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sustainability (publishedVersion, cc-by)
- Organic Eprints (International Centre for Research in Organic Food Systems, and Research Institute of Organic Agriculture) (acceptedVersion)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- European Union’s Horizon 2020 research and innovation programme (N. 727482)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Sustainable Agricultural Systems Analysis
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Agronomic Practices and Intercropping Systems
- Physical Sciences › Environmental Science › Ecology › Agriculture Sustainability and Environmental Impact
- Keywords
- crop diversification, sustainable agriculture, multi-criteria decision making, sustainability indicators, crop rotation, agri-food systems, environmental sustainability, economic sustainability, social sustainability, trade-offs, stakeholder learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.