When experts disagree: the need to rethink indicator selection for assessing sustainability of agriculture

Nonparametric Statistics for the Behavioral Sciences

Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,281 · see citing works

A General Framework for Analyzing Sustainability of Social-Ecological Systems

Ostrom, E. (2009) · Science · doi:10.1126/science.1172133 · Cited by 8,656 · see citing works

Collaborative Governance in Theory and Practice

Ansell, C., & Gash, A. (2008) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mum032 · Cited by 8,256 · see citing works

Nonparametric statistics for the behavioral sciences

McGinn, L. C. (1957) · Journal of the Franklin Institute · doi:10.1016/0016-0032(57)90766-4 · Cited by 7,284 · see citing works

Livestock's long shadow: environmental issues and options.

Steinfeld, H., Gerber, P., Wassenaar, T., Castel, V., Rosales, M., & de Haan, C. (2006) · Agritrop (Cirad) · Cited by 4,383 · see citing works

Sustainability Science

Kates, R. W., Clark, W. C., Corell, R. W., Hall, J. M., Jaeger, C. C., Lowe, I., McCarthy, J. J., Schellnhuber, H. J., Bolin, B., Dickson, N. M., et al. (2001) · Science · doi:10.1126/science.1059386 · Cited by 2,639 · see citing works

Nonparametric Statistical Inference

(2012) · Springer eBooks · doi:10.1007/springerreference_205502 · Cited by 2,398 · see citing works

Agricultural sustainability: concepts, principles and evidence

Pretty, J. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2163 · Cited by 1,941 · cited 2× · see citing works

Challenges in the development and use of ecological indicators

Dale, V. H., & Beyeler, S. C. (2001) · Ecological Indicators · doi:10.1016/s1470-160x(01)00003-6 · Cited by 1,366 · see citing works

Money for Nothing? A Call for Empirical Evaluation of Biodiversity Conservation Investments

Ferraro, P. J., & Pattanayak, S. K. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040105 · Cited by 1,319 · see citing works

Environmentality: Technologies of Government and the Making of Subjects

Agrawal, A. (2005) · Project Muse (Johns Hopkins University) · Cited by 1,215 · see citing works

The Problem of $m$ Rankings

Kendall, M. G., & Smith, B. B. (1939) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732186 · Cited by 992 · see citing works

C HARACTERIZING AND M EASURING S USTAINABLE D EVELOPMENT

Parris, T. M., & Kates, R. W. (2003) · Annual Review of Environment and Resources · doi:10.1146/annurev.energy.28.050302.105551 · Cited by 890 · see citing works

A conceptual framework for selecting environmental indicator sets

Niemeijer, D., & de Groot, R. S. (2007) · Ecological Indicators · doi:10.1016/j.ecolind.2006.11.012 · Cited by 811 · see citing works

An adaptive learning process for developing and applying sustainability indicators with local communities

Reed, M. S., Fraser, E., & Dougill, A. J. (2006) · Ecological Economics · doi:10.1016/j.ecolecon.2005.11.008 · Cited by 788 · see citing works

Sustainability science: building a new discipline

Komiyama, H., & Takeuchi, K. (2006) · Sustainability Science · doi:10.1007/s11625-006-0007-4 · Cited by 612 · see citing works

Sustainability Indicators: measuring the immeasurable?

(2009) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe.2009.24910bae.002 · Cited by 603 · see citing works

Sustainability indicators: measuring the immeasurable?

(2008) · Choice Reviews Online · doi:10.5860/choice.46-1433 · Cited by 600 · see citing works

Environmentality

Agrawal, A. (2005) · Duke University Press eBooks · doi:10.1215/9780822386421 · Cited by 583 · see citing works

The top 100 questions of importance to the future of global agriculture

Pretty, J., Sutherland, W. J., Ashby, J., Auburn, J., Baulcombe, D., Bell, M., Bentley, J., Bickersteth, S., Brown, K., Burke, J., et al. (2010) · International Journal of Agricultural Sustainability · doi:10.3763/ijas.2010.0534 · Cited by 539 · see citing works

Nonparametric Statistical Inference

Gibbons, J. D., & Chakraborti, S. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_420 · Cited by 508 · see citing works

Is agricultural sustainability a useful concept?

Hansen, J. (1996) · Agricultural Systems · doi:10.1016/0308-521x(95)00011-s · Cited by 478 · see citing works

A pragmatist approach to transdisciplinarity in sustainability research: From complex systems theory to reflexive science

Popa, F., Guillermin, M., & Dedeurwaerdere, T. (2014) · Futures · doi:10.1016/j.futures.2014.02.002 · Cited by 438 · see citing works

Dealing with Ambivalence: Farmers' and Consumers' Perceptions of Animal Welfare in Livestock Breeding

Velde, H. T., Aarts, N., & van Woerkum, C. (2002) · Journal of Agricultural and Environmental Ethics · doi:10.1023/a:1015012403331 · Cited by 426 · see citing works

Considering the normative, systemic and procedural dimensions in indicator-based sustainability assessments in agriculture

Binder, C. R., Feola, G., & Steinberger, J. K. (2010) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2009.06.002 · Cited by 396 · see citing works

Assessing sustainability at farm-level: Lessons learned from a comparison of tools in practice

de Olde, E. M., Oudshoorn, F. W., Sørensen, C. A. G., Bokkers, E. A. M., & de Boer, I. J. M. (2016) · Ecological Indicators · doi:10.1016/j.ecolind.2016.01.047 · Cited by 339 · see citing works

Sustainability indicators for livestock farming: A review

Lebacq, T., Baret, P. V., & Stilmant, D. (2013) · Agronomy for Sustainable Development · doi:10.1007/s13593-012-0121-x · Cited by 336 · see citing works

Scope and precision of sustainability assessment approaches to food systems

Schader, C., Grenz, J., Meier, M. S., & Stolze, M. (2014) · Ecology and Society · doi:10.5751/es-06866-190342 · Cited by 286 · see citing works

Comparison of methods to assess the sustainability of agricultural systems. A review

Bockstaller, C., Guichard, L., Keichinger, O., Girardin, P., Galan, M.-B., & Gaillard, G. (2008) · Agronomy for Sustainable Development · doi:10.1051/agro:2008058 · Cited by 205 · see citing works

Communicating science in politicized environments

Lupia, A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212726110 · Cited by 192 · see citing works

MASC, a qualitative multi-attribute decision model for ex ante assessment of the sustainability of cropping systems

Sadok, W., Angevin, F., Bergez, J.-É., Bockstaller, C., Colomb, B., Guichard, L., Réau, R., Messéan, A., & Doré, T. (2009) · Agronomy for Sustainable Development · doi:10.1051/agro/2009006 · Cited by 183 · see citing works

Embedded value systems in sustainability assessment tools and their implications

Gasparatos, A. (2010) · Journal of Environmental Management · doi:10.1016/j.jenvman.2010.03.014 · Cited by 173 · see citing works

Indicators validation for the improvement of environmental and social impact quantitative assessment

Ballester, V. C., Cloquell-Ballester, V.-A., Díaz, R. M., & Siurana, M. C. S. (2005) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2005.06.002 · Cited by 170 · see citing works

Multiscale Methodological Framework to Derive Criteria and Indicators for Sustainability Evaluation of Peasant Natural Resource Management Systems

López‐Ridaura, S., van Keulen, H., van Ittersum, M. K., & Leffelaar, P. A. (2005) · Environment Development and Sustainability · doi:10.1007/s10668-003-6976-x · Cited by 164 · see citing works

Equity, Power Games, and Legitimacy: Dilemmas of Participatory Natural Resource Management

Barnaud, C., & van Paassen, A. (2013) · Ecology and Society · doi:10.5751/es-05459-180221 · Cited by 161 · see citing works

Key characteristics for tool choice in indicator-based sustainability assessment at farm level

Marchand, F., Debruyne, L., Triste, L., Gerrard, C. L., Padel, S., & Lauwers, L. (2014) · Ecology and Society · doi:10.5751/es-06876-190346 · Cited by 156 · see citing works

Scientisation vs. Civic Expertise in Environmental Governance: Eco-feminist, Eco-modern and Post-modern Responses

Bäckstrand, K. (2004) · Environmental Politics · doi:10.1080/0964401042000274322 · Cited by 149 · see citing works

Towards a systemic research methodology in agriculture: Rethinking the role of values in science

Alrøe, H. F., & Kristensen, E. S. (2002) · Agriculture and Human Values · doi:10.1023/a:1015040009300 · Cited by 140 · see citing works

Environmental Indicators for Agriculture

OECD (2001) · OECD eBooks · doi:10.1787/9789264188556-en · Cited by 140 · see citing works

Guidelines for cross‐cultural Participatory Action Research partnerships: A case study of a customary seabird harvest in New Zealand

Møller, H., O'Blyver, P., Bragg, C., Newman, J., Clucas, R., Fletcher, D., Kitson, J., McKechnie, S., Scott, D., & Administering, R. T. I. (2009) · New Zealand Journal of Zoology · doi:10.1080/03014220909510152 · Cited by 109 · see citing works

Issues in evaluating sustainability of farming systems with indicators

Bockstaller, C., Feschet, P., & Angevin, F. (2015) · OCL · doi:10.1051/ocl/2014052 · Cited by 87 · see citing works

Reflection on the development process of a sustainability assessment tool: learning from a Flemish case

Triste, L., Marchand, F., Debruyne, L., Meul, M., & Lauwers, L. (2014) · Ecology and Society · doi:10.5751/es-06789-190347 · Cited by 69 · see citing works

Clarifying the Imperative of Integration Research for Sustainable Environmental Management

Dovers, S. R. (2005) · ANU Open Research (Australian National University) · Cited by 64 · see citing works

The challenge of monitoring biodiversity in payment for environmental service interventions

Sommerville, M., Milner‐Gulland, E. J., & Jones, J. P. G. (2011) · Biological Conservation · doi:10.1016/j.biocon.2011.07.036 · Cited by 58 · see citing works

Punctuated equilibrium: reconciling theory of revolutionary and incremental change

Wollin, A. (1999) · Systems Research and Behavioral Science · doi:10.1002/(sici)1099-1743(199907/08)16:4 · Cited by 57 · see citing works

Learning through stakeholder involvement in the implementation of MOTIFS: an integrated assessment model for sustainable farming in Flanders

Mey, K. D., D’Haene, K., Marchand, F., Meul, M., & Lauwers, L. (2011) · International Journal of Agricultural Sustainability · doi:10.1080/14735903.2011.582355 · Cited by 55 · see citing works

Opportunities and challenges for multicriteria assessment of food system sustainability

Alrøe, H. F., Møller, H., Læssøe, J., & Noe, E. (2016) · Ecology and Society · doi:10.5751/es-08394-210138 · Cited by 54 · see citing works

Is there a meaningful definition of sustainability?

Owens, S. E. (2003) · Plant Genetic Resources · doi:10.1079/pgr20034 · Cited by 52 · see citing works

Generic sustainability assessment themes and the role of context: The case of Danish maize for German biogas

Gasso, V., Oudshoorn, F. W., de Olde, E. M., & Sørensen, C. A. G. (2014) · Ecological Indicators · doi:10.1016/j.ecolind.2014.10.008 · Cited by 47 · see citing works

Integrative research in the university context: Centre for Resource and Environmental Studies, the Australian National University

Wasson, R. J., & Dovers, S. R. (2005) · ANU Open Research (Australian National University) · Cited by 17 · see citing works

Are Organic Standards Sufficient to Ensure Sustainable Agriculture? Lessons From New Zealand’s ARGOS and Sustainability Dashboard Projects

Merfield, C. N., Moller, H., Manhire, J., Rosin, C., Norton, S., Carey, P. L., Hunt, L., Reid, J. D., Fairweather, J., Benge, J., et al. (2015) · Sustainable Agriculture Research · doi:10.5539/sar.v4n3p158 · Cited by 12 · see citing works

Mediated Modeling in Water Resource Dialogues Connecting Multiple Scales

van den Belt, M., & Blake, D. (2015) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.12330 · Cited by 12 · see citing works

Quantifying sustainability of dairy farms with the DAIRYMAN-sustainability-index.

Elsaesser, M., Jilg, T., Herrmann, K., et al. (2015) · Cited by 9 · see citing works

Measurement of sustainability in agriculture: A review of indicators

Latruffe, L., Diazabakana, A., Bockstaller, C., Desjeux, Y., Finn, J., Kelly, E., Ryan, M., & Uthes, S. (2016) · Studies in Agricultural Economics · doi:10.7896/j.1624 · Cited by 324 · see citing works

Agricultural Sustainability: A Review of Concepts and Methods

Lampridi, M., Sørensen, C., & Bochtis, D. (2019) · Sustainability · doi:10.3390/su11185120 · Cited by 184 · see citing works

Crafting actionable knowledge on ecological intensification: Lessons from co-innovation approaches in Uruguay and Europe

Rossing, W. A. H., Albicette, M. M., Aguerre, V., Leoni, C., Ruggia, A., & Dogliotti, S. (2021) · Agricultural Systems · doi:10.1016/j.agsy.2021.103103 · Cited by 62 · see citing works

Deconstructing criteria and assessment tools to build agri-sustainability indicators and support farmers’ decision-making process

Bonisoli, L., Galdeano-Gómez, E., & Piedra-Muñoz, L. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.02.055 · Cited by 61 · see citing works

Assessing the Sustainability Performance of Organic Farms in Denmark

De Olde, E., Oudshoorn, F., Bokkers, E., Stubsgaard, A., Sørensen, C., & De Boer, I. (2016) · Sustainability · doi:10.3390/su8090957 · Cited by 58 · see citing works

Context matters: Agronomic field monitoring and participatory research to identify criteria of farming system sustainability in South-East Asia

Lairez, J., Lopez-Ridaura, S., Jourdain, D., Falconnier, G. N., Lienhard, P., Striffler, B., Syfongxay, C., & Affholder, F. (2020) · Agricultural Systems · doi:10.1016/j.agsy.2020.102830 · Cited by 32 · see citing works

Delivering “less but better” meat in practice—a case study of a farm in agroecological transition

Resare Sahlin, K., Carolus, J., von Greyerz, K., Ekqvist, I., & Röös, E. (2022) · Agronomy for Sustainable Development · doi:10.1007/s13593-021-00737-5 · Cited by 17 · see citing works

Towards A Theoretical Integration Of Sustainability: A Literature Review And Suggested Way Forward

Bateh, J., Horner, D. H., Broadbent, A., et al. (2014) · Journal of Sustainability Management (JSM) · doi:10.19030/jsm.v2i1.8756 · Cited by 17 · see citing works

Relevance judgments between TREC and Non-TREC assessors

Al‐Maskari, A., Sanderson, M., & Clough, P. D. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390450 · Cited by 29 · see citing works

Corporate sustainability strategies: sustainability profiles and maturity levels

Baumgartner, R. J., & Ebner, D. (2010) · Sustainable Development · doi:10.1002/sd.447 · Cited by 855 · see citing works

Investigation on Relevance Ranking of Archives Information Retrieval Results

Jiang, X. (2013) · doi:10.2991/icaicte.2013.161

Group-enhanced ranking

Lin, Y., Lin, H., Xu, K., et al. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.079 · Cited by 3 · see citing works