The appraisal of sustainability: Some problems and possible responses
Open accessThe DOI matches its Crossref record; 74 of the 77 references it cites were found in a registry or an index.
Abstract
The development of ‘indicators’ and associated techniques for the appraisal of ‘sustainability’ requires efforts to systematically define, quantify and aggregate many disparate dimensions of social, environmental and economic performance. This necessarily raises a number of serious theoretical and methodological difficulties, including those relating to the selection and framing of ‘problems’ and ‘options’, the treatment of deep uncertainties and the ‘impossibility’ of aggregating in analysis the divergent social interests and value judgements which govern the prioritisation of the different dimensions of ‘sustainability’. After exploring the depth and scope of some of these difficulties, this paper argues that they render futile any attempt to develop an ‘analytical fix’ for the problems of appraisal. In this light, systematic public participation is recognised not just as an issue of political efficacy and legitimacy, but also as a fundamental matter of analytical rigour. However, it is also concluded that once aspirations to the ‘analytical fix’ are renounced, there is much that might be contributed by transparent, straightforward quantitative analytical tools and the paper ends with some recommendations and an example in this regard.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Knight, F. H. (1921) · Cited by 16,535
Risk Society, Towards a New Modernity
Leiss, W., Beck, U., Ritter, M., Lash, S., & Wynne, B. (1994) · Canadian Journal of Sociology / Cahiers canadiens de sociologie · doi:10.2307/3341155 · Cited by 12,546
The Structure of Scientific Revolutions.
Bohm, D., & Kuhn, T. S. (1964) · The Philosophical Quarterly · doi:10.2307/2217783 · Cited by 9,130
Social Choice and Individual Values.
Shackle, G. L. S., & Arrow, K. J. (1951) · Economica · doi:10.2307/2549613 · Cited by 7,792
Fuzzy sets, uncertainty, and information
(1989) · European Journal of Operational Research · doi:10.1016/0377-2217(89)90454-2 · Cited by 3,175
Decision analysis and behavioral research
von Winterfeldt, D., & Edwards, W. (1986) · Medical Entomology and Zoology · Cited by 3,042
Daly, H. E., Cobb, J. B., & Cobb, C. W. (1989) · Medical Entomology and Zoology · Cited by 2,329
Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis
Morgan, M. G., & Henrion, M. (1990) · Cambridge University Press eBooks · doi:10.1017/cbo9780511840609 · Cited by 1,711
Visser, W., Pearce, D., Markandya, A., & Barbier, E. B. (2013) · The Top 50 Sustainability Books · doi:10.9774/gleaf.978-1-907643-44-6_16 · Cited by 1,607
Research works printed but not linked: 43
- Bernow S., 1990, External Environmental Costs of Electric Power
- Bernow S., 1990, Valuation of Environmental Externalities for Energy Planning and Operations, May 1990 Update
- CEC, 1989, Energy Technology Status Report
- Chernick P., 1989, The Valuation of Externalities from Energy Production, Delivery and Use, Fall 1989 Update
- Collingridge D., 1982, Critical Decision Theory: a new theory of social choice
- Dovers S., 1995, Ambio, 24
- DTI, 1992, The Social Cost of the Fuel Cycles
- ECO Northwest, 1987, Generic Coal Study: quantification and valuation of environmental impacts
- ExternE, draft position paper prepared for the CEC/US Joint Study on Fuel Cycle Costs
- Eyre N., paper to the Third International Conference on External Costs
- Eyre N., 1993, Expert Workshop on Life Cycle Analysis of Energy Systems
- Fankhauser S., 1993, Global Warming Damage Costs: some monetary estimates
- Fiorino D., 1989, Columbia Journal of Environmental Law, 14, 501
- Fischhoff B., 1981, Acceptable Risk
- Friedrich R., 1993, Energy Policy, 21
- Friedrich R., 1990, External Environmental Costs of Electric Power
- Hagen D., 1991, Application of Solar Thermal Technology in Reducing Greenhouse Gas Emissions—opportunities and benefits for Australian industry
- Haszeldine R., 1996, Radioactive Waste Disposal at Sellafield, UK: site selection, geological and engineering problems
- Hohmeyer O., prepared for DG XII of the European Commission by the Fraunhofer Institut fuer Systemtechnik und Innovationforschung
- Hohmeyer O., paper presented at the 1990 European Wind Energy Conference
- Hohmeyer O., 1990, External Environmental Costs of Electric Power
- Hohmeyer O., 1993, Expert Workshop on Life Cycle Analysis of Energy Systems
- IAEA, 1991, Senior Expert Symposium on Electricity and the Environment: key issues papers
- Koomey J., 1990, Environmental Externalities Workshop
- Koomey , J. Comparative Analysis of Monetary Estimates Associated with the Combustion of Fossil Fuels paper presented to conference of News England Public Utility Commissions Environmental Externalities Workshop.
- Lazarus M., 1993, Towards Global Energy Security: the next energy transition‐an energy scenario for a fossil free energy future
- Lele S., 1995, Conservation Biology, 12, 213
- Loveridge D., 1996, International Journal of Technology Management, 11
- MacNaghten P., 1995, Public Perceptions and Sustainability in Lancashire
- Meyer H., submitted to 18th IAEE International Conference
- Norgaard R., 1991, Ecological Economics
- OECD, 1993, Expert Workshop on Life Cycle Analysis of Energy Systems
- Ottinger R., prepared for NYSERDA and US DOE by Pace University Center for Environmental Legal Studies
- Pearce D., paper presented at Green College Seminar
- Shilberg G., 1989, Valuing Reductions in Air Emissions and Incorporation into Electric Resource Planning: theoretical and quantitative aspects
- Shuman M., 1982, A Model Conservation and Electric Power Plan for the Pacific Northwest. Appendix 2: environmental costs
- Stirling , A. 1994b. “Technology choice for electricity supply: putting the money where the mouth is?”. Science Policy Research Unit University of Sussex. D.Phil thesis,
- Stirling A., 1995, Energy Policy, 22, 94
- Stirling A., 1996, Radioactive Disposal at Sellafield
- Stocker L., 1991, Comprehensive Costs of Electricity in Western Australia
- UNEP, 1985, Comparative Data on the Emissions, Residuals and Health Hazards of Energy Sources
- Vatn A., 1994, Journal of Environment Economics and Management, 26
- Winkler G., 1986, Decision Analysis and Behavioural Research
Cited by
Three pillars of sustainability: in search of conceptual origins
Purvis, B., Mao, Y., & Robinson, D. (2019) · Sustainability Science · doi:10.1007/s11625-018-0627-5 · Cited by 3,279
“…‘pillars’ (Basiago 1999; Pope et al. 2004; Gibson 2006; Waas et al. 2011; Moldan et al. 2012; Schoolman et al. 2012; Boyer et al. 2016), ‘dimensions’ (Stirling 1999; Lehtonen 2004; Carter and Moir 2012; Mori and Christodoulou 2012), ‘components’ (Du Pisani 2006; Zijp et al. 2015), ‘stool legs’…”
BackgroundThe Politics of Social-Ecological Resilience and Sustainable Socio-Technical Transitions
Smith, A., & Stirling, A. (2010) · Ecology and Society · doi:10.5751/es-03218-150111 · Cited by 779
Self-citationThe British Regulatory State: High Modernism and Hyper-Innovation
Moran, M. (2003) · doi:10.1093/0199247579.001.0001 · Cited by 738
The Governance of Sustainable Development: Taking Stock and Looking Forwards
Jordan, A. (2008) · Environment and Planning C: Government and Policy · doi:10.1068/cav6 · Cited by 442
Constructing a farm level indicator of sustainable agricultural practice
Rigby, D., Woodhouse, P., Young, T., & Burton, M. (2001) · Ecological Economics · doi:10.1016/s0921-8009(01)00245-2 · Cited by 436
Metadata
- Authors
- Stirling, A.
- Venue
- Local Environment
- Publisher
- Informa UK Limited
- Published
- 1999-06
- Volume
- 4
- Issue
- 2
- Pages
- 111-135
- ISSN
- 1354-9839 (ISSN-L)
- 1469-6711
- OpenAlex
- W2064146997
- Cited by
- 101
- References
- 77
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 6 · 2022: 11 · 2021: 4 · 2020: 4 · 2019: 2 · 2018: 4 · 2017: 2 · 2016: 3 · 2015: 3 · 2014: 4 · 2013: 4 · 2012: 6
- FWCI
- 12.03
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- Local Environment (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Sussex Research Online (University of Sussex) (submittedVersion)
- Funders
- Economic and Social Research Council
- Topics
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Sustainable Development and Environmental Policy
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Environmental and Social Impact Assessments
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Sustainable Development and Environmental Management
- Keywords
- sustainability assessment, sustainability indicators, deep uncertainty, value judgments, citizen participation, problem framing, sustainability dimensions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The appraisal of sustainability: Some problems and possible responses. https://app.cochat.ai/papers/10.1080/13549839908725588
- The paper
- Stirling, A. (1999). The appraisal of sustainability: Some problems and possible responses. Local Environment. https://doi.org/10.1080/13549839908725588
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.