The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Comparative analysis of standardized indicators for Smart sustainable cities: What indicators and standards to use and when?
Open accessAbstract
City managers need indicators for target setting, performance assessment, monitoring, management and decision-making purposes. The choice of the most suitable indicator framework is crucial, but difficult, as it requires expert knowledge. To help cities in their choice, this paper compares seven recently published indicator standards for Smart sustainable cities. A taxonomy was developed to evaluate each of their 413 indicators against five conceptual urban focuses (types of urban sustainability and smartness), ten sectoral application domains (energy, transport, ICT, economy, etc.) and five indicator types (input, process, output, outcome, impact). The results clearly discriminate between indicator standards suited for evaluating the implementation of predominantly smart city approaches versus standards more focused on sustainability assessment. A further distinction is possible in standards almost fully oriented towards impacts reached, and standards that allow for progress evaluation according to steps in the implementation process. Some standards provide a narrow focus on output indicators evaluating the progress in implementing smart urban ICT solutions (e.g. number of smart meters installed). Cities are encouraged to complement such evaluations with impact indicators that demonstrate the effects of those solutions. This paper provides guidance for city managers and policy makers to select the indicators and standard that best correspond to their assessment need and goals, and align with their stage in Smart sustainable city implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,473
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745
Smart cities: Definitions, dimensions, performance, and initiatives
Albino, V., Berardi, U., & Dangelico, R. M. (2015) · Journal of Urban Technology · doi:10.1080/10630732.2014.942092 · Cited by 3,536 · cited 2×
“…smartness into two types, i.e. hard and soft, which is a well-established categorization in the smart city literature (Ahvenniemi et al., 2017; Albino et al., 2015; Angelidou, 2014; Caragliu, del Bo, & Nijkamp, 2011; Kummitha & Crutzen, 2017; Neirotti, De Marco, Cagliano, Mangano, & Scorrano,…”
BackgroundCaragliu, A., Del Bo, C., & Nijkamp, P. (2011) · Journal of Urban Technology · doi:10.1080/10630732.2011.601117 · Cited by 3,409
Will the real smart city please stand up?: Intelligent, progressive or entrepreneurial?
Hollands, R. G. (2008) · City · doi:10.1080/13604810802479126 · Cited by 3,025
Current trends in Smart City initiatives: Some stylised facts
Neirotti, P., De Marco, A., Cagliano, A. C., Mangano, G., & Scorrano, F. (2014) · Cities · doi:10.1016/j.cities.2013.12.010 · Cited by 2,322
Smart sustainable cities of the future: An extensive interdisciplinary literature review
Bibri, S. E., & Krogstie, J. (2017) · Sustainable Cities and Society · doi:10.1016/j.scs.2017.02.016 · Cited by 1,599
What are the differences between sustainable and smart cities?
Ahvenniemi, H., Huovila, A., Pinto-Seppä, I., & Airaksinen, M. (2017) · Cities · doi:10.1016/j.cities.2016.09.009 · Cited by 1,378
Self-citationde Jong, M., Joss, S., Schraven, D., Zhan, C., & Weijnen, M. (2015) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2015.02.004 · Cited by 1,069
Smart city policies: A spatial approach
Angelidou, M. (2014) · Cities · doi:10.1016/j.cities.2014.06.007 · Cited by 986 · cited 1×
“…into two types, i.e. hard and soft, which is a well-established categorization in the smart city literature (Ahvenniemi et al., 2017; Albino et al., 2015; Angelidou, 2014; Caragliu, del Bo, & Nijkamp, 2011; Kummitha & Crutzen, 2017; Neirotti, De Marco, Cagliano, Mangano, & Scorrano, 2014).”
BackgroundCritical interventions into the corporate smart city
Hollands, R. G. (2015) · Cambridge Journal of Regions, Economy and Society · doi:10.1093/cjres/rsu011 · Cited by 931
Review of sustainability indices and indicators: Towards a new City Sustainability Index (CSI)
Mori, K., & Christodoulou, A. (2012) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2011.06.001 · Cited by 846
Reed, M. S., Fraser, E. D. G., & Dougill, A. J. (2006) · Ecological Economics · doi:10.1016/j.ecolecon.2005.11.008 · Cited by 785
Can cities become smart without being sustainable? A systematic review of the literature
Yigitcanlar, T., Kamruzzaman, M., Foth, M., Sabatini-Marques, J., da Costa, E., & Ioppolo, G. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.11.033 · Cited by 708
The First Two Decades of Smart-City Research: A Bibliometric Analysis
Mora, L., Bolici, R., & Deakin, M. (2017) · Journal of Urban Technology · doi:10.1080/10630732.2017.1285123 · Cited by 684
Peer Reviewed: Economic Input–Output Models for Environmental Life-Cycle Assessment
Hendrickson, C., Horvath, A., Joshi, S., & Lave, L. (1998) · Environmental Science & Technology · doi:10.1021/es983471i · Cited by 677
Measuring the sustainability of cities: An analysis of the use of local indicators
Tanguay, G. A., Rajaonson, J., Lefebvre, J.-F., & Lanoie, P. (2010) · Ecological Indicators · doi:10.1016/j.ecolind.2009.07.013 · Cited by 632
Yigitcanlar, T., Kamruzzaman, M., Buys, L., Ioppolo, G., Sabatini-Marques, J., da Costa, E. M., & Yun, J. J. (2018) · Cities · doi:10.1016/j.cities.2018.04.003 · Cited by 615
A critical review of seven selected neighborhood sustainability assessment tools
Sharifi, A., & Murayama, A. (2013) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2012.06.006 · Cited by 607
Knowing and governing cities through urban indicators, city benchmarking and real-time dashboards
Kitchin, R., Lauriault, T. P., & McArdle, G. (2015) · Regional Studies, Regional Science · doi:10.1080/21681376.2014.983149 · Cited by 596
Smart Sustainable Cities: Definition and Challenges
Höjer, M., & Wangel, J. (2015) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-09228-7_20 · Cited by 570
How do we understand smart cities? An evolutionary perspective
Kummitha, R. K. R., & Crutzen, N. (2017) · Cities · doi:10.1016/j.cities.2017.04.010 · Cited by 567
Moving towards smart cities: Solutions that lead to the Smart City Transformation Framework
Kumar, H., Singh, M. K., Gupta, M. P., & Madaan, J. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.04.024 · Cited by 530
The urban sustainable development goal: Indicators, complexity and the politics of measuring cities
Klopp, J. M., & Petretta, D. L. (2017) · Cities · doi:10.1016/j.cities.2016.12.019 · Cited by 524
Kaika, M. (2017) · Environment and Urbanization · doi:10.1177/0956247816684763 · Cited by 447
Meta-principles for developing smart, sustainable, and healthy cities
Ramaswami, A., Russell, A. G., Culligan, P. J., Sharma, K. R., & Kumar, E. (2016) · Science · doi:10.1126/science.aaf7160 · Cited by 411
Does smart city policy lead to sustainability of cities?
Yigitcanlar, T., & Kamruzzaman, M. (2018) · Land Use Policy · doi:10.1016/j.landusepol.2018.01.034 · Cited by 404
Urban sustainability indicators: Challenges and opportunities
Verma, P., & Raghubanshi, A. S. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.05.007 · Cited by 393
Conceptualizing smartness in government: An integrative and multi-dimensional view
Gil-Garcia, J. R., Zhang, J., & Puron-Cid, G. (2016) · Government Information Quarterly · doi:10.1016/j.giq.2016.03.002 · Cited by 383
Re-thinking sustainability indicators: local perspectives of urban sustainability
Turcu, C. (2013) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2012.698984 · Cited by 366
ICT and sustainability in smart cities management
Bifulco, F., Tregua, M., Amitrano, C. C., & D'Auria, A. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-07-2015-0132 · Cited by 322
Towards sustainable urban communities
Haapio, A. (2012) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2011.08.002 · Cited by 318
Indicator-based urban sustainability—A review
Hiremath, R. B., Balachandra, P., Kumar, B., Bansode, S. S., & Murali, J. (2013) · Energy for Sustainable Development · doi:10.1016/j.esd.2013.08.004 · Cited by 313
Evaluating Urban Quality: Indicators and Assessment Tools for Smart Sustainable Cities
Garau, C., & Pavan, V. (2018) · Sustainability · doi:10.3390/su10030575 · Cited by 311
The Lisbon ranking for smart sustainable cities in Europe
Akande, A., Cabral, P., Gomes, P., & Casteleyn, S. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.10.009 · Cited by 308
Understanding Smart Cities: A Tool for Smart Government or an Industrial Trick?
Anthopoulos, L. G. (2017) · Public Administration and Information Technology · doi:10.1007/978-3-319-57015-0 · Cited by 282
The ecological future of cities
McDonnell, M. J., & MacGregor-Fors, I. (2016) · Science · doi:10.1126/science.aaf3630 · Cited by 276
Smart sustainable cities roadmap: Readiness for transformation towards urban sustainability
Ibrahim, M., El-Zaart, A., & Adams, C. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2017.10.008 · Cited by 228
An urban ecology critique on the “Smart City” model
Colding, J., & Barthel, S. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2017.06.191 · Cited by 224
Smart City Implementation: Creating Economic and Public Value in Innovative Urban Systems
Dameri, R. P. (2017) · Progress in IS · doi:10.1007/978-3-319-45766-6 · Cited by 212
A Unified Smart City Model (USCM) for Smart City Conceptualization and Benchmarking
Anthopoulos, L. G., Janssen, M., & Weerakkody, V. (2016) · International Journal of Electronic Government Research · doi:10.4018/ijegr.2016040105 · Cited by 200
The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?
Janger, J., Schubert, T., Andries, P., Rammer, C., & Hoskens, M. (2016) · Research Policy · doi:10.1016/j.respol.2016.10.001 · Cited by 168
Assessing and measuring environmental impact and sustainability
Klemeš, J. J. (2015) · Clean Technologies and Environmental Policy · doi:10.1007/s10098-015-0930-0 · Cited by 166
Corbett, J., & Mellouli, S. (2017) · Information Systems Journal · doi:10.1111/isj.12138 · Cited by 164
A Systems View of Planning: Towards a Theory of the Urban and Regional Planning Process
Chadwick, G. (1971) · Cited by 151
Measuring and Managing the Smartness of Cities: A Framework for Classifying Performance Indicators
Carli, R., Dotoli, M., Pellegrino, R., & Ranieri, L. (2013) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2013.223 · Cited by 145
The significance of digital data systems for smart city policy
Kourtit, K., Nijkamp, P. J., & Steenbruggen, J. (2016) · Socio-Economic Planning Sciences · doi:10.1016/j.seps.2016.10.001 · Cited by 139
New Key Performance Indicators for a Smart Sustainable City
Hara, M., Nagao, T., Hannoe, S., & Nakamura, J. (2016) · Sustainability · doi:10.3390/su8030206 · Cited by 131
Wendling, L., Huovila, A., Castell-Rüdenhausen, M. Z., Hukkalainen, M., & Airaksinen, M. (2018) · Frontiers in Environmental Science · doi:10.3389/fenvs.2018.00069 · Cited by 126
Self-citationA Conceptual Multidimensional Model for Assessing Smart Sustainable Cities
Al-Nasrawi, S., Adams, C., & El‐Zaart, A. (2015) · Journal of Information Systems and Technology Management · doi:10.4301/s1807-17752015000300003 · Cited by 123
Big data dashboards as smart decision support tools for i-cities – An experiment on stockholm
Kourtit, K., & Nijkamp, P. J. (2017) · Land Use Policy · doi:10.1016/j.landusepol.2017.10.019 · Cited by 119
Borseková, K., Koróny, S., Vaňová, A., & Vitálišová, K. (2018) · Cities · doi:10.1016/j.cities.2018.03.010 · Cited by 118
Holden, M. (2013) · Ecological Indicators · doi:10.1016/j.ecolind.2013.03.007 · Cited by 114
Munier, N. (2011) · Ecological Indicators · doi:10.1016/j.ecolind.2011.01.006 · Cited by 111
Assessing a Sustainable Urban Development: Typology of Indicators and Sources of Information
Lützkendorf, T., & Balouktsi, M. (2017) · Procedia Environmental Sciences · doi:10.1016/j.proenv.2017.03.122 · Cited by 98
Urban sustainability in the information age
Castells, M. (2000) · City · doi:10.1080/713656995 · Cited by 74
Khan, S. A., & Zaman, A. U. (2017) · Cities · doi:10.1016/j.cities.2017.08.022 · Cited by 72
Marsal-Llacuna, M.-L. (2015) · Social Indicators Research · doi:10.1007/s11205-015-1192-2 · Cited by 49
Driving Forces Behind Smart City Implementations - The Next Smart Revolution
Tokody, D., & Schuster, G. (2016) · Journal of Emerging research and solutions in ICT · doi:10.20544/ersict.02.16.p01 · Cited by 44
Nieminen, M., & Hyytinen, K. (2015) · Evaluation · doi:10.1177/1356389015606540 · Cited by 43
Improving the Veracity of Open and Real-Time Urban Data
McArdle, G., & Kitchin, R. (2016) · Built Environment · doi:10.2148/benv.42.3.457 · Cited by 42
CITYkeys Smart city performance measurement system
Huovila, A., Airaksinen, M., Pinto-Seppä, I., Piira, K., Bösch, P., Penttinen, T., Neumann, H., & Kontinakis, N. (2017) · TNO Repository · Cited by 37
Self-citationThe Intelligenter Method (II) for “smarter” urban policy-making and regulation drafting
Marsal-Llacuna, M.-L., & Segal, M. E. (2016) · Cities · doi:10.1016/j.cities.2016.05.006 · Cited by 35
Effects of Building Occupancy on Indicators of Energy Efficiency
Huovila, A., Tuominen, P., & Airaksinen, M. (2017) · Energies · doi:10.3390/en10050628 · Cited by 32
Self-citationDeng, D., Liu, S., Wallis, L., Duncan, E., & McManus, P. (2017) · Australian Geographer · doi:10.1080/00049182.2016.1277074 · Cited by 25
Niemann, L., Hoppe, T., & Coenen, F. H. J. M. (2016) · Environmental Policy and Governance · doi:10.1002/eet.1733 · Cited by 20
A Goal-Oriented Framework for Analyzing and Modeling City Dashboards in Smart Cities
Mannaro, K., Baralla, G., & Garau, C. (2018) · Green energy and technology · doi:10.1007/978-3-319-75774-2_13 · Cited by 18
Planning Models and Paradigms in Higher Education
Fincher, C. (1972) · The Journal of Higher Education · doi:10.1080/00221546.1972.11776837 · Cited by 16
Cited by
Mishra, M., Desul, S., Santos, C. A. G., Mishra, S. K., Kamal, A. H. M., Goswami, S., Kalumba, A. M., Biswal, R., da Silva, R. M., dos Santos, C. A. C., et al. (2023) · Environment, Development and Sustainability · doi:10.1007/s10668-023-03225-w · Cited by 317
A critical review of selected smart city assessment tools and indicator sets
Sharifi, A. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.06.172 · Cited by 312
Hui, C. X., Dan, G., Alamri, S., & Toghraie, D. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104985 · Cited by 263
IoT-Enabled Smart Sustainable Cities: Challenges and Approaches
Belli, L., Cilfone, A., Davoli, L., Ferrari, G., Adorni, P., Di Nocera, F., Dall’Olio, A., Pellegrini, C., Mordacci, M., & Bertolotti, E. (2020) · Smart Cities · doi:10.3390/smartcities3030052 · Cited by 262
Blasi, S., Ganzaroli, A., & De Noni, I. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.103793 · Cited by 256
Metadata
- Authors
- Huovila, A., Bosch, P., & Airaksinen, M.
- Venue
- Cities
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 89
- Pages
- 141-153
- ISSN
- 0264-2751 (ISSN-L)
- OpenAlex
- W2913830123
- Cited by
- 488
- References
- 68
- FWCI
- 43.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.