The DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
Handbook on Constructing Composite Indicators: Methodology and User Guide
Open accessAbstract
This Handbook aims to provide a guide for constructing and using composite indicators for policy makers, academics, the media and other interested parties. While there are several types of composite indicators, this Handbook is concerned with those which compare and rank country performance in areas such as industrial competitiveness, sustainable development, globalisation and innovation. The Handbook aims to contribute to a better understanding of the complexity of composite indicators and to an improvement of the techniques currently used to build them. In particular, it contains a set of technical guidelines that can help constructors of composite indicators to improve the quality of their outputs. It has been prepared jointly by the OECD (the Statistics Directorate and the Directorate for Science, Technology and Industry) and the Applied Statistics and Econometrics Unit of the Joint Research Centre of the European Commission in Ispra, Italy. Primary authors from the JRC are Michela Nardo, Michaela Saisana, Andrea Saltelli and Stefano Tarantola. Primary authors from the OECD are Anders Hoffmann and Enrico Giovannini. Editorial assistance was provided by Candice Stevens, Gunseli Baygan and Karsten Olsen. The research is partly funded by the European Commission, Research Directorate, under the project KEI (Knowledge Economy Indicators), Contract FP6 No. 502529. In the OECD context, the work has benefitted from a grant from the Danish government. The views expressed are those of the authors and should not be regarded as stating an official position of either the European Commission or the OECD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
The Analytic Hierarchy Process
SAATY, T. L., & KEARNS, K. P. (1985) · Analytical Planning · doi:10.1016/b978-0-08-032599-6.50008-8 · Cited by 15,357
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“Cronbach Coefficient Alpha The Cronbach Coefficient Alpha (henceforth c-alpha) (Cronbach, 1951) is the most common estimate of internal consistency of items in a model or survey – Reliability/Item Analysis (e.g. Boscarino et al., 2004; Raykov, 1998; Cortina, 1993; Feldt et al., 1987; Green et al., 1977; Hattie, 1985;…”
MethodDecisions with Multiple Objectives: Preferences and Value Tradeoffs.
Tsoukias, A., Keeney, R. L., & Raiffa, H. (1994) · The Journal of the Operational Research Society · doi:10.2307/2584151 · Cited by 8,370
Social Choice and Individual Values.
Shackle, G. L. S., & Arrow, K. J. (1951) · Economica · doi:10.2307/2549613 · Cited by 7,792
Addelman, S. (1979) · Technometrics · doi:10.1080/00401706.1979.10489788 · Cited by 6,750
(1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 5,958
Multivariate Data Analysis with Readings.
Rutherford, G. S. W., Hair, J. F., Anderson, R. E., & Tatham, R. L. (1988) · The Statistician · doi:10.2307/2348783 · Cited by 5,830
Cited by
Greco, S., Ishizaka, A., Tasiou, M., & Torrisi, G. (2019) · Social Indicators Research · doi:10.1007/s11205-017-1832-9 · Cited by 1,847
The geographies of community disaster resilience
Cutter, S. L., Ash, K. D., & Emrich, C. T. (2014) · Global Environmental Change · doi:10.1016/j.gloenvcha.2014.08.005 · Cited by 1,155
Hinkel, J. (2011) · Global Environmental Change · doi:10.1016/j.gloenvcha.2010.08.002 · Cited by 1,084
Social vulnerability to floods: Review of case studies and implications for measurement
Rufat, S., Tate, E., Burton, C. G., & Maroof, A. S. (2015) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2015.09.013 · Cited by 839
An Introduction to ‘Benefit of the Doubt’ Composite Indicators
Cherchye, L., Moesen, W., Rogge, N., & Puyenbroeck, T. V. (2007) · Social Indicators Research · doi:10.1007/s11205-006-9029-7 · Cited by 728
Social vulnerability indices: a comparative assessment using uncertainty and sensitivity analysis
Tate, E. (2012) · Natural Hazards · doi:10.1007/s11069-012-0152-2 · Cited by 656
Regional Governance Matters: Quality of Government within European Union Member States
Charron, N., Dijkstra, L., & Lapuente, V. (2014) · Regional Studies · doi:10.1080/00343404.2013.770141 · Cited by 646
National baselines for the Sustainable Development Goals assessed in the SDG Index and Dashboards
Schmidt-Traub, G., Kroll, C., Teksoz, K., Durand-Delacre, D., & Sachs, J. D. (2017) · Nature Geoscience · doi:10.1038/ngeo2985 · Cited by 616
When to use what: Methods for weighting and aggregating sustainability indicators
Gan, X., Fernandez, I. C., Guo, J., Wilson, M., Zhao, Y., Zhou, B., & Wu, J. (2017) · Ecological Indicators · doi:10.1016/j.ecolind.2017.05.068 · Cited by 604
Is financial inclusion good for bank stability? International evidence
Ahamed, M. M., & Mallick, S. K. (2019) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2017.07.027 · Cited by 577
Validation of a social vulnerability index in context to river-floods in Germany
Fekete, A. (2009) · Natural Hazards and Earth System Sciences · doi:10.5194/nhess-9-393-2009 · Cited by 555
Development of river water quality indices—a review
Sutadian, A. D., Muttil, N., Yilmaz, A. G., & Perera, B. J. C. (2016) · Environmental Monitoring and Assessment · doi:10.1007/s10661-015-5050-0 · Cited by 553
Composite Indicators between Analysis and Advocacy
Saltelli, A. (2007) · Social Indicators Research · doi:10.1007/s11205-006-0024-9 · Cited by 540
Self-citationGlobal tourism vulnerability to climate change
Scott, D., Hall, C. M., & Gössling, S. (2019) · Annals of Tourism Research · doi:10.1016/j.annals.2019.05.007 · Cited by 520
Health Systems Institutional Characteristics: A Survey of 29 OECD Countries
(2010) · OECD Health Working Papers · doi:10.1787/5kmfxfq9qbnr-en · Cited by 499
Liu, X., Shin, H., & Burns, A. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2019.04.042 · Cited by 491
Paracchini, M. L., Zulian, G., Kopperoinen, L., Maes, J., Schägner, J. P., Termansen, M., Zandersen, M., Perez-Soba, M., Scholefield, P. A., & Bidoglio, G. (2014) · Ecological Indicators · doi:10.1016/j.ecolind.2014.04.018 · Cited by 485
Corporate Sustainability Performance Measurement Systems: A Review and Research Agenda
Searcy, C. (2012) · Journal of Business Ethics · doi:10.1007/s10551-011-1038-z · Cited by 480
Empirical evaluation of agricultural sustainability using composite indicators
Gómez-Limón, J. A., & Sanchez-Fernandez, G. (2010) · Ecological Economics · doi:10.1016/j.ecolecon.2009.11.027 · Cited by 424
A critical review of reductionist approaches for assessing the progress towards sustainability
Gasparatos, A., El-Haram, M., & Horner, M. (2008) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2007.09.002 · Cited by 416
“But even by choosing a geometric aggregation there is still a degree of compensability between the different indicators although it is smaller than the linearly aggregated CI (Nardo et al., 2005a).”
BackgroundInfluentialBurton, C. G. (2015) · Annals of the Association of American Geographers · doi:10.1080/00045608.2014.960039 · Cited by 408
Cinelli, M., Kadziński, M., Gonzalez, M., & Słowiński, R. (2020) · Omega · doi:10.1016/j.omega.2020.102261 · Cited by 402
Binder, C. R., Feola, G., & Steinberger, J. K. (2010) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2009.06.002 · Cited by 396
The Competitiveness of Nations: Why Some Countries Prosper While Others Fall Behind
Fagerberg, J., Srholec, M., & Knell, M. (2007) · World Development · doi:10.1016/j.worlddev.2007.01.004 · Cited by 369
Zhou, H., Yang, Y., Chen, Y., & Zhu, J. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.06.023 · Cited by 359
Ratings and Rankings: Voodoo or Science?
Paruolo, P., Saisana, M., & Saltelli, A. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01059.x · Cited by 349
Self-citationA multi-criteria approach for assessing urban flood resilience in Tehran, Iran
Moghadas, M., Asadzadeh, A., Vafeidis, A., Fekete, A., & Kötter, T. (2019) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2019.101069 · Cited by 342
Resource management in big data initiatives: processes and dynamic capabilities
Braganza, A., Brooks, L., Nepelski, D., Ali, M., & Moro, R. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.08.006 · Cited by 339
How (Not) to measure institutions
VOIGT, S. (2013) · Journal of Institutional Economics · doi:10.1017/s1744137412000148 · Cited by 329
Measuring systems sustainability with multi-criteria methods: A critical review
Diaz-Balteiro, L., González-Pachón, J., & Romero, C. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.08.075 · Cited by 326
A mathematical programming approach to constructing composite indicators
Zhou, P., Ang, B. W., & Poh, K. L. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2006.12.020 · Cited by 325
On a Generalized Non-compensatory Composite Index for Measuring Socio-economic Phenomena
Mazziotta, M., & Pareto, A. (2016) · Social Indicators Research · doi:10.1007/s11205-015-0998-2 · Cited by 322
Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., Saisana, M., Saltelli, A., Liska, R., & Tarantola, S. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602445 · Cited by 322
Self-citationRickety numbers: Volatility of university rankings and policy implications
Saisana, M., d’Hombres, B., & Saltelli, A. (2011) · Research Policy · doi:10.1016/j.respol.2010.09.003 · Cited by 318
Self-citationTenaw, D., & Beyene, A. D. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110897 · Cited by 318
Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting
Munda, G., & Nardo, M. (2009) · Applied Economics · doi:10.1080/00036840601019364 · Cited by 313
Self-citationMeasuring Active Citizenship through the Development of a Composite Indicator
Hoskins, B. L., & Mascherini, M. (2009) · Social Indicators Research · doi:10.1007/s11205-008-9271-2 · Cited by 312
Podgórski, D. (2015) · Safety Science · doi:10.1016/j.ssci.2014.11.018 · Cited by 312
Gbetibouo, G. A., Ringler, C., & Hassan, R. (2010) · Natural Resources Forum · doi:10.1111/j.1477-8947.2010.01302.x · Cited by 309
Measuring Patent Quality: Indicators of Technological and Economic Value
(2013) · OECD Science, Technology and Industry Working Papers · doi:10.1787/5k4522wkw1r8-en · Cited by 308
Terres, J.-M., Scacchiafichi, L. N., Wania, A., Ambar, M., Anguiano, E., Buckwell, A., Coppola, A., Gocht, A., Källström, H. N., Pointereau, P., et al. (2015) · Land Use Policy · doi:10.1016/j.landusepol.2015.06.009 · Cited by 305
Agriculture, climate change and sustainability: The case of EU-28
Agovino, M., Casaccia, M., Ciommi, M., Ferrara, M., & Marchesano, K. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2018.04.064 · Cited by 305
Sustainable performance index for tourism policy development
Castellani, V., & Sala, S. (2010) · Tourism Management · doi:10.1016/j.tourman.2009.10.001 · Cited by 303
Parsons, M., Glavac, S., Hastings, P., Marshall, G., McGregor, J., McNeill, J., Morley, P., Reeve, I., & Stayner, R. (2016) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2016.07.005 · Cited by 296
Sustainability performance evaluation: Literature review and future directions
Büyüközkan, G., & Karabulut, Y. (2018) · Journal of Environmental Management · doi:10.1016/j.jenvman.2018.03.064 · Cited by 296
Covid-19 and tourism vulnerability
Duro, J. A., Perez-Laborda, A., Turrion-Prats, J., & Fernández-Fernández, M. (2021) · Tourism Management Perspectives · doi:10.1016/j.tmp.2021.100819 · Cited by 290
Measuring global water security towards sustainable development goals
Gain, A. K., Giupponi, C., & Wada, Y. (2016) · Environmental Research Letters · doi:10.1088/1748-9326/11/12/124015 · Cited by 286
Using indicators to assess sustainable tourism development: a review
Torres-Delgado, A., & Saarinen, J. (2014) · Tourism Geographies · doi:10.1080/14616688.2013.867530 · Cited by 286
Uncertainty Analysis for a Social Vulnerability Index
Tate, E. (2013) · Annals of the Association of American Geographers · doi:10.1080/00045608.2012.700616 · Cited by 285
The medical tourism index: Scale development and validation
Fetscherin, M., & Stephano, R.-M. (2016) · Tourism Management · doi:10.1016/j.tourman.2015.08.010 · Cited by 284
Sustainable tourism indicators as planning tools in cultural destinations
Lozano-Oyola, M., Blancas, F. J., González, M., & Caballero, R. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2012.01.014 · Cited by 274
Comparative Analysis of Alcohol Control Policies in 30 Countries
Brand, D. A., Saisana, M., Rynn, L. A., Pennoni, F., & Lowenfels, A. B. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040151 · Cited by 273
Self-citationE pluribus unum? A critical survey of job quality indicators
Munoz de Bustillo, R., Fernandez-Macias, E., Esteve, F., & Anton, J.-I. (2011) · Socio-Economic Review · doi:10.1093/ser/mwr005 · Cited by 270
Indicator-based water sustainability assessment — A review
Juwana, I., Muttil, N., & Perera, B. J. C. (2012) · Science of The Total Environment · doi:10.1016/j.scitotenv.2012.08.093 · Cited by 260
Review and new evidence on composite innovation indicators for evaluating national performance
Grupp, H., & Schubert, T. (2010) · Research Policy · doi:10.1016/j.respol.2009.10.002 · Cited by 256
Environmentally efficient well-being: Is there a Kuznets curve?
Dietz, T., Rosa, E. A., & York, R. (2012) · Applied Geography · doi:10.1016/j.apgeog.2010.10.011 · Cited by 256
Building composite indicators using multicriteria methods: a review
El Gibari, S., Gómez, T., & Ruiz, F. (2019) · Journal of Business Economics · doi:10.1007/s11573-018-0902-z · Cited by 255
Zhou, P., Ang, B. W., & Zhou, D. Q. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9472-3 · Cited by 240
Should you believe in the Shanghai ranking?: An MCDM view
Billaut, J.-C., Bouyssou, D., & Vincke, P. (2010) · Scientometrics · doi:10.1007/s11192-009-0115-x · Cited by 219
A common weight MCDA–DEA approach to construct composite indicators
Hatefi, S. M., & Torabi, S. A. (2010) · Ecological Economics · doi:10.1016/j.ecolecon.2010.08.014 · Cited by 213
Combining road safety information in a performance index
Hermans, E., Van den Bossche, F., & Wets, G. (2008) · Accident Analysis & Prevention · doi:10.1016/j.aap.2008.02.004 · Cited by 192
Talukder, B., W. Hipel, K., & W. vanLoon, G. (2017) · Resources · doi:10.3390/resources6040066 · Cited by 192
Pradhan, R. P., Arvin, M. B., Hall, J. H., & Bahmani, S. (2014) · Review of Financial Economics · doi:10.1016/j.rfe.2014.07.002 · Cited by 184
Navigating uncertainty in environmental composite indicators
Burgass, M. J., Halpern, B. S., Nicholson, E., & Milner-Gulland, E. J. (2017) · Ecological Indicators · doi:10.1016/j.ecolind.2016.12.034 · Cited by 176
Proposal of a Sustainable Circular Index for Manufacturing Companies
Azevedo, S., Godina, R., & Matias, J. (2017) · Resources · doi:10.3390/resources6040063 · Cited by 165
Garcia, S., Cintra, Y., Torres, R. D. C. S. R., & Lima, F. G. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.01.110 · Cited by 162
Robustness and sensitivity of weighting and aggregation in constructing composite indices
Dobbie, M. J., & Dail, D. (2013) · Ecological Indicators · doi:10.1016/j.ecolind.2012.12.025 · Cited by 155
Measuring psychological resilience to disasters: are evidence-based indicators an achievable goal?
Rodriguez-Llanes, J. M., Vos, F., & Guha-Sapir, D. (2013) · Environmental Health · doi:10.1186/1476-069x-12-115 · Cited by 146
Jiang, Q., Liu, Z., Liu, W., Li, T., Cong, W., Zhang, H., & Shi, J. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.03.255 · Cited by 142
An Unbalance Adjustment Method for Development Indicators
Casadio Tarabusi, E., & Guarini, G. (2013) · Social Indicators Research · doi:10.1007/s11205-012-0070-4 · Cited by 136
(2005) · Joint Research Centre (European Commission) · Cited by 136
Castoldi, N., & Bechini, L. (2010) · European Journal of Agronomy · doi:10.1016/j.eja.2009.02.003 · Cited by 123
Pissourios, I. A. (2013) · Ecological Indicators · doi:10.1016/j.ecolind.2013.06.008 · Cited by 122
Composite Indices: Rank Robustness, Statistical Association, and Redundancy
Foster, J. E., McGillivray, M., & Seth, S. (2013) · Econometric Reviews · doi:10.1080/07474938.2012.690647 · Cited by 111
Weighting indicators of tourism sustainability: A critical note
Mikulić, J., Kožić, I., & Krešić, D. (2015) · Ecological Indicators · doi:10.1016/j.ecolind.2014.08.026 · Cited by 111
Rogge, N. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2012.03.020 · Cited by 107
Robust human development rankings
Cherchye, L., Ooghe, E., & Van Puyenbroeck, T. (2008) · The Journal of Economic Inequality · doi:10.1007/s10888-007-9058-8 · Cited by 107
Geometric mean quantity index numbers with Benefit-of-the-Doubt weights
Van Puyenbroeck, T., & Rogge, N. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.07.038 · Cited by 96
Construction and Analysis of a Composite Quality of Life Index for a Region of South Africa
Greyling, T., & Tregenna, F. (2017) · Social Indicators Research · doi:10.1007/s11205-016-1294-5 · Cited by 93
Greco, S., Ishizaka, A., Matarazzo, B., & Torrisi, G. (2018) · Regional Studies · doi:10.1080/00343404.2017.1347612 · Cited by 90
Choosing Aggregation Rules for Composite Indicators
Munda, G. (2012) · Social Indicators Research · doi:10.1007/s11205-011-9911-9 · Cited by 88
Measuring and assessing regional education inequalities in China under Changing Policy Regimes
Xiang, L., Stillwell, J., Burns, L., & Heppenstall, A. (2020) · Applied Spatial Analysis and Policy · doi:10.1007/s12061-019-09293-8 · Cited by 86
Measuring corporate sustainability performance–the case of European food and beverage companies
Engida, T. G., Rao, X., Berentsen, P. B. M., & Oude Lansink, A. G. J. M. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.05.095 · Cited by 82
Jamshed, A., Birkmann, J., Ahmad Rana, I., & Feldmeyer, D. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.106704 · Cited by 67
Bonisoli, L., Galdeano-Gómez, E., & Piedra-Muñoz, L. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.02.055 · Cited by 61
Rice farming sustainability assessment in Bangladesh
Roy, R., Chan, N. W., & Rainis, R. (2014) · Sustainability Science · doi:10.1007/s11625-013-0234-4 · Cited by 51
Blancas, F. J., Contreras, I., & Ramírez-Hurtado, J. M. (2013) · Journal of the Operational Research Society · doi:10.1057/jors.2012.90 · Cited by 45
Alsaeed, B. S., Hunt, D. V. L., & Sharifi, S. (2022) · Sustainability · doi:10.3390/su142215293 · Cited by 31
The Socioemotional Well-Being Index (SEWBI): Theoretical Framework and Empirical Operationalisation
Bericat, E. (2014) · Social Indicators Research · doi:10.1007/s11205-013-0528-z · Cited by 30
Yang, F.-C., Kao, R.-H., Chen, Y.-T., Ho, Y.-F., Cho, C.-C., & Huang, S.-W. (2018) · Social Indicators Research · doi:10.1007/s11205-017-1603-7 · Cited by 24
Metadata
- Authors
- Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffmann, A., & Giovannini, E.
- Venue
- OECD Statistics Working Papers
- Published
- 2005-08-09
- ISSN
- 1815-2031 (ISSN-L)
- OpenAlex
- W1484750607
- Cited by
- 2,671
- References
- 115
- Type
- report
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.