A comparison of hierarchical cluster analysis and league table rankings as methods for analysis and presentation of district health system performance data in Uganda
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
In 2003, the Uganda Ministry of Health introduced the district league table for district health system performance assessment. The league table presents district performance against a number of input, process and output indicators and a composite index to rank districts. This study explores the use of hierarchical cluster analysis for analysing and presenting district health systems performance data and compares this approach with the use of the league table in Uganda. Ministry of Health and district plans and reports, and published documents were used to provide information on the development and utilization of the Uganda district league table. Quantitative data were accessed from the Ministry of Health databases. Statistical analysis using SPSS version 20 and hierarchical cluster analysis, utilizing Wards' method was used. The hierarchical cluster analysis was conducted on the basis of seven clusters determined for each year from 2003 to 2010, ranging from a cluster of good through moderate-to-poor performers. The characteristics and membership of clusters varied from year to year and were determined by the identity and magnitude of performance of the individual variables. Criticisms of the league table include: perceived unfairness, as it did not take into consideration district peculiarities; and being oversummarized and not adequately informative. Clustering organizes the many data points into clusters of similar entities according to an agreed set of indicators and can provide the beginning point for identifying factors behind the observed performance of districts. Although league table ranking emphasize summation and external control, clustering has the potential to encourage a formative, learning approach. More research is required to shed more light on factors behind observed performance of the different clusters. Other countries especially low-income countries that share many similarities with Uganda can learn from these experiences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“the MoH produces a ‘district league table’ [5] using an HMIS database which is based on a unified reporting system for public and NFP sectors [6, 7].”
From Beyond pilotitis: taking digital health interventions to the national level in China and Uganda (2017) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344
A Survey of Clustering Data Mining Techniques
Berkhin, P. (2006) · Grouping Multidimensional Data · doi:10.1007/3-540-28349-8_2 · Cited by 2,804 · cited 5×
“It was determined that less than seven clusters grouped together too many districts, whereas more than seven clusters were considered unwieldy for decision making (Romesburg 2004; Berkhin 2006).”
BackgroundMethodInfluentialSystematic determination of genetic network architecture
Tavazoie, S., Hughes, J. D., Campbell, M. J., Cho, R. J., & Church, G. M. (1999) · Nature Genetics · doi:10.1038/10343 · Cited by 2,507 · cited 1×
“In health it has been used extensively in biomedicine, in genetics, asthma and cancer studies and in psychology (Tavazoie et al. 1999; Beckstead 2002; Dyrskjot et al. 2003; Haldar et al. 2008; Andreopoulos et al. 2009).”
MethodCluster analysis and clinical asthma phenotypes
Haldar, P., Pavord, I. D., Shaw, D. E., Berry, M. A., Thomas, M., Brightling, C. E., Wardlaw, A. J., & Green, R. H. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200711-1754oc · Cited by 1,987 · cited 2×
“In health it has been used extensively in biomedicine, in genetics, asthma and cancer studies and in psychology (Tavazoie et al. 1999; Beckstead 2002; Dyrskjot et al. 2003; Haldar et al. 2008; Andreopoulos et al. 2009).”
MethodCluster analysis for researchers
(1987) · Environmental Software · doi:10.1016/0266-9838(87)90010-4 · Cited by 1,850
Health systems performance assessment: debates, methods and empiricism.
Murray, C. J. L., & EVANS, D. B. (2003) · Cited by 855
Identifying distinct classes of bladder carcinoma using microarrays
Dyrskjøt, L., Thykjaer, T., Kruhøffer, M., Jensen, J. L., Marcussen, N., Hamilton-Dutoit, S., Wolf, H., & Ørntoft, T. F. (2003) · Nature Genetics · doi:10.1038/ng1061 · Cited by 501 · cited 2×
“In health it has been used extensively in biomedicine, in genetics, asthma and cancer studies and in psychology (Tavazoie et al. 1999; Beckstead 2002; Dyrskjot et al. 2003; Haldar et al. 2008; Andreopoulos et al. 2009).”
MethodPerformance Measurement for Health System Improvement: Experiences, Challenges and Prospects
(2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511711800 · Cited by 426
Assessing health system performance in developing countries: A review of the literature
Kruk, M. E., & Freedman, L. P. (2008) · Health Policy · doi:10.1016/j.healthpol.2007.09.003 · Cited by 332 · cited 2×
“Yet the marked difference in contexts between HICs and L/MICs means that it is not always possible and/or desirable to copy HSPA approaches and frameworks from one context to the other (Kruk and Freedman 2008; Smith et al. 2009; Tashobya et al. 2014).”
BackgroundGrouping Multidimensional Data
(2006) · Springer eBooks · doi:10.1007/3-540-28349-8 · Cited by 323
Freeman, T. (2002) · Health Services Management Research · doi:10.1258/0951484021912897 · Cited by 244 · cited 8×
“In most instances, clustering can be done on the basis of readily available data as it does not require data of high precision (given application of data) (Freeman 2002; Gibberd 2005).”
BackgroundMethodInfluentialA roadmap of clustering algorithms: finding a match for a biomedical application
Andreopoulos, B., An, A., Wang, X., & Schroeder, M. (2008) · Briefings in Bioinformatics · doi:10.1093/bib/bbn058 · Cited by 220
the HELENA Study Group, Ottevaere, C., Huybrechts, I., Benser, J., De Bourdeaudhuij, I., Cuenca-Garcia, M., Dallongeville, J., Zaccaria, M., Gottrand, F., Kersting, M., et al. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-328 · Cited by 198 · cited 2×
“…to date in health systems research, a few studies have shown that hierarchical cluster analysis (HCA), one form of clustering, can be a powerful tool for comparison of entities and for highlighting inequalities (Lakhani et al. 2005; Ruger and Kim 2006; Day et al. 2008; Ottevaere et al. 2011).”
BackgroundMethodAssessment of the World Health Report 2000
Navarro, V. (2000) · The Lancet · doi:10.1016/s0140-6736(00)03139-1 · Cited by 180 · cited 1×
“Such criticisms were raised, for example, against the ranking of WHO member countries in 2000, and for the UK NHS performance assessment approach (Navarro 2000, 2001; Adab et al. 2002; Freeman 2002; Rixom 2002).”
BackgroundThe current state of performance measurement in health care
Loeb, J. M. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh007 · Cited by 146 · cited 1×
“Performance assessment should make it possible to make comparisons within a system across time and different levels, and between systems and across various settings (World Health Organization 2000; Smith 2002; Loeb 2004).”
BackgroundPerformance league tables: the NHS deserves better
Adab, P., Rouse, A., Mohammed, M. A., & Marshall, T. P. (2002) · BMJ · doi:10.1136/bmj.324.7329.95 · Cited by 137 · cited 5×
“Such criticisms were raised, for example, against the ranking of WHO member countries in 2000, and for the UK NHS performance assessment approach (Navarro 2000, 2001; Adab et al. 2002; Freeman 2002; Rixom 2002).”
BackgroundMethodInfluentialHildon, Z., Allwood, D., & Black, N. (2012) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzr072 · Cited by 119 · cited 1×
“The analysis and presentation of performance data does matter since it contributes to whether the information is used in decision making or not (Freeman 2002; Gysels et al. 2004; Gibberd 2005; Hildon et al. 2012).”
MethodGlobal health inequalities: an international comparison
Ruger, J. P., & Kim, H.-J. (2006) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2005.041954 · Cited by 110 · cited 1×
“This approach to HCA has been used by other researchers in health systems research and is appropriate for the relatively few data points in this study (Lakhani et al. 2005; Berkhin 2006; Ottevaere et al. 2011).”
MethodMeasuring health system performance
Smith, P. (2002) · The European Journal of Health Economics · doi:10.1007/s10198-002-0138-1 · Cited by 97 · cited 1×
“Performance assessment should make it possible to make comparisons within a system across time and different levels, and between systems and across various settings (World Health Organization 2000; Smith 2002; Loeb 2004).”
BackgroundTrust in performance indicators?
Davies, H. T. O., & Lampel, J. (1998) · BMJ Quality & Safety · doi:10.1136/qshc.7.3.159 · Cited by 96 · cited 2×
“Such an approach has been noted to have a higher potential to facilitate positive change (Davies and Lampel 1998, Freeman 2002).”
BackgroundTashobya, C. K., da Silveira, V., Ssengooba, F., Nabyonga‐Orem, J., Macq, J., & Criel, B. (2014) · Globalization and Health · doi:10.1186/1744-8603-10-5 · Cited by 73 · cited 3×
“Yet the marked difference in contexts between HICs and L/MICs means that it is not always possible and/or desirable to copy HSPA approaches and frameworks from one context to the other (Kruk and Freedman 2008; Smith et al. 2009; Tashobya et al. 2014).”
BackgroundSelf-citationReporting health care performance: learning from the past, prospects for the future
Mannion, R., & Davies, H. T. O. (2002) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2002.00331.x · Cited by 67
Using Hierarchical Cluster Analysis in Nursing Research
Beckstead, J. W. (2002) · Western Journal of Nursing Research · doi:10.1177/01939450222045923 · Cited by 66 · cited 2×
“In health it has been used extensively in biomedicine, in genetics, asthma and cancer studies and in psychology (Tavazoie et al. 1999; Beckstead 2002; Dyrskjot et al. 2003; Haldar et al. 2008; Andreopoulos et al. 2009).”
MethodThe New Conventional Wisdom: An Evaluation of the Who Report Health Systems: Improving Performance
Navarro, V. (2001) · International Journal of Health Services · doi:10.2190/3lm8-a37q-fkj4-te0r · Cited by 61 · cited 1×
“Such criticisms were raised, for example, against the ranking of WHO member countries in 2000, and for the UK NHS performance assessment approach (Navarro 2000, 2001; Adab et al. 2002; Freeman 2002; Rixom 2002).”
BackgroundLeague Tables for Performance Improvement in Health Care
Nutley, S., & Smith, P. C. (1998) · Journal of Health Services Research & Policy · doi:10.1177/135581969800300111 · Cited by 61 · cited 2×
“…for high quality data; the creation of perverse incentives resulting in gaming and misrepresentation of information and the opinion that such tables are a ritual and not used to support decision making (Nutley and Smith 1998; Freeman 2002; Mannion 2002; Gysels et al.2004; Marshall et al. 2004).”
BackgroundLakhani, A. D. H., Coles, J., Eayres, D., Spence, C., & Rachet, B. (2005) · BMJ · doi:10.1136/bmj.330.7505.1426 · Cited by 55 · cited 3×
“…to date in health systems research, a few studies have shown that hierarchical cluster analysis (HCA), one form of clustering, can be a powerful tool for comparison of entities and for highlighting inequalities (Lakhani et al. 2005; Ruger and Kim 2006; Day et al. 2008; Ottevaere et al. 2011).”
BackgroundMethodMarshall, T. P. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh054 · Cited by 55 · cited 3×
“…for high quality data; the creation of perverse incentives resulting in gaming and misrepresentation of information and the opinion that such tables are a ritual and not used to support decision making (Nutley and Smith 1998; Freeman 2002; Mannion 2002; Gysels et al.2004; Marshall et al. 2004).”
BackgroundMethodLauer, J. A., Lovell, C. A. K., Murray, C. J. L., & EVANS, D. B. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-19 · Cited by 51 · cited 1×
“The choice of equal weighting by the researchers was made given the rationale behind the weighting in the DLT was never explicitly indicated, and the widely differing views in the literature on weighting generally (World Health Organization 2003; Lauer et al. 2004).”
BackgroundHealth systems reforms in Uganda: processes and outputs
Tashobya, C. K., Ssengooba, F., & Oliveira‐Cruz, V. (2006) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 49
Self-citationTwelve worlds: a geo-demographic comparison of global inequalities in mortality
Day, P., Pearce, J. R., & Dorling, D. (2008) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2007.067702 · Cited by 38 · cited 2×
“…to date in health systems research, a few studies have shown that hierarchical cluster analysis (HCA), one form of clustering, can be a powerful tool for comparison of entities and for highlighting inequalities (Lakhani et al. 2005; Ruger and Kim 2006; Day et al. 2008; Ottevaere et al. 2011).”
BackgroundMethodThe way I see it: Working in the Caribbean in the gap between basic and higher surgical training
Pathak, S. (2002) · BMJ · doi:10.1136/bmj.324.7339.s95 · Cited by 30
Public health information needs in districts
Boerma, T. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-s2-s12 · Cited by 21 · cited 2×
“In the recent past, efforts were made by governments and agencies in low-and middle-income countries (L/MICs) to develop comprehensive health system performance assessment (HSPA) frameworks (Barron et al. 2005; Boerma 2013; Ministry of Health 2011).”
BackgroundMethodRixom, A. (2002) · BMJ · doi:10.1136/bmj.325.7357.177 · Cited by 17
Gysels, M. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh067 · Cited by 13 · cited 3×
“…for high quality data; the creation of perverse incentives resulting in gaming and misrepresentation of information and the opinion that such tables are a ritual and not used to support decision making (Nutley and Smith 1998; Freeman 2002; Mannion 2002; Gysels et al.2004; Marshall et al. 2004).”
BackgroundMethodMurindwa, G., Tashobya, C. K., Kyabaggu, J., Rutebemberwa, E., & Nabyonga, J. (2006) · Cited by 10
Self-citationPerformance measurement: is it now more scientific?
Gibberd, R. W. (2005) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzi045 · Cited by 8 · cited 2×
“In most instances, clustering can be done on the basis of readily available data as it does not require data of high precision (given application of data) (Freeman 2002; Gibberd 2005).”
BackgroundMethodDevelopment of HMIS in Least Developed Country Settings: the Case for Uganda
Kintu, P., Nayunja, M., Nzabanita, A., & Magoola, R. (2004) · Cited by 8
Wafula, F., Marwa, C. W., & McCoy, D. (2014) · Globalization and Health · doi:10.1186/1744-8603-10-15 · Cited by 6
DIRTY DATA: DISEASE SURVEILLANCE IN ARUA DISTRICT, UGANDA
Driwale, A. (2005) · Bioline International (Bioline International) · Cited by 5
Smith, G. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609848.008 · Cited by 1
Research works printed but not linked: 6
- Foro GP . 2013. Evaluation de la Performance des Districts Sanitaires An Burkina faso: Analyse Situationnelle et Perspectives. Masters in Public Health, Health Policy and Management, Thesis, Institute of Tropical Medicine, Antwerp.
- Komakech, 2005, The curse of league tables: how Uganda missed the point, Health Policy and Development, 3, 164
- Ministry of Health. 2008a. Aide Memoire: The 7th National Health Assembly and 15th Health Sector Joint Review Mission. Kampala: Ministry of Health and Development Partners.
- Ministry of Health. 2008c. Mid-Term Review of the Health Sector Strategic Plan II. Kampala: Ministry of Health, Uganda.
- Ministry of Health. 2011. Independent review health sector programme of Work 2010. Final Report. Accra, Ministry of Health Ghana.
- Ministry of Health. 2012. Aide Memoire: The 18th Government of Uganda and Development Partners Health Sector Joint Review Mission. Kampala: Ministry of Health and Development Partners.
Cited by
Hogan, D. R., Stevens, G. A., Hosseinpoor, A. R., & Boerma, T. (2018) · The Lancet Global Health · doi:10.1016/s2214-109x(17)30472-2 · Cited by 444
Beyond pilotitis: taking digital health interventions to the national level in China and Uganda
Huang, F., Blaschke, S., & Lucas, H. (2017) · Globalization and Health · doi:10.1186/s12992-017-0275-z · Cited by 182
“District Health Teams are held responsible for the overall performance of services in their district, to the extent that the MoH produces a ‘district league table’ [5] using an HMIS database which is based on a unified reporting system for public and NFP sectors [6, 7].”
MethodMaina, I., Wanjala, P., Soti, D., Kipruto, H., Droti, B., & Boerma, T. (2017) · Bulletin of the World Health Organization · doi:10.2471/blt.17.194399 · Cited by 119
Zakumumpa, H., Tumwine, C., Kiconco, M., & Spicer, N. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06607-w · Cited by 45
“Uganda has a decentralized health system whereby subnational units known as districts retain overall responsibility for social service provision [11, 12].”
BackgroundHenriksson, D. K., Ayebare, F., Waiswa, P., Peterson, S., Tumushabe, E. K., & Fredriksson, M. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2059-9 · Cited by 35
“Although the Ministry of Health in Uganda recognizes the best performing districts annually through the league table [58], it is also important to systematize recognition for good performance at the district level in order to motivate staff.”
Background
Metadata
- Authors
- Tashobya, C. K., Dubourg, D., Ssengooba, F., Speybroeck, N., Macq, J., & Criel, B.
- Affiliations
- Ministry of Health (UG)
- Instituut voor Tropische Geneeskunde (BE)
- Makerere University (UG)
- UCLouvain (BE)
- Corresponding author
- Tashobya, Christine K
- Venue
- Health Policy and Planning
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-05-28
- Volume
- 31
- Issue
- 2
- Pages
- 217-228
- ISSN
- 0268-1080 (ISSN-L)
- 1460-2237
- PMC
- PMC4748130
- OpenAlex
- W2261717200
- Cited by
- 22
- References
- 40
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2022: 1 · 2021: 6 · 2018: 4 · 2017: 5
- FWCI
- 5.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Health Policy and Planning (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (publishedVersion)
- Digital Access to Libraries (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Practices
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Reforms
- Keywords
- hierarchical clustering, health performance indicators, composite index, Uganda, low-income countries
- MeSH terms
- Decision Making, Delivery of Health Care, Government Programs, Humans, Uganda, Models, Statistical, Cluster Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.