Systematic review of statistics on causes of deaths in hospitals: strengthening the evidence for policy-makers
Open accessAbstract
OBJECTIVE: To systematically review the reliability of hospital data on cause of death and encourage periodic reviews of these data using a standard method. METHODS: We searched Google Scholar, Pubmed and Biblioteca Virtual de la Salud for articles in English, Spanish and Portuguese that reported validation studies of data on cause of death. We analysed the results of 199 studies that had used medical record reviews to validate the cause of death reported on death certificates or by the vital registration system. FINDINGS: The screened studies had been published between 1983 and 2013 and their results had been reported in English (n = 124), Portuguese (n = 25) or Spanish (n = 50). Only 29 of the studies met our inclusion criteria. Of these, 13 had examined cause of death patterns at the population level - with a view to correcting cause-specific mortality fractions - while the other 16 had been undertaken to identify discrepancies in the diagnosis for specific diseases before and after medical record review. Most of the selected studies reported substantial misdiagnosis of causes of death in hospitals. There was wide variation in study methodologies. Many studies did not describe the methods used in sufficient detail to be able to assess the reproducibility or comparability of their results. CONCLUSION: The assumption that causes of death are being accurately reported in hospitals is unfounded. To improve the reliability and usefulness of reported causes of death, national governments should do periodic medical record reviews to validate the quality of their hospital cause of death data, using a standard.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ICD coding practices documenting the underlying cause of death can vary.
“Other limitations of our study include, first, that ICD coding practices documenting the underlying cause of death can vary.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Validation of cause-of-death statistics in urban China
Rao, C., Yang, G., Hu, J., Ma, J., Xia, W., & Lopez, A. D. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym003 · Cited by 88 · see citing works
Pattaraarchachai, J., Rao, C., Polprasert, W., Porapakkham, Y., Pao-in, W., Singwerathum, N., & Lopez, A. D. (2010) · Population Health Metrics · doi:10.1186/1478-7954-8-12 · Cited by 64 · see citing works
Flagged first, then by citations
Research works printed but not linked: 38
- [1]Gaete-Darbó A. Appraisal of vital statistics in Latin America. Milbank Mem Fund Q. 1964; 42(2): 86– 117. 10.2307/3348659 5889230 · DOI
- [2]Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al.; Monitoring Vital Events. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007 10; 370(9599): 1653– 63. 10.1016/S0140-6736(07)61308-7 18029006 · DOI · Paper page
- [3]Rao C, Lopez AD, Yang G, Begg S, Ma J. Evaluating national cause-of-death statistics: principles and application to the case of China. Bull World Health Organ. 2005; 83(8): 618– 25. 16184281 PMC2626325
- [4]Polprasert W, Rao C, Adair T, Pattaraarchachai J, Porapakkham Y, Lopez AD. Cause-of-death ascertainment for deaths that occur outside hospitals in Thailand: application of verbal autopsy methods. Popul Health Metr. 2010; 8(1): 13.. 10.1186/1478-7954-8-13 20482760 PMC2881896 · DOI
- [5]World Health Organization. Annual epidemiological and vital statistics 1939-1946. Part 1: vital statistics and causes of death. New York: Columbia University Press; 1952.
- [7]Shibuya K, Scheele S, Boerma T. Health statistics: time to get serious. Bull World Health Organ. 2005; 83(10): 722. 16283042 PMC2626417
- [8]Ruzicka LT, Lopez AD. The use of cause-of-death statistics for health situation assessment: national and international experiences. World Health Stat Q. 1990; 43(4): 249– 58. 2293493
- [12]Rampatige R, Mikkelsen L, Hernandez B, Riley I, Lopez AD. Hospital cause-of-death statistics: what should we make of them? Bull World Health Organ. 2014; 92(1): 3– 3A. 10.2471/BLT.13.134106 24391292 PMC3865553 · DOI
- [14]Burger EH, Groenewald P, Bradshaw D, Ward AM, Yudkin PL, Volmink J. Validation study of cause of death statistics in Cape Town, South Africa, found poor agreement. J Clin Epidemiol. 2012; 65(3): 309– 16. 10.1016/j.jclinepi.2011.08.007 22169084 · DOI
- [15]González-Medina A, Martínez-Natera O. Concordancia entre el diagnóstico de defunción y el diagnóstico anatomopatológico por necropsias en el Hospital Central Militar. Rev Sanid Milit. 2001; 55(3): 95– 101. Spanish.
- [16]Hernández B, Ramírez-Villalobos D, Romero M, Gómez S, Atkinson C, Lozano R. Assessing quality of medical death certification: Concordance between gold standard diagnosis and underlying cause of death in selected Mexican hospitals. Popul Health Metr. 2011; 9(1): 38. 10.1186/1478-7954-9-38 21816103 PMC3160931 · DOI
- [19]Shojania KG, Burton EC, McDonald KM, Goldman L. Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. JAMA. 2003; 289(21): 2849– 56. 10.1001/jama.289.21.2849 12783916 · DOI
- [20]Carter K, Hufanga S, Rao C, Akauola S, Lopez AD, Rampatige R, et al. Causes of death in Tonga: quality of certification and implications for statistics. Popul Health Metr. 2012; 10(1): 4. 10.1186/1478-7954-10-4 22390221 PMC3378436 · DOI
- [21]de Carvalho MH, Álvarez-Hernández G, Denman C, Harlow SD. Validity of underlying cause of death statistics in Hermosillo, Mexico. Salud Publica Mex. 2011; 53(4): 312– 9. 10.1590/S0036-36342011000400005 21986787 · DOI
- [22]Rampatige R, Gamage S, Peiris S, Lopez AD. Assessing the reliability of causes of death reported by the Vital Registration System in Sri Lanka: medical records review in Colombo. HIM J. 2013; 42(3): 20– 8. 24067238
- [23]Gotsens M, Marí-Dell’Olmo M, Rodríguez-Sanz M, Martos D, Espelt A, Pérez G, et al. [Validation of the underlying cause of death in medico-legal deaths]. Rev Esp Salud Publica. 2011; 85(2): 163– 74. Spanish. 10.1590/S1135-57272011000200005 21826379 · DOI
- [24]Rodriguez Almada H, Ciriacos C, Piñeyrúa M, Logaldo R, González González D. Calidad del registro en el certificado de defunción en un hospital publico de referencia. Montevideo, Uruguay. Rev Med Urug (Montev). 2010; 26: 216– 23 Spanish.
- [25]Durruthy Wilson O, Sifontes Estrada M, Martínez Varona C, Olazábal Hernández A. [From the death certificate to the protocol of necropsy: basic causes of death]. Rev Arch Méd. 2011; 15(3): 542- 52. Spanish. 10.1016/0895-4356(90)90094-6 2254765 · DOI
- [26]Fajardo S, Aerts DR, Bassanesi SL. [Accuracy of the Mortality Information System team in the specification of underlying cause of death in a State capital in southern Brazil]. Cad Saude Publica. 2009; 25(10): 2218– 28. Portuguese. 10.1590/S0102-311X2009001000012 19851621 · DOI
- [27]Khosravi A, Rao C, Naghavi M, Taylor R, Jafari N, Lopez AD. Impact of misclassification on measures of cardiovascular disease mortality in the Islamic Republic of Iran: a cross-sectional study. Bull World Health Organ. 2008 9; 86(9): 688– 96. 10.2471/BLT.07.046532 18797644 PMC2649498 · DOI · Paper page
- [28]Alpérovitch A, Bertrand M, Jougla E, Vidal J-S, Ducimetière P, Helmer C, et al. Do we really know the cause of death of the very old? Comparison between official mortality statistics and cohort study classification. Eur J Epidemiol. 2009; 24(11): 669– 75. 10.1007/s10654-009-9383-2 19728117 · DOI
- [29]Agarwal R, Norton JM, Konty K, Zimmerman R, Glover M, Lekiachvili A, et al. Overreporting of deaths from coronary heart disease in New York City hospitals, 2003. Prev Chronic Dis. 2010; 7(3): A47. 20394686 PMC2879979
- [30]Casco Jarquín A. MitaAlbán LC. [Clinical study of the discrepancy between death diagnosis and the findings of autopsy in the Hospital Calderón Guardia]. Acta Med Costarric. 2003; 45(1): 15– 9 Spanish.
- [31]Nunes J, Koifman RJ, Mattos IE, Monteiro GT. [Reliability and validity of uterine cancer death certificates in the municipality of Belém, Pará, Brazil]. Cad Saude Publica. 2004; 20(5): 1262– 8. Portuguese. 10.1590/S0102-311X2004000500020 15486669 · DOI
- [32]Piñón Pérez J, Hernández Amaro Y, Lores Echevarría C, Lemus Sarracino A, Alvarez Miranda C. Certificados de defunción versus estudios necrópsicos en el infarto miocárdico agudo. Rev Ciencias Medicas Pinar del Rio. 2006; 10(3): 61– 70 Spanish.
- [33]Carvalho ML, Silver LD. [Reliability of the certification of the basic causes of neonatal deaths: implications for the study of preventable mortality]. Rev Saude Publica. 1995; 29(5): 342– 8. Portuguese. 10.1590/S0034-89101995000500002 8731273 · DOI
- [34]Niobey FM, Cascão AM, Duchiade MP, Sabroza PC. [The quality of the filling-in of death certificates of children below one year of age in the metropolitan area of Rio de Janeiro]. Rev Saude Publica. 1990; 24(4): 311– 8. Portuguese. 10.1590/S0034-89101990000400009 2103649 · DOI
- [35]Johansson LA, Björkenstam C, Westerling R. Unexplained differences between hospital and mortality data indicated mistakes in death certification: an investigation of 1,094 deaths in Sweden during 1995. J Clin Epidemiol. 2009; 62(11): 1202– 9. 10.1016/j.jclinepi.2009.01.010 19364635 · DOI
- [36]de Arán Barés M, Pérez G, Rosell J, Molina P. [Exactness of mortality statistics by external and natural causes of death with medico-legal intervention in Catalonia, 1996]. Gac Sanit. 2000; 14(5): 356– 62. Spanish. 11187453
- [37]Granero R, Ortiz R, Gómez-Marín O, Isaacura C, Goyo A, Rodríguez J. [Validation of “myocardial infarction” as cause of death on death certificates in Barquisimeto, Lara state, Venezuela]. Cad Saude Publica. 1997; 13(3): 383– 7. Spanish. 10.1590/S0102-311X1997000300013 10886877 · DOI
- [38]Laclé-Murray A. Causas de muerte en una cohorte de diabéticos tipo 2 de Costa Rica y la calidad de su certificado de defunción. Acta Med Costarric. 2012; 54(1): 23– 30 Spanish.
- [39]Cordeiro R, Peñaloza ERO, Cardoso CF, Cortez DB, Kakinami E, Souza JJ, et al. [Validity of information on occupation and principal cause of death certificates in Botucatu, Sao Paulo]. Cad Saude Publica. 1999; 15(4): 719– 28. Portuguese. 10.1590/S0102-311X1999000400006 10633194 · DOI
- [40]Monteiro GT, Koifman RJ, Koifman S. [Reliability and accuracy of reported causes of death from cancer. II. Accuracy of stomach cancer reported in the municipality of Rio de Janeiro County, Brazil]. Cad Saude Publica. 1997; 13 Suppl 1: 53– 65. Portuguese. 10.1590/S0102-311X1997000500006 10886924 · DOI
- [41]Schnitman A. [Analysis of the reliability of the declaration of cancer as the basic cause of death in Salvador, Brazil]. Rev Saude Publica. 1990; 24(6): 490– 6. Portuguese. 10.1590/S0034-89101990000600007 2103070 · DOI
- [43]Moussa MAA, Shafie MZ, Khogali MM, el-Sayed AM, Sugathan TN, Cherian G, et al. Reliability of death certificate diagnoses. J Clin Epidemiol. 1990; 43(12): 1285– 95. 10.1016/0895-4356(90)90094-6 2254765 · DOI
- [44]Porapakkham Y, Rao C, Pattaraarchachai J, Polprasert W, Vos T, Adair T, et al. Estimated causes of death in Thailand, 2005: implications for health policy. Popul Health Metr. 2010; 8(1): 14. 10.1186/1478-7954-8-14 20482761 PMC2885317 · DOI
- [45]Maudsley G, Williams L. Death certification–a sad state of affairs. J Public Health Med. 1994; 16(3): 370– 1. 7999397
- [46]Murray CJL, Lozano R, Flaxman AD, Vahdatpour A, Lopez AD. Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studies. Popul Health Metr. 2011; 9(1): 28. 10.1186/1478-7954-9-28 21816106 PMC3160921 · DOI · Paper page
Cited by
Sorted by citations
Ong, K. L., Stafford, L. K., McLaughlin, S. A., Boyko, E. J., Vollset, S. E., Smith, A. E., Dalton, B. E., Duprey, J., Cruz, J. A., Hagins, H., et al. (2023) · The Lancet · doi:10.1016/s0140-6736(23)01301-6 · Cited by 4,681 · see citing works
“86 Second, many deaths that are coded as being caused by diabetes do not specify the diabetes type.”
Naghavi, M., Richards, N., Chowdhury, H., Eynstone-Hinkins, J., Franca, E., Hegnauer, M., Khosravi, A., Moran, L., Mikkelsen, L., & Lopez, A. D. (2020) · BMC Medicine · doi:10.1186/s12916-020-01525-w · Cited by 74 · see citing works
Self-citationAge and the relative importance of liver-related deaths in nonalcoholic fatty liver disease
Lin, H., Yip, T. C., Zhang, X., Li, G., Tse, Y., Hui, V. W., Liang, L. Y., Lai, J. C., Chan, S. L., Chan, H. L., et al. (2023) · Hepatology · doi:10.1002/hep.32633 · Cited by 52 · see citing works
- Authors
- Rampatige, R., Mikkelsen, L., Hernandez, B., Riley, I., & Lopez, A. D.
- Affiliations
- The University of Queensland (AU)
- LM Consulting, Brisbane, Australia.
- Institute for Health Metrics and Evaluation, University of Washington, Seattle, United States of America.
- University of Melbourne, Melbourne School of Population and Global Health, Building 379, 207 Bouverie Street, Carlton 3053, Victoria, Australia.
- Venue
- Bulletin of the World Health Organization
- Publisher
- WHO Press
- Published
- 2014-09-16
- Volume
- 92
- Issue
- 11
- Pages
- 807-816
- ISSN
- 0042-9686 (ISSN-L)
- PMC
- PMC4221770
- OpenAlex
- W2102740800
- Cited by
- 98
- References
- 2
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 7 · 2023: 9 · 2022: 9 · 2021: 10 · 2020: 17 · 2019: 8 · 2018: 12 · 2017: 5 · 2016: 6 · 2015: 4
- FWCI
- 0.76
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Bulletin of the World Health Organization (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Autopsy Techniques and Outcomes
- Health Sciences › Health Professions › Health Information Management › Global Health and Epidemiology
- Keywords
- causes of death, data validation, medical records review, death certificates, civil registration, misdiagnosis, cause-specific mortality fractions, data quality
- MeSH terms
- Cause of Death, Death Certificates, Health Policy, Humans, Medical Records, Statistics as Topic, Hospital Mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review