The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Measuring misclassification of Covid-19 as garbage codes: Results of investigating 1,365 deaths and implications for vital statistics in Brazil
Open accessAbstract
The purpose of this article is to quantify the amount of misclassification of the Coronavirus Disease-2019 (COVID-19) mortality occurring in hospitals and other health facilities in selected cities in Brazil, discuss potential factors contributing to this misclassification, and consider the implications for vital statistics. Hospital deaths assigned to causes classified as garbage code (GC) COVID-related cases (severe acute respiratory syndrome, pneumonia unspecified, sepsis, respiratory failure and ill-defined causes) were selected in three Brazilian state capitals. Data from medical charts and forensic reports were extracted from standard forms and analyzed by study physicians who re-assigned the underlying cause based on standardized criteria. Descriptive statistical analysis was performed and the potential impact in vital statistics in the country was also evaluated. Among 1,365 investigated deaths due to GC-COVID-related causes, COVID-19 was detected in 17.3% in the age group 0–59 years and 25.5% deaths in 60 years and over. These GCs rose substantially in 2020 in the country and were responsible for 211,611 registered deaths. Applying observed proportions by age, location and specific GC-COVID-related cause to national data, there would be an increase of 37,163 cases in the total of COVID-19 deaths, higher in the elderly. In conclusion, important undercount of deaths from COVID-19 among GC-COVID-related causes was detected in three selected capitals of Brazil. After extrapolating the study results for national GC-COVID-related deaths we infer that the burden of COVID-19 disease in Brazil in official vital statistics was probably under estimated by at least 18% in the country in 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“During these years, there is evidence that deaths due to COVID-19 were misclassified as other causes of death.24, 25”
In the citing paper
“A recent study in Brazil found marked levels of misclassified COVID-19 deaths in garbage codes and hypothesised that there are additional misclassified COVID-19 deaths in other respiratory diseases.81”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Roth, G. A., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32203-7 · Cited by 8,600
Naghavi, M., Abajobir, A. A., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abera, S. F., Aboyans, V., Adetokunboh, O., Afshin, A., Agrawal, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32152-9 · Cited by 4,821
de Souza, F. S. H., Hojo-Souza, N. S., Batista, B. D. D. O., da Silva, C. M., & Guidoni, D. L. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248580 · Cited by 250 · cited 1×
“Concerning the issue of completeness of total deaths, considering SIM in this study as the source of cases to be investigated has the advantage that this system probably has better quality in monitoring deaths than the surveillance system SIVEP-Gripe, which is based on passive notifications of hospital admissions due…”
ResultCOVID-19 deaths in Africa: prospective systematic postmortem surveillance study
Mwananyanda, L., Gill, C. J., MacLeod, W., Kwenda, G., Pieciak, R., Mupila, Z., Lapidot, R., Mupeta, F., Forman, L., Ziko, L., et al. (2021) · BMJ · doi:10.1136/bmj.n334 · Cited by 211
Desafios e propostas para ampliação da testagem e diagnóstico para COVID-19 no Brasil
Magno, L., Rossi, T. R. A., Lima, F. W. D. M., dos Santos, C. C., Campos, G. B., Marques, L. M., Pereira, M. E., Prado, N. M. D. B. L., & Dourado, I. C. (2020) · Ciência & Saúde Coletiva · doi:10.1590/1413-81232020259.17812020 · Cited by 209 · cited 2×
“The lack of tests for the population was higher in the first months of 2020, and over time testing has increased [6,19].”
BackgroundPublic health utility of cause of death data: applying empirical algorithms to improve data quality
Johnson, S. C., Cunningham, M., Dippenaar, I. N., Sharara, F., Wool, E. E., Agesa, K. M., Han, C., Miller-Petrie, M. K., Wilson, S., Fuller, J. E., et al. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01501-1 · Cited by 175 · cited 1×
“Multiple cause analysis, negative correlation, and proportional redistribution are the three most frequent methods used for defining the target codes to which deaths are redistributed and the redistribution factors [21].”
MethodReduction in life expectancy in Brazil after COVID-19
Castro, M. C., Gurzenda, S., Turra, C. M., Kim, S., Andrasfay, T., & Goldman, N. (2021) · Nature Medicine · doi:10.1038/s41591-021-01437-z · Cited by 168 · cited 1×
“The excess of deaths impacted life expectancy, and reduced the quality of classification of the underlying cause of death [10].”
BackgroundVictora, C. G., Castro, M. C., Gurzenda, S., de Medeiros, A. C., de França, G. V. A., & Barros, A. J. D. (2021) · EClinicalMedicine · doi:10.1016/j.eclinm.2021.101036 · Cited by 154 · cited 1×
“Monitoring deaths is an important element in evaluating mortality trends and vaccine effectiveness for COVID-19 [1].”
BackgroundA shortened verbal autopsy instrument for use in routine mortality surveillance systems
Serina, P. T., Riley, I. D., Stewart, A., Flaxman, A. D., Lozano, R., Mooney, M., Luning, R., Hernández, B., Black, R. E., Ahuja, R., et al. (2015) · BMC Medicine · doi:10.1186/s12916-015-0528-8 · Cited by 110 · cited 1×
“Another specific diagnosis not COVID-19: criteria with degree of certainty as proposed previously [12].”
BackgroundHart, J., Sorchik, R., Bo, K. S., Chowdhury, H. R., Gamage, S., Joshi, R., Kwa, V., Li, H., Mahesh, P. K. B., McLaughlin, D., et al. (2020) · BMC Medicine · doi:10.1186/s12916-020-01519-8 · Cited by 109 · cited 1×
“Therefore, efforts should be directed towards better quality of medical care and more access to quality health services [26], and also in training of physicians regarding death certificate completion [27], particularly in the dramatic epidemic situation in the country in which the counting of deaths is of great intere…”
Background
Research works printed but not linked: 6
- KLM Messias, 2016, The quality of certification of deaths due to external causes in the city of Fortaleza in the State of Ceará, Brazil, Cien Saude Colet, 21, 1255
- MF Marinho, 2019, Data for health: impact on improving the quality of cause-of-death information in Brazil, Rev Bras Epidemiol, 22
- Cortez-Escalante J, França E, Vasconcelos AMN, Abreu, DMX, Ishitani L, França GVA. Impacto da COVID-19 no perfil dos óbitos hospitalares e domiciliares no Brasil em 2020. 11º Congresso Brasileiro de Epidemiologia, Pôster Eletrônico, novembro de 2021. http://proceedings.science/epi-2021/papers/impacto-da-covid-19-no-perfil-dos-obitos-hospitalares-e-domiciliares-no-brasil-em-2020.
- FET Lima, 2020, Time interval between onset of symptoms and COVID-19 testing in Brazilian state capitals, August 2020, Epidemiol Serv Saude, 30, e2020788
- FB Pilecco, 2021, The effect of laboratory testing on COVID-19 monitoring indicators: an analysis of the 50 countries with the highest number of cases, Epidemiol Serv Saude, 30, e2020722
- MR Souza, 2019, Deaths from sepsis: underlying causes of death after investigation in 60 Brazilian municipalities in 2017, Rev Bras Epidemiol, 22
Cited by
Naghavi, M., Kyu, H. H., A, B., Aalipour, M. A., Aalruz, H., Ababneh, H. S., Abafita, B. J., Abaraogu, U. O., Abbafati, C., Abbasi, M., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)01917-8 · Cited by 595
Estatística Cardiovascular – Brasil 2023
de Oliveira, G. M. M., Brant, L. C. C., Polanczyk, C. A., Malta, D. C., Biolo, A., Nascimento, B. R., de Souza, M. D. F. M., Lorenzo, A. D., Fagundes, A. A. D. P., Schaan, B. D., et al. (2024) · Arquivos Brasileiros de Cardiologia · doi:10.36660/abc.20240079 · Cited by 339
Self-citationSirota, S. B., Doxey, M. C., Dominguez, R.-M. V., Bender, R. G., Vongpradith, A., Albertson, S. B., Novotney, A., Burkart, K. G., Carter, A., Abdi, P., et al. (2024) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(24)00430-4 · Cited by 189
Ledesma, J. R., Ma, J., Zhang, M., Basting, A. V. L., Chu, H. T., Vongpradith, A., Novotney, A., LeGrand, K. E., Xu, Y. Y., Dai, X., et al. (2024) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(24)00007-0 · Cited by 146
“81 Several other studies have also shown potential misclassified COVID-19 deaths in non-COVID-19 respiratory conditions, 82,83 which might be amplified in locations with scarce or inadequate SARS-CoV-2 diagnostic capabilities.”
Brant, L. C. C., Pinheiro, P. C., Passaglia, L. G., Souza, M. F., Malta, D. C., Banerjee, A., Ribeiro, A. L. P., & Nascimento, B. R. (2022) · Public Health · doi:10.1016/j.puhe.2023.08.027 · Cited by 12
Metadata
- Authors
- França, E. B., Ishitani, L. H., de Abreu, D. M. X., Teixeira, R. A., Corrêa, P. R. L., de Jesus, E. D. S., Marinho, M. A. D., Bahia, T. V., Bierrenbach, A. L., Setel, P., & Marinho, F.
- Affiliations
- Universidade Federal de Minas Gerais (BR)
- Vital Strategies (US)
- Corresponding author
- França, Elisabeth B.
- ORCID
- Venue
- PLOS Global Public Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-05-05
- Volume
- 2
- Issue
- 5
- Pages
- e0000199
- ISSN
- 2767-3375 (ISSN-L)
- PMC
- PMC10021639
- OpenAlex
- W4229021858
- Cited by
- 21
- References
- 28
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 9 · 2023: 2 · 2022: 1
- FWCI
- 3.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Global Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Vital Strategies- GGP-CRVS Brazil Data for Health (23998 n. Fundep)
- Resolve to Save Lives – an initiative of Vital Strategies (RE-NC-CCRV-35-BR)
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Keywords
- COVID-19 mortality, garbage codes, vital statistics, in-hospital mortality, underlying cause of death, COVID-19 detection, Brazil, older adults, age-specific mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.