Performance of four computer-coded verbal autopsy methods for cause of death assignment compared with physician coding on 24,000 deaths in low- and middle-income countries
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: Physician-coded verbal autopsy (PCVA) is the most widely used method to determine causes of death (CODs) in countries where medical certification of death is uncommon. Computer-coded verbal autopsy (CCVA) methods have been proposed as a faster and cheaper alternative to PCVA, though they have not been widely compared to PCVA or to each other. Methods: We compared the performance of open-source random forest, open-source tariff method, InterVA-4, and the King-Lu method to PCVA on five datasets comprising over 24,000 verbal autopsies from low- and middle-income countries. Metrics to assess performance were positive predictive value and partial chance-corrected concordance at the individual level, and cause-specific mortality fraction accuracy and cause-specific mortality fraction error at the population level. Results: The positive predictive value for the most probable COD predicted by the four CCVA methods averaged about 43% to 44% across the datasets. The average positive predictive value improved for the top three most probable CODs, with greater improvements for open-source random forest (69%) and open-source tariff method (68%) than for InterVA-4 (62%). The average partial chance-corrected concordance for the most probable COD predicted by the open-source random forest, open-source tariff method and InterVA-4 were 41%, 40% and 41%, respectively, with better results for the top three most probable CODs. Performance generally improved with larger datasets. At the population level, the King-Lu method had the highest average cause-specific mortality fraction accuracy across all five datasets (91%), followed by InterVA-4 (72% across three datasets), open-source random forest (71%) and open-source tariff method (54%). Conclusions: On an individual level, no single method was able to replicate the physician assignment of COD more than about half the time. At the population level, the King-Lu method was the best method to estimate cause-specific mortality fractions, though it does not assign individual CODs. Future testing should focus on combining different computer-coded verbal autopsy tools, paired with PCVA strengths. This includes using open-source tools applied to larger and varied datasets (especially those including a random sample of deaths drawn from the population), so as to establish the performance for age- and sex-specific CODs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Verbal Autopsy: Methods in Transition
Fottrell, E., & Byass, P. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq003 · Cited by 195 · cited 5×
“Background Verbal autopsy (VA) is used in areas with limited medical certification of death to obtain information on causes of death (CODs) [1-3].”
BackgroundMethodInfluentialSelf-citationMurray, C. J., Lopez, A. D., Black, R., Ahuja, R., Ali, S. M., Baqui, A., Dandona, L., Dantzer, E., Das, V., Dhingra, U., et al. (2011) · Population Health Metrics · doi:10.1186/1478-7954-9-27 · Cited by 194 · cited 4×
“The ORF showed very similar trends to those from the IHME random forest, though differences were to be expected due to the unavailability of the full IHME hospital-based dataset [7].”
BackgroundMethodResultInfluentialRevising the WHO verbal autopsy instrument to facilitate routine cause-of-death monitoring
Leitao, J., Chandramohan, D., Byass, P., Jakob, R., Bundhamcharoen, K., Choprapawon, C., de Savigny, D., Fottrell, E., França, E., Frøen, F., et al. (2013) · Global Health Action · doi:10.3402/gha.v6i0.21518 · Cited by 137 · cited 1×
“Two slightly modified versions of each original dataset were created; one version to be used for the data-driven methods (ORF, OTM, KL), and another for InterVA-4, which only uses specific indicators [16].”
MethodSelf-citationAnker, M. (1997) · International Journal of Epidemiology · doi:10.1093/ije/26.5.1090 · Cited by 119
Aleksandrowicz, L., Malhotra, V., Dikshit, R., Gupta, P. C., Kumar, R., Sheth, J., Rathi, S. K., Suraweera, W., Miasnikof, P., Jotkar, R., et al. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-21 · Cited by 74 · cited 2×
“The Indian Million Death Study (MDS) [9,10] included only child deaths from ages 1 to 59 months.”
Self-citation
Cited by
Ahmed, I., Ali, S. M., Amenga-Etego, S., Ariff, S., Bahl, R., Baqui, A. H., Begum, N., Bhandari, N., Bhatia, K., Bhutta, Z. A., et al. (2018) · The Lancet Global Health · doi:10.1016/s2214-109x(18)30385-1 · Cited by 330
Aleksandrowicz, L., Malhotra, V., Dikshit, R., Gupta, P. C., Kumar, R., Sheth, J., Rathi, S. K., Suraweera, W., Miasnikof, P., Jotkar, R., et al. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-21 · Cited by 74
“The debate about physician versus machine coding is somewhat misleading [52], as it misses the key point that far more nationally-representative studies are needed.”
Self-citationExtracting Cause of Death from Verbal Autopsy with Deep Learning interpretable methods
Blanco, A., Perez, A., Casillas, A., & Cobos, D. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3005769 · Cited by 17
Metadata
- Authors
- Desai, N., Aleksandrowicz, L., Miasnikof, P., Lu, Y., Leitao, J., Byass, P., Tollman, S., Mee, P., Alam, D., Rathi, S. K., Singh, A., Kumar, R., Ram, F., & Jha, P.
- Venue
- BMC Medicine
- Published
- 2014-02-04
- Volume
- 12
- Issue
- 1
- Pages
- 20-20
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W2004590896
- Cited by
- 53
- References
- 5
- FWCI
- 11.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance of four computer-coded verbal autopsy methods for cause of death assignment compared with physician coding on 24,000 deaths in low- and middle-income countries. https://app.cochat.ai/papers/10.1186/1741-7015-12-20
- The paper
- Desai, N., Aleksandrowicz, L., Miasnikof, P., Lu, Y., Leitao, J., Byass, P., Tollman, S., Mee, P., Alam, D., Rathi, S. K., Singh, A., Kumar, R., Ram, F., & Jha, P. (2014). Performance of four computer-coded verbal autopsy methods for cause of death assignment compared with physician coding on 24,000 deaths in low- and middle-income countries. BMC Medicine. https://doi.org/10.1186/1741-7015-12-20
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.