Performance of the Tariff Method: validation of a simple additive algorithm for analysis of verbal autopsies
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Background: Verbal autopsies provide valuable information for studying mortality patterns in populations that lack reliable vital registration data. Methods for transforming verbal autopsy results into meaningful information for health workers and policymakers, however, are often costly or complicated to use. We present a simple additive algorithm, the Tariff Method (termed Tariff), which can be used for assigning individual cause of death and for determining cause-specific mortality fractions (CSMFs) from verbal autopsy data. Methods: Tariff calculates a score, or "tariff," for each cause, for each sign/symptom, across a pool of validated verbal autopsy data. The tariffs are summed for a given response pattern in a verbal autopsy, and this sum (score) provides the basis for predicting the cause of death in a dataset. We implemented this algorithm and evaluated the method's predictive ability, both in terms of chance-corrected concordance at the individual cause assignment level and in terms of CSMF accuracy at the population level. The analysis was conducted separately for adult, child, and neonatal verbal autopsies across 500 pairs of train-test validation verbal autopsy data. Results: Tariff is capable of outperforming physician-certified verbal autopsy in most cases. In terms of chance-corrected concordance, the method achieves 44.5% in adults, 39% in children, and 23.9% in neonates. CSMF accuracy was 0.745 in adults, 0.709 in children, and 0.679 in neonates. Conclusions: Verbal autopsies can be an efficient means of obtaining cause of death data, and Tariff provides an intuitive, reliable method for generating individual cause assignment and CSMFs. The method is transparent and flexible and can be readily implemented by users without training in statistics or computer science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Verbal Autopsy: Methods in Transition
Fottrell, E., & Byass, P. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq003 · Cited by 195 · cited 2×
“Background Verbal autopsies (VAs) are increasingly being used to provide information on causes of death in demographic surveillance sites (DSSs), national surveys, censuses, and sample registration schemes [1-3].”
BackgroundMurray, C. J., Lopez, A. D., Black, R., Ahuja, R., Ali, S. M., Baqui, A., Dandona, L., Dantzer, E., Das, V., Dhingra, U., et al. (2011) · Population Health Metrics · doi:10.1186/1478-7954-9-27 · Cited by 194 · cited 7×
“We have repeated the development of tariffs and tariff scores using household recall of health care experience (HCE) and excluding these variables [10] in order to estimate the method’s performance in settings where access to health care is uncommon.”
MethodSelf-citationLozano, R., Lopez, A. D., Atkinson, C., Naghavi, M., Flaxman, A. D., & Murray, C. J. (2011) · Population Health Metrics · doi:10.1186/1478-7954-9-32 · Cited by 101
Self-citation
Research works printed but not linked: 13
- Soleman N, Chandramohan D, Shibuya K: Verbal autopsy: current practices and challenges. Bull World Health Organ 2006, 84: 239-245. 10.2471/BLT.05.027003 · DOI · Paper page
- Baiden F, Bawah A, Biai S, Binka F, Boerma T, Byass P, Chandramohan D, Chatterji S, Engmann C, Greet D, Jakob R, Kahn K, Kunii O, Lopez AD, Murray CJL, Nahlen B, Rao C, Sankoh O, Setel PW, Shibuya K, Soleman N, Wright L, Yang G: Setting international standards for verbal autopsy. Bull World Health Organ 2007, 85: 570-571. 10.2471/BLT.07.043745 · DOI · Paper page
- Byass P, Fottrell E, Dao LH, Berhane Y, Corrah T, Kahn K, Muhe L, Do DV: Refining a probabilistic model for interpreting verbal autopsy data. Scand J Public Health 2006, 34: 26-31. 10.1080/14034940510032202 · DOI · Paper page
- Byass P, Huong DL, Minh HV: A probabilistic approach to interpreting verbal autopsies: methodology and preliminary validation in Vietnam. Scand J Public Health Suppl 2003, 62: 32-37. · DOI · Paper page
- Byass P, Kahn K, Fottrell E, Collinson MA, Tollman SM: Moving from data on deaths to public health policy in Agincourt, South Africa: approaches to analysing and understanding verbal autopsy findings. PLoS Med 2010, 7: e1000325. 10.1371/journal.pmed.1000325 · DOI · Paper page
- Flaxman AD, Vahdatpour A, Green S, James SL, Murray CJL, the Population Health Metrics Research Consortium (PHMRC): Random forests for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standards. Popul Health Metr 2011, 9: 29. 10.1186/1478-7954-9-29 · DOI · Paper page
- Murray CJL, James SL, Birnbaum JK, Freeman MK, Lozano R, Lopez AD, the Population Health Metrics Research Consortium (PHMRC): Simplified Symptom Pattern Method for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standards. Popul Health Metr 2011, 9: 30. 10.1186/1478-7954-9-30 · DOI · Paper page
- Murray CJL, Lopez AD, Feehan DM, Peter ST, Yang G: Validation of the Symptom Pattern Method for Analyzing Verbal Autopsy Data. PLoS Med 2007, 4: e327. 10.1371/journal.pmed.0040327 · DOI · Paper page
- Gakidou E, Lopez AD: What do children die from in India today? The Lancet 2010, 376: 1810-1811. 10.1016/S0140-6736(10)62054-5 · DOI
- King G, Lu Y: Verbal Autopsy Methods with Multiple Causes of Death. Statistical Science 2008, 23: 78-91. 10.1214/07-STS247 · DOI · Paper page
- Flaxman AD, Vahdatpour A, James SL, Birnbaum JK, Murray CJL, the Population Health Metrics Research Consortium (PHMRC): Direct estimation of cause-specific mortality fractions from verbal autopsies: multisite validation study using clinical diagnostic gold standards. Popul Health Metr 2011, 9: 35. 10.1186/1478-7954-9-35 · DOI · Paper page
- Murray CJL, Lozano R, Flaxman AD, Vahdatpour A, Lopez AD: Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studies. Popul Health Metr 2011, 9: 28. 10.1186/1478-7954-9-28 · DOI · Paper page
- Lozano R, Freeman MK, James SL, Campbell B, Lopez AD, Flaxman AD, Murray CJL, the Population Health Metrics Research Consortium (PHMRC): Performance of InterVA for assigning causes of death to verbal autopsies: multisite validation study using clinical diagnostic gold standards. Popul Health Metr 2011, 9: 50. 10.1186/1478-7954-9-50 · DOI · Paper page
Cited by
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
Self-citationGlobal malaria mortality between 1980 and 2010: a systematic analysis
Murray, C. J., Rosenfeld, L. C., Lim, S. S., Andrews, K. G., Foreman, K. J., Haring, D., Fullman, N., Naghavi, M., Lozano, R., & Lopez, A. D. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60034-8 · Cited by 1,452
Self-citationKyu, H. H., Maddison, E. R., Henry, N. J., Ledesma, J. R., Wiens, K. E., Reiner, R., Biehl, M. H., Shields, C., Osgood-Zimmerman, A., Ross, J. M., et al. (2018) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(18)30625-x · Cited by 437
Self-citationThe global burden of tuberculosis: results from the Global Burden of Disease Study 2015
Kyu, H. H., Maddison, E. R., Henry, N. J., Mumford, J. E., Barber, R., Shields, C., Brown, J. C., Nguyen, G., Carter, A., Wolock, T. M., et al. (2018) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(17)30703-x · Cited by 376
Self-citationHe, C., Liu, L., Chu, Y., Perin, J., Dai, L., Li, X., Miao, L., Kang, L., Li, Q., Scherpbier, R., et al. (2017) · The Lancet Global Health · doi:10.1016/s2214-109x(16)30334-5 · Cited by 204
Metadata
- Authors
- James, S. L., Flaxman, A. D., & Murray, C. J.
- Venue
- Population Health Metrics
- Published
- 2011-08-04
- Volume
- 9
- Issue
- 1
- Pages
- 31-31
- ISSN
- 1478-7954 (ISSN-L)
- OpenAlex
- W2129381080
- Cited by
- 112
- References
- 3
- FWCI
- 12.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance of the Tariff Method: validation of a simple additive algorithm for analysis of verbal autopsies. https://app.cochat.ai/papers/10.1186/1478-7954-9-31
- The paper
- James, S. L., Flaxman, A. D., & Murray, C. J. (2011). Performance of the Tariff Method: validation of a simple additive algorithm for analysis of verbal autopsies. Population Health Metrics. https://doi.org/10.1186/1478-7954-9-31
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.