Validation of the Symptom Pattern Method for Analyzing Verbal Autopsy Data
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Cause of death data are a critical input to formulating good public health policy. In the absence of reliable vital registration data, information collected after death from household members, called verbal autopsy (VA), is commonly used to study causes of death. VA data are usually analyzed by physician-coded verbal autopsy (PCVA). PCVA is expensive and its comparability across regions is questionable. Nearly all validation studies of PCVA have allowed physicians access to information collected from the household members' recall of medical records or contact with health services, thus exaggerating accuracy of PCVA in communities where few deaths had any interaction with the health system. In this study we develop and validate a statistical strategy for analyzing VA data that overcomes the limitations of PCVA. METHODS AND FINDINGS: We propose and validate a method that combines the advantages of methods proposed by King and Lu, and Byass, which we term the symptom pattern (SP) method. The SP method uses two sources of VA data. First, it requires a dataset for which we know the true cause of death, but which need not be representative of the population of interest; this dataset might come from deaths that occur in a hospital. The SP method can then be applied to a second VA sample that is representative of the population of interest. From the hospital data we compute the properties of each symptom; that is, the probability of responding yes to each symptom, given the true cause of death. These symptom properties allow us first to estimate the population-level cause-specific mortality fractions (CSMFs), and to then use the CSMFs as an input in assigning a cause of death to each individual VA response. Finally, we use our individual cause-of-death assignments to refine our population-level CSMF estimates. The results from applying our method to data collected in China are promising. At the population level, SP estimates the CSMFs with 16% average relative error and 0.7% average absolute error, while PCVA results in 27% average relative error and 1.1% average absolute error. At the individual level, SP assigns the correct cause of death in 83% of the cases, while PCVA does so for 69% of the cases. We also compare the results of SP and PCVA when both methods have restricted access to the information from the medical record recall section of the VA instrument. At the population level, without medical record recall, the SP method estimates the CSMFs with 14% average relative error and 0.6% average absolute error, while PCVA results in 70% average relative error and 3.2% average absolute error. For individual estimates without medical record recall, SP assigns the correct cause of death in 78% of cases, while PCVA does so for 38% of cases. CONCLUSIONS: Our results from the data collected in China suggest that the SP method outperforms PCVA, both at the population and especially at the individual level. Further study is needed on additional VA datasets in order to continue validation of the method, and to understand how the symptom properties vary as a function of culture, language, and other factors. Our results also suggest that PCVA relies heavily on household recall of medical records and related information, limiting its applicability in low-resource settings. SP does not require that additional information to adequately estimate causes of death.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lopez, A. D., Mathers, C. D., Ezzati, M., Jamison, D. T., & Murray, C. J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68770-9 · Cited by 5,630
Self-citationGlobal mortality, disability, and the contribution of risk factors: Global Burden of Disease Study
Murray, C. J., & Lopez, A. D. (1997) · The Lancet · doi:10.1016/s0140-6736(96)07495-8 · Cited by 4,492 · cited 1×
“Groups I, II, and III refer to the Global Burden of Disease cause groupings. Group I is communicable, maternal, perinatal, and nutritional disorders; Group II is noncommunicable diseases; Group III is injuries l”
BackgroundSelf-citationValidation of verbal autopsy procedures for adult deaths in China
Yang, G., Rao, C., Ma, J., Wang, L., Wan, X., Dubrovsky, G., & Lopez, A. D. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyi181 · Cited by 187 · cited 2×
“To illustrate this approach, we have used data from our China VA validation study based on medical record review [11].”
MethodSelf-citationAnker, M. (1997) · International Journal of Epidemiology · doi:10.1093/ije/26.5.1090 · Cited by 119
Validation of cause-of-death statistics in urban China
Rao, C., Yang, G., Hu, J., Ma, J., Xia, W., & Lopez, A. D. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym003 · Cited by 88 · cited 1×
“The key exception to this has been validation studies of VA that seek to categorize deaths into only two causes, AIDS and non-AIDS, where HIV serostatus in a cohort is used as a the gold standard [27,31,32].”
BackgroundSelf-citationMurray, C. J. L., Kulkarni, S. C., & Ezzati, M. (2006) · Circulation · doi:10.1161/circulationaha.105.595777 · Cited by 62
Self-citation
Cited by
Global and regional causes of death
Mathers, C. D., Boerma, T., & Ma Fat, D. (2009) · British Medical Bulletin · doi:10.1093/bmb/ldp028 · Cited by 597
Pagidipati, N. J., & Gaziano, T. A. (2013) · Circulation · doi:10.1161/circulationaha.112.128413 · Cited by 504
Verbal Autopsy: Methods in Transition
Fottrell, E., & Byass, P. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq003 · Cited by 195
Murray, C. J., Lopez, A. D., Black, R., Ahuja, R., Ali, S. M., Baqui, A., Dandona, L., Dantzer, E., Das, V., Dhingra, U., et al. (2011) · Population Health Metrics · doi:10.1186/1478-7954-9-27 · Cited by 194
“A variety of methods have been proposed for VA cause assignment [1,2], ranging from physician-certified verbal autopsy (PCVA) [3,4] to data-derived algorithms [5-7], various applications of Bayes’ theorem [8-13], and direct statistical estimation of cause fractions [14].”
BackgroundMethodSelf-citationFour million neonatal deaths: counting and attribution of cause of death
Lawn, J. E., Osrin, D., Adler, A., & Cousens, S. (2008) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2008.00960.x · Cited by 123
Metadata
- Authors
- Murray, C. J. L., Lopez, A. D., Feehan, D. M., Peter, S. T., & Yang, G.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-11-20
- Volume
- 4
- Issue
- 11
- Pages
- e327
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W1996138553
- Cited by
- 99
- References
- 6
- FWCI
- 32.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validation of the Symptom Pattern Method for Analyzing Verbal Autopsy Data. https://app.cochat.ai/papers/10.1371/journal.pmed.0040327
- The paper
- Murray, C. J. L., Lopez, A. D., Feehan, D. M., Peter, S. T., & Yang, G. (2007). Validation of the Symptom Pattern Method for Analyzing Verbal Autopsy Data. PLoS Medicine. https://doi.org/10.1371/journal.pmed.0040327
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.