The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards
Open accessAbstract
BACKGROUND: Physician review of a verbal autopsy (VA) and completion of a death certificate remains the most widely used approach for VA analysis. This study provides new evidence about the performance of physician-certified verbal autopsy (PCVA) using defined clinical diagnostic criteria as a gold standard for a multisite sample of 12,542 VAs. The study was also designed to analyze issues related to PCVA, such as the impact of a second physician reader on the cause of death assigned, the variation in performance with and without household recall of health care experience (HCE), and the importance of local information for physicians reading VAs. METHODS: The certification was performed by 24 physicians. The assignment of VA was random and blinded. Each VA was certified by one physician. Half of the VAs were reviewed by a different physician with household recall of health care experience included. The completed death certificate was processed for automated ICD-10 coding of the underlying cause of death. PCVA was compared to gold standard cause of death assignment based on strictly defined clinical diagnostic criteria that are part of the Population Health Metrics Research Consortium (PHMRC) gold standard verbal autopsy study. RESULTS: For individual cause assignment, the overall chance-corrected concordance for PCVA against the gold standard cause of death is less than 50%, with substantial variability by cause and physician. Physicians assign the correct cause around 30% of the time without HCE, and addition of HCE improves performance in adults to 45% and slightly higher in children to 48%. Physicians estimate cause-specific mortality fractions (CSMFs) with considerable error for adults, children, and neonates. Only for neonates for a cause list of six causes with HCE is accuracy above 0.7. In all three age groups, CSMF accuracy improves when household recall of health care experience is available. CONCLUSIONS: Results show that physician coding for cause of death assignment may not be as robust as previously thought. The time and cost required to initially collect the verbal autopsies must be considered in addition to the analysis, as well as the impact of diverting physicians from servicing immediate health needs in a population to review VAs. All of these considerations highlight the importance and urgency of developing better methods to more reliably analyze past and future verbal autopsies to obtain the highest quality mortality data from populations without reliable death certification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Validation studies suggest that verbal autopsy studies overestimate adult deaths at low malaria cause fractions and underestimate adult malaria deaths when malaria deaths are common.68”
From Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. (2012) · cites this paper as [68]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The high levels of mortality for lower respiratory infections might be related to the bias in physician diagnosis of verbal autopsies, which was demonstrated in a rigorous validation study.68”
From Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. (2012) · cites this paper as [68]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Fourth, in adjusting VA studies relative to medical certification, we rely on the single available study on this comparison;68 of necessity this is a limited basis for the adjustment.”
From Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016 (2017) · cites this paper as [68]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Verbal autopsy validation studies68 suggest that verbal autopsy is accurate for some causes such as breast cancer, drowning, or road injury, but less accurate for other causes. Verbal autopsy performance for some key causes of child death such as lower respiratory infections is particularly poor.”
The cited source says what the claim attributes to it.
In the citing paper
“Performance of verbal autopsy is suboptimal in accurately capturing the underlying cause of death.”
From Liver cirrhosis mortality in 187 countries between 1980 and 2010: a systematic analysis (2014) · cites this paper as [78]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Murray, C. J., & Lopez, A. D. (1997) · The Lancet · doi:10.1016/s0140-6736(96)07492-2 · Cited by 7,007 · cited 1×
“in the list, residual categories include deaths that occur from other causes, clustered according to Global Burden of Disease categories to allow for a balanced distribution of residual causes in the data [34].”
BackgroundSelf-citationJournal of Epidemiology and Community Health
(1982) · International Journal of Epidemiology · doi:10.1093/ije/11.2.201 · Cited by 1,255
Soleman, N. (2006) · Bulletin of the World Health Organisation · doi:10.2471/blt.05.027003 · Cited by 313 · cited 1×
“Interpreting the available validation studies is complicated by the considerable heterogeneity across studies in these various dimensions [28,29].”
BackgroundChildhood deaths in Africa: uses and limitations of verbal autopsies
Snow, R. W., Winstanley, M. T., Marsh, V. M., Newton, C., Waruiru, C., Mwangi, I., Winstanley, P. A., Marsh, K., Snow, R. W., Forster, D., et al. (1992) · The Lancet · doi:10.1016/0140-6736(92)91414-4 · Cited by 294 · cited 2×
“Some previously published studies [14-20] have reported substantially higher concordances compared to medical record review and quite small errors in estimated CSMFs.”
ResultValidation and application of verbal autopsies in a rural area of South Africa
Kahn, K., Tollman, S. M., Garenne, M., & Gear, J. S. S. (2000) · Tropical Medicine & International Health · doi:10.1046/j.1365-3156.2000.00638.x · Cited by 235 · cited 2×
“Some previously published studies [14-20] have reported substantially higher concordances compared to medical record review and quite small errors in estimated CSMFs.”
ResultMurray, C. J., Lopez, A. D., Black, R., Ahuja, R., Ali, S. M., Baqui, A., Dandona, L., Dantzer, E., Das, V., Dhingra, U., et al. (2011) · Population Health Metrics · doi:10.1186/1478-7954-9-27 · Cited by 194 · cited 5×
“The Population Health Metrics Research Consortium (PHMRC) has undertaken a five-year study to develop a range of new analytical methods for verbal autopsy and test these methods using data collected at six sites in four countries (Mexico, Tanzania, India, and the Philippines) [33].”
BackgroundMethodInfluentialSelf-citationValidation of verbal autopsy procedures for adult deaths in China
Yang, G., Rao, C., Ma, J., Wang, L., Wan, X., Dubrovsky, G., & Lopez, A. D. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyi181 · Cited by 187 · cited 2×
“Some previously published studies [14-20] have reported substantially higher concordances compared to medical record review and quite small errors in estimated CSMFs.”
ResultMeasuring mortality in developing countries
Adjuik, M. (2006) · Bulletin of the World Health Organisation · doi:10.2471/blt.05.026492 · Cited by 168
Validity of verbal autopsy procedures for determining cause of death in Tanzania
Setel, P. W., Whiting, D. R., Hemed, Y., Chandramohan, D., Wolfson, L. J., Alberti, K. G. M. M., & Lopez, A. D. (2006) · Tropical Medicine & International Health · doi:10.1111/j.1365-3156.2006.01603.x · Cited by 165 · cited 2×
“Some previously published studies [14-20] have reported substantially higher concordances compared to medical record review and quite small errors in estimated CSMFs.”
ResultVerbal Autopsy Methods with Multiple Causes of Death
King, G., & Lu, Y. (2008) · Statistical Science · doi:10.1214/07-sts247 · Cited by 158 · cited 1×
“While alternative approaches such as InterVA, the Symptom Pattern Method, and direct estimation of cause-specific mortality fractions (CSMFs) [7-13] have been used, physician review of a verbal autopsy and completion of a death certificate remains the most widely used approach for VA analysis.”
Method
Research works printed but not linked: 1
- Losos J: Routine and sentinel surveillance methods. East Mediterr Health J 1996, 2: 45-60.
Cited by
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
“We have also revised the method used to estimate the fraction of maternal deaths related to HIV/AIDS in this study compared to Lozano et al. 2011.23 In this study, our estimates of the fraction of maternal deaths related to HIV/AIDS come from a review and statistical analysis of available data that…”
InfluentialSelf-citationNaghavi, M., Abajobir, A. A., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abera, S. F., Aboyans, V., Adetokunboh, O., Afshin, A., Agrawal, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32152-9 · Cited by 4,821
Self-citationGlobal malaria mortality between 1980 and 2010: a systematic analysis
Murray, C. J., Rosenfeld, L. C., Lim, S. S., Andrews, K. G., Foreman, K. J., Haring, D., Fullman, N., Naghavi, M., Lozano, R., & Lopez, A. D. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60034-8 · Cited by 1,452
Self-citationLiver cirrhosis mortality in 187 countries between 1980 and 2010: a systematic analysis
Mokdad, A. A., Lopez, A. D., Shahraz, S., Lozano, R., Mokdad, A. H., Stanaway, J., Murray, C. J., & Naghavi, M. (2014) · BMC Medicine · doi:10.1186/s12916-014-0145-y · Cited by 1,129
Self-citationBreast and cervical cancer in 187 countries between 1980 and 2010: a systematic analysis
Forouzanfar, M. H., Foreman, K. J., Delossantos, A. M., Lozano, R., Lopez, A. D., Murray, C. J. L., & Naghavi, M. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61351-2 · Cited by 1,009
Self-citation
Metadata
- Authors
- Lozano, R., Lopez, A. D., Atkinson, C., Naghavi, M., Flaxman, A. D., & Murray, C. J.
- Affiliations
- University of Washington (US)
- Corresponding author
- Lozano, Rafael
- Venue
- Population Health Metrics
- Published
- 2011-08-04
- Volume
- 9
- Issue
- 1
- Pages
- 32-32
- ISSN
- 1478-7954 (ISSN-L)
- PMC
- PMC3160925
- OpenAlex
- W2043272963
- Cited by
- 101
- References
- 38
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 4 · 2023: 1 · 2022: 9 · 2021: 6 · 2020: 13 · 2019: 3 · 2018: 5 · 2017: 5 · 2016: 5 · 2015: 7 · 2014: 14 · 2013: 6 · 2012: 8
- FWCI
- 9.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- Population Health Metrics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Bill and Melinda Gates Foundation
- Topics
- Health Sciences › Medicine › Pathology and Forensic Medicine › Autopsy Techniques and Outcomes
- Social Sciences › Demography › Insurance, Mortality, Demography, Risk Management
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Global Maternal and Child Health
- Keywords
- cause of death assignment, mortality measurement, cause-specific mortality fractions, ICD-10 coding, death certificates, clinical criteria, neonatal mortality, child mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards. https://app.cochat.ai/papers/10.1186/1478-7954-9-32
- The paper
- Lozano, R., Lopez, A. D., Atkinson, C., Naghavi, M., Flaxman, A. D., & Murray, C. J. (2011). Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards. Population Health Metrics. https://doi.org/10.1186/1478-7954-9-32
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.