Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards

Open access
Lozano, Rafael, Lopez, Alan D, Atkinson, Charles, Naghavi, Mohsen, Flaxman, Abraham D, Murray, Christopher JL · 2011 · Population Health Metrics

Abstract

BACKGROUND: Physician review of a verbal autopsy (VA) and completion of a death certificate remains the most widely used approach for VA analysis. This study provides new evidence about the performance of physician-certified verbal autopsy (PCVA) using defined clinical diagnostic criteria as a gold standard for a multisite sample of 12,542 VAs. The study was also designed to analyze issues related to PCVA, such as the impact of a second physician reader on the cause of death assigned, the variation in performance with and without household recall of health care experience (HCE), and the importance of local information for physicians reading VAs. METHODS: The certification was performed by 24 physicians. The assignment of VA was random and blinded. Each VA was certified by one physician. Half of the VAs were reviewed by a different physician with household recall of health care experience included. The completed death certificate was processed for automated ICD-10 coding of the underlying cause of death. PCVA was compared to gold standard cause of death assignment based on strictly defined clinical diagnostic criteria that are part of the Population Health Metrics Research Consortium (PHMRC) gold standard verbal autopsy study. RESULTS: For individual cause assignment, the overall chance-corrected concordance for PCVA against the gold standard cause of death is less than 50%, with substantial variability by cause and physician. Physicians assign the correct cause around 30% of the time without HCE, and addition of HCE improves performance in adults to 45% and slightly higher in children to 48%. Physicians estimate cause-specific mortality fractions (CSMFs) with considerable error for adults, children, and neonates. Only for neonates for a cause list of six causes with HCE is accuracy above 0.7. In all three age groups, CSMF accuracy improves when household recall of health care experience is available. CONCLUSIONS: Results show that physician coding for cause of death assignment may not be as robust as previously thought. The time and cost required to initially collect the verbal autopsies must be considered in addition to the analysis, as well as the impact of diverting physicians from servicing immediate health needs in a population to review VAs. All of these considerations highlight the importance and urgency of developing better methods to more reliably analyze past and future verbal autopsies to obtain the highest quality mortality data from populations without reliable death certification.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1478-7954-9-32

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Illustration of the review framework used for physician certification.
Figure 1 Illustration of the review framework used for physician certification.CC BY · PubMed Central
Figure 2 Diagram of the process for physician review and data analysis.
Figure 2 Diagram of the process for physician review and data analysis.CC BY · PubMed Central
Figure 3 Median chance-corrected concordance (%), by adult cause with and without HCE.
Figure 3 Median chance-corrected concordance (%), by adult cause with and without HCE.CC BY · PubMed Central
Figure 4 Median chance-corrected concordance (%), by child cause with and without HCE.
Figure 4 Median chance-corrected concordance (%), by child cause with and without HCE.CC BY · PubMed Central
Figure 5 Median chance-corrected concordance (%), by neonate cause with and without HCE.
Figure 5 Median chance-corrected concordance (%), by neonate cause with and without HCE.CC BY · PubMed Central
Figure 6 Random effect logistic regression odds ratios (OR) and standard errors (SE) by physician, of assigning the correct cause as a function of the physician reading the VA for adult, child, and neonatal causes.
Figure 6 Random effect logistic regression odds ratios (OR) and standard errors (SE) by physician, of assigning the correct cause as a function of the physician reading the VA for adult, child, and neonatal causes.CC BY · PubMed Central
Figure 7 Estimated versus true CSMFs across 500 Dirichlet splits, for adult bite of venomous animal without HCE.
Figure 7 Estimated versus true CSMFs across 500 Dirichlet splits, for adult bite of venomous animal without HCE.CC BY · PubMed Central
Figure 8 Estimated versus true CSMFs across 500 Dirichlet splits, for adult bite of venomous animal with HCE.
Figure 8 Estimated versus true CSMFs across 500 Dirichlet splits, for adult bite of venomous animal with HCE.CC BY · PubMed Central
Figure 9 Estimated versus true CSMFs across 500 Dirichlet splits, for adult asthma without HCE.
Figure 9 Estimated versus true CSMFs across 500 Dirichlet splits, for adult asthma without HCE.CC BY · PubMed Central
Figure 10 Estimated versus true CSMFs across 500 Dirichlet splits, for adult asthma with HCE.
Figure 10 Estimated versus true CSMFs across 500 Dirichlet splits, for adult asthma with HCE.CC BY · PubMed Central
Figure 11 Estimated versus true CSMFs across 500 Dirichlet splits, for adult other noncommunicable diseases without HCE.
Figure 11 Estimated versus true CSMFs across 500 Dirichlet splits, for adult other noncommunicable diseases without HCE.CC BY · PubMed Central
Figure 12 Estimated versus true CSMFs across 500 Dirichlet splits, for adult other noncommunicable diseases with HCE.
Figure 12 Estimated versus true CSMFs across 500 Dirichlet splits, for adult other noncommunicable diseases with HCE.CC BY · PubMed Central
Figure 13 Estimated versus true CSMFs across 500 Dirichlet splits, for child falls without HCE.
Figure 13 Estimated versus true CSMFs across 500 Dirichlet splits, for child falls without HCE.CC BY · PubMed Central
Figure 14 Estimated versus true CSMFs across 500 Dirichlet splits, for child falls with HCE.
Figure 14 Estimated versus true CSMFs across 500 Dirichlet splits, for child falls with HCE.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 38 references

Research works printed but not linked: 1

  1. Losos J: Routine and sentinel surveillance methods. East Mediterr Health J 1996, 2: 45-60.

Cited by

See all 106

Metadata

Authors
Lozano, R., Lopez, A. D., Atkinson, C., Naghavi, M., Flaxman, A. D., & Murray, C. J.
Affiliations
University of Washington (US)
Corresponding author
Lozano, Rafael
Venue
Population Health Metrics
Published
2011-08-04
Volume
9
Issue
1
Pages
32-32
ISSN
1478-7954 (ISSN-L)
OpenAlex
W2043272963
Cited by
101
References
38
Citations by year
2026: 3 · 2025: 1 · 2024: 4 · 2023: 1 · 2022: 9 · 2021: 6 · 2020: 13 · 2019: 3 · 2018: 5 · 2017: 5 · 2016: 5 · 2015: 7 · 2014: 14 · 2013: 6 · 2012: 8
FWCI
9.55
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/2.0 (tdm)
Locations
  • Population Health Metrics (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Bill and Melinda Gates Foundation
Topics
  • Health Sciences › Medicine › Pathology and Forensic Medicine › Autopsy Techniques and Outcomes
  • Social Sciences › Demography › Insurance, Mortality, Demography, Risk Management
  • Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Global Maternal and Child Health
Keywords
cause of death assignment, mortality measurement, cause-specific mortality fractions, ICD-10 coding, death certificates, clinical criteria, neonatal mortality, child mortality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards. https://app.cochat.ai/papers/10.1186/1478-7954-9-32
The paper
Lozano, R., Lopez, A. D., Atkinson, C., Naghavi, M., Flaxman, A. D., & Murray, C. J. (2011). Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards. Population Health Metrics. https://doi.org/10.1186/1478-7954-9-32

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.