CoChat

Modeling causes of death: an integrated approach using CODEm

Open access
Foreman, Kyle J, Lozano, Rafael, Lopez, Alan D, Murray, Christopher JL · 2012 · Population Health Metrics

The DOI matches its Crossref record; 105 of the 107 references it cites were found in a registry or an index; 8 of the 74 sources its claims cite were checked for support.

Abstract

Background: Data on causes of death by age and sex are a critical input into health decision-making. Priority setting in public health should be informed not only by the current magnitude of health problems but by trends in them. However, cause of death data are often not available or are subject to substantial problems of comparability. We propose five general principles for cause of death model development, validation, and reporting. Methods: We detail a specific implementation of these principles that is embodied in an analytical tool - the Cause of Death Ensemble model (CODEm) - which explores a large variety of possible models to estimate trends in causes of death. Possible models are identified using a covariate selection algorithm that yields many plausible combinations of covariates, which are then run through four model classes. The model classes include mixed effects linear models and spatial-temporal Gaussian Process Regression models for cause fractions and death rates. All models for each cause of death are then assessed using out-of-sample predictive validity and combined into an ensemble with optimal out-of-sample predictive performance. Results: Ensemble models for cause of death estimation outperform any single component model in tests of root mean square error, frequency of predicting correct temporal trends, and achieving 95% coverage of the prediction interval. We present detailed results for CODEm applied to maternal mortality and summary results for several other causes of death, including cardiovascular disease and several cancers. Conclusions: CODEm produces better estimates of cause of death trends than previous methods and is less susceptible to bias in model specification. We demonstrate the utility of CODEm for the estimation of several major causes of death.

Overview

CoChat Summary

TL;DR

CODEm is an integrated cause-of-death modeling environment built on five principles: comprehensive data identification, comparability/quality improvement, diverse plausible models, out-of-sample predictive validity, and selection of the best model or ensemble. It produces better estimates of cause-of-death trends than single component models and is illustrated for maternal mortality and several other causes.

Key findings

  • For maternal mortality, the final CODEm ensemble outperformed the top component model on test 2: RMSE 0.626 vs 0.636, trend test 0.665 vs 0.663, and 95% prediction-interval coverage 97.3% vs 96.9% (Table 6).
  • Maternal mortality covariate selection began with 1,984 possible models each for rates and cause fractions; after running 261 rate regressions and 226 cause-fraction regressions, 98 rate models and 71 cause-fraction models fulfilled all priors, yielding 338 total component models. The top 88 slots were spatial-temporal models on logit(cause fraction).
  • Across selected causes, ensembles generally matched or improved on the best component model; for male cardiovascular disease, test-2 RMSE was 0.290 for the ensemble vs 0.292 for the best component, and coverage was 0.853 vs 0.822. Male lung cancer was an exception with slightly worse RMSE and trend for the ensemble, but coverage improved from 0.800 to 0.841.
  • Test-retest stability was high: the Pearson correlation for final mean log rates across two runs with 25 hold-outs was 0.9998; rankings stabilized after 25 hold-outs with rank correlation exceeding .98, and 40 hold-outs yielded rank correlations above 0.99.

Methods

  • The paper proposes five principles for cause-of-death model development, validation, and reporting: identify all available data; maximize comparability and quality; develop a diverse set of plausible models; assess out-of-sample predictive validity; and choose the model or ensemble with the best performance.
  • CODEm implements these principles using a covariate selection algorithm with level 1–3 covariates and directional priors, four model families (linear mixed effects and spatial-temporal Gaussian Process Regression models for ln death rates and logit cause fractions), and ensemble weighting based on out-of-sample performance.
  • Predictive validity uses train–test 1–test 2 datasets (70%/15%/15%), 25 hold-outs, and metrics for RMSE of log death rates, correct temporal trend direction, and 95% prediction-interval coverage. The application uses the IHME cause-of-death database; maternal mortality had 4,563 site-years available for analysis.

Limitations

  • Stated: the current implementation is limited to four modeling families; expanding the model pool would likely improve prediction but is constrained by computational power and time, with each model run taking approximately 600 hours of processor time (about 5,000 GFlops on their cluster). The approach cannot yet capture uncertainty from bias correction, outlier exclusion, or covariate measurement/forecasting, and garbage-code redistribution remains largely expert-opinion based.
  • Stated: it is computationally intractable to compute full confidence intervals for every component model, and simultaneous modeling of all causes is infeasible due to computational restrictions, limitations on data usability, and analysis infeasibility.
  • Evident: the paper notes that the exact set of top-performing models can vary between stochastic runs even when predictions are highly consistent, and that the approach depends critically on the database, covariate quality, and evidence on expected covariate relationships. Some cause-specific test-2 coverage values remain below 95% (e.g., male cardiovascular disease 0.853 and male lung cancer 0.841), though ensembles improved coverage over component models.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/1478-7954-10-1

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Examples of missingness patterns observed in data for a single country and cause of death. Green represents available data and red represents missing.
Figure 1 Examples of missingness patterns observed in data for a single country and cause of death. Green represents available data and red represents missing.CC BY · PubMed Central
Figure 2 Example weighting schemes for 100 component models at different values of ψ.
Figure 2 Example weighting schemes for 100 component models at different values of ψ.CC BY · PubMed Central
Figure 3 Heatmap of stability in maternal mortality component model rankings. Each row represents a component model, and each column corresponds to how many hold-outs are used when ranking. Rows are sorted by rankings using all 25 hold-outs. Cells are colored based on their ranking, with the green models being the best and red the worst. The last column displays in-sample ranks. The figure shows that rankings stabilize as hold-outs increase, and that in-sample ranking does not correlate well with out-of-sample.
Figure 3 Heatmap of stability in maternal mortality component model rankings. Each row represents a component model, and each column corresponds to how many hold-outs are used when ranking. Rows are sorted by rankings using all 25 hold-outs. Cells are colored based on their ranking, with the green models being the best and red the worst. The last column displays in-sample ranks. The figure shows that rankings stabilize as hold-outs increase, and that in-sample ranking does not correlate well with out-of-sample.CC BY · PubMed Central
Figure 4 In-sample, test 1, and test 2 performance on RMSE and trend test for maternal mortality component models.
Figure 4 In-sample, test 1, and test 2 performance on RMSE and trend test for maternal mortality component models.CC BY · PubMed Central
Figure 5 Correlation between test 1 and test 2 rankings of maternal mortality component models.
Figure 5 Correlation between test 1 and test 2 rankings of maternal mortality component models.CC BY · PubMed Central
Figure 6 Correlation in maternal mortality component model rankings by number of hold-outs performed.
Figure 6 Correlation in maternal mortality component model rankings by number of hold-outs performed.CC BY · PubMed Central

Verification

Claims the paper makes

4 Valid · 1 Not valid · 18 Not checked · 82 Own results and interpretations

58 more claims

Create a free account to see all 105 claims and to verify the 66 references still open.

See all claims — free account
  • It may state two separate claims as one. 26
  • Probably not a substantial claim. 23

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 105 references

Research works printed but not linked: 4

  1. Jougla E, Pavillon G, Rossollin F, De Smedt M, Bonte J: Improvement of the quality and comparability of causes-of-death statistics inside the European Community. Rev Epidemiol Sante Publique 1998, 46: 447-56.
  2. World Health Organization: Manual of the International Statistical Classification of Diseases, Injuries, and Causes of Death, 1975 Revision. Geneva: World Health Organization; 1977.
  3. Rooney C, Griffiths C, Cook L: The implementation of ICD-10 for cause of death coding-some preliminary results from the bridge coding study. Health Statistics Quarterly 2002, 13: 31-41.
  4. Mathers C, Bernard C, Iburg K, Inoue M, Ma Fat D, Shibuya K, Stein C, Tomijima N, Xu H: Global burden of disease in 2002: data sources, methods and results. Geneva: GPE Discussion PAper- No. 54-World Health Organization; 2003.

Cited by

See all 564

Metadata

Authors
Foreman, K. J., Lozano, R., Lopez, A. D., & Murray, C. J.
Affiliations
University of Washington (US)
Corresponding author
Murray, Christopher JL
Venue
Population Health Metrics
Published
2012-01-06
Volume
10
Issue
1
Pages
1-1
ISSN
1478-7954 (ISSN-L)
OpenAlex
W2136007084
Cited by
564
References
107
Citations by year
2026: 52 · 2025: 63 · 2024: 64 · 2023: 35 · 2022: 48 · 2021: 44 · 2020: 38 · 2019: 38 · 2018: 38 · 2017: 46 · 2016: 31 · 2015: 27 · 2014: 22 · 2013: 11 · 2012: 5
FWCI
52.27
Type
journal article
Language
en
Open access
Locations
  • Population Health Metrics (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Bill and Melinda Gates Foundation
Topics
  • Social Sciences › Demography › Insurance, Mortality, Demography, Risk Management
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Health Sciences › Medicine › Epidemiology › Healthcare Systems and Public Health
Keywords
causes of death, ensemble learning, covariate selection, linear mixed models, out-of-sample forecasting, model validation, maternal mortality, cardiovascular mortality, cancer mortality, age and sex differences in mortality, health priority setting

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Modeling causes of death: an integrated approach using CODEm. https://app.cochat.ai/papers/10.1186/1478-7954-10-1
The paper
Foreman, K. J., Lozano, R., Lopez, A. D., & Murray, C. J. (2012). Modeling causes of death: an integrated approach using CODEm. Population Health Metrics. https://doi.org/10.1186/1478-7954-10-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.