Calibrating Models in Economic Evaluation: A Seven-Step Approach
Abstract
In economic evaluation, mathematical models have a central role as a way of integrating all the relevant information about a disease and health interventions, in order to estimate costs and consequences over an extended time horizon. Models are based on scientific knowledge of disease (which is likely to change over time), simplifying assumptions and input parameters with different levels of uncertainty; therefore, it is sensible to explore the consistency of model predictions with observational data. Calibration is a useful tool for estimating uncertain parameters, as well as more accurately defining model uncertainty (particularly with respect to the representation of correlations between parameters). Calibration involves the comparison of model outputs (e.g. disease prevalence rates) with empirical data, leading to the identification of model parameter values that achieve a good fit. This article provides guidance on the theoretical underpinnings of different calibration methods. The calibration process is divided into seven steps and different potential methods at each step are discussed, focusing on the particular features of disease models in economic evaluation. The seven steps are (i) Which parameters should be varied in the calibration process? (ii) Which calibration targets should be used? (iii) What measure of goodness of fit should be used? (iv) What parameter search strategy should be used? (v) What determines acceptable goodness-of-fit parameter sets (convergenc…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Steps in calibration include identifying calibration targets, selecting individual and aggregated measures of goodness of fit, defining the parameter space, selecting a search strategy, defining convergence thresholds, and specifying a stopping rule.
“Steps in calibration include identifying calibration targets, selecting individual and aggregated measures of goodness of fit, defining the parameter space, selecting a search strategy, defining convergence thresholds, and specifying a stopping rule [22].”
From Model Parameter Estimation and Uncertainty: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6 (2012) · cites this paper as [22]
Cites
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648 · see citing works
Karnon, J., McIntosh, A., Dean, J., Bath, P., Hutchinson, A., Oakley, J., Thomas, N., Pratt, P., Freeman-Parry, L., Karsh, B.-T., et al. (2007) · Safety Science · doi:10.1016/j.ssci.2006.08.026 · Cited by 26 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Briggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.014 · Cited by 711 · see citing works
Self-citationGlobal childhood cancer survival estimates and priority-setting: A simulation-based analysis
Ward, Z. J., Yeh, J. M., Bhakta, N., Frazier, A. L., Girardi, F., & Atun, R. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30273-6 · Cited by 277 · see citing works
Societal and Family Lifetime Cost of Dementia: Implications for Policy
Jutkowitz, E., Kane, R. L., Gaugler, J. E., MacLehose, R. F., Dowd, B., & Kuntz, K. M. (2017) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15043 · Cited by 164 · see citing works
- Authors
- Vanni, T., Karnon, J., Madan, J., White, R. G., Edmunds, W. J., Foss, A. M., & Legood, R.
- Affiliations
- The University of Adelaide (AU)
- University of Bristol (GB)
- London School of Hygiene & Tropical Medicine (GB)
- Venue
- PharmacoEconomics
- Published
- 2011-01
- Volume
- 29
- Issue
- 1
- Pages
- 35-49
- ISSN
- 1170-7690 (ISSN-L)
- OpenAlex
- W1482581820
- Cited by
- 173
- References
- 2
- Citations by year
- 2026: 11 · 2025: 8 · 2024: 10 · 2023: 6 · 2022: 11 · 2021: 8 · 2020: 19 · 2019: 18 · 2018: 14 · 2017: 8 · 2016: 10 · 2015: 13 · 2014: 11 · 2013: 11 · 2012: 7
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PharmacoEconomics (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- model calibration, economic evaluation, disease models, parameter uncertainty, goodness of fit, stopping rules, convergence conditions, calibration targets, parameter estimation
- MeSH terms
- Calibration, Cost-Benefit Analysis, Models, Theoretical, Models, Econometric, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review