Calibration Methods Used in Cancer Simulation Models and Suggested Reporting Guidelines
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
AbstractIncreasingly, computer simulation models are used for economic and policy evaluation in cancer prevention and control. A model’s predictions of key outcomes, such as screening effectiveness, depend on the values of unobservable natural history parameters. Calibration is the process of determining the values of unobservable parameters by constraining model output to replicate observed data. Because there are many approaches for model calibration and little consensus on best practices, we surveyed the literature to catalogue the use and reporting of these methods in cancer simulation models.We conducted a MEDLINE search (1980 through 2006) for articles on cancer-screening models and supplemented search results with articles from our personal reference databases. For each article, two authors independently abstracted pre-determined items using a standard form. Data items included cancer site, model type, methods used for determination of unobservable parameter values and description of any calibration protocol. All authors reached consensus on items of disagreement. Reviews and non-cancer models were excluded. Articles describing analytical models, which estimate parameters with statistical approaches (e.g. maximum likelihood) were catalogued separately.Models that included unobservable parameters were analysed and classified by whether calibration methods were reported and if so, the methods used.The review process yielded 154 articles that met our inclusion criteria and, of these, we concluded that 131 may have used calibration methods to determine model parameters. Although the term ‘calibration’ was not always used, descriptions of calibration or ‘model fitting’ were found in 50% (n = 66) of the articles, with an additional 16% (n = 21) providing a reference to methods. Calibration target data were identified in nearly all of these articles. Other methodological details, such as the goodness-of-fit metric, were discussed in 54% (n = 47 of 87) of the articles reporting calibration methods, while few details were provided on the algorithms used to search the parameter space.Our review shows that the use of cancer simulation modelling is increasing, although thorough descriptions of calibration procedures are rare in the published literature for these models. Calibration is a key component of model development and is central to the validity and credibility of subsequent analyses and inferences drawn from model predictions. To aid peer-review and facilitate discussion of modelling methods, we propose a standardized Calibration Reporting Checklist for model documentation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Weinstein, M. C., O'Brien, B., Hornberger, J., Jackson, J., Johannesson, M., McCabe, C., & Luce, B. R. (2003) · Value in Health · doi:10.1046/j.1524-4733.2003.00234.x · Cited by 1,172
Cost-Effectiveness of Cervical-Cancer Screening in Five Developing Countries
Goldie, S. J., Gaffikin, L., Goldhaber-Fiebert, J. D., Gordillo-Tobar, A., Levin, C., Mahé, C., & Wright, T. C. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa044278 · Cited by 671
Myers, E. R., McCrory, D. C., Nanda, K., Bastian, L., & Matchar, D. B. (2000) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010166 · Cited by 470
Recent developments in decision-analytic modelling for economic evaluation
Weinstein, M. C. (2006) · PharmacoEconomics · doi:10.2165/00019053-200624110-00002 · Cited by 220
Goldie, S. J., Grima, D., Kohli, M., Wright, T. C., Weinstein, M., & Franco, E. (2003) · International Journal of Cancer · doi:10.1002/ijc.11334 · Cited by 209
Calibrating Models in Economic Evaluation: A Seven-Step Approach
Vanni, T., Karnon, J., Madan, J., White, R. G., Edmunds, W. J., Foss, A. M., & Legood, R. (2011) · PharmacoEconomics · doi:10.2165/11584600-000000000-00000 · Cited by 173
Multiparameter calibration of a natural history model of cervical cancer
Kim, J. J., Kuntz, K. M., Stout, N. K., Mahmud, S., Villa, L. L., Franco, E. L., & Goldie, S. J. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm086 · Cited by 161
Self-citation
Cited by
A catalogue of reporting guidelines for health research
Simera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2009.02234.x · Cited by 1,047
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
Husereau, D., Drummond, M., Augustovski, F., de Bekker-Grob, E., Briggs, A. H., Carswell, C., Caulley, L., Chaiyakunapruk, N., Greenberg, D., Loder, E., et al. (2022) · Value in Health · doi:10.1016/j.jval.2021.10.008 · Cited by 847
Trevena, L. J., Zikmund-Fisher, B. J., Edwards, A., Gaissmaier, W., Galesic, M., Han, P. K., King, J., Lawson, M. L., Linder, S. K., Lipkus, I., et al. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-s2-s7 · Cited by 538
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.012 · Cited by 466
Metadata
- Authors
- Stout, N. K., Knudsen, A. B., Kong, C. Y., McMahon, P. M., & Gazelle, G. S.
- Venue
- PharmacoEconomics
- Published
- 2009-07
- Volume
- 27
- Issue
- 7
- Pages
- 533-545
- ISSN
- 1170-7690 (ISSN-L)
- OpenAlex
- W2034380059
- Cited by
- 126
- References
- 7
- FWCI
- 3.13
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Calibration Methods Used in Cancer Simulation Models and Suggested Reporting Guidelines. https://app.cochat.ai/papers/10.2165/11314830-000000000-00000
- The paper
- Stout, N. K., Knudsen, A. B., Kong, C. Y., McMahon, P. M., & Gazelle, G. S. (2009). Calibration Methods Used in Cancer Simulation Models and Suggested Reporting Guidelines. PharmacoEconomics. https://doi.org/10.2165/11314830-000000000-00000
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.