The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Review of guidelines for good practice in decision-analytic modelling in health technology assessment
Open accessAbstract
OBJECTIVES: To identify existing guidelines and develop a synthesised guideline plus accompanying checklist. In addition to provide guidance on key theoretical, methodological and practical issues and consider the implications of this research for what might be expected of future decision-analytic models. DATA SOURCES: Electronic databases. REVIEW METHODS: A systematic review of existing good practice guidelines was undertaken to identify and summarise guidelines currently available for assessing the quality of decision-analytic models that have been undertaken for health technology assessment. A synthesised good practice guidance and accompanying checklist was developed. Two specific methods areas in decision modelling were considered. The first method's topic is the identification of parameter estimates from published literature. Parameter searches were developed and piloted using a case-study model. The second topic relates to bias in parameter estimates; that is, how to adjust estimates of treatment effect from observational studies where there are risks of selection bias. A systematic literature review was conducted to identify those studies looking at quantification of bias in parameter estimates and the implication of this bias. RESULTS: Fifteen studies met the inclusion criteria and were reviewed and consolidated into a single set of brief statements of good practice. From this, a checklist was developed and applied to three independent decision-analytic models. Although the checklist provided excellent guidance on some key issues for model evaluation, it was too general to pick up on the specific nuances of each model. The searches that were developed helped to identify important data for inclusion in the model. However, the quality of life searches proved to be problematic: the published search filters did not focus on those measures specific to cost-effectiveness analysis and although the strategies developed as part of this project were more successful few data were found. Of the 11 studies meeting the criteria on the effect of selection bias, five concluded that a non-randomised trial design is associated with bias and six studies found 'similar' estimates of treatment effects from observational studies or non-randomised clinical trials and randomised controlled trials (RCTs). One purpose of developing the synthesised guideline and checklist was to provide a framework for critical appraisal by the various parties involved in the health technology assessment process. First, the guideline and checklist can be used by groups that are reviewing other analysts' models and, secondly, the guideline and checklist could be used by the various analysts as they develop their models (to use it as a check on how they are developing and reporting their analyses). The Expert Advisory Group (EAG) that was convened to discuss the potential role of the guidance and checklist felt that, in general, the guidance and checklist would be a useful tool, although the checklist is not meant to be used exclusively to determine a model's quality, and so should not be used as a substitute for critical appraisal. CONCLUSIONS: The review of current guidelines showed that although authors may provide a consistent message regarding some aspects of modelling, in other areas conflicting attributes are presented in different guidelines. In general, the checklist appears to perform well, in terms of identifying those aspects of the model that should be of particular concern to the reader. The checklist cannot, however, provide answers to the appropriateness of the model structure and structural assumptions, as these may be seen as a general problem with generic checklists and do not reflect any shortcoming with the synthesised guidance and checklist developed here. The assessment of the checklist, as well as feedback from the EAG, indicated the importance of its use in conjunction with a more general checklist or guidelines on economic evaluation. Further methods research into the following areas would be valuable: the quantification of selection bias in non-controlled studies and in controlled observational studies; the level of bias in the different non-RCT study designs; a comparison of results from RCTs with those from other non-randomised studies; assessment of the strengths and weaknesses of alternative ways to adjust for bias in a decision model; and how to prioritise searching for parameter estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
The National Institute for Clinical Excellence
(2001) · Nursing Management · doi:10.7748/nm.8.2.39.s15 · Cited by 3,876
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Markov Models in Medical Decision Making: A Practical Guide
Sonnenberg, F. A., & Beck, J. R. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300409 · Cited by 2,419
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Bayesian Approaches to Clinical Trials and Health‐Care Evaluation
Spiegelhalter, D. J., Abrams, K. R., & Myles, J. P. (2003) · Wiley eBooks · doi:10.1002/0470092602 · Cited by 1,673
Weinstein, M. C., O'Brien, B., Hornberger, J., Jackson, J., Johannesson, M., McCabe, C., & Luce, B. R. (2003) · Value in Health · doi:10.1046/j.1524-4733.2003.00234.x · Cited by 1,172
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Cited by
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Picot, J., Jones, J., Colquitt, J., Gospodarevskaya, E., Loveman, E., Baxter, L., & Clegg, A. (2009) · Health Technology Assessment · doi:10.3310/hta13410 · Cited by 1,066
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
Latthe, P., Latthe, M., Say, L., Gülmezoglu, M., & Khan, K. S. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-177 · Cited by 764
Connock, M., Juarez-Garcia, A., Jowett, S., Frew, E., Liu, Z., Taylor, R., Fry-Smith, A., Day, E., Lintzeris, N., Roberts, T., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11090 · Cited by 585
A taxonomy of model structures for economic evaluation of health technologies
Brennan, A., Chick, S. E., & Davies, R. (2006) · Health Economics · doi:10.1002/hec.1148 · Cited by 555
Burr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 522
Developing prediction models for clinical use using logistic regression: an overview
Shipe, M. E., Deppen, S. A., Farjah, F., & Grogan, E. L. (2019) · Journal of Thoracic Disease · doi:10.21037/jtd.2019.01.25 · Cited by 512
Philips, Z., Bojke, L., Sculpher, M., Claxton, K., & Golder, S. (2006) · PharmacoEconomics · doi:10.2165/00019053-200624040-00006 · Cited by 502
Self-citationEddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.012 · Cited by 466
Whither trial‐based economic evaluation for health care decision making?
Sculpher, M. J., Claxton, K., Drummond, M., & McCabe, C. (2006) · Health Economics · doi:10.1002/hec.1093 · Cited by 407
Self-citationConceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–2
Roberts, M., Russell, L. B., Paltiel, A. D., Chambers, M., McEwan, P., & Krahn, M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454941 · Cited by 389
The Impact of Prices and Taxes on the Use of Tobacco Products in Latin America and the Caribbean
Guindon, G. E., Paraje, G. R., & Chaloupka, F. J. (2018) · American Journal of Public Health · doi:10.2105/ajph.2014.302396r · Cited by 382
Bias in published cost effectiveness studies: systematic review
Bell, C. M., Urbach, D. R., Ray, J. G., Bayoumi, A., Rosen, A. B., Greenberg, D., & Neumann, P. J. (2006) · BMJ · doi:10.1136/bmj.38737.607558.80 · Cited by 382
Pavey, T., Anokye, N., Taylor, A., Trueman, P., Moxham, T., Fox, K., Hillsdon, M., Green, C., Campbell, J., Foster, C., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15440 · Cited by 351
Jones, J., Shepherd, J., Baxter, L., Gospodarevskaya, E., Hartwell, D., Harris, P., & Price, A. (2009) · Health Technology Assessment · doi:10.3310/hta13350 · Cited by 357
Loveman, E., Frampton, G., Shepherd, J., Picot, J., Cooper, K., Bryant, J., Welch, K., & Clegg, A. (2011) · Health Technology Assessment · doi:10.3310/hta15020 · Cited by 296
Economic evaluation using decision analytical modelling: design, conduct, analysis, and reporting
Petrou, S., & Gray, A. (2011) · BMJ · doi:10.1136/bmj.d1766 · Cited by 292
Bone morphogenetic protein (BMP) for fracture healing in adults
Garrison, K. R., Shemilt, I., Donell, S., Ryder, J. J., Mugford, M., Harvey, I., Song, F., & Alt, V. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006950.pub2 · Cited by 278
Claxton, K., Ginnelly, L., Sculpher, M., Philips, Z., & Palmer, S. (2004) · Health Technology Assessment · doi:10.3310/hta8310 · Cited by 258
Self-citationAutologous chondrocyte implantation in the knee: systematic review and economic evaluation
Mistry, H., Connock, M., Pink, J., Shyangdan, D., Clar, C., Royle, P., Court, R., Biant, L. C., Metcalfe, A., & Waugh, N. (2017) · Health Technology Assessment · doi:10.3310/hta21060 · Cited by 255
Conceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2
Roberts, M., Russell, L. B., Paltiel, A. D., Chambers, M., McEwan, P., & Krahn, M. (2012) · Value in Health · doi:10.1016/j.jval.2012.06.016 · Cited by 241
Calibrating Models in Economic Evaluation: A Seven-Step Approach
Vanni, T., Karnon, J., Madan, J., White, R. G., Edmunds, W. J., Foss, A. M., & Legood, R. (2011) · PharmacoEconomics · doi:10.2165/11584600-000000000-00000 · Cited by 173
Mandrik, O. (., Severens, J. L. (., Bardach, A., Ghabri, S., Hamel, C., Mathes, T., Vale, L., Wisløff, T., & Goldhaber-Fiebert, J. D. (2021) · Value in Health · doi:10.1016/j.jval.2021.01.002 · Cited by 110
Brisson, M., & Edmunds, W. J. (2006) · Medical Decision Making · doi:10.1177/0272989x06290485 · Cited by 109
Lamb, S. E., Mistry, D., Alleyne, S., Atherton, N., Brown, D., Copsey, B., Dosanjh, S., Finnegan, S., Fordham, B., Griffiths, F., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22280 · Cited by 98
Decision-analytic modeling to evaluate benefits and harms of medical tests: uses and limitations
Trikalinos, T. A., Siebert, U., & Lau, J. (2009) · Medical Decision Making · doi:10.1177/0272989x09345022 · Cited by 88
The Impact of Prices and Taxes on the Use of Tobacco Products in Latin America and the Caribbean
Guindon, G. E., Paraje, G. R., & Chaloupka, F. J. (2015) · American Journal of Public Health · doi:10.2105/ajph.2014.302396 · Cited by 87
the MYRIAD team, Kuyken, W., Nuthall, E., Byford, S., Crane, C., Dalgleish, T., Ford, T., Greenberg, M. T., Ukoumunne, O. C., Viner, R. M., et al. (2017) · Trials · doi:10.1186/s13063-017-1917-4 · Cited by 77
Karnon, J., & Vanni, T. (2011) · PharmacoEconomics · doi:10.2165/11584610-000000000-00000 · Cited by 67
Vithlani, J., Hawksworth, C., Elvidge, J., Ayiku, L., & Dawoud, D. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1220950 · Cited by 65
Is brief advice in primary care a cost-effective way to promote physical activity?
Anokye, N. K., Lord, J., & Fox-Rushby, J. (2014) · British Journal of Sports Medicine · doi:10.1136/bjsports-2013-092897 · Cited by 64
Glazener, C., Breeman, S., Elders, A., Hemming, C., Cooper, K., Freeman, R., Smith, A., Hagen, S., Montgomery, I., Kilonzo, M., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20950 · Cited by 35
Jacobsen, E., Boyers, D., & Avenell, A. (2020) · PharmacoEconomics · doi:10.1007/s40273-019-00878-2 · Cited by 35
Geppert, J., Auguste, P., Asgharzadeh, A., Ghiasvand, H., Patel, M., Brown, A., Jayakody, S., Helm, E., Todkill, D., Madan, J., et al. (2025) · Health Technology Assessment · doi:10.3310/jytw8921 · Cited by 22
Luhnen, M., Prediger, B., Neugebauer, E. A. M., & Mathes, T. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462318000624 · Cited by 13
Metadata
- Authors
- Philips, Z., Ginnelly, L., Sculpher, M., Claxton, K., Golder, S., Riemsma, R., Woolacoot, N., & Glanville, J.
- Venue
- Health Technology Assessment
- Published
- 2004-09
- Volume
- 8
- Issue
- 36
- Pages
- iii-iv, ix
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2142704172
- Cited by
- 697
- References
- 68
- FWCI
- 48.20
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.