Modeling Using Discrete Event Simulation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–4
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Discrete event simulation (DES) is a form of computer-based modeling that provides an intuitive and flexible approach to representing complex systems. It has been used in a wide range of health care applications. Most early applications involved analyses of systems with constrained resources, where the general aim was to improve the organization of delivered services. More recently, DES has increasingly been applied to evaluate specific technologies in the context of health technology assessment. The aim of this article is to provide consensus-based guidelines on the application of DES in a health care setting, covering the range of issues to which DES can be applied. The article works through the different stages of the modeling process: structural development, parameter estimation, model implementation, model analysis, and representation and reporting. For each stage, a brief description is provided, followed by consideration of issues that are of particular relevance to the application of DES in a health care setting. Each section contains a number of best practice recommendations that were iterated among the authors, as well as the wider modeling task force.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simulation Modeling and Analysis.
Schervish, M. J., Law, A. M., & Kelton, W. D. (1983) · Journal of the American Statistical Association · doi:10.2307/2288169 · Cited by 8,697
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 2×
“[35] Grimshaw JM, Thomas RE, MacLennan G, et al.”
BackgroundUncertain Judgements: Eliciting Experts' Probabilities
O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Oakley, J. E., & Rakow, T. (2006) · doi:10.1002/0470033312 · Cited by 1,550
Briggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Medical Decision Making · doi:10.1177/0272989x12458348 · Cited by 887
Self-citationEddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
Self-citationA taxonomy of model structures for economic evaluation of health technologies
Brennan, A., Chick, S. E., & Davies, R. (2006) · Health Economics · doi:10.1002/hec.1148 · Cited by 555
Self-citationCaro, J. J., Briggs, A. H., Siebert, U., & Kuntz, K. M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454577 · Cited by 520
Self-citationConceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–2
Roberts, M., Russell, L. B., Paltiel, A. D., Chambers, M., McEwan, P., & Krahn, M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454941 · Cited by 389
State-Transition Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–3
Siebert, U., Alagoz, O., Bayoumi, A. M., Jahn, B., Owens, D. K., Cohen, D. J., & Kuntz, K. M. (2012) · Medical Decision Making · doi:10.1177/0272989x12455463 · Cited by 348
Auchincloss, A. H., & Diez Roux, A. V. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn118 · Cited by 334
Shortening the Timeline of Pediatric Phase I Trials: The Rolling Six Design
Skolnik, J. M., Barrett, J. S., Jayaraman, B., Patel, D., & Adamson, P. C. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.7712 · Cited by 282
Computer simulation in management science
Kotiadis, K. (2006) · Journal of Simulation · doi:10.1057/palgrave.jos.4250005 · Cited by 276
Discrete-Event Simulation of Health Care Systems
Jacobson, S. H., Hall, S. N., & Swisher, J. R. (2006) · International Series in Operations Research & Management Science · doi:10.1007/978-0-387-33636-7_8 · Cited by 212
Calibrating Models in Economic Evaluation: A Seven-Step Approach
Vanni, T., Karnon, J., Madan, J., White, R. G., Edmunds, W. J., Foss, A. M., & Legood, R. (2011) · PharmacoEconomics · doi:10.2165/11584600-000000000-00000 · Cited by 173
Self-citationModelling Methods for Pharmacoeconomics and Health Technology Assessment: An Overview and Guide
Stahl, J. E. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826020-00004 · Cited by 171
Self-citationPitman, R., Fisman, D., Zaric, G. S., Postma, M., Kretzschmar, M., Edmunds, J., & Brisson, M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454578 · Cited by 150
Barton, P. M., Jobanputra, P., Wilson, J. L., Bryan, S., & Burls, A. (2004) · Health Technology Assessment · doi:10.3310/hta8110 · Cited by 125
O’Hagan, A., Stevenson, M., & Madan, J. J. (2006) · Health Economics · doi:10.1002/hec.1199 · Cited by 116
Selecting a decision model for economic evaluation: a case study and review
Karnon, J. D., & Brown, J. (1998) · Health Care Management Science · doi:10.1023/a:1019090401655 · Cited by 110
Self-citationStevenson, M. D., Oakley, J., & Chilcott, J. B. (2004) · Medical Decision Making · doi:10.1177/0272989x03261561 · Cited by 81
Computer simulation and discrete-event models in the analysis of a mammography clinic patient flow
Coelli, F. C., Ferreira, R. B., de Almeida, R. M. V. R., & Pereira, W. C. D. A. (2007) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2007.05.006 · Cited by 78
Karnon, J., & Vanni, T. (2011) · PharmacoEconomics · doi:10.2165/11584610-000000000-00000 · Cited by 67 · cited 1×
“Costs and quality-of-life weights are attached to events and time spent with different health conditions to estimate long-term costs and health outcomes (e.g., quality-adjusted life-years [QALYs]).”
BackgroundSelf-citationComas, M., Castells, X., Hoffmeister, L., Román, R., Cots, F., Mar, J., Moreno, S. G., & Espallargues, M. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00322.x · Cited by 66
Self-citationThe Development of a Simulation Model of the Treatment of Coronary Heart Disease
Cooper, K., Davies, R., Roderick, P., Chase, D., & Raftery, J. (2002) · Health Care Management Science · doi:10.1023/a:1020378022303 · Cited by 62
Budget Impact Analysis of Thrombolysis for Stroke in Spain: A Discrete Event Simulation Model
Mar, J., Arrospide, A., & Comas, M. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00655.x · Cited by 59
Self-citationStahl, J. E., Rattner, D. W., Wiklund, R. A., Lester, J. S., Beinfeld, M. T., & Gazelle, G. S. (2004) · Medical Decision Making · doi:10.1177/0272989x04268951 · Cited by 56
Self-citationCaro, J. J., Ward, A., Deniz, H. B., O’Brien, J. A., & Ehreth, J. L. (2006) · Value in Health · doi:10.1111/j.1524-4733.2006.00140.x · Cited by 33
Self-citationUncertainty and Sensitivity Analyses of a Dynamic Economic Evaluation Model for Vaccination Programs
Tebbens, R. J. D., Thompson, K. M., Hunink, M. G. M., Mazzuchi, T. A., Lewandowski, D., Kurowicka, D., & Cooke, R. M. (2008) · Medical Decision Making · doi:10.1177/0272989x07311752 · Cited by 31
Capacity Constraints and Cost-Effectiveness: A Discrete Event Simulation for Drug-Eluting Stents
Jahn, B., Pfeiffer, K. P., Theurl, E., Tarride, J., & Goeree, R. A. (2009) · Medical Decision Making · doi:10.1177/0272989x09336075 · Cited by 28
Tosh, J. C., Wailoo, A., Scott, D. L., & Deighton, C. (2011) · The Journal of Rheumatology · doi:10.3899/jrheum.101327 · Cited by 25
Stochastic discrete event simulation of germinal center reactions
Figge, M. T. (2005) · Physical Review E · doi:10.1103/physreve.71.051907 · Cited by 24
Karnon, J., Czoski-Murray, C., Smith, K. J., & Brand, C. (2009) · Medical Decision Making · doi:10.1177/0272989x08327491 · Cited by 21 · cited 1×
“There are two categories of DES applications in health care: non–constrained-resource [24–26] and constrained-resource models [27,28].”
BackgroundSelf-citationDiscrete Event Modeling of CD4+ Memory T Cell Generation
Zand, M. S., Briggs, B. J., Bose, A., & Vo, T. (2004) · The Journal of Immunology · doi:10.4049/jimmunol.173.6.3763 · Cited by 21
Chase, D., Roderick, P., Cooper, K., Davies, R., Quinn, T., & Raftery, J. (2005) · Emergency Medicine Journal · doi:10.1136/emj.2004.023036 · Cited by 19
Monte Carlo simulation experiments for analysis of HIV vaccine effects and vaccine trial design
Barth-Jones, D. C., Adams, A. L., & Koopman, J. S. (2002) · Winter Simulation Conference · doi:10.1109/wsc.2000.899196 · Cited by 13
Assessing emerging technologies—The case of organ replacement technologies: Volume, durability, cost
Stahl, J. E., Vacanti, J. P., & Gazelle, S. (2007) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462307070535 · Cited by 9
Self-citationDiscrete Event Simulation in the Health Policy and Management Program
Groothuis, S., & van Merode, G. G. (2000) · Methods of Information in Medicine · doi:10.1055/s-0038-1634444 · Cited by 7
Crane, G. J., Karnon, J. D., Kymes, S. M., Casson, R. J., Metcalfe, A. V., & Hiller, J. E. (2011) · Value in Health · doi:10.1016/j.jval.2011.02.314 · Cited by 3
Self-citation
Cited by
Briggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Medical Decision Making · doi:10.1177/0272989x12458348 · Cited by 887
Self-citationRamsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
Self-citationCaro, J. J., Briggs, A. H., Siebert, U., & Kuntz, K. M. (2012) · Value in Health · doi:10.1016/j.jval.2012.06.012 · Cited by 766
Self-citationBriggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.014 · Cited by 823
Self-citation
Metadata
- Authors
- Karnon, J., Stahl, J., Brennan, A., Caro, J. J., Mar, J., & Möller, J.
- Venue
- Medical Decision Making
- Publisher
- SAGE Publications
- Published
- 2012-09
- Volume
- 32
- Issue
- 5
- Pages
- 701-711
- ISSN
- 0272-989X (ISSN-L)
- 1552-681X
- OpenAlex
- W2793717112
- Cited by
- 336
- References
- 38
- FWCI
- 36.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.