CoChat
Sign Up
PreprintCited by 13Health Systems, Economic Evaluations, Quality of LifeSimulation Techniques and ApplicationsPharmaceutical Economics and Policy

hesim: Health Economic Simulation Modeling and Decision Analysis

Open access
Incerti, Devin, Jansen, Jeroen P·2021·arXiv
DOI 10.48550/arxiv.2102.09437arXiv 2102.09437
Open this paper in CoChat — free accountOpen PDF

Abstract

Health economic models simulate the costs and effects of health technologies for use in health technology assessment (HTA) to inform efficient use of scarce resources. Models have historically been developed using spreadsheet software (e.g., Microsoft Excel) and while use of R is growing, general purpose modeling software is still limited. hesim is an R package that helps fill this gap by facilitating parameterization, simulation, and analysis of economic models in an integrated manner. Supported model types include cohort discrete time state transition models (cDTSTMs), individual continuous time state transition models (iCTSTMs), and partitioned survival models (PSMs), encompassing Markov (time-homogeneous and time-inhomogeneous) and semi-Markov processes. A modular design based on R6 and S3 classes allows users to combine separate submodels for disease progression, costs, and utility in a flexible way. Probabilistic sensitivity analysis (PSA) is used to propagate uncertainty in model parameters to model outputs. Simulation code is written in C++ so complex simulations such as those combining PSA and individual simulation can be run much more quickly than previously possible. Decision analysis within a cost-effectiveness framework is performed using simulated costs and quality-adjusted life years (QALYs) from a PSA.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2102.09437

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In the case of hesim, all the memory pre-allocation and loops are made at the C++ level, making it more efficient than looping over base R but might require more RAM.

    “And in the case of hesim, all the memory pre-allocation and loops are made at the C++ level, making it more efficient than looping over base R but might require more RAM.”

    From A Tutorial on Time-Dependent Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example (2023) · cites this paper as [36]

    The Discussion says hesim’s simulations are performed at the C++ level and reports substantially faster runtimes than other R packages. The Conclusion also says its algorithms are written in C++. Neither passage establishes that all memory pre-allocation occurs in C++ or that hesim may require more RAM; the paper does not make a direct comparison with loops in base R. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • R packages such as heemod and hesim can support modeling arbitrary patient populations or many treatment strategies.

    “However, there are R packages for building and running cSTMs and conducting CEAs, such as heemod35 and hesim,36 that are made such that they can support modeling arbitrary patient populations or many treatment strategies.”

    From A Tutorial on Time-Dependent Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example (2023) · cites this paper as [36]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 39

  1. OO, Johansen S (1978). "An Empirical Transition Matrix for Non-Homogeneous Markov Chains Based on Censored Observations." Scandinavian Journal of Statistics, pp. 141-150.
  2. Asaria M, Griffin S, Cookson R (2016). "Distributional Cost-Effectiveness Analysis: A Tuto- rial." Medical Decision Making, 36(1), 8-19. doi:10.1177/0272989X15583266. · DOI
  3. Baio G (2012). Bayesian Methods in Health Economics. CRC Press. doi:10.1201/b13099. · DOI
  4. Baio G (2020). "survHE: Survival Analysis for Health Economic Evaluation and Cost- Effectiveness Modeling." Journal of Statistical Software, 95(1), 1-47. doi:10.18637/jss. v095.i14. · DOI
  5. Baio G, Berardi A, Heath A (2017). Bayesian Cost-Effectiveness Analysis with the R Package BCEA. Springer. doi:10.1007/978-3-319-55718-2. · DOI
  6. Baio G, Heath A (2017). "When Simple Becomes Complicated: Why Excel Should Lose Its Place at the Top Table." Global & Regional Health Technology Assessment. doi: 10.5301/grhta.5000247. · DOI
  7. Brennan A, Chick SE, Davies R (2006). "A Taxonomy of Model Structures for Economic Evaluation of Health Technologies." Health Economics, 15(12), 1295-1310. doi:10.1002/ hec.1148. · DOI
  8. Briggs A, Sculpher M (1998). "An Introduction to Markov Modelling for Economic Evalua- tion." Pharmacoeconomics, 13(4), 397-409. doi:10.2165/00019053-199813040-00003. · DOI
  9. Briggs A, Sculpher M, Claxton K (2006). Decision Modelling for Health Economic Evaluation. Oup Oxford.
  10. Claxton K, Sculpher M, McCabe C, Briggs A, Akehurst R, Buxton M, Brazier J, O'Hagan T (2005). "Probabilistic Sensitivity Analysis for NICE Technology Assessment: Not an Optional Extra." Health Economics, 14(4), 339-347. doi:10.1002/hec.985. · DOI
  11. Cookson R, Mirelman AJ, Griffin S, Asaria M, Dawkins B, Norheim OF, Verguet S, Culyer AJ (2017). "Using Cost-Effectiveness Analysis to Address Health Equity Concerns." Value in Health, 20(2), 206-212. doi:10.1016/j.jval.2016.11.027. · DOI
  12. Cox DR, Miller HD (1977). The Theory of Stochastic Processes, volume 134. CRC press. doi:10.1201/9780203719152. · DOI
  13. Dakin H, Devlin N, Feng Y, Rice N, O'Neill P, Parkin D (2015). "The Influence of Cost- Effectiveness and Other Factors on NICE Decisions." Health Economics, 24(10), 1256-1271. doi:10.1002/hec.3086. · DOI
  14. de Wreede LC, Fiocco M, Putter H, et al. (2011). "mstate: An R Package for the Analysis of Competing Risks and Multi-State Models." Journal of statistical software, 38(7), 1-30. doi:10.18637/jss.v038.i07. · DOI
  15. Dias S, Ades AE, Welton NJ, Jansen JP, Sutton AJ (2018). Network Meta-Analysis for Decision-Making. John Wiley & Sons. doi:10.1002/9781118951651. · DOI
  16. Filipović-Pierucci A, Zarca K, Durand-Zaleski I (2017). "Markov Models for Health Economic Evaluations: The R Package heemod." ArXiv:1702.03252 [stat.AP], URL https://arxiv. org/abs/1702.03252. · arXiv
  17. Fiocco M, Putter H, van Houwelingen HC (2008). "Reduced-Rank Proportional Hazards Re- gression and Simulation-Based Prediction for Multi-State Models." Statistics in Medicine, 27(21), 4340-4358. doi:https://doi.org/10.1002/sim.3305. · DOI
  18. Glasziou P, Simes R, Gelber R (1990). "Quality Adjusted Survival Analysis." Statistics in Medicine, 9(11), 1259-1276. doi:10.1002/sim.4780091106. · DOI
  19. Goldhirsch A, Gelber RD, Simes RJ, Glasziou P, Coates AS (1989). "Costs and Benefits of Adjuvant Therapy in Breast Cancer: A Quality-Adjusted Survival Analysis." Journal of Clinical Oncology, 7(1), 36-44. doi:10.1200/JCO.1989.7.1.36. Guyot P, Ades A, Ouwens MJ, Welton NJ (2012). "Enhanced Secondary Analysis of Survival Data: Reconstructing the Data from Published Kaplan-Meier Survival Curves." BMC Medical Research Methodology, 12(1), 9. doi:10.1186/1471-2288-12-9. · DOI
  20. Heath A, Manolopoulou I, Baio G (2018). "Efficient Monte Carlo Estimation of the Expected Value of Sample Information using Moment Matching." Medical Decision Making, 38(2), 163-173. doi:10.1177/0272989X17738515. · DOI
  21. Hernández Alava M, Wailoo A, Wolfe F, Michaud K (2013). "The Relationship Between EQ- 5d, HAQ and Pain in Patients with Rheumatoid Arthritis." Rheumatology, 52(5), 944-950. doi:10.1093/rheumatology/kes400. · DOI
  22. Incerti D, Thom H, Baio G, Jansen JP (2019). "R you Still using Excel? The Advantages of Modern Software Tools for Health Technology Assessment." Value in Health, 22(5), 575-579. doi:10.1016/j.jval.2019.01.003. · DOI
  23. Jackson CH (2016). "flexsurv: A Platform for Parametric Survival Modeling in R." Journal of Statistical Software, 70. doi:10.18637/jss.v070.i08. · DOI · Paper page
  24. Jalal H, Pechlivanoglou P, Krijkamp E, Alarid-Escudero F, Enns E, Hunink MM (2017). "An Overview of R in Health Decision Sciences." Medical Decision Making, 37(7), 735-746. doi:10.1177/0272989X16686559. · DOI
  25. Jansen JP, Incerti D, Trikalinos T (2020). "Multi-State Network Meta-Analysis of Cause- Specific Survival Data." medRxiv. doi:10.1101/2020.11.13.20231332. · DOI
  26. Kharroubi SA, Brazier JE, Roberts J, O'Hagan A (2007). "Modelling SF-6D Health State Preference Data using a Nonparametric Bayesian Method." Journal of Health Economics, 26(3), 597-612. doi:10.1016/j.jhealeco.2006.09.002. · DOI
  27. Lenderking WR, Gelber RD, Cotton DJ, Cole BF, Goldhirsch A, Volberding PA, Testa MA (1994). "Evaluation of the Quality of Life Associated with Zidovudine Treatment in Asymp- tomatic Human Immunodeficiency Virus Infection." New England Journal of Medicine, 330(11), 738-743. doi:10.1056/NEJM199403173301102. · DOI
  28. Nixon RM, Thompson SG (2005). "Methods for Incorporating Covariate Adjustment, Sub- group Analysis and Between-Centre Differences into Cost-Effectiveness Evaluations." Health Economics, 14(12), 1217-1229. doi:10.1002/hec.1008. · DOI
  29. O'Hagan A, Stevenson M, Madan J (2007). "Monte Carlo Probabilistic Sensitivity Analysis for Patient Level Simulation Models: Efficient Estimation of Mean and Variance using ANOVA." Health Economics, 16(10), 1009-1023. doi:10.1002/hec.1199. · DOI
  30. Pahuta MA, Werier J, Wai EK, Patchell RA, Coyle D (2019). "A Technique for Approximat- ing Transition Rates from Published Survival Analyses." Cost Effectiveness and Resource Allocation, 17(1), 12. doi:10.1186/s12962-019-0182-7. · DOI
  31. Price MJ, Welton NJ, Ades A (2011). "Parameterization of Treatment Effects for Meta- Analysis in Multi-State Markov Models." Statistics in Medicine, 30(2), 140-151. doi: 10.1002/sim.4059. · DOI
  32. Putter H, Fiocco M, Geskus RB (2007). "Tutorial in Biostatistics: Competing Risks and Multi-State Models." Statistics in Medicine, 26(11), 2389-2430. doi:https://doi.org/ 10.1002/sim.2712. · DOI
  33. Strong M, Oakley JE, Brennan A (2014). "Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample: A Non- parametric Regression Approach." Medical Decision Making, 34(3), 311-326. doi: 10.1177/0272989X13505910. · DOI
  34. Torrance GW (1986). "Measurement of Health State Utilities for Economic Appraisal: A Review." Journal of Health Economics, 5(1), 1-30. doi:10.1016/0167-6296(86)90020-2. · DOI
  35. Trosman JR, Van Bebber SL, Phillips KA (2011). "Health Technology Assessment and Private Payers' Coverage of Personalized Medicine." Journal of Oncology Practice, 7(3S), 18s-24s. doi:10.1200/JOP.2011.000300. · DOI
  36. Wickham H (2016). ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York. ISBN 978-3-319-24277-4. doi:10.1007/978-0-387-98141-3. URL https://ggplot2. tidyverse.org. · DOI · Paper page
  37. Williams C, Lewsey JD, Briggs AH, Mackay DF (2017). "Cost-Effectiveness Analysis in R using a Multi-State Modeling Survival Analysis Framework: A Tutorial." Medical Decision Making, 37(4), 340-352. doi:10.1177/0272989X16651869. · DOI
  38. Woods B, Sideris E, Palmer S, Latimer N, Soares M (2018). "NICE DSU Technical Support Document 19: Partitioned Survival Analysis for Decision Modelling in Health Care: A Critical Review." Technical report, National Institute for Health and Care Excellence, Decision Support Unit. URL http://nicedsu.org.uk/wp-content/uploads/2017/06/ Partitioned-Survival-Analysis-final-report.pdf.
  39. Woods BS, Sideris E, Palmer S, Latimer N, Soares M (2020). "Partitioned Survival and State Transition Models for Healthcare Decision Making in Oncology: Where Are We Now?" Value in Health. doi:10.1016/j.jval.2020.08.2094. · DOI

Cited by

Sorted by citations

Authors
Incerti, D., & Jansen, J. P.
Affiliations
  • Genentech (US)
  • University of California, San Francisco (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2102.09437
arXiv
2102.09437
OpenAlex
W3131469478
Cited by
13
References
1
Citations by year
2025: 1 · 2024: 3 · 2023: 2 · 2022: 6 · 2021: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Pharmaceutical Economics and Policy
Keywords
decision analysis, health technology assessment, state transition model, Markov model, semi-Markov model, partitioned survival model, probabilistic sensitivity analysis, cost-effectiveness, quality-adjusted life years, R package, C++ simulation, disease progression modeling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review