Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Partial expected value of perfect information (EVPI) calculations can quantify the value of learning about particular subsets of uncertain parameters in decision models. Published case studies have used different computational approaches. This article examines the computation of partial EVPI estimates via Monte Carlo sampling algorithms. The mathematical definition shows 2 nested expectations, which must be evaluated separately because of the need to compute a maximum between them. A generalized Monte Carlo sampling algorithm uses nested simulation with an outer loop to sample parameters of interest and, conditional upon these, an inner loop to sample remaining uncertain parameters. Alternative computation methods and shortcut algorithms are discussed and mathematical conditions for their use considered. Maxima of Monte Carlo estimates of expectations are biased upward, and the authors show that the use of small samples results in biased EVPI estimates. Three case studies illustrate 1) the bias due to maximization and also the inaccuracy of shortcut algorithms 2) when correlated variables are present and 3) when there is nonlinearity in net benefit functions. If relatively small correlation or nonlinearity is present, then the shortcut algorithm can be substantially inaccurate. Empirical investigation of the numbers of Monte Carlo samples suggests that fewer samples on the outer level and more on the inner level could be efficient and that relatively small numbers of samples can sometimes be used. Several remaining areas for methodological development are set out. A wider application of partial EVPI is recommended both for greater understanding of decision uncertainty and for analyzing research priorities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Expected Value of Sample Information Calculations in Medical Decision Modeling
Ades, A. E., Lu, G., & Claxton, K. (2004) · Medical Decision Making · doi:10.1177/0272989x04263162 · Cited by 364
Cited by
Briggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Medical Decision Making · doi:10.1177/0272989x12458348 · Cited by 887
Briggs, A. H., Weinstein, M. C., Fenwick, E. A. L., Karnon, J., Sculpher, M. J., & Paltiel, A. D. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.014 · Cited by 823
Uncertainty and patient heterogeneity in medical decision models
Groot Koerkamp, B., Weinstein, M. C., Stijnen, T., Heijenbrok-Kal, M. H., & Hunink, M. G. M. (2010) · Medical Decision Making · doi:10.1177/0272989x09342277 · Cited by 105
Bruce, I., Harman, N., Williamson, P., Tierney, S., Callery, P., Mohiuddin, S., Payne, K., Fenwick, E., Kirkham, J., & O’Brien, K. (2015) · Health Technology Assessment · doi:10.3310/hta19680 · Cited by 65
Solomon, D., Proudfoot, J., Clarke, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4207 · Cited by 55
“To estimate the EVPPI with accuracy [50], we ran an optimal number of iterations for each analysis.”
Metadata
- Authors
- Brennan, A., Kharroubi, S., O'Hagan, A., & Chilcott, J.
- Venue
- Medical Decision Making
- Publisher
- SAGE Publications
- Published
- 2007-07
- Volume
- 27
- Issue
- 4
- Pages
- 448-470
- ISSN
- 0272-989X (ISSN-L)
- 1552-681X
- OpenAlex
- W2168448560
- Cited by
- 134
- References
- 1
- FWCI
- 18.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms. https://app.cochat.ai/papers/10.1177/0272989x07302555
- The paper
- Brennan, A., Kharroubi, S., O'Hagan, A., & Chilcott, J. (2007). Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms. Medical Decision Making. https://doi.org/10.1177/0272989x07302555
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.