The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
A Review of Modern Computational Algorithms for Bayesian Optimal Design
Open accessAbstract
Summary: Bayesian experimental design is a fast growing area of research with many real‐world applications. As computational power has increased over the years, so has the development of simulation‐based design methods, which involve a number of algorithms, such as Markov chain Monte Carlo, sequential Monte Carlo and approximate Bayes methods, facilitating more complex design problems to be solved. The Bayesian framework provides a unified approach for incorporating prior information and/or uncertainties regarding the statistical model with a utility function which describes the experimental aims. In this paper, we provide a general overview on the concepts involved in Bayesian experimental design, and focus on describing some of the more commonly used Bayesian utility functions and methods for their estimation, as well as a number of algorithms that are used to search over the design space to find the Bayesian optimal design. We also discuss other computational strategies for further research in Bayesian optimal design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Rue, H., Martino, S., & Chopin, N. (2009) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00700.x · Cited by 5,279
Optimal Statistical Decisions.
Siegmund, D., & DeGroot, M. H. (1972) · Journal of the American Statistical Association · doi:10.2307/2284675 · Cited by 3,386
Simulated annealing: theory and applications.
(1988) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(88)90023-7 · Cited by 2,966
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Stastical Decision Theory and Bayesian Analysis.
Ghosh, M., & Berger, J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,905
Simulated Annealing: Theory and Applications
van Laarhoven, P. J. M., & Aarts, E. H. L. (1987) · Springer eBooks · doi:10.1007/978-94-015-7744-1 · Cited by 2,385
Fedorov, V. V., Studden, W. J., & Klimko, E. M. (1972) · Cited by 2,092
Theory of Optimal Experiments.
Herzberg, A. M., Wynn, H. P., Fedorov, V. V., Studden, W. J., & Klimko, E. M. (1972) · Biometrika · doi:10.2307/2334826 · Cited by 1,897
Bayesian Experimental Design: A Review
Chaloner, K., & Verdinelli, I. (1995) · Statistical Science · doi:10.1214/ss/1177009939 · Cited by 1,839
Optimal Statistical Decisions.
Lindley, D. V., & de Groot, M. (1971) · Applied Statistics · doi:10.2307/2346640 · Cited by 1,802
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0986 · Cited by 1,540
On a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509
Wheeler, R. E., Atkinson, A. C., & Donev, A. N. (1993) · Technometrics · doi:10.2307/1270278 · Cited by 1,447
(2006) · Optimal Control and Forecasting of Complex Dynamical Systems · doi:10.1142/9789812774248_0002 · Cited by 1,362
Sequential Monte Carlo Samplers
Del Moral, P., Doucet, A., & Jasra, A. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2006.00553.x · Cited by 1,239
Introduction to Stochastic Dynamic Programming.
Berry, D. A., & Ross, S. M. (1986) · Journal of the American Statistical Association · doi:10.2307/2289262 · Cited by 1,133
The Equivalence of Two Extremum Problems
Kiefer, J., & Wolfowitz, J. (1960) · Canadian Journal of Mathematics · doi:10.4153/cjm-1960-030-4 · Cited by 879
Optimum Designs in Regression Problems
Kiefer, J., & Wolfowitz, J. (1959) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706252 · Cited by 791
General Equivalence Theory for Optimum Designs (Approximate Theory)
Kiefer, J. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342810 · Cited by 761
Atkinson, A. C., & Donev, A. N. (1992) · doi:10.1093/oso/9780198522546.001.0001 · Cited by 752
Kiefer, J. C. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_28 · Cited by 654
A sequential particle filter method for static models
Chopin, N. (2002) · Biometrika · doi:10.1093/biomet/89.3.539 · Cited by 569
Expected Information as Expected Utility
Bernardo, J. M. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 568
1. Bayesian Statistics a Review
Lindley, D. V. (1972) · Bayesian Statistics · doi:10.1137/1.9781611970654.ch1 · Cited by 521
Simulation-based optimal bayesian experimental design for nonlinear systems
Huan, X., & Marzouk, Y. M. (2013) · Journal of Computational Physics · doi:10.1016/j.jcp.2012.08.013 · Cited by 438 · cited 5×
“Huan and Marzouk (2012, 2013) used polynomial chaos approximations and nested Monte Carlo integration (Ryan [2003]) to estimate the KLD between the prior and posterior distributions for static design problems for parameter estimation.”
MethodInfluentialDiscrimination Among Mechanistic Models
Box, G. E. P., & Hill, W. J. (1967) · Technometrics · doi:10.1080/00401706.1967.10490441 · Cited by 426
An Overview of the Simultaneous Perturbation Method for Efficient Optimization
Spall, J. C. (1998) · doi:10.26144/yqez-2q90 · Cited by 422
Explaining Variational Approximations
Ormerod, J. T., & Wand, M. P. (2010) · The American Statistician · doi:10.1198/tast.2010.09058 · Cited by 401
Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems
Bengtsson, T., Bickel, P., & Li, B. (2008) · Institute of Mathematical Statistics Collections · doi:10.1214/193940307000000518 · Cited by 397
Keogh, E., & Mueen, A. (2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_192 · Cited by 351
Lindley, D. V. (1972) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970654 · Cited by 238
The Choice of Variables in Multiple Regression
Lindley, D. V. (1968) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1968.tb01505.x · Cited by 232
Drovandi, C. C., & Pettitt, A. N. (2011) · Biometrics · doi:10.1111/j.1541-0420.2010.01410.x · Cited by 230
Self-citationBayesian Geostatistical Design
Diggle, P. J., & Lophaven, S. (2005) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2005.00469.x · Cited by 225
Ruggeri, F., Ríos Insua, D., & Martín, J. (2005) · Handbook of Statistics · doi:10.1016/s0169-7161(05)25021-6 · Cited by 201
Monte Carlo and Quasi-Monte Carlo Methods 2004
(2006) · Springer eBooks · doi:10.1007/3-540-31186-6 · Cited by 198
(2000) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-1306-2 · Cited by 198
Simulation Based Optimal Design
Müller, P. (2005) · Handbook of Statistics · doi:10.1016/s0169-7161(05)25017-4 · Cited by 184
Maximizing the information content of experiments in systems biology
Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002888 · Cited by 170
Cavagnaro, D. R., Myung, J. I., Pitt, M. A., & Kujala, J. V. (2009) · Neural Computation · doi:10.1162/neco.2009.02-09-959 · Cited by 170
Ryan, K. J. (2003) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860032012 · Cited by 169
Optimal Bayesian Design by Inhomogeneous Markov Chain Simulation
Müller, P., Sansó, B., & De Iorio, M. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001123 · Cited by 169
Sisson, S. A., & Fan, Y. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-13 · Cited by 165
BAYESIAN DECISION PROCEDURES FOR DOSE DETERMINING EXPERIMENTS
Whitehead, J., & Brunier, H. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140904 · Cited by 144
Long, Q., Scavino, M., Tempone, R. F., & Wang, S. (2013) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2013.02.017 · Cited by 129
Sequential Optimal Design of Neurophysiology Experiments
Lewi, J., Butera, R. J., & Paninski, L. (2008) · Neural Computation · doi:10.1162/neco.2008.08-07-594 · Cited by 126
Optimal Design via Curve Fitting of Monte Carlo Experiments
Müller, P., & Parmigiani, G. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476636 · Cited by 120
GRADIENT-BASED STOCHASTIC OPTIMIZATION METHODS IN BAYESIAN EXPERIMENTAL DESIGN
Huan, X., & Marzouk, Y. (2014) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2014006730 · Cited by 115
Bayesian decision procedures based on logistic regression models for dose-finding studies
Whitehead, J., & Williamson, D. (1998) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543409808835252 · Cited by 112
Group Sequential Clinical Trials: A Classical Evaluation of Bayesian Decision-Theoretic Designs
Lewis, R. J., & Berry, D. A. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476893 · Cited by 110
Approaches for Optimal Sequential Decision Analysis in Clinical Trials
Carlin, B. P., Kadane, J. B., & Gelfand, A. E. (1998) · Biometrics · doi:10.2307/2533849 · Cited by 110
Asymptotic Theory of Information-Theoretic Experimental Design
Paninski, L. (2005) · Neural Computation · doi:10.1162/0899766053723032 · Cited by 108
An Optimal Experimental Design Criterion for Discriminating Between Non-Normal Models
López–Fidalgo, J., Tommasi, C., & Trandafir, P. C. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.00586.x · Cited by 108
Batch sequential designs for computer experiments
Loeppky, J. L., Moore, L. M., & Williams, B. J. (2009) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2009.12.004 · Cited by 103
One-Sided Sequential Stopping Boundaries for Clinical Trials: A Decision- Theoretic Approach
Berry, D. A., & Ho, C.-H. (1988) · Biometrics · doi:10.2307/2531909 · Cited by 103
Approximate Bayesian Computation Using Indirect Inference
Drovandi, C. C., Pettitt, A. N., & Faddy, M. J. (2011) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2010.00747.x · Cited by 100
Self-citationSimulation-Based Optimal Design
Moller, P. (1999) · doi:10.1093/oso/9780198504856.003.0020 · Cited by 99
The Usefulness of Optimum Experimental Designs
Atkinson, A. C. (1996) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1996.tb02067.x · Cited by 98
Designing and Integrating Composite Networks for Monitoring Multivariate Gaussian Pollution Fields
Zidek, J. V., Sun, W., & Le, N. D. (2000) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00179 · Cited by 97
A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design
Drovandi, C., McGree, J. M., & Pettitt, A. N. (2012) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.730083 · Cited by 87
Self-citationBayesian adaptive estimation: The next dimension
Kujala, J. V., & Lukka, T. J. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.12.005 · Cited by 82
D’Argenio, D. Z. (1990) · Mathematical Biosciences · doi:10.1016/0025-5564(90)90141-k · Cited by 82
A Hierarchical Adaptive Approach to Optimal Experimental Design
Kim, W., Pitt, M. A., Lu, Z., Mark Steyvers, B., & Myung, J. I. (2014) · Neural Computation · doi:10.1162/neco_a_00654 · Cited by 78
(1997) · Technometrics · doi:10.1080/00401706.1997.10485467 · Cited by 74
Decision Analysis by Augmented Probability Simulation
Bielza, C., Müller, P., & Insua, D. R. (1999) · Management Science · doi:10.1287/mnsc.45.7.995 · Cited by 70
Loredo, T. J., & Chernoff, D. F. (2006) · Springer eBooks · doi:10.1007/0-387-21529-8_4 · Cited by 67
Bayesian Experimental Design for Models with Intractable Likelihoods
Drovandi, C., & Pettitt, A. N. (2013) · Biometrics · doi:10.1111/biom.12081 · Cited by 66
Self-citationOptimal Experimental Design for Another's Analysis
Etzioni, R., & Kadane, J. B. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476425 · Cited by 64
Loredo, T. J. (2004) · AIP conference proceedings · doi:10.1063/1.1751377 · Cited by 61
A Gridding Method for Bayesian Sequential Decision Problems
Brockwell, A., & Kadane, J. B. (2003) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860032274 · Cited by 56
Optimal experiment design for model selection in biochemical networks
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-20 · Cited by 55
An Expected Loss Approach to the Design of Dosage Regimens Via Sampling-Based Methods
Wakefield, J. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348929 · Cited by 52
Ryan, E., Drovandi, C., Thompson, H., & Pettitt, A. N. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.08.017 · Cited by 51
Self-citationResponse-adaptive dose-finding under model uncertainty
Bornkamp, B., Bretz, F., Holger Dette, A., & Pinheiro, J. (2011) · The Annals of Applied Statistics · doi:10.1214/10-aoas445 · Cited by 51
Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data
Drovandi, C., McGree, J. M., & Pettitt, A. N. (2012) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.05.014 · Cited by 51
Self-citationGlobal random optimization by simultaneous perturbation stochastic approximation
Maryak, J. L., & Chin, D. C. (2001) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2001.945806 · Cited by 49
Fully Bayesian Experimental Design for Pharmacokinetic Studies
Ryan, E., Drovandi, C., & Pettitt, A. N. (2015) · Entropy · doi:10.3390/e17031063 · Cited by 40
Self-citationOptimal Sampling Times in Population Pharmacokinetic Studies
Stroud, J., Müller, P., & Rosner, G. L. (2001) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00239 · Cited by 39
Global random optimization by simultaneous perturbation stochastic approximation
Maryak, J. L., & Chin, D. C. (2001) · Winter Simulation Conference · doi:10.5555/564124.564167 · Cited by 37
A Bayesian Decision-Theoretic Dose-Finding Trial
Müller, P., Berry, D. A., Grieve, A. P., et al. (2006) · Decision Analysis · doi:10.1287/deca.1060.0079 · Cited by 35
Experimental Design: A Bayesian Perspective
Clyde, M. A. (2001) · Cited by 33
SMC Samplers for Bayesian Optimal Nonlinear Design
Kück, H., de Freitas, N., & Doucet, A. (2006) · doi:10.1109/nsspw.2006.4378829 · Cited by 30
Optimal Design Criteria for Discrimination and Estimation in Nonlinear Models
Waterhouse, T., Eccleston, J. A., & Duffull, S. B. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802677257 · Cited by 22
Design of follow‐up experiments for improving model discrimination and parameter estimation
Ng, S. H., & Chick, S. E. (2004) · Naval Research Logistics (NRL) · doi:10.1002/nav.20046 · Cited by 20
Simulation-based fully Bayesian experimental design for mixed effects models
Ryan, E., Drovandi, C., & Pettitt, A. N. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.06.007 · Cited by 19
Self-citationAdvances in Bayesian Experimental Design
Verdinelli, I. (1992) · doi:10.1093/oso/9780198522669.003.0026 · Cited by 18
Bayesian randomized clinical trials: A decision‐theoretic sequential design
Christen, J. A., Müller, P., Wathen, K., & Wolf, J. K. (2004) · Canadian Journal of Statistics · doi:10.2307/3316023 · Cited by 17
Sequential Markov Chain Monte Carlo (MCMC) model discrimination
(2012) · doi:10.1002/cjce.21711 · Cited by 16
Global random optimization by simultaneous perturbation stochastic approximation
Maryak, J. L., & Chin, D. C. (2002) · Winter Simulation Conference · doi:10.1109/wsc.2001.977290 · Cited by 16
Likelihood-Free Simulation-Based Optimal Design: An Introduction
Hainy, M., Müller, W. G., & Wagner, H. (2014) · Springer proceedings in mathematics & statistics · doi:10.1007/978-1-4939-2104-1_26 · Cited by 10
Cited by
Ultra-large library docking for discovering new chemotypes
Lyu, J., Wang, S., Balius, T. E., Singh, I., Levit, A., Moroz, Y. S., O’Meara, M. J., Che, T., Algaa, E., Tolmachova, K., et al. (2019) · Nature · doi:10.1038/s41586-019-0917-9 · Cited by 998
Artificial intelligence and machine learning for quantum technologies
Krenn, M., Landgraf, J., Foesel, T., & Marquardt, F. (2023) · Physical Review A · doi:10.1103/physreva.107.010101 · Cited by 162
Designing optimal behavioral experiments using machine learning
Valentin, S., Kleinegesse, S., Bramley, N. R., Seriès, P., Gutmann, M. U., & Lucas, C. G. (2024) · eLife · doi:10.7554/elife.86224 · Cited by 8
Metadata
- Authors
- Ryan, E. G., Drovandi, C. C., McGree, J. M., & Pettitt, A. N.
- Venue
- International Statistical Review
- Publisher
- Wiley
- Published
- 2015-06-15
- Volume
- 84
- Issue
- 1
- Pages
- 128-154
- ISSN
- 0306-7734 (ISSN-L)
- 1751-5823
- OpenAlex
- W2101484286
- Cited by
- 312
- References
- 97
- FWCI
- 17.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.