Dose finding—a challenge in statistics.
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
A good understanding and characterization of the dose response relationship of any new compound is an important and ubiquitous problem in many areas of scientific investigation. This is especially true in the context of pharmaceutical drug development, where it is mandatory to launch safe drugs which demonstrate a clinically relevant effect. Selecting a dose too high may result in unacceptable safety problems, while selecting a dose too low may lead to ineffective drugs. Dose finding studies thus play a key role in any drug development program and are often the gate‐keeper for large confirmatory studies. In this overview paper we focus on definitive and confirmatory dose finding studies in Phase II or III, reviewing relevant statistical design and analysis methods. In particular, we describe multiple comparison procedures, modeling approaches, and hybrid methods combining the advantages of both. An outlook to adaptive dose finding methods is also given. We use a real data example to illustrate the methods, together with a brief overview of relevant software. (© 2008 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,847 · cited 1×
“Alternatively, simultaneous confidence lower or upper bounds for Dunnett’s 1-sided method can be computed with the multcomp package implemented in R (Bretz et al., 2008; Hothorn et al., 2008).”
MethodSelf-citationMixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Self-citationA Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,094
Nonlinear Regression Analysis and Its Applications
Bates, D. M., & Watts, D. G. (1988) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316757 · Cited by 3,979
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
Seber, G. A. F., & Wild, C. J. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725315 · Cited by 1,962
Assessment and Propagation of Model Uncertainty
Draper, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02015.x · Cited by 1,599 · cited 1×
“Ignoring model uncertainty thus can lead to highly undesirable effects, see Chatfield (1995), Draper (1995), and Hjorth (1994).”
BackgroundOrder Restricted Statistical Inference.
Santner, T., Robertson, T., Wright, F. T., & Dykstra, R. L. (1990) · Journal of the American Statistical Association · doi:10.2307/2289813 · Cited by 1,586
On closed testing procedures with special reference to ordered analysis of variance
MARCUS, R., ERIC, P., & GABRIEL, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,423 · cited 1×
“This method is based on the closure principle (Marcus et al., 1976) for controlling the overall type I error rate.”
MethodGroup Sequential Methods with Applications to Clinical Trials
Jennison, C., & Turnbull, B. W. (1999) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367805326 · Cited by 1,336
Local Regression and Likelihood
Loader, C. (1999) · Statistics and Computing · doi:10.1007/b98858 · Cited by 1,195
Model uncertainty, data mining and statistical inference
Chatfield, C. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983440 · Cited by 1,103 · cited 1×
“Ignoring model uncertainty thus can lead to highly undesirable effects, see Chatfield (1995), Draper (1995), and Hjorth (1994).”
BackgroundKlockars, A., & Sax, G. (1986) · Sage eBooks · doi:10.4135/9781412985185 · Cited by 1,013
Order Restricted Statistical Inference
Shoemaker, L. H. (1990) · Technometrics · doi:10.1080/00401706.1990.10484618 · Cited by 869
Evaluation of Experiments with Adaptive Interim Analyses
Bauer, P., & Kohne, K. (1994) · Biometrics · doi:10.2307/2533441 · Cited by 865
Handbook of Nonlinear Regression Models.
Giddings, D. R., & Ratkowsky, D. A. (1991) · Applied Statistics · doi:10.2307/2347928 · Cited by 771
Adaptive Sample Size Calculations in Group Sequential Trials
Lehmacher, W., & Wassmer, G. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.01286.x · Cited by 598 · cited 1×
“Lehmacher and Wassmer (1999) first established a connection between adaptive designs and group sequential tests.”
BackgroundHsu, J. C. (1996) · Springer eBooks · doi:10.1007/978-1-4899-7180-7 · Cited by 593
Self-citationDesigned Extension of Studies Based on Conditional Power
Proschan, M. A., & Hunsberger, S. A. (1995) · Biometrics · doi:10.2307/2533262 · Cited by 534
Freund, R. J., & Littell, R. C. (2000) · Medical Entomology and Zoology · Cited by 525
Testing the Statistical Certainty of a Response to Increasing Doses of a Drug
Tukey, J. W., Ciminera, J. L., & Heyse, J. F. (1985) · Biometrics · doi:10.2307/2530666 · Cited by 486
Krams, M., Lees, K. R., Hacke, W., Grieve, A. P., Orgogozo, J.-M., & Ford, G. A. (2003) · Stroke · doi:10.1161/01.str.0000092527.33910.89 · Cited by 430 · cited 1×
“We refer to Berry et al. (2001) and Krams et al. (2003) for more methodological details and an example clinical study employing Bayesian dose finding methods in practice.”
MethodCombining Multiple Comparisons and Modeling Techniques in Dose‐Response Studies
Bretz, F., Pinheiro, J. C., & Branson, M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00344.x · Cited by 398 · cited 6×
“Bretz et al. (2005) proposed an extension of this methodology, denoted MCP-Mod, which provides the flexibility of modeling for dose estimation, while preserving the robustness to model misspecification associated with multiple comparison procedures.”
BackgroundMethodInfluentialSelf-citationComparison of Methods for the Computation of Multivariate t Probabilities
Genz, A., & Bretz, F. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002394 · Cited by 394 · cited 1×
“…l¼1 c 2 il=nl Pk l¼1 c 2 jl=nl q : ð12Þ Numerical integration routines, such as those implemented in the R package mvtnorm (Hothorn et al., 2001; Genz and Bretz, 2002) can be used to compute multiplicity adjusted p-values and critical values.”
MethodSelf-citationMüller, H.-H., & Schäfer, H. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00886.x · Cited by 372
Multiple Comparisons Procedures
Cabral, H. J. (2008) · Circulation · doi:10.1161/circulationaha.107.700971 · Cited by 309
Combining different phases in the development of medical treatments within a single trial
Bauer, P., & Kieser, M. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990730)18:14<1833::aid-sim221>3.0.co;2-3 · Cited by 287 · cited 1×
“In the meantime, a number of further considerations related to confirmatory adaptive designs with treatment or dose selection at interim have been investigated, see Bauer and Kieser (1999), Posch et al. (2005), Bretz et al. (2006) and Schmidli et al. (2006).”
BackgroundHandbook of Nonlinear Regression Models
Ziegel, E. R. (1991) · Technometrics · doi:10.1080/00401706.1991.10484814 · Cited by 276 · cited 1×
“In broader context, Ratkowsky (1989) summarized many further non-linear regression models, some of which are well applicable to clinical practice.”
BackgroundBretz, F., Schmidli, H., König, F., Racine, A., & Maurer, W. (2006) · Biometrical Journal · doi:10.1002/bimj.200510232 · Cited by 272 · cited 1×
“In the meantime, a number of further considerations related to confirmatory adaptive designs with treatment or dose selection at interim have been investigated, see Bauer and Kieser (1999), Posch et al. (2005), Bretz et al. (2006) and Schmidli et al. (2006).”
BackgroundSelf-citationComputer Intensive Statistical Methods: Validation Model Selection and Bootstrap.
Buckland, S. T., & Hjorth, J. S. U. (1994) · Biometrics · doi:10.2307/2533409 · Cited by 260
Testing and estimation in flexible group sequential designs with adaptive treatment selection
Posch, M., Koenig, F., Branson, M., Brannath, W., Dunger‐Baldauf, C., & Bauer, P. (2005) · Statistics in Medicine · doi:10.1002/sim.2389 · Cited by 243 · cited 1×
“In the meantime, a number of further considerations related to confirmatory adaptive designs with treatment or dose selection at interim have been investigated, see Bauer and Kieser (1999), Posch et al. (2005), Bretz et al. (2006) and Schmidli et al. (2006).”
BackgroundDose Finding in Drug Development
(2006) · Statistics for Biology and Health · doi:10.1007/0-387-33706-7 · Cited by 224
Nelder, J. A., & Baker, R. J. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess0866.pub2 · Cited by 197
Innovative Approaches for Designing and Analyzing Adaptive Dose-Ranging Trials
Bornkamp, B., Bretz, F., Dmitrienko, A., Enas, G., Gaydos, B., Hsu, C.-H., König, F., Krams, M., Liu, Q., Neuenschwander, B., et al. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701643848 · Cited by 195 · cited 5×
“One major conclusion from the PhRMA working group activities is that innovative dose finding methods typically outperform traditional methods, especially with respect to the precision of estimating the functional dose response relationship and related target doses (Bornkamp et al., 2007).”
BackgroundMethodInfluentialSelf-citationComputer Intensive Statistical Methods: Validation, Model Selection, and Bootstrap
Lenth, R. V. (1995) · Technometrics · doi:10.1080/00401706.1995.10484382 · Cited by 183 · cited 1×
“Ignoring model uncertainty thus can lead to highly undesirable effects, see Chatfield (1995), Draper (1995), and Hjorth (1994).”
BackgroundAdaptive Modifications of Hypotheses After an Interim Analysis
Hommel, G. (2001) · Biometrical Journal · doi:10.1002/1521-4036(200109)43:5<581::aid-bimj581>3.0.co;2-j · Cited by 170
Self-citationStepwise Confidence Intervals without Multiplicity Adjustment for Dose-Response and Toxicity Studies
Hsu, J. C., & Berger, R. L. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474141 · Cited by 145
Self-citationAdaptive Bayesian Designs for Dose-Ranging Drug Trials
Berry, D. A., Müller, P., Grieve, A. P., Smith, M. K., Parke, T., Blazek, R., Mitchard, N., & Krams, M. (2002) · Lecture notes in statistics · doi:10.1007/978-1-4613-0035-9_2 · Cited by 137
Statistical Methods for Dose‐Finding Experiments
(2006) · Wiley eBooks · doi:10.1002/0470861258 · Cited by 137 · cited 1×
“For general reading about dose finding in drug development we refer to the edited books by Ting (2006), Chevret (2006), and Krishna (2006) and the references therein.”
Adaptive Dunnett tests for treatment selection
König, F., Brannath, W., Bretz, F., & Posch, M. (2007) · Statistics in Medicine · doi:10.1002/sim.3048 · Cited by 130
Self-citationSchmidli, H., Bretz, F., Racine, A., & Maurer, W. (2006) · Biometrical Journal · doi:10.1002/bimj.200510231 · Cited by 126 · cited 1×
“In the meantime, a number of further considerations related to confirmatory adaptive designs with treatment or dose selection at interim have been investigated, see Bauer and Kieser (1999), Posch et al. (2005), Bretz et al. (2006) and Schmidli et al. (2006).”
BackgroundSelf-citationThe partitioning principle: a powerful tool in multiple decision theory
Finner, H., & Straßburger, K. (2002) · The Annals of Statistics · doi:10.1214/aos/1031689023 · Cited by 125
Dose response studies I. some design considerations
Ruberg, S. J. (1995) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543409508835096 · Cited by 119 · cited 5×
“As an illustration, we use the data from Ruberg (1995b), presented in Section 2.”
BackgroundMethodInfluentialOptimal Designs for Dose-Finding Studies
Dette, H., Bretz, F., Pepelyshev, A., & Pinheiro, J. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000427 · Cited by 119
Self-citationDose response studies II. analysis and interpretation
Ruberg, S. J. (1995) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543409508835097 · Cited by 118 · cited 5×
“As an illustration, we use the data from Ruberg (1995b), presented in Section 2.”
BackgroundMethodInfluentialOn Confidence Sets in Multiple Comparisons
Stefánsson, G., Kim, W.-C., & Hsu, J. C. (1988) · Springer eBooks · doi:10.1007/978-1-4612-3818-8_8 · Cited by 101 · cited 1×
“The most popular of these is the Gauss– Newton algorithm (Bates and Watts, 1988; Seber and Wild, 1989), which is an iterative procedure consisting of solving, until convergence, a sequence of linear least squares problems based on a local approximation of the nonlinear model.”
MethodSelf-citationMCPMod: AnRPackage for the Design and Analysis of Dose-Finding Studies
Bornkamp, B., Pinheiro, J., & Bretz, F. (2009) · Journal of Statistical Software · doi:10.18637/jss.v029.i07 · Cited by 93 · cited 5×
“Ignoring model uncertainty thus can lead to highly undesirable effects, see Chatfield (1995), Draper (1995), and Hjorth (1994). Hybrid dose finding methods that combine principles of multiple comparisons with modeling techniques have recently been investigated to overcome some of the shortenings of applying either app…”
BackgroundMethodInfluentialSelf-citationDesign and Analysis of Dose-Finding Studies Combining Multiple Comparisons and Modeling Procedures
Pinheiro, J., Bornkamp, B., & Bretz, F. (2006) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400600860428 · Cited by 91 · cited 3×
“Practical considerations regarding the implementation of this methodology were discussed by Pinheiro et al. (2006b).”
MethodSelf-citationOptimum biased-coin designs for sequential treatment allocation with covariate information
Atkinson, A. C. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990730)18:14<1741::aid-sim210>3.0.co;2-f · Cited by 85
Statistical methods for dose-finding experiments
Chevret, S. (2006) · Wiley eBooks · Cited by 80
Stepwise Confidence Intervals without Multiplicity Adjustment for Dose-Response and Toxicity Studies
Hsu, J. C., & Berger, R. L. (1999) · Journal of the American Statistical Association · doi:10.2307/2670167 · Cited by 76
Self-citationAnalysis of Dose–Response Studies—Modeling Approaches
Pinheiro, J. C., Bretz, F., & Branson, M. (2006) · Springer eBooks · doi:10.1007/0-387-33706-7_10 · Cited by 65 · cited 3×
“Practical considerations regarding the implementation of this methodology were discussed by Pinheiro et al. (2006b).”
MethodSelf-citationAn extension of the Williams trend test to general unbalanced linear models
Bretz, F. (2005) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2005.02.005 · Cited by 63 · cited 1×
“We refer to Robertson et al. (1988), Hothorn (2006), Bretz (2006) and the references therein for details.”
BackgroundSelf-citationOptimal designs for estimating the interesting part of a dose-effect curve
Holger Dette, A., Guilbaud, O. J. M., & Miller, F. (2007) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-14532 · Cited by 62
Thomas, N. (2006) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400600860469 · Cited by 53
A Practical Comparison of Group-Sequential and Adaptive Designs
Kelly, P. J., Roshini Sooriyarachchi, M., Stallard, N., & Todd, S. (2005) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-200062859 · Cited by 44 · cited 1×
“It can be shown that if the interim analyses occur at the pre-planned information fractions and the design is not adapted during the conduct of the trial, the resulting stopping boundaries are the same as in classical group sequential methods but not the test statistics (Kelly et al., 2005).”
BackgroundON MULTIVARIATE t AND GAUSS PROBABILITIES IN R
Hothorn, T., Bretz, F., & Genz, A. C. (2016) · Cited by 40
Self-citationMultiple Comparison Procedures in Linear Models
Bretz, F., Hothorn, T., & Westfall, P. H. (2008) · Physica-Verlag eBooks · doi:10.1007/978-3-7908-2084-3_35 · Cited by 29 · cited 1×
“Alternatively, simultaneous confidence lower or upper bounds for Dunnett’s 1-sided method can be computed with the multcomp package implemented in R (Bretz et al., 2008; Hothorn et al., 2008).”
MethodSelf-citationAdaptive dose finding based on t‐statistic for dose–response trials
Ivanova, A., Bolognese, J. A., & Perevozskaya, I. T. (2008) · Statistics in Medicine · doi:10.1002/sim.3209 · Cited by 24
Dose Optimization in Drug Development
(2006) · CRC Press eBooks · doi:10.1201/9781420018585 · Cited by 19 · cited 1×
“For general reading about dose finding in drug development we refer to the edited books by Ting (2006), Chevret (2006), and Krishna (2006) and the references therein.”
MethodHothorn, L. A. (2006) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400600860576 · Cited by 18 · cited 1×
“We refer to Robertson et al. (1988), Hothorn (2006), Bretz (2006) and the references therein for details.”
BackgroundBates, D. M., & Chambers, J. M. (2017) · Routledge eBooks · doi:10.1201/9780203738535-10 · Cited by 16
A method for therapeutic dose selection in a phase II clinical trial using contrast statistics
Wakana, A., Yoshimura, I., & Hamada, C. (2006) · Statistics in Medicine · doi:10.1002/sim.2552 · Cited by 12 · cited 1×
“Extensions to Bayesian methods estimating or selecting the dose response curve from a sparse dose design have also been investigated (Neal, 2006; Wakana et al., 2007).”
MethodRadetsky, M. (1996) · The Pediatric Infectious Disease Journal · doi:10.1097/00006454-199609000-00015 · Cited by 10
Qualitative Dosis-Wirkungs-Analysen.
Flühler, H., Unkelbach, H. D., & Wolf, T. (1987) · Biometrics · doi:10.2307/2531564 · Cited by 10
Dose Response: Pharmacokinetic–Pharmacodynamic Approach
Holford, N. H. G. (2006) · Springer eBooks · doi:10.1007/0-387-33706-7_6 · Cited by 5 · cited 1×
“Dose-exposure-response models Pharmacometricians tend to approach dose response modeling by decomposing it into two submodels (Holford, 2006).”
BackgroundGeneralized nonlinear models in R.
Tuner, H., & Firth, D. (2007) · Cited by 3
Sun, H., & Fadiran, E. O. (2006) · Pharmacometrics · doi:10.1002/9780470087978.ch38 · Cited by 1
Research works printed but not linked: 3
- Bornkamp B.(2006).Comparison of model‐based and model‐free approaches for the analysis of dose response studies. Diploma thesis University of Dortmund.
- 1991, FDC Reports from May 6, 1991, The Pink Sheet, 53, 14
- 10.1080/10543400701645140 · doi:10.1080/10543400701645140
Cited by
Workgroup, E. M., Marshall, S., Burghaus, R., Cosson, V, Cheung, S., Chenel, M., DellaPasqua, O., Frey, N., Hamrén, B., Harnisch, L., et al. (2016) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12049 · Cited by 373
Dose-response meta-analysis of differences in means
Crippa, A., & Orsini, N. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0189-0 · Cited by 202
“The most common choice in dose findings [2] is the use of the Emax model which is expressed in terms of three”
BackgroundMethodAerobic Exercise and Weight Loss in Adults: A Systematic Review and Dose-Response Meta-Analysis
Jayedi, A., Soltani, S., Emadi, A., Zargar, M.-S., & Najafi, A. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.52185 · Cited by 172
Adjedj, J., Tóth, G. G., Johnson, N. P., Pellicano, M., Ferrara, A., Floré, V., Gioia, G. D., Barbato, E., Müller, O., & Bruyne, B. D. (2015) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2015.04.028 · Cited by 125
“Dose-response analysis was performed in 2 ways (14).”
Jayedi, A., Zeraattalab-Motlagh, S., Jabbarzadeh, B., Hosseini, Y., Jibril, A. T., Shahinfar, H., Mirrafiei, A., Hosseini, F., & Shab-Bidar, S. (2022) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqac066 · Cited by 85
Metadata
- Authors
- Bretz, F., Hsu, J., Pinheiro, J., & Liu, Y.
- Affiliations
- Novartis (Switzerland) (CH)
- The Ohio State University (US)
- Corresponding author
- Bretz, Frank
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2008-07-29
- Volume
- 50
- Issue
- 4
- Pages
- 480-504
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W1994654755
- Cited by
- 101
- References
- 68
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 5 · 2023: 4 · 2022: 3 · 2021: 7 · 2019: 8 · 2018: 6 · 2017: 7 · 2016: 4 · 2015: 9 · 2014: 9 · 2013: 6 · 2012: 6
- FWCI
- 1.05
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrical Journal (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Pharmaceutical studies and practices
- Keywords
- dose-finding, dose-response relationship, drug development, multiple comparisons, dose-response modeling, statistical design, phase II and III clinical trials
- MeSH terms
- Algorithms, Clinical Trials as Topic, Dose-Response Relationship, Drug, Pharmaceutical Preparations, Humans, Software, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.