A practical guide for the generation of model-based virtual clinical trials
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Mathematical modeling has made significant contributions to drug design, development, and optimization. Virtual clinical trials that integrate mathematical models to explore patient heterogeneity and its impact on a variety of therapeutic questions have recently risen in popularity. Here, we outline best practices for creating virtual patients from mathematical models to ultimately implement and execute a virtual clinical trial. In this practical guide, we discuss and provide examples of model design, parameter estimation, parameter sensitivity, model identifiability, and virtual patient cohort creation. Our goal is to help researchers adopt these approaches to further the use of virtual population-based analysis and virtual clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![FIGURE 3 Example of conducting a virtual clinical trial. (A) Model of oncolytic virotherapy, where uV(t) is the source term of the virus determined by the administration schedule shown in (C) (Wares et al., 2015). (B) Model parameters and initial conditions. (C) Best fit of model to average experimental data when fitting only the parameters and initial conditions specified in (B). (D–F) Profile likelihood curves for the non-fixed parameters. (G) 100 virtual patients that form our virtual population. (H) Virtual clinical trial predicts what percent of virtual patients shrink in response to OV treatment as a function of OV dose [with the protocol fixed as in (C)]. Doses range from experimental dose of 1010 OVs/injection to 90 times the experimental dose.](https://figures.cochat.ai/paper-figures/619271ef94034b73a05822184fc8aebe/a-practical-guide-for-the-generation-of-model-based-virtual-clinical-trials-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Because virtual population generation and virtual clinical trials depend on parameter distributions rather than point estimates4,5, calibration must quantify uncertainty.”
From Structured Schemas for Provenance-Rich, LLM-Assisted QSP Model Calibration (2026) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Because virtual population generation and virtual clinical trials depend on parameter distributions rather than point estimates [4, 5], calibration must quantify uncertainty.”
From Structured Schemas for Provenance‐Rich, LLM ‐Assisted QSP Model Calibration (2026) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A methodology for performing global uncertainty and sensitivity analysis in systems biology
Marino, S., Hogue, I. B., Ray, C. J., & Kirschner, D. E. (2008) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2008.04.011 · Cited by 2,999
Handbook of Markov Chain Monte Carlo
Brooks, S., Gelman, A., Jones, G., & Meng, X.-L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905 · Cited by 2,993
Mckay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.1080/00401706.2000.10485979 · Cited by 2,833
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Approximate Bayesian Computation (ABC) in practice
Csilléry, K., Blum, M. G. B., Gaggiotti, O. E., & François, O. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.04.001 · Cited by 1,302 · cited 1×
“There also exist non-parametric methods for generating posterior distributions for the fi t parameters, including MCMC and the relatively new Approximate Bayesian Computation (ABC) method (Csilléry et al., 2010).”
Mould, D., & Upton, R. (2013) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2013.14 · Cited by 897
Sensitivity and specificity of information criteria
(2019) · doi:10.1093/bib/bbz016 · Cited by 718
Basic Concepts in Population Modeling, Simulation, and Model‐Based Drug Development
Mould, D., & Upton, R. (2012) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2012.4 · Cited by 544
Zhang, X., Trame, M., Lesko, L., & Schmidt, S. (2015) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.6 · Cited by 467 · cited 5×
“This in turn informs model structure, as highlighted in the schematic in Figure 1, and may even lead to recommendations for future experimental design (Zhang et al., 2015).”
InfluentialSensitivity analysis approaches applied to systems biology models
Zi, Z. (2011) · IET Systems Biology · doi:10.1049/iet-syb.2011.0015 · Cited by 384
On structural and practical identifiability
Wieland, F.-G., Hauber, A. L., Rosenblatt, M., Tönsing, C., & Timmer, J. (2021) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2021.03.005 · Cited by 325
Holford, N. H. G., Kimko, H. C., Monteleone, J. P. R., & Peck, C. C. (2000) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev.pharmtox.40.1.209 · Cited by 289
In silico clinical trials: concepts and early adoptions
Pappalardo, F., Russo, G., Tshinanu, F. M., & Viceconti, M. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bby043 · Cited by 279
Narrow therapeutic index drugs: a clinical pharmacological consideration to flecainide
Tamargo, J., Le Heuzey, J.-Y., & Mabo, P. (2015) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-015-1832-0 · Cited by 276
Sensitivity analysis for volcanic source modeling quality assessment and model selection
Cannavó, F. (2012) · Computers & Geosciences · doi:10.1016/j.cageo.2012.03.008 · Cited by 260
Clinical Trial Simulation: A Review
Holford, N., Ma, S. C., & Ploeger, B. A. (2010) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2010.114 · Cited by 191
Allen, R., Rieger, T., & Musante, C. (2016) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12063 · Cited by 179
Sensitivity analysis methods in the biomedical sciences
Qian, G., & Mahdi, A. (2020) · Mathematical Biosciences · doi:10.1016/j.mbs.2020.108306 · Cited by 169
Mathematical Models of Cancer: When to Predict Novel Therapies, and When Not to
Brady, R., & Enderling, H. (2019) · Bulletin of Mathematical Biology · doi:10.1007/s11538-019-00640-x · Cited by 166
The Clinical Viewpoint: Definitions, Limitations of RECIST, Practical Considerations of Measurement
Villaruz, L. C., & Socinski, M. A. (2013) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-12-2935 · Cited by 165
Huang, Q., & Riviere, J. E. (2014) · Expert Opinion on Drug Metabolism & Toxicology · doi:10.1517/17425255.2014.934671 · Cited by 149
Scaling Pharmacodynamics from In Vitro and Preclinical Animal Studies to Humans
Mager, D. E., Woo, S., & Jusko, W. J. (2009) · Drug Metabolism and Pharmacokinetics · doi:10.2133/dmpk.24.16 · Cited by 141
Huang, J.-H., Zhang, S.-N., Choi, K., Choi, I.-K., Kim, J.-H., Lee, M., Kim, H., & Yun, C. (2009) · Molecular Therapy · doi:10.1038/mt.2009.205 · Cited by 133
Davies, M., Jones, R. D. O., Grime, K., Jansson-Löfmark, R., Fretland, A. J., Winiwarter, S., Morgan, P., & McGinnity, D. F. (2020) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2020.03.004 · Cited by 123
Calibration of ionic and cellular cardiac electrophysiology models
Whittaker, D. J., Clerx, M., Lei, C. L., Christini, D. J., & Mirams, G. R. (2020) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1482 · Cited by 104
COVID-19 virtual patient cohort suggests immune mechanisms driving disease outcomes
Jenner, A. L., Aogo, R. A., Alfonso, S., Crowe, V., Deng, X., Smith, A. P., Morel, P. A., Davis, C. L., Smith, A. M., & Craig, M. (2021) · PLoS Pathogens · doi:10.1371/journal.ppat.1009753 · Cited by 99
Self-citationRieger, T. R., Allen, R. J., Bystricky, L., Chen, Y., Colopy, G. W., Cui, Y., Gonzalez, A., Liu, Y., White, R. D., Everett, R. A., et al. (2018) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2018.06.002 · Cited by 94
Eisenberg, M. C., & Jain, H. V. (2017) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2017.07.018 · Cited by 79
Wilkie, K. P., & Hahnfeldt, P. (2013) · Cancer Research · doi:10.1158/0008-5472.can-12-4590 · Cited by 76
Self-citationNonlinear mixed-effects modeling: individualization and prediction.
Olofsen, E., Dinges, D. F., & Dongen, H. P. A. V. (2004) · PubMed · Cited by 71
Cassidy, T., & Craig, M. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007495 · Cited by 63
Self-citationVirtual Twins: Understanding the Data Required for Model‐Informed Precision Dosing
Polasek, T. M., & Rostami‐Hodjegan, A. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1778 · Cited by 60
Wilkie, K. P., & Hahnfeldt, P. (2017) · Bulletin of Mathematical Biology · doi:10.1007/s11538-017-0291-4 · Cited by 54
Self-citationVirtual Populations for Quantitative Systems Pharmacology Models
Cheng, Y., Straube, R., Alnaif, A. E., Huang, L., Leil, T. A., & Schmidt, B. J. (2022) · Methods in Molecular Biology · doi:10.1007/978-1-0716-2265-0_8 · Cited by 54
Jenner, A. L., Cassidy, T., Belaid, K., Bourgeois‐Daigneault, M., & Craig, M. (2021) · Journal for ImmunoTherapy of Cancer · doi:10.1136/jitc-2020-001387 · Cited by 52
Self-citationWang, H., Sové, R. J., Jafarnejad, M., Rahmeh, S., Jaffee, E. M., Stearns, V., Torres, E. T. R., Connolly, R. M., & Popel, A. S. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00141 · Cited by 51
A Quantitative Systems Pharmacology Perspective on the Importance of Parameter Identifiability
Sher, A., Niederer, S., Mirams, G. R., Kirpichnikova, A., Allen, R., Pathmanathan, P., Gavaghan, D. J., van der Graaf, P. H., & Noble, D. (2022) · Bulletin of Mathematical Biology · doi:10.1007/s11538-021-00982-5 · Cited by 51
Barish, S., Ochs, M. F., Sontag, E. D., & Gevertz, J. L. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1703355114 · Cited by 48
Self-citationGenerating Virtual Patients by Multivariate and Discrete Re-Sampling Techniques
Teutonico, D., Musuamba, F. T., Maas, H. J., Facius, A., Yang, S., Danhof, M., & Pasqua, O. E. D. (2015) · Pharmaceutical Research · doi:10.1007/s11095-015-1699-x · Cited by 47
Phase i trials in melanoma: A framework to translate preclinical findings to the clinic
Kim, E., Rebecca, V. W., Smalley, K. S. M., & Anderson, A. R. A. (2016) · European Journal of Cancer · doi:10.1016/j.ejca.2016.07.024 · Cited by 44
Dynamics-Adapted Radiotherapy Dose (DARD) for Head and Neck Cancer Radiotherapy Dose Personalization
Zahid, M. U., Mohamed, A., Caudell, J. J., Harrison, L. B., Fuller, C. D., Moros, E. G., & Enderling, H. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11111124 · Cited by 38
Wares, J. R., Crivelli, J. J., Yun, C., Choi, I., Gevertz, J. L., & Kim, P. (2015) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2015.12.1237 · Cited by 36
Self-citationTranslational approaches to treating dynamical diseases through in silico clinical trials
Alfonso, S., Jenner, A. L., & Craig, M. (2020) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0019556 · Cited by 30
Self-citationShoarinezhad, V., Wieprecht, S., & Haun, S. (2020) · Water · doi:10.3390/w12051333 · Cited by 28
Liu, J., Hormuth, D. A., Davis, T., Yang, J., McKenna, M. T., Jarrett, A. M., Enderling, H., Brock, A., & Yankeelov, T. E. (2021) · Integrative Biology · doi:10.1093/intbio/zyab010 · Cited by 25
Scott, J. (2012) · The Lancet Oncology · doi:10.1016/s1470-2045(12)70098-0 · Cited by 23
Cho, H., Lewis, A., Storey, K. M., & Byrne, H. M. (2022) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2022.111377 · Cited by 23
From Fitting the Average to Fitting the Individual: A Cautionary Tale for Mathematical Modelers
Luo, M. C., Nikolopoulou, E., & Gevertz, J. L. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.793908 · Cited by 20
Self-citationVälitalo, P. A. J., Kokki, M., Ranta, V., Olkkola, K. T., Hooker, A. C., & Kokki, H. J. (2017) · Pharmaceutical Research · doi:10.1007/s11095-017-2122-6 · Cited by 19
Approaches to Generating Virtual Patient Cohorts with Applications in Oncology
Surendran, A., Sauteur-Robitaille, J. L., Kleimeier, D., Gevertz, J. L., Wilkie, K. P., Jenner, A. L., & Craig, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-32614-1_8 · Cited by 19
Self-citationCardinal, O., Burlot, C., Fu, Y., Crosley, P., Hitt, M., Craig, M., & Jenner, A. L. (2022) · Computational and Systems Oncology · doi:10.1002/cso2.1035 · Cited by 17
Self-citationChemotherapy-induced cachexia and model-informed dosing to preserve lean mass in cancer treatment
Farhang‐Sardroodi, S., Croix, M. A. L., & Wilkie, K. P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009505 · Cited by 15
Self-citationGuiding principles for mechanistic modeling of bispecific antibodies
Kareva, I., Zutshi, A., & Kabilan, S. (2018) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2018.08.011 · Cited by 14
Self-citationThe creation of breast lesion models for mammographic virtual clinical trials: a topical review
Camp, A. V., Houbrechts, K., Cockmartin, L., Woodruff, H. C., Lambin, P., Marshall, N., & Bosmans, H. (2023) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/acc4fc · Cited by 13
Mutual Information-Based Methods to Improve Local Region-of-Interest Image Registration
Wilkie, K., & Vrscay, E. (2005) · International Conference on Image Analysis and Recognition · doi:10.1007/11559573_9 · Cited by 12
Self-citationCárdenas, S. D., Reznik, C. J., Ranaweera, R. S., Song, F., Chung, C. H., Fertig, E. J., & Gevertz, J. L. (2022) · npj Systems Biology and Applications · doi:10.1038/s41540-022-00244-7 · Cited by 12
Self-citationAdvocate Involvement in I-SPY 2
Perlmutter, J. (2011) · Breast Diseases A Year Book Quarterly · doi:10.1016/j.breastdis.2011.01.045 · Cited by 11
Modeling is data driven: Use it for successful virtual patient generation
Rieger, T. R., Allen, R., & Musante, C. J. (2021) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12630 · Cited by 11
Bispecific antibodies: A guide to model informed drug discovery and development
Kareva, I., Zutshi, A., GUPTA, P. K., & Kabilan, S. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07649 · Cited by 10
Self-citationDerippe, T., Fouliard, S., Declèves, X., & Mager, D. E. (2022) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-022-09826-8 · Cited by 8
Approaches to generating virtual patient cohorts with applications in oncologyPreprint
Surendran, A., Sauteur-Robitaille, J. L., Kleimeier, D., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.24.493265 · Cited by 7
Research works printed but not linked: 2
- FDA (2022). Project Optimus Reforming the dose optimization and dose selection paradigm in oncology. Bethesda, MD: Food and Drug Administration of the United States of America.
- Mendes P. (2001). Modeling large biological systems from functional genomic data: Parameter estimation. Found. Syst. Biol. 2001, 163– 168.
Cited by
Wang, H., Arulraj, T., Ippolito, A., & Popel, A. S. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01188-4 · Cited by 122
Highly Multiplexed Tissue Imaging in Precision Oncology and Translational Cancer Research
Bollhagen, A., & Bodenmiller, B. (2024) · Cancer Discovery · doi:10.1158/2159-8290.cd-23-1165 · Cited by 59
Embracing the future of medicine with virtual patients
Wang, K., Parrott, N. J., & Lavé, T. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104322 · Cited by 21
Mathematical Oncology: How Modeling Is Transforming Clinical Decision-Making
Scibilia, K., Gallagher, K., Masud, M. A., Robertson‐Tessi, M., Gatenbee, C., West, J., Llamas, P., Prabhakaran, S., Gallaher, J. A., & Anderson, A. R. A. (2025) · Cancer Research · doi:10.1158/0008-5472.can-25-0750 · Cited by 20
Porthiyas, J., Nussey, D., Beauchemin, C. A. A., Warren, D. C., Quirouette, C., & Wilkie, K. P. (2024) · npj Systems Biology and Applications · doi:10.1038/s41540-024-00409-6 · Cited by 21
Self-citation
Metadata
- Authors
- Craig, M., Gevertz, J. L., Kareva, I., & Wilkie, K. P.
- Affiliations
- Centre Hospitalier Universitaire Sainte-Justine (CA)
- The College of New Jersey (US)
- EMD Serono, Inc. (United States) (US)
- Toronto Metropolitan University (CA)
- Corresponding author
- Craig, Morgan
- Wilkie, Kathleen P.
- Venue
- Frontiers in Systems Biology
- Publisher
- Frontiers Media SA
- Published
- 2023-06-16
- Volume
- 3
- Pages
- 1174647-1174647
- ISSN
- 2674-0702 (ISSN-L)
- PMC
- PMC12341971
- OpenAlex
- W4380988248
- Cited by
- 52
- References
- 60
- Citations by year
- 2026: 21 · 2025: 20 · 2024: 10 · 2023: 1
- FWCI
- 10.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Systems Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2018-04546)
- Fonds de Recherche du Québec—Santé
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Pharmaceutical studies and practices
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Keywords
- virtual clinical trials, virtual patients, mathematical modeling, patient heterogeneity, parameter estimation, parameter sensitivity analysis, model identifiability, virtual patient cohorts, drug development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.