Scientific and regulatory evaluation of mechanistic in silico drug and disease models in drug development: Building model credibility
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The value of in silico methods in drug development and evaluation has been demonstrated repeatedly and convincingly. While their benefits are now unanimously recognized, international standards for their evaluation, accepted by all stakeholders involved, are still to be established. In this white paper, we propose a risk‐informed evaluation framework for mechanistic model credibility evaluation. To properly frame the proposed verification and validation activities, concepts such as context of use, regulatory impact and risk‐based analysis are discussed. To ensure common understanding between all stakeholders, an overview is provided of relevant in silico terminology used throughout this paper. To illustrate the feasibility of the proposed approach, we have applied it to three real case examples in the context of drug development, using a credibility matrix currently being tested as a quick‐start tool by regulators. Altogether, this white paper provides a practical approach to model evaluation, applicable in both scientific and regulatory evaluation contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Workgroup, E. M., Marshall, S., Burghaus, R., Cosson, V, Cheung, S., Chenel, M., DellaPasqua, O., Frey, N., Hamrén, B., Harnisch, L., et al. (2016) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12049 · Cited by 373
Viceconti, M., Pappalardo, F., Rodriguez, B., Horner, M., Bischoff, J., & Musuamba Tshinanu, F. (2021) · Methods · doi:10.1016/j.ymeth.2020.01.011 · Cited by 361
Self-citationModel‐Informed Drug Development: Current US Regulatory Practice and Future Considerations
Wang, Y., Zhu, H., Madabushi, R., Liu, Q., Huang, S., & Zineh, I. (2019) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1363 · Cited by 228
Kuemmel, C., Yang, Y., Zhang, X., Florian, J., Zhu, H., Tegenge, M., Huang, S., Wang, Y., Morrison, T., & Zineh, I. (2020) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12479 · Cited by 177
Reproducibility in systems biology modelling
Tiwari, K., Kananathan, S., Roberts, M. G., Meyer, J. P., Sharif Shohan, M. U., Xavier, A., Maire, M., Zyoud, A., Men, J., Ng, S., et al. (2021) · Molecular Systems Biology · doi:10.15252/msb.20209982 · Cited by 131
Erdemir, A., Mulugeta, L., Ku, J. P., Drach, A., Horner, M., Morrison, T. M., Peng, G. C. Y., Vadigepalli, R., Lytton, W. W., & Myers, J. G. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02540-4 · Cited by 118
Manolis, E., Rohou, S., Hemmings, R., Salmonson, T., Karlsson, M., & Milligan, P. (2013) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2013.7 · Cited by 70
Self-citationCredibility of In Silico Trial Technologies—A Theoretical Framing
Viceconti, M., Juarez, M. A., Curreli, C., Pennisi, M., Russo, G., & Pappalardo, F. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2949888 · Cited by 67
Self-citationSystems Biology, Systems Medicine, Systems Pharmacology: The What and The Why
Stéphanou, A., Fanchon, E., Innominato, P. F., & Ballesta, A. (2018) · Acta Biotheoretica · doi:10.1007/s10441-018-9330-2 · Cited by 50
Cited by
Innovations in Genomics and Big Data Analytics for Personalized Medicine and Health Care: A Review
Hassan, M., Awan, F. M., Naz, A., deAndrés-Galiana, E. J., Alvarez, O., Cernea, A., Fernández-Brillet, L., Fernández-Martínez, J. L., & Kloczkowski, A. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23094645 · Cited by 317
“(EMA) [34,35].”
BackgroundArtificial Intelligence for Drug Discovery: Are We There Yet?
Hasselgren, C., & Oprea, T. I. (2024) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-040323-040828 · Cited by 236
“area of Modeling and Simulation (M&S), which is now a standard tool used to demonstrate effects on physiology or safety when expanding to other clinical populations or indications, efforts are being made to define criteria for model evaluation (153).”
MethodAn industry perspective on current QSP trends in drug development
Cucurull-Sanchez, L. (2024) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-024-09905-y · Cited by 37
Metadata
- Authors
- Musuamba, F. T., Skottheim Rusten, I., Lesage, R., Russo, G., Bursi, R., Emili, L., Wangorsch, G., Manolis, E., Karlsson, K. E., Kulesza, A., Courcelles, E., Boissel, J., Rousseau, C. F., Voisin, E. M., Alessandrello, R., Curado, N., Dall’ara, E., Rodriguez, B., Pappalardo, F., & Geris, L.
- Venue
- CPT: Pharmacometrics & Systems Pharmacology
- Publisher
- Wiley
- Published
- 2021-07-13
- Volume
- 10
- Issue
- 8
- Pages
- 804-825
- ISSN
- 2163-8306 (ISSN-L)
- OpenAlex
- W3168038426
- Cited by
- 164
- References
- 11
- FWCI
- 9.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Scientific and regulatory evaluation of mechanistic in silico drug and disease models in drug development: Building model credibility. https://app.cochat.ai/papers/10.1002/psp4.12669
- The paper
- Musuamba, F. T., Skottheim Rusten, I., Lesage, R., Russo, G., Bursi, R., Emili, L., Wangorsch, G., Manolis, E., Karlsson, K. E., Kulesza, A., Courcelles, E., Boissel, J., Rousseau, C. F., Voisin, E. M., Alessandrello, R., Curado, N., Dall’ara, E., Rodriguez, B., Pappalardo, F., & Geris, L. (2021). Scientific and regulatory evaluation of mechanistic in silico drug and disease models in drug development: Building model credibility. CPT: Pharmacometrics & Systems Pharmacology. https://doi.org/10.1002/psp4.12669
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.