The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Predicting With Confidence: Using Conformal Prediction in Drug Discovery
Open accessAbstract
One of the challenges with predictive modeling is how to quantify the reliability of the models' predictions on new objects. In this work we give an introduction to conformal prediction, a framework that sits on top of traditional machine learning algorithms and which outputs valid confidence estimates to predictions from QSAR models in the form of prediction intervals that are specific to each predicted object. For regression, a prediction interval consists of an upper and a lower bound. For classification, a prediction interval is a set that contains none, one, or many of the potential classes. The size of the prediction interval is affected by a user-specified confidence/significance level, and by the nonconformity of the predicted object; i.e., the strangeness as defined by a nonconformity function. Conformal prediction provides a rigorous and mathematically proven framework for in silico modeling with guarantees on error rates as well as a consistent handling of the models' applicability domain intrinsically linked to the underlying machine learning model. Apart from introducing the concepts and types of conformal prediction, we also provide an example application for modeling ABC transporters using conformal prediction, as well as a discussion on general implications for drug discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another limitation of most AI/ML models is that they do not assign a confidence interval to the predictions.277,278”
From Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial Intelligence (2023) · cites this paper as [278]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Data Mining and Knowledge Discovery Handbook
(2010) · doi:10.1007/978-0-387-09823-4 · Cited by 2,190
Data Mining for Imbalanced Datasets: An Overview
Chawla, N. V. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_45 · Cited by 1,197
On a simple approach for determining applicability domain of QSAR models
Roy, K., Kar, S., & Ambure, P. S. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.04.013 · Cited by 800
Role of the Breast Cancer Resistance Protein (BCRP/ABCG2) in Drug Transport—an Update
Mao, Q., & Unadkat, J. D. (2014) · The AAPS Journal · doi:10.1208/s12248-014-9668-6 · Cited by 708
A tutorial on conformal prediction
Shafer, G., & Vovk, V. (2007) · arXiv · doi:10.48550/arxiv.0706.3188 · Cited by 655
The Role of ABC Transporters in Drug Resistance, Metabolism and Toxicity
Glavinas, H., Krajcsi, P., Cserepes, J., & Sarkadi, B. (2004) · Current Drug Delivery · doi:10.2174/1567201043480036 · Cited by 559
The P-glycoprotein multidrug transporter
Sharom, F. J. (2011) · Essays in Biochemistry · doi:10.1042/bse0500161 · Cited by 528
Norinder, U., Carlsson, L., Boyer, S. K., & Eklund, M. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci5001168 · Cited by 208
Self-citationVovk, V. (2013) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-013-9368-4 · Cited by 174
Flagged first, then by citations
Research works printed but not linked: 1
- Kubinyi, 1993, vol. 1
Cited by
Sorted by citations
Items 101–116 of 116
Sreenivasan, A. P., Harrison, P. J., Schaal, W., Matuszewski, D. J., Kultima, K., & Spjuth, O. (2022) · Figshare · doi:10.6084/m9.figshare.20329449
Self-citationAdditional file 1 of CPSign: conformal prediction for cheminformatics modeling
Arvidsson, S., Norinder, U., Alvarsson, J., Ahlberg, E., Carlsson, L., & Spjuth, O. (2024) · Figshare · doi:10.6084/m9.figshare.26740850
Self-citationApplication of Confidence and Probabilistic Models to Practical Problems
Carlsson, L., Szabadváry, J. H., Ahlberg, E., & Gammerman, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-15120-9_12
A Review of Theoretical Advances and Practical Applications of Conformal Prediction in China
Zhao, S., Zhang, Z., Liu, Y., Nguyen, K. A., Wang, Y. G., Luo, Z., & Li, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-15120-9_11
Uncertainty-Aware Solar Flare Regression
Hong, J., Pandey, C., & Aydin, B. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00238
Awuku, B., Asa, E., & Williams-Peniel, P. (2026) · ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems Part A Civil Engineering · doi:10.1061/ajrua6.rueng-1800
Shakeri, E., Santos, R. D. S., & Far, B. H. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00151
Jeliazkova, N., Kochev, N. T., Iliev, L., & Jeliazkov, V. (2026) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.6c00065 · Cited by 1
Santos, V., Beatriz, A., & Dias, J. (2025) · International Journal of Pharmaceutical and Phytopharmacological Research · doi:10.51847/ofw9syzsje
Uncertainty Quantification with Domain Classification Models for Acetylcholinesterase Inhibition
Harris, J. S., Vignaux, P. A., Lane, T. R., & Ekins, S. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c00981
Interpretable Prediction of Ligand–Protein Binding without Protein Structural Information
Sadagopan, A., Sodhi, A., & Gibson, W. J. (2026) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.6c00249
Guo, Y. (2026) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2026.109371
Huy, N. T., Minh, P. Q., & Bich, L. T. (2022) · Journal of Artificial Intelligence for Healthcare Systems · doi:10.68159/f249917157
Khairbek, A. A., Alzahrani, A. Y. A., Moussa, S. B., Pooventhiran, T., & Thomas, R. (2026) · Physical Chemistry Chemical Physics · doi:10.1039/d6cp03239g
Advances in the Use of Artificial Intelligence in the Pharmaceutical Industry
Montaña, A. F., Mora, J. A., Martínez, J. J., Pulido, D. F., & Brijaldo, M. H. (2026) · BioMedInformatics · doi:10.3390/biomedinformatics6050083
Gangwal, A., & Lavecchia, A. (2026) · Drug Discovery Today · doi:10.1016/j.drudis.2026.104835 · Cited by 1
Metadata
- Authors
- Alvarsson, J., Arvidsson McShane, S., Norinder, U., & Spjuth, O.
- Affiliations
- Uppsala University (SE)
- Corresponding author
- Spjuth, Ola
- Venue
- Journal of Pharmaceutical Sciences
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 110
- Issue
- 1
- Pages
- 42-49
- ISSN
- 0022-3549 (ISSN-L)
- OpenAlex
- W3093152954
- Cited by
- 116
- References
- 30
- Citations by year
- 2026: 16 · 2025: 30 · 2024: 24 · 2023: 16 · 2022: 15 · 2021: 15
- FWCI
- 5.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Pharmaceutical Sciences (publishedVersion, cc-by)
- PubMed (publishedVersion)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- Funders
- Svenska Forskningsrådet Formas (2018-00924)
- Stiftelsen för Strategisk Forskning (BD15-0008SB16-0046)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Keywords
- conformal prediction, prediction intervals, QSAR, confidence estimation, applicability domain, ABC transporters, drug discovery, in silico modeling, forecast uncertainty
- MeSH terms
- Machine Learning, Algorithms, Molecular Conformation, Reproducibility of Results, Quantitative Structure-Activity Relationship, Drug Discovery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
