Predicting With Confidence: Using Conformal Prediction in Drug Discovery
Open accessAbstract
One of the challenges with predictive modeling is how to quantify the reliability of the models' predictions on new objects. In this work we give an introduction to conformal prediction, a framework that sits on top of traditional machine learning algorithms and which outputs valid confidence estimates to predictions from QSAR models in the form of prediction intervals that are specific to each predicted object. For regression, a prediction interval consists of an upper and a lower bound. For classification, a prediction interval is a set that contains none, one, or many of the potential classes. The size of the prediction interval is affected by a user-specified confidence/significance level, and by the nonconformity of the predicted object; i.e., the strangeness as defined by a nonconformity function. Conformal prediction provides a rigorous and mathematically proven framework for in silico modeling with guarantees on error rates as well as a consistent handling of the models' applicability domain intrinsically linked to the underlying machine learning model. Apart from introducing the concepts and types of conformal prediction, we also provide an example application for modeling ABC transporters using conformal prediction, as well as a discussion on general implications for drug discovery.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most AI/ML models do not assign a confidence interval to the predictions.
“Another limitation of most AI/ML models is that they do not assign a confidence interval to the predictions.277,278”
From Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial Intelligence (2023) · cites this paper as [278]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Data Mining and Knowledge Discovery Handbook
(2010) · doi:10.1007/978-0-387-09823-4 · Cited by 2,190 · see citing works
Data Mining for Imbalanced Datasets: An Overview
Chawla, N. V. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_45 · Cited by 1,092 · see citing works
On a simple approach for determining applicability domain of QSAR models
Roy, K., Kar, S., & Ambure, P. S. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.04.013 · Cited by 800 · see citing works
Role of the Breast Cancer Resistance Protein (BCRP/ABCG2) in Drug Transport—an Update
Mao, Q., & Unadkat, J. D. (2014) · The AAPS Journal · doi:10.1208/s12248-014-9668-6 · Cited by 676 · see citing works
A tutorial on conformal prediction
Shafer, G., & Vovk, V. (2007) · arXiv · doi:10.48550/arxiv.0706.3188 · Cited by 655 · see citing works
The Role of ABC Transporters in Drug Resistance, Metabolism and Toxicity
Glavinas, H., Krajcsi, P., Cserepes, J., & Sarkadi, B. (2004) · Current Drug Delivery · doi:10.2174/1567201043480036 · Cited by 559 · see citing works
The P-glycoprotein multidrug transporter
Sharom, F. J. (2011) · Essays in Biochemistry · doi:10.1042/bse0500161 · Cited by 508 · see citing works
Norinder, U., Carlsson, L., Boyer, S. K., & Eklund, M. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci5001168 · Cited by 208 · see citing works
Self-citationVovk, V. (2013) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-013-9368-4 · Cited by 174 · see citing works
Conformal Prediction for Reliable Machine Learning: Theory, Adaptations and Applications
Balasubramanian, V. N., Ho, S.-S., & Vovk, V. (2014) · Cited by 155 · see citing works
Role of the bile salt export pump, BSEP, in acquired forms of cholestasis
Stieger, B. (2009) · Drug Metabolism Reviews · doi:10.3109/03602530903492004 · Cited by 134 · see citing works
Principles of Clinical Pharmacology
Atkinson, A. J. (2007) · Elsevier eBooks · doi:10.1016/b978-0-12-369417-1.x5039-1 · Cited by 129 · see citing works
Principles of Clinical Pharmacology
Zakusov, V. V. (2012) · Elsevier eBooks · doi:10.1016/c2009-0-63932-5 · Cited by 96 · see citing works
The application of conformal prediction to the drug discovery process
Eklund, M., Norinder, U., Boyer, S. K., & Carlsson, L. (2013) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-013-9378-2 · Cited by 73 · see citing works
Self-citationSvensson, F., Aniceto, N., Norinder, U., Cortés‐Ciriano, I., Spjuth, O., Carlsson, L., & Bender, A. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00054 · Cited by 72 · see citing works
Self-citationSun, J., Carlsson, L., Ahlberg, E., Norinder, U., Engkvist, O., & Chen, H. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00159 · Cited by 69 · see citing works
Self-citationModelling compound cytotoxicity using conformal prediction and PubChem HTS data
Svensson, F. J. E., Norinder, U., & Bender, A. (2016) · Toxicology Research · doi:10.1039/c6tx00252h · Cited by 63 · see citing works
Self-citationResampling methods improve the predictive power of modeling in class-imbalanced datasets
Lee, P. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph110909776 · Cited by 62 · see citing works
Binary classification of imbalanced datasets using conformal prediction
Norinder, U., & Boyer, S. K. (2017) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2017.01.008 · Cited by 62 · see citing works
Self-citationA confidence predictor for logD using conformal regression and a support-vector machine
Lapins, M., Arvidsson, S., Lampa, S., Berg, A., Schaal, W., Alvarsson, J., & Spjuth, O. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0271-1 · Cited by 58 · see citing works
Self-citationATP binding cassette systems: structures, mechanisms, and functions
Licht, A., & Schneider, E. (2011) · Open Life Sciences · doi:10.2478/s11535-011-0054-4 · Cited by 54 · see citing works
Aggregated Conformal Prediction
Carlsson, L., Eklund, M., & Norinder, U. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44722-2_25 · Cited by 50 · see citing works
Self-citationA New Imbalanced Learning and Dictions Tree Method for Breast Cancer Diagnosis
Parvïn, H., Bidgoli, B. M., & Alinejad‐Rokny, H. (2013) · Journal of Bionanoscience · doi:10.1166/jbns.2013.1162 · Cited by 46 · see citing works
Montanari, F., Knasmuller, B., Kohlbacher, S. M., Hillisch, C., Baierová, C., Grandits, M., & Ecker, G. F. (2020) · Frontiers in Chemistry · doi:10.3389/fchem.2019.00899 · Cited by 35 · see citing works
Predicting Off-Target Binding Profiles With Confidence Using Conformal Prediction
Lampa, S., Alvarsson, J., Arvidsson, S., Berg, A., Ahlberg, E., & Spjuth, O. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.01256 · Cited by 34 · see citing works
Self-citationIntegrated Decision Support for Assessing Chemical Liabilities
Spjuth, O., Eklund, M., Helgee, E. A., Boyer, S. K., & Carlsson, L. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200242c · Cited by 33 · see citing works
Self-citationReliable Confidence Predictions Using Conformal Prediction
Linusson, H., Johansson, U., Boström, H., & Löfström, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31753-3_7 · Cited by 13 · see citing works
Improving peptide-MHC class I binding prediction for unbalanced datasets
Sales, A. P., Tomaras, G. D., & Kepler, T. B. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-385 · Cited by 11 · see citing works
Training conformal predictorsPreprint
Colombo, N., & Vovk, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07037 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Kubinyi H. QSAR: Hansch Analysis and Related Approaches. vol. 1. VcH; 1993.
- Huang S-M, Lertora JJ, Markey SP, Atkinson Jr AJ. Principles of Clinical Phar- macology. Academic Press; 2012.
Cited by
Sorted by citations
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Dojat, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 318 · see citing works
GHOST: Adjusting the Decision Threshold to Handle Imbalanced Data in Machine Learning
Esposito, C., Landrum, G. A., Schneider, N., Stiefl, N., & Riniker, S. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00160 · Cited by 203 · see citing works
Olsson, H., Kartasalo, K., Mulliqi, N., Capuccini, M., Ruusuvuori, P., Samaratunga, H., Delahunt, B., Lindskog, C., Janssen, E. A. M., Blilie, A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-34945-8 · Cited by 111 · see citing works
Self-citationGraph Neural Networks in Modern AI-Aided Drug Discovery
Zhang, O., Lin, H., Zhang, X., Wang, X., Wu, Z., Ye, Q., Zhao, W., Wang, J., Ying, K., Kang, Y., et al. (2025) · Chemical Reviews · doi:10.1021/acs.chemrev.5c00461 · Cited by 103 · see citing works
Predictive Modeling in Medicine
Toma, M., & Ong, C. W. (2023) · Encyclopedia · doi:10.3390/encyclopedia3020042 · Cited by 70 · see citing works
Assigning confidence to molecular property prediction
Nigam, A., Pollice, R., Hurley, M. F. D., Hickman, R. J., Aldeghi, M., Yoshikawa, N., Chithrananda, S., Voelz, V. A., & Aspuru‐Guzik, A. (2021) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2021.1925247 · Cited by 68 · see citing works
Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial Intelligence
Duran-Frigola, M., Cigler, M., & Winter, G. E. (2023) · Journal of the American Chemical Society · doi:10.1021/jacs.2c11098 · Cited by 50 · see citing works
Vasilev, B., & Atanasova, M. (2025) · Applied Sciences · doi:10.3390/app15031206 · Cited by 50 · see citing works
Validation guidelines for drug-target prediction methods
Tanoli, Z., Schulman, A., & Aittokallio, T. A. (2024) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2024.2430955 · Cited by 51 · see citing works
Air traffic controller workload level prediction using conformalized dynamical graph learning
Pang, Y., Hu, J., Lieber, C. S., Cooke, N. J., & Liu, Y. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102113 · Cited by 53 · see citing works
Sun, E., Ma, R., Negredo, P. N., Brunet, A., & Zou, J. (2024) · Nature Methods · doi:10.1038/s41592-024-02184-y · Cited by 39 · see citing works
Impact of Artificial Intelligence on Compound Discovery, Design, and Synthesis
Miljković, F. N., Rodríguez-Pérez, R., & Bajorath, J. (2021) · ACS Omega · doi:10.1021/acsomega.1c05512 · Cited by 39 · see citing works
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · Alternatives to Laboratory Animals · doi:10.1177/02611929221148447 · Cited by 29 · see citing works
Self-citationClassifying rockburst with confidence: A novel conformal prediction approach
Ibrahim, B., & Ahenkorah, I. (2024) · International Journal of Mining Science and Technology · doi:10.1016/j.ijmst.2023.12.005 · Cited by 28 · see citing works
CPSign: conformal prediction for cheminformatics modeling
Arvidsson, S., Norinder, U., Alvarsson, J., Ahlberg, E., Carlsson, L., & Spjuth, O. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00870-9 · Cited by 28 · see citing works
Self-citationWind speed forecasting approach using conformal prediction and feature importance selection
Züge, C. V., Stefenon, S. F., Yamaguchi, C. K., Mariani, V. C., González, G. V., & Coelho, L. D. S. (2025) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2025.110700 · Cited by 27 · see citing works
Chemoinformatic regression methods and their applicability domain
Dutschmann, T., Schlenker, V., & Baumann, K. (2024) · Molecular Informatics · doi:10.1002/minf.202400018 · Cited by 26 · see citing works
Fagerholm, U., Hellberg, S., Alvarsson, J., Arvidsson, S., & Spjuth, O. (2021) · Xenobiotica · doi:10.1080/00498254.2021.2011471 · Cited by 25 · see citing works
Self-citationAssessing the calibration in toxicological in vitro models with conformal prediction
Morger, A., Svensson, F., Arvidsson, S., Gauraha, N., Norinder, U., Spjuth, O., & Volkamer, A. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-021-00511-5 · Cited by 24 · see citing works
Self-citationYang, M., Chen, H., Hu, W., Mischi, M., Shan, C., Li, J., Long, X., & Liu, C. (2024) · Journal of Medical Internet Research · doi:10.2196/50369 · Cited by 24 · see citing works
Xu, Y., Liaw, A. I., Sheridan, R. P., & Svetnik, V. (2024) · ACS Omega · doi:10.1021/acsomega.4c02017 · Cited by 20 · see citing works
Chen, H., Liu, F., & Lin, Z. (2025) · Pharmacophore · doi:10.51847/bhyi6rjara · Cited by 18 · see citing works
Ibrahim, B., Tetteh-Asare, A., & Ahenkorah, I. (2024) · Rock Mechanics and Rock Engineering · doi:10.1007/s00603-024-03847-0 · Cited by 16 · see citing works
Davis, A. J. S., Groom, Q., Adriaens, T., Vanderhoeven, S., Troch, R. D., Oldoni, D., Desmet, P., Reyserhove, L., Lens, L., & Strubbe, D. (2024) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2024.1148895 · Cited by 16 · see citing works
Machine learning with asymmetric abstention for biomedical decision-making
Gandouz, M., Holzmann, H., & Heider, D. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01655-y · Cited by 15 · see citing works
Wang, D., Wang, P., Wang, C., & Wang, P. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.02.003 · Cited by 15 · see citing works
Morger, A., de Lomana, M. G., Norinder, U., Svensson, F., Kirchmair, J., Mathea, M., & Volkamer, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-09309-3 · Cited by 15 · see citing works
Self-citationGeylan, G., Maria, L. D., Engkvist, O., David, F., & Norinder, U. (2024) · Digital Discovery · doi:10.1039/d4dd00056k · Cited by 13 · see citing works
Self-citationKlutzny, S., Kornhuber, M., Morger, A., Schönfelder, G., Volkamer, A., Oelgeschläger, M., & Dunst, S. (2021) · Environment International · doi:10.1016/j.envint.2021.106947 · Cited by 14 · see citing works
Reliable machine learning models in genomic medicine using conformal prediction
Papangelou, C., Kyriakidis, K., Natsiavas, P., Chouvarda, I., & Malousi, A. (2025) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2025.1507448 · Cited by 12 · see citing works
van den Maagdenberg, H. W., van Otterloo, J. D. M., van Hasselt, J. G. C., van der Graaf, P. H., & van Westen, G. J. P. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00107 · Cited by 12 · see citing works
Reliable anti-cancer drug sensitivity prediction and prioritization
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2024) · Scientific Reports · doi:10.1038/s41598-024-62956-6 · Cited by 11 · see citing works
Machine Learning Strategies When Transitioning between Biological Assays
Arvidsson, S., Ahlberg, E., Noeske, T., & Spjuth, O. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00293 · Cited by 11 · see citing works
Self-citationApplying regression conformal prediction with nearest neighbors to time series data
Tajmouati, S., Wahbi, B. E., & Dakkon, M. (2022) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918.2022.2057538 · Cited by 11 · see citing works
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · Xenobiotica · doi:10.1080/00498254.2022.2049397 · Cited by 11 · see citing works
Self-citationHow to predict effective drug combinations – moving beyond synergy scores
Eckhart, L., Lenhof, K., Herrmann, L., Rolli, L.-M., & Lenhof, H. (2025) · iScience · doi:10.1016/j.isci.2025.112622 · Cited by 11 · see citing works
Lou, X., Luo, P., & Meng, L. (2025) · Annals of the American Association of Geographers · doi:10.1080/24694452.2025.2516091 · Cited by 15 · see citing works
Karmacharya, U., Chaudhary, P., Lim, D., Dahal, S., Awasthi, B. P., Park, H. D., Kim, J., & Jeong, B. (2021) · Bioorganic Chemistry · doi:10.1016/j.bioorg.2021.104805 · Cited by 10 · see citing works
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · Journal of Pharmaceutical Sciences · doi:10.1016/j.xphs.2022.05.010 · Cited by 10 · see citing works
Self-citationWu, X., Zhan, J., Li, T., Ding, W., & Pedrycz, W. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05280-w · Cited by 10 · see citing works
Kong, W., Zhu, J., Shan, P., Ying, H., Chen, T., Zhang, B., Peng, C., Wang, Z., Wang, Y., Huang, L., et al. (2024) · SmartMat · doi:10.1002/smm2.1278 · Cited by 9 · see citing works
Predicting the Hallucinogenic Potential of Molecules Using Artificial Intelligence
Urbina, F., Jones, T., Harris, J. S., Snyder, S. H., Lane, T. R., & Ekins, S. (2024) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.4c00405 · Cited by 9 · see citing works
Talib, A. M., Al-Hgaish, A. M., Atan, R. B., Alshammari, A., Alomary, F. O., Yaakob, R., Alsahli, A., & Osman, M. H. (2025) · IEEE Access · doi:10.1109/access.2025.3546925 · Cited by 10 · see citing works
Bassani, D., Morger, A., Zhang, J. D., Docci, L., Cecere, G., Pähler, A., Belubbi, T., Laye, P., Shih, I., & Parrott, N. J. (2026) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.5c01317 · Cited by 9 · see citing works
Functional protein mining with conformal guarantees
Boger, R. S., Chithrananda, S., Angelopoulos, A. N., Yoon, P. H., Jordan, M. I., & Doudna, J. A. (2025) · Nature Communications · doi:10.1038/s41467-024-55676-y · Cited by 9 · see citing works
Conformal efficiency as a metric for comparative model assessment befitting federated learning
Heyndrickx, W., Arany, A., Simm, J., Pentina, A., Sturm, N., Humbeck, L., Mervin, L. H., Zalewski, A., Oldenhof, M., Schmidtke, P., et al. (2023) · Artificial Intelligence in the Life Sciences · doi:10.1016/j.ailsci.2023.100070 · Cited by 10 · see citing works
AI-powered programmable virtual humans toward human physiologically-based drug discovery
Wu, Y., Bourne, P. E., & Xie, L. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104497 · Cited by 8 · see citing works
Uncertainty assessment of proarrhythmia predictions derived from multi-level in silico models
Kopańska, K., Rodríguez-Belenguer, P., Llopis‐Lorente, J., Trénor, B., Sáiz, J., & Pastor, M. (2023) · Archives of Toxicology · doi:10.1007/s00204-023-03557-6 · Cited by 8 · see citing works
Oršolić, D., & Šmuc, T. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad465 · Cited by 8 · see citing works
Rapid Traversal of Ultralarge Chemical Space using Machine Learning Guided Docking ScreensPreprint
Luttens, A., de Vaca, I. C., Sparring, L., Norinder, U., & Carlsson, J. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-w3x36 · Cited by 8 · see citing works
Self-citationAdvancements in Rational Multi‐Targeted Drug Discovery
Ravikumar, B., Cichońska, A., Sahni, N., Aittokallio, T. A., & Rahman, R. (2024) · Polypharmacology · doi:10.1002/9781394182862.ch9 · Cited by 8 · see citing works
Astigarraga, M., Sánchez-Ruiz, A., & Colmenarejo, G. (2025) · Artificial Intelligence in the Life Sciences · doi:10.1016/j.ailsci.2025.100127 · Cited by 9 · see citing works
Pham, T., Bassett, R., & Aickelin, U. (2025) · Computers and Chemical Engineering · doi:10.1016/j.compchemeng.2025.109136 · Cited by 8 · see citing works
Badkul, A., Xie, L., Zhang, S., & Xie, L. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01151-2 · Cited by 7 · see citing works
Synergy conformal prediction applied to large-scale bioactivity datasets and in federated learning
Norinder, U., Spjuth, O., & Svensson, F. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-021-00555-7 · Cited by 7 · see citing works
Self-citationFagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.17.504228 · Cited by 7 · see citing works
Self-citationDistance-Aware Molecular Property Prediction in Nonlinear Structure–Property Space
Kim, J. Y., & Vlachos, D. G. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c01037 · Cited by 6 · see citing works
Hernández-Hernández, S., Guo, Q., & Ballester, P. J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112501 · Cited by 6 · see citing works
Kos, V. M., Arvidsson, S., Islam, B., Nikiforova, V., Mickols, E., Meyer, A., Svensson, R., Boztepe, Ü. G., Banti, E., Lundquist, P., et al. (2025) · Environmental Toxicology and Pharmacology · doi:10.1016/j.etap.2025.104750 · Cited by 4 · see citing works
Self-citationConformal Selection for Efficient and Accurate Compound Screening in Drug Discovery
Bai, T., Tang, P., Xu, Y., Svetnik, V., Yang, B., Khalili, A., Yu, X., & Yang, A. Y. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c01633 · Cited by 3 · see citing works
Predicting protein network topology clusters from chemical structure using deep learning
Sreenivasan, A. P., Harrison, P. J., Schaal, W., Matuszewski, D. J., Kultima, K., & Spjuth, O. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00622-7 · Cited by 4 · see citing works
Self-citationVià, L. D., Depoortere, M., Willacy, R. D., Roberts, A. J., Sokkar, P., Fossepré, M., Ruba, A. A., & Zwierzyna, M. (2024) · Organic Process Research & Development · doi:10.1021/acs.oprd.4c00384 · Cited by 4 · see citing works
Uncertainty Quantification of Multimodal Models
Obayemi, A., & Nguyen, K. A. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8889-0_23 · Cited by 4 · see citing works
Disease phenotype prediction in multiple sclerosis
Herman, S., Arvidsson, S., Zjukovskaja, C., Khoonsari, P. E., Svenningsson, A., Burman, J., Spjuth, O., & Kultima, K. (2023) · iScience · doi:10.1016/j.isci.2023.106906 · Cited by 5 · see citing works
Self-citationOn the early detection of Sepsis in MIMIC-III
Medina, M., & Sala, P. (2021) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi52183.2021.00035 · Cited by 4 · see citing works
Fagerholm, U., Hellberg, S., Alvarsson, J., Ekmefjord, M., & Spjuth, O. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.20.608791 · Cited by 4 · see citing works
Self-citationLiu, W., & Zhao, Z. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf090 · Cited by 3 · see citing works
Clarke, N., Urchs, S., Nguyen, H., Moreau, C. A., Dansereau, C., Tam, A., Evans, A. C., & Bellec, L. (2025) · GigaScience · doi:10.1093/gigascience/giaf091 · Cited by 2 · see citing works
Sachin, A. S., & Karthikeyan, J. (2026) · IEEE Access · doi:10.1109/access.2026.3654582 · Cited by 3 · see citing works
Conformal Prediction for Counterfactual Detection in Concept Learning from Synthetic Visual Patterns
Norinder, U., Lowry, S. M., Müller, H., & Holzinger, A. (2026) · Electronics · doi:10.3390/electronics15071346 · Cited by 3 · see citing works
Self-citationNorinder, U., & Lowry, S. M. (2023) · Remote Sensing Letters · doi:10.1080/2150704x.2023.2258460 · Cited by 3 · see citing works
Self-citationFagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.28.509936 · Cited by 3 · see citing works
Self-citationValidation of predicted conformal intervals for prediction of human clinical pharmacokineticsPreprint
Fagerholm, U., Alvarsson, J., Hellberg, S., & Spjuth, O. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.10.515917 · Cited by 3 · see citing works
Self-citationPredicting in vitro assays related to liver function using probabilistic machine learning
Morelli, F. M., Raschke, M., Jungmann, N. A., Bairlein, M., & de Lomana, M. G. (2025) · Toxicology · doi:10.1016/j.tox.2025.154195 · Cited by 2 · see citing works
Error Reduction in Leukemia Machine Learning Classification With Conformal Prediction
Wiklander, M. L., Zachariah, D., Krali, O., & Nordlund, J. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-24-00324 · Cited by 2 · see citing works
Afzali, A. M., Maleki, S., Tavakkoli-Moghaddam, R. R., Bozorgi-Amiri, A., & Tafakkori, K. (2025) · Health and Technology · doi:10.1007/s12553-025-01007-0 · Cited by 2 · see citing works
Afrose, N., Sahoo, S., Chakraborty, R., Bhowmick, P., & Bhowmick, M. (2026) · Journal of Dispersion Science and Technology · doi:10.1080/01932691.2026.2618053 · Cited by 2 · see citing works
Prediction of Biopharmaceutical Characteristics of PROTACs using the ANDROMEDA by Prosilico SoftwarePreprint
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.22.509053 · Cited by 2 · see citing works
Self-citationReliability and Applicability Assessment for Machine Learning Models
Urbina, F., & Ekins, S. (2024) · Wiley eBooks · doi:10.1002/9783527840748.ch13 · Cited by 2 · see citing works
Totis, N., Sips, F. L. P., Catozzi, S., Bisotti, M.-A., Bambury, P., Stathopoulos, S., Carbone, V., Emili, L., Torchia, M., Belgiovine, V., et al. (2026) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.70353 · Cited by 1 · see citing works
Vazakidou, P., Koopmans, C., Grimberg, S., Evangelista, S., Koekkoek, J. C., Lamoree, M. H., Leonards, P. E. G., & van Duursen, M. B. M. (2021) · Toxicology Letters · doi:10.1016/s0378-4274(21)00401-x · Cited by 1 · see citing works
Data-Efficient Handling of Temporary Uncertainties in Online Alarm Flood Classification
Manca, G., Kunze, F. C., & Fay, A. (2025) · IEEE International Conference on Industrial Cyber-Physical Systems (ICPS) · doi:10.1109/icps65515.2025.11087828 · Cited by 1 · see citing works
Confidence-Aware Fine-Tuning of Sequential Recommendation Systems Via Conformal Prediction
Wang, C., Wang, F., Guo, R., Liang, Y., & Yu, P. S. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401637 · Cited by 4 · see citing works
March-Vila, E., Ferretti, G., Terricabras, E., Ardao, I., Brea, J. M., Varela, M. J., Arana, Á. J., Rubiolo, J. A., Sanz, F., Loza, M. I., et al. (2023) · Archives of Toxicology · doi:10.1007/s00204-023-03459-7 · Cited by 1 · see citing works
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3542373/v1 · Cited by 1 · see citing works
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3542373/v2 · Cited by 1 · see citing works
Oršolić, D., & Šmuc, T. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.22.504786
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.03.18.533259
Self-citationPrediction of the Human Pharmacokinetics of 30 Modern Antibiotics Using the ANDROMEDA SoftwarePreprint
Fagerholm, U., Hellberg, S., Alvarsson, J., & Spjuth, O. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.03.28.534601
Self-citationBAARD: Blocking Adversarial Examples by Testing for Applicability, Reliability and Decidability
Chang, X., Dost, K., Zhao, K., Demontis, A., Roli, F., Dobbie, G., & Wicker, J. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_1
Uncertainty measurement for complex event prediction in safety-critical systemsPreprint
Peixoto, M. J. P., & Azim, A. (2023) · Research Square · doi:10.21203/rs.3.rs-3237791/v1
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2024) · Research Square · doi:10.21203/rs.3.rs-3542373/v3
Debnath, T., Oishi, K., & Nakabayashi, A. (2024) · IEEE International Symposium on Olfaction and Electronic Nose (ISOEN) · doi:10.1109/isoen61239.2024.10555997
Development and Implementation of Anartificial Intelligence-Based Model for Predicting Drug SalesPreprint
Xiong, Y. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5010591
HCS-DFC: A Diffusion Classifier for Mode of Action Prediction Using Morphological Profiles
Kosciukiewicz, J., Rymarczyk, D., & Zielinski, B. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00408
Neural network custom loss function for flexible and high-quality prediction intervals
Wang, H., & Wang, D. (2025) · Mathematical Foundations of Computing · doi:10.3934/mfc.2025039
Norinder, U., Spjuth, O., & Fredrik, S. (2021) · Figshare · doi:10.6084/m9.figshare.16726850
Self-citationAdditional file 1 of Machine learning with asymmetric abstention for biomedical decision-making
Gandouz, M., Holzmann, H., & Heider, D. (2021) · Figshare · doi:10.6084/m9.figshare.16880413
Morger, A., Svensson, F., Arvidsson, S., Gauraha, N., Norinder, U., Spjuth, O., & Volkamer, A. (2021) · Figshare · doi:10.6084/m9.figshare.14516380
Self-citation
- Authors
- Alvarsson, J., Arvidsson McShane, S., Norinder, U., & Spjuth, O.
- Affiliations
- Uppsala University (SE)
- Corresponding author
- Spjuth, Ola
- Venue
- Journal of Pharmaceutical Sciences
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 110
- Issue
- 1
- Pages
- 42-49
- ISSN
- 0022-3549 (ISSN-L)
- OpenAlex
- W3093152954
- Cited by
- 116
- References
- 30
- Citations by year
- 2026: 16 · 2025: 30 · 2024: 24 · 2023: 16 · 2022: 15 · 2021: 15
- FWCI
- 5.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Pharmaceutical Sciences (publishedVersion, cc-by)
- PubMed (publishedVersion)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- Funders
- Svenska Forskningsrådet Formas (2018-00924)
- Stiftelsen för Strategisk Forskning (BD15-0008SB16-0046)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Keywords
- conformal prediction, prediction intervals, QSAR, confidence estimation, applicability domain, ABC transporters, drug discovery, in silico modeling, forecast uncertainty
- MeSH terms
- Machine Learning, Algorithms, Molecular Conformation, Reproducibility of Results, Quantitative Structure-Activity Relationship, Drug Discovery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review