The DOI matches its Crossref record; 69 of the 73 references it cites were found in a registry or an index, and 4 are not checked yet.
Model agnostic generation of counterfactual explanations for molecules
Open accessPublished version of a preprint
Abstract
Generating model agnostic molecular counterfactual explanations to explain model predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This often reveals punctual modifications of the input that cause abrupt changes in the output (a.k.a. “counterfactuals”),276”
From Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial Intelligence (2023) · cites this paper as [276]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,869
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Double-slit photoelectron interference in strong-field ionization of the neon dimer
Kunitski, M., Eicke, N., Huber, P., Köhler, J., Zeller, S., Voigtsberger, J., Schlott, N., Henrichs, K., Sann, H., Trinter, F., et al. (2019) · Nature Communications · doi:10.1038/s41467-018-07882-8 · Cited by 8,162
Weininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
PubChem in 2021: new data content and improved web interfaces
Kim, S., Chen, J., Cheng, T., Gindulyte, A., He, J., He, S., Li, Q., Shoemaker, B. A., Thiessen, P. A., Yu, B., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa971 · Cited by 3,953
Making things happen: a theory of causal explanation
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5840 · Cited by 3,383
Demopoulos, W., & van Fraassen, B. C. (1982) · The Philosophical Review · doi:10.2307/2184804 · Cited by 3,321
Norm theory: Comparing reality to its alternatives.
Kahneman, D. J., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,247
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107
Shapley, L. S. (1953) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.39.10.1095 · Cited by 2,549
Drug Solubility: Importance and Enhancement Techniques
Savjani, K. T., Gajjar, A. K., & Savjani, J. (2012) · ISRN Pharmaceutics · doi:10.5402/2012/195727 · Cited by 2,155
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
(2020) · doi:10.1109/cvpr42600.2020 · Cited by 1,831
International Conference on Learning Representations (ICLR)
Abbas, M. Z. A., Kivinen, J., & Raiko, T. (2016) · Cited by 1,694
Why is Tanimoto index an appropriate choice for fingerprint-based similarity calculations?
Bajusz, D., Rácz, A., & Héberger, K. (2015) · Journal of Cheminformatics · doi:10.1186/s13321-015-0069-3 · Cited by 1,646
Mordred: a molecular descriptor calculator
Moriwaki, H., Tian, Y., Kawashita, N., & Takagi, T. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0258-y · Cited by 1,558
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6 · Cited by 1,377
ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property PredictionPreprint
Chithrananda, S., Grand, G., & Ramsundar, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09885 · Cited by 1,181
ESOL: Estimating Aqueous Solubility Directly from Molecular Structure
Delaney, J. S. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034243x · Cited by 1,137
Machine Learning Interatomic Potentials as Emerging Tools for Materials Science
Deringer, V. L., Caro, M. A., & Cśanyi, G. (2019) · Advanced Materials · doi:10.1002/adma.201902765 · Cited by 1,136
Xiong, Z., Wang, D., Liu, X., Zhong, F., Wan, X., Li, X., Li, Z. S., Luo, X., Chen, K., Jiang, H., et al. (2019) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.9b00959 · Cited by 1,126
Drug discovery with explainable artificial intelligence
Jiménez-Luna, J., Grisoni, F., & Schneider, G. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00236-4 · Cited by 1,063
Self-referencing embedded strings (SELFIES): A 100% robust molecular string representation
Krenn, M., Häse, F., Nigam, A., Friederich, P., & Aspuru‐Guzik, A. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/aba947 · Cited by 1,048
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047
The Functional Theory of Counterfactual Thinking
Epstude, K., & Roese, N. J. (2008) · Personality and Social Psychology Review · doi:10.1177/1088868308316091 · Cited by 905
Prediction of drug solubility from structure
Jorgensen, W. L., & Duffy, E. M. (2002) · Advanced Drug Delivery Reviews · doi:10.1016/s0169-409x(02)00008-x · Cited by 892
Linear Inversion of Band-Limited Reflection Seismograms
Santosa, F., & Symes, W. W. (1986) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0907087 · Cited by 737
Shapley, L. S. (1953) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.39.10.1953 · Cited by 699
Jiang, D., Wu, Z., Hsieh, C.-Y., Chen, G., Liao, B., Wang, Z., Shen, C., Cao, D., Wu, J., & Hou, T. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-020-00479-8 · Cited by 664
Prediction Errors of Molecular Machine Learning Models Lower than Hybrid DFT Error
Faber, F. A., Hutchison, L., Huang, B., Gilmer, J., Schoenholz, S. S., Dahl, G. E., Vinyals, O., Kearnes, S., Riley, P. F., & von Lilienfeld, O. A. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00577 · Cited by 651
Self-referencing embedded strings (SELFIES): A 100% robust molecular string representation
Krenn, M., Häse, F., Nigam, A., Friederich, P., & Aspuru‐Guzik, A. (2020) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000128111 · Cited by 616
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580
Lusci, A., Pollastri, G., & Baldi, P. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400187y · Cited by 575
Sterne, J. A. C., Hernán, M. Á., Ledergerber, B., Tilling, K. M., Weber, R. K., Sendi, P., Rickenbach, M., Robins, J. M., & Egger, M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67022-5 · Cited by 550
Computationally Efficient Algorithm to Identify Matched Molecular Pairs (MMPs) in Large Data Sets
Hussain, J., & Rea, C. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci900450m · Cited by 420
Stepin, I., Alonso, J. M., Catala, A., & Pereira-Farina, M. (2021) · IEEE Access · doi:10.1109/access.2021.3051315 · Cited by 376
A Bayesian Approach to in Silico Blood-Brain Barrier Penetration Modeling
Martins, I. F. D. S., Teixeira, A. L., Pinheiro, L., & Falcão, A. O. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300124c · Cited by 336
Boobier, S., Hose, D. R. J., Blacker, A. J., & Nguyen, B. N. (2020) · Nature Communications · doi:10.1038/s41467-020-19594-z · Cited by 326
Explanatory Generalizations, Part I: A Counterfactual Account
Woodward, J., & Hitchcock, C. (2003) · Noûs · doi:10.1111/1468-0068.00426 · Cited by 317
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K. E., Dickerson, J. P., & Shah, C. (2020) · arXiv · doi:10.48550/arxiv.2010.10596 · Cited by 267
Huang, R., Xia, M., Sakamuru, S., Zhao, J., Shahane, S. A., Attene‐Ramos, M. S., Zhao, T., Austin, C. P., & Simeonov, A. M. (2016) · Nature Communications · doi:10.1038/ncomms10425 · Cited by 259
Sorkun, M. C., Khetan, A., & Er, S. (2019) · Scientific Data · doi:10.1038/s41597-019-0151-1 · Cited by 230
Author Correction: A compendium of geochemical information from the Saanich Inlet water column
Torres-Beltrán, M., Hawley, A. K., Capelle, D. W., Zaikova, E., Walsh, D. A., Mueller, A., Scofield, M., Payne, C. D., Pakhomova, L., Kheirandish, S., et al. (2019) · Scientific Data · doi:10.1038/s41597-018-0005-2 · Cited by 186
Cheminformatics analysis and learning in a data pipelining environment
Hassan, M., Brown, R. D., Varma‐O'Brien, S., & Rogers, D. O. W. (2006) · Molecular Diversity · doi:10.1007/s11030-006-9041-5 · Cited by 184
Nigam, A., Pollice, R., Krenn, M., Gomes, G., & Aspuru‐Guzik, A. (2021) · Chemical Science · doi:10.1039/d1sc00231g · Cited by 177
Stigmata: An Algorithm To Determine Structural Commonalities in Diverse Datasets
Shemetulskis, N. E., Weininger, D., Blankley, C. J., Yang, J. J., & Humblet, C. C. (1996) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci950169+ · Cited by 159
Takayama, N., Sato, N., O’Brien, S. G., Ikeda, Y., & Okamoto, S. (2002) · British Journal of Haematology · doi:10.1046/j.1365-2141.2002.03881.x · Cited by 152
Learning Graph-Level Representation for Drug DiscoveryPreprint
Li, J., Cai, D., & He, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.03741 · Cited by 117
Reutlinger, A. (2016) · Philosophy of Science · doi:10.1086/687859 · Cited by 116
Coloring Molecules with Explainable Artificial Intelligence for Preclinical Relevance Assessment
Jiménez-Luna, J., Skalic, M., Weskamp, N., & Schneider, G. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01344 · Cited by 96
Explainability in Graph Neural Networks: A Taxonomic SurveyPreprint
Yuan, H., Yu, H., Gui, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15445 · Cited by 89
Sheridan, R. P. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00825 · Cited by 84
Interpretable Credit Application Predictions With Counterfactual ExplanationsPreprint
McGrath, R., Costabello, L., Van, C. L., Sweeney, P., Kamiab, F., Shen, Z., & Lécué, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05245 · Cited by 78
Findings of the Second Challenge to Predict Aqueous Solubility
Llinàs, A., Oprisiu, I., & Avdeef, A. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00701 · Cited by 70
Contrastive and counterfactual reasoning in causal judgment.
McGill, A. L., & Klein, J. G. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.64.6.897 · Cited by 56
Shen, C., Krenn, M., Eppel, S., & Aspuru‐Guzik, A. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac09d6 · Cited by 53
van Ravenhorst, M. B., van der Klis, F. R. M., van Rooijen, D. M., Sanders, E. A. M., & Berbers, G. A. M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0650-3 · Cited by 53
Deep Learning for Molecules and Materials
White, A. D. (2022) · Living Journal of Computational Molecular Science · doi:10.33011/livecoms.3.1.1499 · Cited by 49
Self-citationQSAR-based solubility model for drug-like compounds
Gozalbes, R., & Pineda‐Lucena, A. (2010) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2010.08.003 · Cited by 40
ChemInformatics Model Explorer (CIME): exploratory analysis of chemical model explanations
Humer, C., Heberle, H., Montanari, F., Wolf, T., Huber, F., Henderson, R., Heinrich, J., & Streit, M. (2022) · Journal of Cheminformatics · doi:10.1186/s13321-022-00600-z · Cited by 35
CF-GNNExplainer: Counterfactual Explanations for Graph Neural NetworksPreprint
Lučić, A., ter Hoeve, M., Tolomei, G., et al. (2021) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2102.03322 · Cited by 34
PermuteAttack: Counterfactual Explanation of Machine Learning Credit ScorecardsPreprint
Hashemi, M., & Fathi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10138 · Cited by 31
Lee, J., Paintsil, E., Gopalakrishnan, V., & Ghebremichael, M. S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0848-z · Cited by 18
Nigam, A., Pollice, R., & Aspuru‐Guzik, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04011 · Cited by 17
Explaining Deep Graph Networks with Molecular CounterfactualsPreprint
Numeroso, D., & Bacciu, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05134 · Cited by 15
Research works printed but not linked: 22
- Huang, 2016, Nat. Commun., 7, 1
- Lee, 2004, Hum. Factors, 46, 50, 10.1518/hfes.46.1.50.30392 · DOI · Paper page
- Goodman, 2017, AI Mag., 38, 50
- A. I. ACT , On Artificial Intelligence: A European Approach to Excellence and Trust , 2021 , COM/2021/206
- O.Biran and C.Cotton , IJCAI-17 workshop on explainable AI (XAI) , 2017 , pp. 8–13
- M.Sundararajan , A.Taly and Q.Yan , International Conference on Machine Learning , 2017 , pp. 3319–3328
- D.Erhan , Y.Bengio , A.Courville and P.Vincent , Technical Report , Univeristé de Montréal , 2009
- P. W.Koh and P.Liang , International Conference on Machine Learning , 2017 , pp. 1885–1894
- Humer, 2021, ChemRxiv
- M. F.Frisch , Theories, models, and explanation , University of California , Berkeley , 1998
- M. A.Bruckner , Banking & Financial Services Policy Report , 2018 , vol. 37
- S.Singla , Machine Learning to Predict Credit Risk in Lending Industry , 2020 , https://www.aitimejournal.com/@saurav.singla/machine-learning-to-predict-credit-risk-in-lending-industry
- Wachter, 2017, Harv. J. Law Technol., 31, 841
- J.Woodward , The Stanford Encyclopedia of Philosophy, Metaphysics Research Lab , Stanford University , Winter , 2016th edn, 2016
- Mauri, 2006, Match, 56, 237
- P. W.Battaglia , J. B.Hamrick , V.Bapst , A.Sanchez-Gonzalez , V.Zambaldi , M.Malinowski , A.Tacchetti , D.Raposo , A.Santoro , R.Faulkner et al. , 2018 , arXiv preprint arXiv:1806.01261 · arXiv
- T. T.Tanimoto , Internal IBM Technical Report , 1958
- M.Ester , H.-P.Kriegel , J.Sander and X.Xu , KDD , 1996 , pp. 226–231
- Pedregosa, 2011, J. Mach. Learn. Res., 12, 2825
- Savjani, 2012, Int. Scholarly Res. Not., 2012, 195727
- Bradley, 2010, Nat. Preced., 1
- D.Kingma and J.Ba , International Conference on Learning Representations , 2014
Cited by
Sorted by citations
Augmenting large language models with chemistry tools
M. Bran, A., Cox, S., Schilter, O., Baldassari, C., White, A. D., & Schwaller, P. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00832-8 · Cited by 794
Self-citationInterpretable and Explainable Machine Learning for Materials Science and Chemistry
Oviedo, F., Ferres, J. L., Buonassisi, T., & Butler, K. T. (2022) · Accounts of Materials Research · doi:10.1021/accountsmr.1c00244 · Cited by 435
On scientific understanding with artificial intelligence
Krenn, M., Pollice, R., Guo, S. Y., Aldeghi, M., Cervera-Lierta, A., Friederich, P., Gomes, G., Häse, F., Jinich, A., Nigam, A., et al. (2022) · Nature Reviews Physics · doi:10.1038/s42254-022-00518-3 · Cited by 444
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K. E., Dickerson, J. P., & Shah, C. (2020) · arXiv · doi:10.48550/arxiv.2010.10596 · Cited by 267
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K., Dickerson, J. P., & Shah, C. S. (2024) · ACM Computing Surveys · doi:10.1145/3677119 · Cited by 723
Metadata
- Authors
- Wellawatte, G. P., Seshadri, A., & White, A. D.
- Affiliations
- University of Rochester (US)
- Corresponding author
- White, Andrew D.
- Venue
- Chemical Science
- Publisher
- Royal Society of Chemistry (RSC)
- Published
- 2022
- Volume
- 13
- Issue
- 13
- Pages
- 3697-3705
- ISSN
- 2041-6520 (ISSN-L)
- 2041-6539
- PMC
- PMC8966631
- OpenAlex
- W4225876201
- Cited by
- 143
- References
- 67
- Citations by year
- 2026: 32 · 2025: 27 · 2024: 28 · 2023: 34 · 2022: 22
- FWCI
- 9.13
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Chemical Science (publishedVersion, cc-by)
- ChemRxiv (acceptedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute of General Medical Sciences (R35GM137966)
- National Science Foundation (1764415)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Keywords
- counterfactual explanations, model-agnostic explanation, explainable deep learning, interpretability, black-box models, molecular property prediction, graph neural networks, random forest, sequence models, spurious correlations, molecular structure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review