The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Interpretation of Compound Activity Predictions from Complex Machine Learning Models Using Local Approximations and Shapley Values
Open accessAbstract
In qualitative or quantitative studies of structure-activity relationships (SARs), machine learning (ML) models are trained to recognize structural patterns that differentiate between active and inactive compounds. Understanding model decisions is challenging but of critical importance to guide compound design. Moreover, the interpretation of ML results provides an additional level of model validation based on expert knowledge. A number of complex ML approaches, especially deep learning (DL) architectures, have distinctive black-box character. Herein, a locally interpretable explanatory method termed Shapley additive explanations (SHAP) is introduced for rationalizing activity predictions of any ML algorithm, regardless of its complexity. Models resulting from random forest (RF), nonlinear support vector machine (SVM), and deep neural network (DNN) learning are interpreted, and structural patterns determining the predicted probability of activity are identified and mapped onto test compounds. The results indicate that SHAP has high potential for rationalizing predictions of complex ML models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Extended-Connectivity Fingerprints
Rogers, D., & Hahn, M. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100050t · Cited by 7,524
(1994) · Cited by 5,513
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399
ChEMBL: a large-scale bioactivity database for drug discovery
Gaulton, A., Bellis, L. J., Bento, A. P., Chambers, J., Davies, M., Hersey, A., Light, Y., McGlinchey, S., Michalovich, D., Al-Lazikani, B., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr777 · Cited by 4,382
Baell, J. B., & Holloway, G. A. (2010) · Journal of Medicinal Chemistry · doi:10.1021/jm901137j · Cited by 3,944
ZINC 15 – Ligand Discovery for Everyone
Sterling, T., & Irwin, J. J. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00559 · Cited by 3,224
QSAR Modeling: Where have you been? Where are you going to?
Cherkasov, A., Muratov, E. N., Fourches, D., Varnek, A., Baskin, I. I., Cronin, M., Dearden, J., Gramatica, P., Martin, Y. C., Todeschini, R., et al. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm4004285 · Cited by 2,164
Explainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
The Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816
Contributions to the Theory of Games
Rubin, H., Kuhn, H. W., & Tucker, A. W. (1952) · Econometrica · doi:10.2307/1907817 · Cited by 1,198
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., & Svetnik, V. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500747n · Cited by 1,159
Machine learning in chemoinformatics and drug discovery
Lo, Y.-C., Rensi, S. E., Torng, W., & Altman, R. B. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.05.010 · Cited by 960
Integration of virtual and high-throughput screening
Bajorath, J. (2002) · Nature Reviews Drug Discovery · doi:10.1038/nrd941 · Cited by 930
Self-citationMonotonic solutions of cooperative games
Young, H. P. (1985) · International Journal of Game Theory · doi:10.1007/bf01769885 · Cited by 895
Machine-learning approaches in drug discovery: methods and applications
Lavecchia, A. (2015) · Drug Discovery Today · doi:10.1016/j.drudis.2014.10.012 · Cited by 784
Large-scale comparison of machine learning methods for drug target prediction on ChEMBL
Mayr, A., Klambauer, G., Unterthiner, T., Steijaert, M., Wegner, J. K., Ceulemans, H., Clevert, D.-A., & Hochreiter, S. (2018) · Chemical Science · doi:10.1039/c8sc00148k · Cited by 584
Handbook of Uncertainty Quantification
(2016) · Springer eBooks · doi:10.1007/978-3-319-11259-6 · Cited by 581
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
Graph kernels for chemical informatics
Ralaivola, L., Swamidass, S. J., Saigo, H., & Baldi, P. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.07.009 · Cited by 442
Recognizing Pitfalls in Virtual Screening: A Critical Review
Scior, T., Bender, A., Tresadern, G., Medina-Franco, J. L., Martínez-Mayorga, K., Langer, T., Cuanalo-Contreras, K., & Agrafiotis, D. K. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci200528d · Cited by 438
Lenselink, E. B., ten Dijke, N., Bongers, B., Papadatos, G., van Vlijmen, H. W. T., Kowalczyk, W., IJzerman, A. P., & van Westen, G. J. P. (2017) · Journal of Cheminformatics · doi:10.1186/s13321-017-0232-0 · Cited by 334
Sieg, J., Flachsenberg, F., & Rarey, M. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00712 · Cited by 321
Is Multitask Deep Learning Practical for Pharma?
Ramsundar, B., Liu, B., Wu, Z., Verras, A., Tudor, M., Sheridan, R. P., & Pande, V. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00146 · Cited by 263
Machine Learning Methods for Property Prediction in Chemoinformatics:Quo Vadis?
Varnek, A., & Baskin, I. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci200409x · Cited by 245
Demystifying Multitask Deep Neural Networks for Quantitative Structure–Activity Relationships
Xu, Y., Ma, J., Liaw, A., Sheridan, R. P., & Svetnik, V. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00087 · Cited by 238
Interpretation of Quantitative Structure-Activity Relationship Models: Past, Present, and Future
Polishchuk, P. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00274 · Cited by 236
A renaissance of neural networks in drug discovery
Baskin, I. I., Winkler, D., & Tetko, I. V. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1201262 · Cited by 235
The Next Era: Deep Learning in Pharmaceutical Research
Ekins, S. (2016) · Pharmaceutical Research · doi:10.1007/s11095-016-2029-7 · Cited by 235
Introduction to Sensitivity Analysis
(2007) · Global Sensitivity Analysis. The Primer · doi:10.1002/9780470725184.ch1 · Cited by 169
Activity, assay and target data curation and quality in the ChEMBL database
Papadatos, G., Gaulton, A., Hersey, A., & Overington, J. P. (2015) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-015-9860-5 · Cited by 168
Baumann, D., & Baumann, K. (2014) · Journal of Cheminformatics · doi:10.1186/s13321-014-0047-1 · Cited by 167
Understanding the Roles of the “Two QSARs”
Fujita, T., & Winkler, D. A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00229 · Cited by 166
QSAR Modeling of Imbalanced High-Throughput Screening Data in PubChem
Zakharov, A. V., Peach, M. L., Sitzmann, M., & Nicklaus, M. C. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci400737s · Cited by 140
So, S., & Richards, W. G. (1992) · Journal of Medicinal Chemistry · doi:10.1021/jm00095a016 · Cited by 137
Doweyko, A. M. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-007-9162-7 · Cited by 134
Rodríguez-Pérez, R., Vogt, M., & Bajorath, J. (2017) · ACS Omega · doi:10.1021/acsomega.7b01079 · Cited by 117
Self-citationTrade-Off Between Accuracy and Interpretability for PredictiveIn SilicoModeling
Johansson, U., Sönströd, C., Norinder, U., & Boström, H. (2011) · Future Medicinal Chemistry · doi:10.4155/fmc.11.23 · Cited by 114
On the interpretation and interpretability of quantitative structure–activity relationship models
Guha, R. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-008-9240-5 · Cited by 106
Klon, A. E., Lowrie, J. F., & Diller, D. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci0601315 · Cited by 101
A General Method for Exploiting QSAR Models in Lead Optimization
Lewis, R. A. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm049228d · Cited by 77
Multitask Machine Learning for Classifying Highly and Weakly Potent Kinase Inhibitors
Rodríguez-Pérez, R., & Bajorath, J. (2019) · ACS Omega · doi:10.1021/acsomega.9b00298 · Cited by 74
Self-citationStumpfe, D., Dimova, D., & Bajorath, J. (2016) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.6b00906 · Cited by 62
Self-citationAn approach to the interpretation of backpropagation neural network models in QSAR studies
Baskin, I. I., Айт, А. О., Halberstam, N. M., Palyulin, V. A., & Зефиров, Н. С. (2002) · SAR and QSAR in environmental research · doi:10.1080/10629360290002073 · Cited by 55
Visual Interpretation of Kernel‐Based Prediction Models
Hansen, K., Baehrens, D., Schroeter, T. S., Rupp, M., & Müller, K. (2011) · Molecular Informatics · doi:10.1002/minf.201100059 · Cited by 55
Visualization and Interpretation of Support Vector Machine Activity Predictions
Balfer, J., & Bajorath, J. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00175 · Cited by 53
Self-citationRodríguez-Pérez, R., Vogt, M., & Bajorath, J. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00088 · Cited by 53
Self-citationInterpretability of SAR/QSAR Models of any Complexity by Atomic Contributions
Marcou, G., Horvath, D., Solov’ev, V. P., Arrault, A., Vayer, P., & Varnek, A. A. (2012) · Molecular Informatics · doi:10.1002/minf.201100136 · Cited by 45
Learning from ‘big data’: compounds and targets
Hu, Y., & Bajorath, J. (2014) · Drug Discovery Today · doi:10.1016/j.drudis.2014.02.004 · Cited by 44
Self-citationPrediction of Compound Profiling Matrices Using Machine Learning
Rodríguez-Pérez, R., Miyao, T., Jasial, S., Vogt, M., & Bajorath, J. (2018) · ACS Omega · doi:10.1021/acsomega.8b00462 · Cited by 40
Self-citationHu, Y., & Bajorath, J. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci5005509 · Cited by 33
Self-citationRodríguez-Pérez, R., & Bajorath, J. (2018) · ACS Omega · doi:10.1021/acsomega.8b01682 · Cited by 33
Self-citationBalfer, J., & Bajorath, J. (2014) · Journal of Chemical Information and Modeling · doi:10.1021/ci500410g · Cited by 14
Self-citation
Cited by
Drug discovery with explainable artificial intelligence
Jiménez-Luna, J., Grisoni, F., & Schneider, G. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00236-4 · Cited by 1,063
Rodríguez-Pérez, R., & Bajorath, J. (2020) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-020-00314-0 · Cited by 718
Self-citationJiang, D., Wu, Z., Hsieh, C.-Y., Chen, G., Liao, B., Wang, Z., Shen, C., Cao, D., Wu, J., & Hou, T. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-020-00479-8 · Cited by 664
Coloring Molecules with Explainable Artificial Intelligence for Preclinical Relevance Assessment
Jiménez-Luna, J., Skalic, M., Weskamp, N., & Schneider, G. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01344 · Cited by 96
Quantitative evaluation of explainable graph neural networks for molecular property prediction
Rao, J., Zheng, S., Lu, Y., & Yang, Y. (2022) · Patterns · doi:10.1016/j.patter.2022.100628 · Cited by 90
“For example, Rodrı́guez-Pérez et al.13 interpreted relevant features and substructures for compound activity prediction through the Shapley additive explanations.”
Method
Metadata
- Authors
- Rodríguez-Pérez, R., & Bajorath, J.
- Venue
- Journal of Medicinal Chemistry
- Publisher
- American Chemical Society (ACS)
- Published
- 2019-09-12
- Volume
- 63
- Issue
- 16
- Pages
- 8761-8777
- ISSN
- 0022-2623 (ISSN-L)
- 1520-4804
- OpenAlex
- W2973049920
- Cited by
- 512
- References
- 63
- FWCI
- 17.84
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.