The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Deep Architectures and Deep Learning in Chemoinformatics: The Prediction of Aqueous Solubility for Drug-Like Molecules
Open accessAbstract
Shallow machine learning methods have been applied to chemoinformatics problems with some success. As more data becomes available and more complex problems are tackled, deep machine learning methods may also become useful. Here, we present a brief overview of deep learning methods and show in particular how recursive neural network approaches can be applied to the problem of predicting molecular properties. However, molecules are typically described by undirected cyclic graphs, while recursive approaches typically use directed acyclic graphs. Thus, we develop methods to address this discrepancy, essentially by considering an ensemble of recursive neural networks associated with all possible vertex-centered acyclic orientations of the molecular graph. One advantage of this approach is that it relies only minimally on the identification of suitable molecular descriptors because suitable representations are learned automatically from the data. Several variants of this approach are applied to the problem of predicting aqueous solubility and tested on four benchmark data sets. Experimental results show that the performance of the deep learning methods matches or exceeds the performance of other state-of-the-art methods according to several evaluation metrics and expose the fundamental limitations arising from training sets that are too small or too noisy. A Web-based predictor, AquaSol, is available online through the ChemDB portal ( cdb.ics.uci.edu ) together with additional material.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
(2009) · Cited by 6,153
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Partition coefficients and their uses
Leo, A., Hansch, C., & Elkins, D. (1971) · Chemical Reviews · doi:10.1021/cr60274a001 · Cited by 4,540
Handbook of Molecular Descriptors
Todeschini, R., & Consonni, V. (2000) · Methods and Principles in Medicinal Chemistry · doi:10.1002/9783527613106 · Cited by 4,107 · cited 1×
“24 An example is the prediction method combining logP, first order valency connectivity indices ( 1 χ V ), delta chi ( Δ 2 χ ), and information content ( 2 IC) by Louis et al. 25 Although nowadays many other descriptors have been incorporated into the prediction tools, no model seems to be able to…”
MethodAdvanced Organic Chemistry: Reactions, Mechanisms, and Structure
March, J. (1977) · Andalas University Repository (Andalas University) · Cited by 4,022
Characterization of molecular branching
Randic, M. (1975) · Journal of the American Chemical Society · doi:10.1021/ja00856a001 · Cited by 3,630
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Cited by 2,178
ADMET in silico modelling: towards prediction paradise?
van de Waterbeemd, H., & Gifford, E. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1032 · Cited by 1,863
Exploring Strategies for Training Deep Neural Networks
Larochelle, H., Bengio, Y., Louradour, J., & Lamblin, P. (2009) · doi:10.1145/1577069.1577070 · Cited by 1,095
ESOL: Estimating Aqueous Solubility Directly from Molecular Structure
Delaney, J. S. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034243x · Cited by 1,091
Prediction of drug solubility from structure
Jorgensen, W. L., & Duffy, E. M. (2002) · Advanced Drug Delivery Reviews · doi:10.1016/s0169-409x(02)00008-x · Cited by 891
Netzeva, T. I., Worth, A. P., Aldenberg, T., Benigni, R., Cronin, M. T. D., Gramatica, P., Jaworska, J. S., Kahn, S., Klopman, G., Marchant, C. A., et al. (2005) · Alternatives to Laboratory Animals · doi:10.1177/026119290503300209 · Cited by 836
Calculating log Poct from structures
Leo, A. J. (1993) · Chemical Reviews · doi:10.1021/cr00020a001 · Cited by 695
Molecular Connectivity in Structure–activity Analysis
Unger, S. H. (1987) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.2600760325 · Cited by 628
Solubility and partitioning I: Solubility of nonelectrolytes in water
Yalkowsky, S. H., & Valvani, S. C. (1980) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.2600690814 · Cited by 577
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7496.001.0001 · Cited by 536
Exploiting the past and the future in protein secondary structure prediction
Baldi, P., Brunak, S., Frasconi, P., Soda, G., & Pollastri, G. (1999) · Bioinformatics · doi:10.1093/bioinformatics/15.11.937 · Cited by 497
Self-citationBioinformatics: The Machine Learning Approach
Leunissen, J. (2002) · Briefings in Bioinformatics · doi:10.1093/bib/3.3.321 · Cited by 473
Graph kernels for chemical informatics
Ralaivola, L., Swamidass, S. J., Saigo, H., & Baldi, P. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.07.009 · Cited by 442
Self-citationEstimation of the aqueous solubility I: Application to organic nonelectrolytes
Jain, N., & Yalkowsky, S. H. (2001) · Journal of Pharmaceutical Sciences · doi:10.1002/1520-6017(200102)90:2<234::aid-jps14>3.0.co;2-v · Cited by 375
Estimation of Aqueous Solubility for a Diverse Set of Organic Compounds Based on Molecular Topology
Huuskonen, J. (2000) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci9901338 · Cited by 306
Glomme, A., März, J., & Dressman, J. B. (2005) · Journal of Pharmaceutical Sciences · doi:10.1002/jps.20212 · Cited by 295
Empirical Correlation Between Hydrophobic Free Energy and Aqueous Cavity Surface Area
Reynolds, J. A., Gilbert, D. B., & Tanford, C. (1974) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.71.8.2925 · Cited by 292
Deep architectures for protein contact map prediction
Di Lena, P., Nagata, K., & Baldi, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts475 · Cited by 270
Self-citationGradient descent learning algorithm overview: a general dynamical systems perspective
Baldi, P. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363438 · Cited by 258
Self-citationAbsorption Classification of Oral Drugs Based on Molecular Surface Properties
Bergström, C. A. S., Strafford, M., Lazorova, L., Avdeef, A., Luthman, K., & Artursson, P. (2003) · Journal of Medicinal Chemistry · doi:10.1021/jm020986i · Cited by 252
Can we estimate the accuracy of ADME–Tox predictions?
Tetko, I. V., Bruneau, P., Mewes, H.-W., Rohrer, D. C., & Poda, G. I. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.06.013 · Cited by 243
Annual Reports in Computational Chemistry
(2016) · Annual Reports in Computational Chemistry · doi:10.1016/s1574-1400(16)30008-1 · Cited by 241
Graph kernels based on tree patterns for molecules
Mahé, P., & Vert, J.-P. (2009) · Machine Learning · doi:10.1007/s10994-008-5086-2 · Cited by 214
Llinàs, A., Glen, R. C., & Goodman, J. M. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci800058v · Cited by 204
Learning to Predict Chemical Reactions
Kayala, M. A., Azencott, C.-A., Chen, J. H., & Baldi, P. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200207y · Cited by 190
Self-citationKayala, M. A., & Baldi, P. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci3003039 · Cited by 183
Self-citationComputational approaches to determine drug solubility
Faller, B., & Ertl, P. (2007) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2007.05.005 · Cited by 172
Pollastri, G., & Baldi, P. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_1.s62 · Cited by 151
Self-citationNNcon: improved protein contact map prediction using 2D-recursive neural networks
Tegge, A. N., Wang, Z., Eickholt, J., & Cheng, J. J. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp305 · Cited by 148
Contribution of solid-state properties to the aqueous solubility of drugs
Wassvik, C. M., Holmén, A. G., Bergström, C. A. S., Zamora, I., & Artursson, P. (2006) · European Journal of Pharmaceutical Sciences · doi:10.1016/j.ejps.2006.05.013 · Cited by 139
In silicoprediction of aqueous solubility
Dearden, J. C. (2006) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.1.1.31 · Cited by 114
Micheli, A., Sperduti, A., Starita, A., & Bianucci, A. M. (2000) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci9903399 · Cited by 74
Schroeter, T. S., Schwaighofer, A., Mika, S., ter Laak, A., Suelzle, D., Ganzer, U., Heinrich, N., & Müller, K. (2007) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-007-9125-z · Cited by 70
Bruneau, P., & McElroy, N. R. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci0504014 · Cited by 68
Azencott, C., Ksikes, A., Swamidass, S. J., Chen, J. H., Ralaivola, L., & Baldi, P. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci600397p · Cited by 64
Self-citationPrediction of intrinsic solubility of generic drugs using MLR, ANN and SVM analyses
Louis, B., Agrawal, V. K., & Khadikar, P. V. (2010) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2010.05.059 · Cited by 51
Fröhlich, H., Wegner, J. K., & Zell, A. (2004) · QSAR & Combinatorial Science · doi:10.1002/qsar.200410011 · Cited by 37
Learning to play Go using recursive neural networks
Wu, L., & Baldi, P. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.002 · Cited by 33
Self-citationClassification of small molecules by two- and three-dimensional decomposition kernels
Ceroni, A., Costa, F., & Frasconi, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm298 · Cited by 31
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107
Convolutional Networks on Graphs for Learning Molecular Fingerprints
Duvenaud, D., Maclaurin, D., Aguilera-Iparraguirre, J., Gómez-Bombarelli, R., Hirzel, T., Aspuru-Guzik, A., & Adams, R. P. (2015) · arXiv · doi:10.48550/arxiv.1509.09292 · Cited by 2,628
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Analyzing Learned Molecular Representations for Property Prediction
Yang, K., Swanson, K., Jin, W., Coley, C., Eiden, P., Gao, H., Guzman-Perez, A., Hopper, T., Kelley, B., Mathea, M., et al. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00237 · Cited by 1,923
Metadata
- Authors
- Lusci, A., Pollastri, G., & Baldi, P.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2013-07-02
- Volume
- 53
- Issue
- 7
- Pages
- 1563-1575
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2046589863
- Cited by
- 555
- References
- 53
- FWCI
- 15.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
