Cited by 155Computational Drug Discovery MethodsMachine Learning in Materials ScienceProtein Degradation and Inhibitors

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index; none of the 26 sources its claims cite is checked for support yet.

Mathematical deep learning for pose and binding affinity prediction and ranking in D3R Grand Challenges

Open access
Nguyen, Duc Duy, Cang, Zixuan, Wu, Kedi, Wang, Menglun, Cao, Yin, Wei, Guo-Wei·2019·Journal of Computer-Aided Molecular Design

Abstract

Advanced mathematics, such as multiscale weighted colored subgraph and element specific persistent homology, and machine learning including deep neural networks were integrated to construct mathematical deep learning models for pose and binding affinity prediction and ranking in the last two D3R Grand Challenges in computer-aided drug design and discovery. D3R Grand Challenge 2 focused on the pose prediction, binding affinity ranking and free energy prediction for Farnesoid X receptor ligands. Our models obtained the top place in absolute free energy prediction for free energy set 1 in stage 2. The latest competition, D3R Grand Challenge 3 (GC3), is considered as the most difficult challenge so far. It has five subchallenges involving Cathepsin S and five other kinase targets, namely VEGFR2, JAK2, p38-α, TIE2, and ABL1. There is a total of 26 official competitive tasks for GC3. Our predictions were ranked 1st in 10 out of these 26 tasks.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

The paper reports mathematical deep learning models combining multiscale weighted colored subgraphs and element-specific persistent homology with machine learning for D3R Grand Challenge 2 and 3 pose, affinity ranking, and free energy tasks. In GC3, the authors’ submissions ranked 1st in 10 of 26 official competitive tasks, and in GC2 they achieved the top place in free energy prediction for free energy set 1 in stage 2.

Key findings

  • In D3R GC3, the authors’ predictions were ranked 1st in 10 out of 26 official competitive tasks.
  • For GC3 Subchallenge 1 (Cathepsin S), the best Kendall’s τ improved from 0.23 in stage 1 to 0.54 in stage 2 (receipt ID 6jekk); free energy RMSEc was 0.33 kcal/mol in stage 1 (receipt ID fomca) and 0.29 kcal/mol in stage 2 (receipt ID v4jv4).
  • For GC3 Subchallenge 4 (TIE2), the model ranked first on all evaluated metrics: affinity ranking excluding Kds > 10 μM gave Kendall’s τ = 0.57 and Spearman = 0.76 (receipt ID uuihe); active/inactive classification gave MCC = 0.78; Set 1 absolute free energy gave MCC = 1.0 (receipt ID vwbp8); Set 2 gave RMSEc = 1.02 kcal/mol (receipt ID 5g8ed).
  • In GC2, the submission with receipt ID 5bvwx ranked second in free energy set 1 of stage 1 with RMSEc = 0.68 kcal/mol, and in stage 2 the model obtained first place for free energy set 1 with Kendall’s τ = 0.41 (receipt ID 4rbjk).

Methods

  • The models used multiscale weighted colored subgraph (MWCS) and element-specific persistent homology descriptors, combined with machine learning methods including random forest, gradient boosting trees, convolutional neural networks, and multi-task learning; training used PDBbind data.
  • Ligands were prepared from SMILES using LIGPREP at pH 7.5, with Gasteiger charges added via MGLTools v1.5.6; docking used Autodock Vina, GOLD, GLIDE, induced fit docking, and several protocols named align-close, align-target, close-dock, cross-dock, constraint-IFD, and free-IFD.
  • The paper evaluates submissions in D3R GC2 and GC3. GC2 involved FXR with 36 crystallographic ligands, 102 compounds for affinity ranking, and free energy subsets of 18 and 15 ligands. GC3 had five subchallenges involving Cathepsin S and kinases VEGFR2, JAK2, p38-α, TIE2, and ABL1, with 26 official competitive tasks; reported metrics include Kendall’s τ, Spearman correlation, RMSEc, and MCC.

Limitations

  • The paper states that docking accuracy remains a bottleneck for affinity prediction, that none of the tried docking protocols showed a dominant role in binding affinity accuracy, and that excluding pose prediction error improved Kendall’s τ from 0.21 to 0.54 on Cathepsin S affinity ranking.
  • The paper also states that machine learning-based scoring function performance depends crucially on training data quality and statistical distribution, and on selected features that may not accurately or completely describe protein–ligand binding interactions.
  • Evident from the reported results: the models did not perform well on GC3 Subchallenge 2, with the best result being second place on VEGFR2 active/inactive classification (MCC = 0.48), and affinity ranking in Subchallenge 3 was described as unremarkable; GC2 pose ranking power was also described as not impressive.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10822-018-0146-6

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

18 Own result · 14 Not checked yet · 5 Own interpretation · 5 No basis given

Verify all 26 references — free account
  • It may state two separate claims as one. 9
  • Probably not a substantial claim. 8
16 of 16
  • The authors state this as an assumption.

    The intrinsic physics of interest of complex biomolecules and interactions lies on low-dimensional manifolds or subspaces embedded in a high-dimensional data space.

    “We assume that the intrinsic physics of interest of complex biomolecules and interactions lies on low-dimensional manifolds or subspaces embedded in a high-dimensional data space.”
  • The paper relies on this without support.

    The performance of machine learning-based scoring functions depends crucially on the quality and statistical distribution of training data and on selected features that may or may not accurately and completely describe protein–ligand binding interactions.

    “However, the performance of machine learning-based SFs depends crucially on the training data quality and statistic distribution. Additionally, it also depends on selected features that might or might not accurately and completely describe the protein–ligand binding interactions.”
  • The authors state this as an assumption.

    Grouping weak learners can improve learning capability.

    “Ensemble of trees methods build models consisting of a collection of decision trees with the assumption that grouping the weak learners can improve the learning capability.”
  • The paper relies on this without support.

    Random forest is better at lowering bias and gradient boosting trees focus more on reducing variance.

    “As these two models attempt to reduce error in two different ways, they behave differently in the bias-variance trade-off where the random forest is better at lowering bias and gradient boosting trees focus more on reducing variance.”
  • The paper relies on this without support.

    Ensemble learning methods are robust and overfitting can be reduced by learning partial problems.

    “The ensemble learning methods are also robust and overfitting can be reduced by learning partial problems.”
  • The paper relies on this without support.

    When the feature is complex or has an underlying dimension in feature space, deep learning models can further improve predictor performance.

    “When the feature is complex or there is some underlying dimension in the feature space, deep learning models can further imporve the performance of the predictor.”
  • The paper relies on this without support.

    A spatial dimension associated to the filtration parameter lies in the persistent homology representation of protein–ligand systems.

    “For example, a spatial dimension associated to the filtration parameter lies in the persistent homology representation of protein–ligand systems.”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 70 references

Research works printed but not linked: 2

  1. Schrödinger LLC (2017) Schrödinger release 2017-4. Schrödinger LLC, New York
  2. Edelsbrunner H (1992) Weighted alpha shapes. Technical report. University of Illinois, Champaign

Cited by

Sorted by citations

See all 155

Metadata

Authors
Nguyen, D. D., Cang, Z., Wu, K., Wang, M., Cao, Y., & Wei, G.-W.
Affiliations
Michigan State University (US)
Corresponding author
Wei, Guo-Wei
Venue
Journal of Computer-Aided Molecular Design
Published
2018-08-16
Volume
33
Issue
1
Pages
71-82
ISSN
  • 0920-654X (ISSN-L)
  • 1573-4951
OpenAlex
W2963883198
Cited by
155
References
70
Citations by year
2026: 8 · 2025: 25 · 2024: 19 · 2023: 18 · 2022: 20 · 2021: 27 · 2020: 21 · 2019: 15 · 2018: 2
FWCI
12.13
Type
journal article
Language
en
Open access
Locations
  • Journal of Computer-Aided Molecular Design (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Science Foundation (1160352, 1302285, 1761320)
  • National Institute of General Medical Sciences (R01GM126189)
Topics
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
  • Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Degradation and Inhibitors
Keywords
binding affinity ranking, free energy prediction, persistent homology, cathepsin S, kinase inhibitors, VEGFR2, JAK2, Tie2, c-Abl
MeSH terms
Deep Learning, Receptor, Farnesoid X-Activated, Binding Sites, Cathepsins, Ligands, Protein Binding, Protein Conformation, Protein Kinases, Thermodynamics, Drug Design, Computer-Aided Design, Receptors, Cytoplasmic and Nuclear, Crystallography, X-Ray, Databases, Protein, Molecular Docking Simulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review