An Unbiased Method To Build Benchmarking Sets for Ligand-Based Virtual Screening and its Application To GPCRs
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Benchmarking data sets have become common in recent years for the purpose of virtual screening, though the main focus had been placed on the structure-based virtual screening (SBVS) approaches. Due to the lack of crystal structures, there is great need for unbiased benchmarking sets to evaluate various ligand-based virtual screening (LBVS) methods for important drug targets such as G protein-coupled receptors (GPCRs). To date these ready-to-apply data sets for LBVS are fairly limited, and the direct usage of benchmarking sets designed for SBVS could bring the biases to the evaluation of LBVS. Herein, we propose an unbiased method to build benchmarking sets for LBVS and validate it on a multitude of GPCRs targets. To be more specific, our methods can (1) ensure chemical diversity of ligands, (2) maintain the physicochemical similarity between ligands and decoys, (3) make the decoys dissimilar in chemical topology to all ligands to avoid false negatives, and (4) maximize spatial random distribution of ligands and decoys. We evaluated the quality of our Unbiased Ligand Set (ULS) and Unbiased Decoy Set (UDS) using three common LBVS approaches, with Leave-One-Out (LOO) Cross-Validation (CV) and a metric of average AUC of the ROC curves. Our method has greatly reduced the "artificial enrichment" and "analogue bias" of a published GPCRs benchmarking set, i.e., GPCR Ligand Library (GLL)/GPCR Decoy Database (GDD). In addition, we addressed an important issue about the ratio of decoys per ligand and found that for a range of 30 to 100 it does not affect the quality of the benchmarking set, so we kept the original ratio of 39 from the GLL/GDD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How many drug targets are there?
Overington, J. P., Al-Lazikani, B., & Hopkins, A. L. (2006) · Nature Reviews Drug Discovery · doi:10.1038/nrd2199 · Cited by 3,505
Directory of useful decoys, enhanced (DUD-E): better ligands and decoys for better benchmarking.
Mysinger, M. M., Carchia, M., Irwin, J. J., & Shoichet, B. K. (2012) · Journal of Medicinal Chemistry · doi:10.1021/jm300687e · Cited by 2,412
Predicting new molecular targets for known drugs
Keiser, M. J., Setola, V., Irwin, J. J., Laggner, C., Abbas, A. I., Hufeisen, S. J., Jensen, N. H., Kuijer, M. B., Matos, R. C., Tran, T. B., et al. (2009) · Nature · doi:10.1038/nature08506 · Cited by 1,667
Benchmarking sets for molecular docking.
Huang, N., Shoichet, B. K., & Irwin, J. J. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm0608356 · Cited by 1,318 · cited 2×
“29,36,39,41,42 In the future, the benchmarking sets generated by our method can be extended to evaluate the methods of SBVS or even make a comparison between SBVS and LBVS in an unbiased manner.”
MethodSimilarity-based virtual screening using 2D fingerprints
Willett, P. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.10.005 · Cited by 849
G protein-coupled receptors: novel targets for drug discovery in cancer
Lappano, R., & Maggiolini, M. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3320 · Cited by 717
Recognizing Pitfalls in Virtual Screening: A Critical Review
Scior, T., Bender, A., Tresadern, G., Medina-Franco, J. L., Martínez-Mayorga, K., Langer, T., Cuanalo-Contreras, K., & Agrafiotis, D. K. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci200528d · Cited by 438
Cited by
Most Ligand-Based Classification Benchmarks Reward Memorization Rather than Generalization
Wallach, I., & Heifets, A. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00403 · Cited by 260
Lagarde, N., Zagury, J.-F., & Montes, M. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00090 · Cited by 85
Zhou, H., Cao, H., & Skolnick, J. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00309 · Cited by 39
FRAGSITE: A Fragment-Based Approach for Virtual Ligand Screening
Zhou, H., Cao, H., & Skolnick, J. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01160 · Cited by 32
The discovery of novel HDAC3 inhibitors via virtual screening and in vitro bioassay
Xia, J., Hu, H., Xue, W., Wang, X. S., & Wu, S. (2018) · Journal of Enzyme Inhibition and Medicinal Chemistry · doi:10.1080/14756366.2018.1437156 · Cited by 24
Self-citation
Metadata
- Authors
- Xia, J., Jin, H., Liu, Z., Zhang, L., & Wang, X. S.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2014-05-01
- Volume
- 54
- Issue
- 5
- Pages
- 1433-1450
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2083339697
- Cited by
- 53
- References
- 7
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Unbiased Method To Build Benchmarking Sets for Ligand-Based Virtual Screening and its Application To GPCRs. https://app.cochat.ai/papers/10.1021/ci500062f
- The paper
- Xia, J., Jin, H., Liu, Z., Zhang, L., & Wang, X. S. (2014). An Unbiased Method To Build Benchmarking Sets for Ligand-Based Virtual Screening and its Application To GPCRs. Journal of Chemical Information and Modeling. https://doi.org/10.1021/ci500062f
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.